151
|
Giełczyk A, Marciniak A, Tarczewska M, Lutowski Z. Pre-processing methods in chest X-ray image classification. PLoS One 2022; 17:e0265949. [PMID: 35381050 PMCID: PMC8982897 DOI: 10.1371/journal.pone.0265949] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/25/2021] [Accepted: 03/10/2022] [Indexed: 12/24/2022] Open
Abstract
BACKGROUND The SARS-CoV-2 pandemic began in early 2020, paralyzing human life all over the world and threatening our security. Thus, the need for an effective, novel approach to diagnosing, preventing, and treating COVID-19 infections became paramount. METHODS This article proposes a machine learning-based method for the classification of chest X-ray images. We also examined some of the pre-processing methods such as thresholding, blurring, and histogram equalization. RESULTS We found the F1-score results rose to 97%, 96%, and 99% for the three analyzed classes: healthy, COVID-19, and pneumonia, respectively. CONCLUSION Our research provides proof that machine learning can be used to support medics in chest X-ray classification and improving pre-processing leads to improvements in accuracy, precision, recall, and F1-scores.
Collapse
Affiliation(s)
- Agata Giełczyk
- Bydgoszcz University of Science and Technology, Bydgoszcz, Poland
- * E-mail:
| | - Anna Marciniak
- Bydgoszcz University of Science and Technology, Bydgoszcz, Poland
- Faculty of Medicine Ludwik Rydygier Collegium Medicum in Bydgoszcz, Nicolaus Copernicus University in Torun, Bydgoszcz, Poland
| | | | | |
Collapse
|
152
|
Let AI Perform Better Next Time—A Systematic Review of Medical Imaging-Based Automated Diagnosis of COVID-19: 2020–2022. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12083895] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
Abstract
The pandemic of COVID-19 has caused millions of infections, which has led to a great loss all over the world, socially and economically. Due to the false-negative rate and the time-consuming characteristic of the Reverse Transcription Polymerase Chain Reaction (RT-PCR) tests, diagnosing based on X-ray images and Computed Tomography (CT) images has been widely adopted to confirm positive COVID-19 RT-PCR tests. Since the very beginning of the pandemic, researchers in the artificial intelligence area have proposed a large number of automatic diagnosing models, hoping to assist radiologists and improve the diagnosing accuracy. However, after two years of development, there are still few models that can actually be applied in real-world scenarios. Numerous problems have emerged in the research of the automated diagnosis of COVID-19. In this paper, we present a systematic review of these diagnosing models. A total of 179 proposed models are involved. First, we compare the medical image modalities (CT or X-ray) for COVID-19 diagnosis from both the clinical perspective and the artificial intelligence perspective. Then, we classify existing methods into two types—image-level diagnosis (i.e., classification-based methods) and pixel-level diagnosis (i.e., segmentation-based models). For both types of methods, we define universal model pipelines and analyze the techniques that have been applied in each step of the pipeline in detail. In addition, we also review some commonly adopted public COVID-19 datasets. More importantly, we present an in-depth discussion of the existing automated diagnosis models and note a total of three significant problems: biased model performance evaluation; inappropriate implementation details; and a low reproducibility, reliability and explainability. For each point, we give corresponding recommendations on how we can avoid making the same mistakes and let AI perform better in the next pandemic.
Collapse
|
153
|
Yun D, Kang D, Jang J, Angeles AT, Pyo J, Jeon J, Baek SS, Cho KH. A novel method for micropollutant quantification using deep learning and multi-objective optimization. WATER RESEARCH 2022; 212:118080. [PMID: 35114526 DOI: 10.1016/j.watres.2022.118080] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/13/2021] [Revised: 01/11/2022] [Accepted: 01/12/2022] [Indexed: 06/14/2023]
Abstract
Micropollutants (MPs) released into aquatic ecosystems have adverse effects on public health. Hence, monitoring and managing MPs in aquatic systems are imperative. MPs can be quantified by high-resolution mass spectrometry (HRMS) with stable isotope-labeled (SIL) standards. However, high cost of SIL solutions is a significant issue. This study aims to develop a rapid and cost-effective analytical approach to estimate MP concentrations in aquatic systems based on deep learning (DL) and multi-objective optimization. We hypothesized that internal standards could quantify the MP concentrations other than the target substance. Our approach considered the precision of intra-/inter-day repeatability and natural organic matter information to reduce instrumental error and matrix effect. We selected standard solutions to estimate the concentrations of 18 MPs. Among the optimal DL models, DarkNet-53 using nine standard solutions yielded the highest performance, while ResNet-50 yielded the lowest. Overall, this study demonstrated the capability of DL models for estimating MP concentrations.
Collapse
Affiliation(s)
- Daeun Yun
- School of Urban and Environmental Engineering, Ulsan National Institute of Science and Technology, 50 UNIST-gil, Ulsan 44919, South Korea
| | - Daeho Kang
- Department of Environmental Engineering, Changwon National University, Changwon, Gyeongsangnamdo, 51140, South Korea
| | - Jiyi Jang
- School of Urban and Environmental Engineering, Ulsan National Institute of Science and Technology, 50 UNIST-gil, Ulsan 44919, South Korea
| | - Anne Therese Angeles
- School of Urban and Environmental Engineering, Ulsan National Institute of Science and Technology, 50 UNIST-gil, Ulsan 44919, South Korea
| | - JongCheol Pyo
- Center for Environmental Data Strategy, Korea Environment Institute, Sejong 30147, South Korea
| | - Junho Jeon
- Department of Environmental Engineering, Changwon National University, Changwon, Gyeongsangnamdo, 51140, South Korea; School of Smart and Green Engineering, Changwon National University, Changwon, Gyeongsangnamdo, 51140, South Korea
| | - Sang-Soo Baek
- Department of Environmental Engineering, Yeungnam University, 280 Daehak-Ro, Gyeongsan-Si, Gyeongbuk 38541, South Korea.
| | - Kyung Hwa Cho
- School of Urban and Environmental Engineering, Ulsan National Institute of Science and Technology, 50 UNIST-gil, Ulsan 44919, South Korea.
| |
Collapse
|
154
|
Vaidyanathan A, Guiot J, Zerka F, Belmans F, Van Peufflik I, Deprez L, Danthine D, Canivet G, Lambin P, Walsh S, Occchipinti M, Meunier P, Vos W, Lovinfosse P, Leijenaar RT. An externally validated fully automated deep learning algorithm to classify COVID-19 and other pneumonias on chest CT. ERJ Open Res 2022; 8:00579-2021. [PMID: 35509437 PMCID: PMC8958945 DOI: 10.1183/23120541.00579-2021] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/08/2021] [Accepted: 03/04/2022] [Indexed: 01/08/2023] Open
Abstract
Purpose In this study, we propose an artificial intelligence (AI) framework based on three-dimensional convolutional neural networks to classify computed tomography (CT) scans of patients with coronavirus disease 2019 (COVID-19), influenza/community-acquired pneumonia (CAP), and no infection, after automatic segmentation of the lungs and lung abnormalities. Methods The AI classification model is based on inflated three-dimensional Inception architecture and was trained and validated on retrospective data of CT images of 667 adult patients (no infection n=188, COVID-19 n=230, influenza/CAP n=249) and 210 adult patients (no infection n=70, COVID-19 n=70, influenza/CAP n=70), respectively. The model's performance was independently evaluated on an internal test set of 273 adult patients (no infection n=55, COVID-19 n= 94, influenza/CAP n=124) and an external validation set from a different centre (305 adult patients: COVID-19 n=169, no infection n=76, influenza/CAP n=60). Results The model showed excellent performance in the external validation set with area under the curve of 0.90, 0.92 and 0.92 for COVID-19, influenza/CAP and no infection, respectively. The selection of the input slices based on automatic segmentation of the abnormalities in the lung reduces analysis time (56 s per scan) and computational burden of the model. The Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis (TRIPOD) score of the proposed model is 47% (15 out of 32 TRIPOD items). Conclusion This AI solution provides rapid and accurate diagnosis in patients suspected of COVID-19 infection and influenza. A fully automated artificial intelligence-based network is proposed to classify CT volumes of patients affected with COVID-19 or influenza/CAP, and in the uninfectedhttps://bit.ly/3MJrVRi
Collapse
|
155
|
Xu F, Lou K, Chen C, Chen Q, Wang D, Wu J, Zhu W, Tan W, Zhou Y, Liu Y, Wang B, Zhang X, Zhang Z, Zhang J, Sun M, Zhang G, Dai G, Hu H. An original deep learning model using limited data for COVID-19 discrimination: A multi-center study. Med Phys 2022; 49:3874-3885. [PMID: 35305027 PMCID: PMC9088453 DOI: 10.1002/mp.15549] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2021] [Revised: 12/24/2021] [Accepted: 02/07/2022] [Indexed: 11/06/2022] Open
Abstract
OBJECTIVES Artificial intelligence (AI) has been proved to be a highly efficient tool for COVID-19 diagnosis, but the large data size and heavy label force required for algorithm development and the poor generalizability of AI algorithms, to some extent, limit the application of AI technology in clinical practice. The aim of this study is to develop an AI algorithm with high robustness using limited chest CT data for COVID-19 discrimination. METHODS A three dimensional algorithm that combined multi-instance learning (MIL) with the long and short-term memory (LSTM) architecture (3DMTM) was developed for differentiating COVID-19 from community acquired pneumonia (CAP) while logistic regression (LR), k-nearest neighbor (KNN), support vector machine (SVM) and a three dimensional convolutional neural network (3D CNN) set for comparison. Totally, 515 patients with or without COVID-19 between December 2019 and March 2020 from 5 different hospitals were recruited and divided into relatively large (150 COVID-19 and 183 CAP cases) and relatively small datasets (17 COVID-19 and 35 CAP cases) for either training or validation and another independent dataset (37 COVID-19 and 93 CAP cases) for external test. Area under the receiver operating characteristic curve (AUC), sensitivity, specificity, precision, accuracy, F1 score, and G-Mean were utilized for performance evaluation. RESULTS In the external test cohort, the relatively large data-based 3DMTM-LD achieved an AUC of 0.956 (95%CI, 0.929∼0.982) with 86.2% and 98.0% for its sensitivity and specificity. 3DMTM-SD got an AUC of 0.937 (95%CI, 0.909∼0.965) while the AUC of 3DCM-SD decreased dramatically to 0.714 (95%CI, 0.649∼0.780) with training data reduction. KNN-MMSD, LR-MMSD, SVM-MMSD and 3DCM-MMSD benefited significantly from the inclusion of clinical information while models trained with relatively large dataset got slight performance improvement in COVID-19 discrimination. 3DMTM, trained with either CT or multi-modal data, presented comparably excellent performance in COVID-19 discrimination. CONCLUSIONS The 3DMTM algorithm presented excellent robustness for COVID-19 discrimination with limited CT data. 3DMTM based on CT data performed comparably in COVID-19 discrimination with that trained with multi-modal information. Clinical information could improve the performance of KNN, LR, SVM and 3DCM in COVID-19 discrimination, especially in the scenario with limited data for training. This article is protected by copyright. All rights reserved.
Collapse
Affiliation(s)
- Fangyi Xu
- Department of Radiology, Sir Run Run Shaw Hospital, Zhejiang University School of Medicine, No.3, Qingchun East Road, Shangcheng District, Hangzhou, Zhejiang, China
| | - Kaihua Lou
- Department of Radiology, Sir Run Run Shaw Hospital, Zhejiang University School of Medicine, No.3, Qingchun East Road, Shangcheng District, Hangzhou, Zhejiang, China
| | - Chao Chen
- Department of Radiology, Sir Run Run Shaw Hospital, Zhejiang University School of Medicine, No.3, Qingchun East Road, Shangcheng District, Hangzhou, Zhejiang, China
| | - Qingqing Chen
- Department of Radiology, Sir Run Run Shaw Hospital, Zhejiang University School of Medicine, No.3, Qingchun East Road, Shangcheng District, Hangzhou, Zhejiang, China
| | - Dawei Wang
- Institute of Advanced Research, Infervision Medical Technology Co., Ltd., 18F, Building E. Yuanyang International Center, Chaoyang District, Beijing, China
| | - Jiangfen Wu
- Institute of Advanced Research, Infervision Medical Technology Co., Ltd., 18F, Building E. Yuanyang International Center, Chaoyang District, Beijing, China
| | - Wenchao Zhu
- Department of Radiology, Sir Run Run Shaw Hospital, Zhejiang University School of Medicine, No.3, Qingchun East Road, Shangcheng District, Hangzhou, Zhejiang, China
| | - Weixiong Tan
- Institute of Advanced Research, Infervision Medical Technology Co., Ltd., 18F, Building E. Yuanyang International Center, Chaoyang District, Beijing, China
| | - Yong Zhou
- Department of Pulmonary and Critical Care Medicine, Sir Run Run Shaw Hospital, Zhejiang University School of Medicine, No.3, Qingchun East Road, Shangcheng District, Hangzhou, Zhejiang, China.,China National Respiratory Regional Medical Center (East China), No.3, Qingchun East Road, Shangcheng District, Hangzhou, Zhejiang, China
| | - Yongjiu Liu
- Department of Radiology, JINGMEN NO.1 PEOPLE'S HOSPITAL, No.168, Xiangshan Road, Dongbao District, Jingmen, Hubei, China
| | - Bing Wang
- Department of Radiology, JINGMEN NO.1 PEOPLE'S HOSPITAL, No.168, Xiangshan Road, Dongbao District, Jingmen, Hubei, China
| | - Xiaoguo Zhang
- Department of respiratory medicine, Jinan Infectious Disease Hospital, Shandong University, No.22029, Jingshi Road, Shizhong District, Jinan, China
| | - Zhongfa Zhang
- Department of respiratory medicine, Jinan Infectious Disease Hospital, Shandong University, No.22029, Jingshi Road, Shizhong District, Jinan, China
| | - Jianjun Zhang
- Department of Radiology, Zhejiang Hospital, No.12, Lingyin Road, Xihu District, Hangzhou, China
| | - Mingxia Sun
- Department of Radiology, Zhejiang Hospital, No.12, Lingyin Road, Xihu District, Hangzhou, China
| | - Guohua Zhang
- Department of Radiology, TAIZHOU NO.1 PEOPLE'S HOSPITAL, No.218, Hengjie Road, Huangyan District, Taizhou, Zhejiang, China
| | - Guojiao Dai
- Department of Radiology, TAIZHOU NO.1 PEOPLE'S HOSPITAL, No.218, Hengjie Road, Huangyan District, Taizhou, Zhejiang, China
| | - Hongjie Hu
- Department of Radiology, Sir Run Run Shaw Hospital, Zhejiang University School of Medicine, No.3, Qingchun East Road, Shangcheng District, Hangzhou, Zhejiang, China
| |
Collapse
|
156
|
Das D, Biswas SK, Bandyopadhyay S. Perspective of AI system for COVID-19 detection using chest images: a review. MULTIMEDIA TOOLS AND APPLICATIONS 2022; 81:21471-21501. [PMID: 35310889 PMCID: PMC8923339 DOI: 10.1007/s11042-022-11913-4] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/03/2021] [Revised: 09/27/2021] [Accepted: 01/03/2022] [Indexed: 05/11/2023]
Abstract
Coronavirus Disease 2019 (COVID-19) is an evolving communicable disease caused due to Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2) which has led to a global pandemic since December 2019. The virus has its origin from bat and is suspected to have transmitted to humans through zoonotic links. The disease shows dynamic symptoms, nature and reaction to the human body thereby challenging the world of medicine. Moreover, it has tremendous resemblance to viral pneumonia or Community Acquired Pneumonia (CAP). Reverse Transcription Polymerase Chain Reaction (RT-PCR) is performed for detection of COVID-19. Nevertheless, RT-PCR is not completely reliable and sometimes unavailable. Therefore, scientists and researchers have suggested analysis and examination of Computing Tomography (CT) scans and Chest X-Ray (CXR) images to identify the features of COVID-19 in patients having clinical manifestation of the disease, using expert systems deploying learning algorithms such as Machine Learning (ML) and Deep Learning (DL). The paper identifies and reviews various chest image features using the aforementioned imaging modalities for reliable and faster detection of COVID-19 than laboratory processes. The paper also reviews and compares the different aspects of ML and DL using chest images, for detection of COVID-19.
Collapse
Affiliation(s)
- Dolly Das
- Department of Computer Science and Engineering, National Institute of Technology Silchar, Assam Silchar, Cachar, India
| | - Saroj Kumar Biswas
- Department of Computer Science and Engineering, National Institute of Technology Silchar, Assam Silchar, Cachar, India
| | - Sivaji Bandyopadhyay
- Department of Computer Science and Engineering, National Institute of Technology Silchar, Assam Silchar, Cachar, India
| |
Collapse
|
157
|
Ahsan MM, Luna SA, Siddique Z. Machine-Learning-Based Disease Diagnosis: A Comprehensive Review. Healthcare (Basel) 2022; 10:541. [PMID: 35327018 PMCID: PMC8950225 DOI: 10.3390/healthcare10030541] [Citation(s) in RCA: 93] [Impact Index Per Article: 31.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2022] [Revised: 03/08/2022] [Accepted: 03/10/2022] [Indexed: 02/06/2023] Open
Abstract
Globally, there is a substantial unmet need to diagnose various diseases effectively. The complexity of the different disease mechanisms and underlying symptoms of the patient population presents massive challenges in developing the early diagnosis tool and effective treatment. Machine learning (ML), an area of artificial intelligence (AI), enables researchers, physicians, and patients to solve some of these issues. Based on relevant research, this review explains how machine learning (ML) is being used to help in the early identification of numerous diseases. Initially, a bibliometric analysis of the publication is carried out using data from the Scopus and Web of Science (WOS) databases. The bibliometric study of 1216 publications was undertaken to determine the most prolific authors, nations, organizations, and most cited articles. The review then summarizes the most recent trends and approaches in machine-learning-based disease diagnosis (MLBDD), considering the following factors: algorithm, disease types, data type, application, and evaluation metrics. Finally, in this paper, we highlight key results and provides insight into future trends and opportunities in the MLBDD area.
Collapse
Affiliation(s)
- Md Manjurul Ahsan
- School of Industrial and Systems Engineering, University of Oklahoma, Norman, OK 73019, USA
| | - Shahana Akter Luna
- Medicine & Surgery, Dhaka Medical College & Hospital, Dhaka 1000, Bangladesh;
| | - Zahed Siddique
- Department of Aerospace and Mechanical Engineering, University of Oklahoma, Norman, OK 73019, USA;
| |
Collapse
|
158
|
Farahat IS, Sharafeldeen A, Elsharkawy M, Soliman A, Mahmoud A, Ghazal M, Taher F, Bilal M, Abdel Razek AAK, Aladrousy W, Elmougy S, Tolba AE, El-Melegy M, El-Baz A. The Role of 3D CT Imaging in the Accurate Diagnosis of Lung Function in Coronavirus Patients. Diagnostics (Basel) 2022; 12:696. [PMID: 35328249 PMCID: PMC8947065 DOI: 10.3390/diagnostics12030696] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2022] [Revised: 02/25/2022] [Accepted: 03/08/2022] [Indexed: 12/04/2022] Open
Abstract
Early grading of coronavirus disease 2019 (COVID-19), as well as ventilator support machines, are prime ways to help the world fight this virus and reduce the mortality rate. To reduce the burden on physicians, we developed an automatic Computer-Aided Diagnostic (CAD) system to grade COVID-19 from Computed Tomography (CT) images. This system segments the lung region from chest CT scans using an unsupervised approach based on an appearance model, followed by 3D rotation invariant Markov-Gibbs Random Field (MGRF)-based morphological constraints. This system analyzes the segmented lung and generates precise, analytical imaging markers by estimating the MGRF-based analytical potentials. Three Gibbs energy markers were extracted from each CT scan by tuning the MGRF parameters on each lesion separately. The latter were healthy/mild, moderate, and severe lesions. To represent these markers more reliably, a Cumulative Distribution Function (CDF) was generated, then statistical markers were extracted from it, namely, 10th through 90th CDF percentiles with 10% increments. Subsequently, the three extracted markers were combined together and fed into a backpropagation neural network to make the diagnosis. The developed system was assessed on 76 COVID-19-infected patients using two metrics, namely, accuracy and Kappa. In this paper, the proposed system was trained and tested by three approaches. In the first approach, the MGRF model was trained and tested on the lungs. This approach achieved 95.83% accuracy and 93.39% kappa. In the second approach, we trained the MGRF model on the lesions and tested it on the lungs. This approach achieved 91.67% accuracy and 86.67% kappa. Finally, we trained and tested the MGRF model on lesions. It achieved 100% accuracy and 100% kappa. The results reported in this paper show the ability of the developed system to accurately grade COVID-19 lesions compared to other machine learning classifiers, such as k-Nearest Neighbor (KNN), decision tree, naïve Bayes, and random forest.
Collapse
Affiliation(s)
- Ibrahim Shawky Farahat
- BioImaging Laboratory, Department of Bioengineering, University of Louisville, Louisville, KY 40292, USA; (I.S.F.); (A.S.); (M.E.); (A.S.); (A.M.)
| | - Ahmed Sharafeldeen
- BioImaging Laboratory, Department of Bioengineering, University of Louisville, Louisville, KY 40292, USA; (I.S.F.); (A.S.); (M.E.); (A.S.); (A.M.)
| | - Mohamed Elsharkawy
- BioImaging Laboratory, Department of Bioengineering, University of Louisville, Louisville, KY 40292, USA; (I.S.F.); (A.S.); (M.E.); (A.S.); (A.M.)
| | - Ahmed Soliman
- BioImaging Laboratory, Department of Bioengineering, University of Louisville, Louisville, KY 40292, USA; (I.S.F.); (A.S.); (M.E.); (A.S.); (A.M.)
| | - Ali Mahmoud
- BioImaging Laboratory, Department of Bioengineering, University of Louisville, Louisville, KY 40292, USA; (I.S.F.); (A.S.); (M.E.); (A.S.); (A.M.)
| | - Mohammed Ghazal
- Electrical, Computer, and Biomedical Engineering Department, College of Engineering, Abu Dhabi University, Abu Dhabi 59911, United Arab Emirates;
| | - Fatma Taher
- College of Technological Innovation, Zayed University, Dubai 19282, United Arab Emirates;
| | - Maha Bilal
- Department of Diagnostic Radiology, Faculty of Medicine, Mansoura University, Mansoura 35516, Egypt; (M.B.); (A.A.K.A.R.)
| | - Ahmed Abdel Khalek Abdel Razek
- Department of Diagnostic Radiology, Faculty of Medicine, Mansoura University, Mansoura 35516, Egypt; (M.B.); (A.A.K.A.R.)
| | - Waleed Aladrousy
- Computer Science Department, Faculty of Computers and Information, Mansoura University, Mansoura 35516, Egypt; (W.A.); (S.E.); (A.E.T.)
| | - Samir Elmougy
- Computer Science Department, Faculty of Computers and Information, Mansoura University, Mansoura 35516, Egypt; (W.A.); (S.E.); (A.E.T.)
| | - Ahmed Elsaid Tolba
- Computer Science Department, Faculty of Computers and Information, Mansoura University, Mansoura 35516, Egypt; (W.A.); (S.E.); (A.E.T.)
- The Higher Institute of Engineering and Automotive Technology and Energy, New Heliopolis 11829, Cairo, Egypt
| | - Moumen El-Melegy
- Department of Electrical Engineering, Assiut University, Assiut 71511, Egypt;
| | - Ayman El-Baz
- BioImaging Laboratory, Department of Bioengineering, University of Louisville, Louisville, KY 40292, USA; (I.S.F.); (A.S.); (M.E.); (A.S.); (A.M.)
| |
Collapse
|
159
|
Gunraj H, Sabri A, Koff D, Wong A. COVID-Net CT-2: Enhanced Deep Neural Networks for Detection of COVID-19 From Chest CT Images Through Bigger, More Diverse Learning. Front Med (Lausanne) 2022; 8:729287. [PMID: 35360446 PMCID: PMC8960961 DOI: 10.3389/fmed.2021.729287] [Citation(s) in RCA: 20] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2021] [Accepted: 12/31/2021] [Indexed: 01/08/2023] Open
Abstract
The COVID-19 pandemic continues to rage on, with multiple waves causing substantial harm to health and economies around the world. Motivated by the use of computed tomography (CT) imaging at clinical institutes around the world as an effective complementary screening method to RT-PCR testing, we introduced COVID-Net CT, a deep neural network tailored for detection of COVID-19 cases from chest CT images, along with a large curated benchmark dataset comprising 1,489 patient cases as part of the open-source COVID-Net initiative. However, one potential limiting factor is restricted data quantity and diversity given the single nation patient cohort used in the study. To address this limitation, in this study we introduce enhanced deep neural networks for COVID-19 detection from chest CT images which are trained using a large, diverse, multinational patient cohort. We accomplish this through the introduction of two new CT benchmark datasets, the largest of which comprises a multinational cohort of 4,501 patients from at least 16 countries. To the best of our knowledge, this represents the largest, most diverse multinational cohort for COVID-19 CT images in open-access form. Additionally, we introduce a novel lightweight neural network architecture called COVID-Net CT S, which is significantly smaller and faster than the previously introduced COVID-Net CT architecture. We leverage explainability to investigate the decision-making behavior of the trained models and ensure that decisions are based on relevant indicators, with the results for select cases reviewed and reported on by two board-certified radiologists with over 10 and 30 years of experience, respectively. The best-performing deep neural network in this study achieved accuracy, COVID-19 sensitivity, positive predictive value, specificity, and negative predictive value of 99.0%/99.1%/98.0%/99.4%/99.7%, respectively. Moreover, explainability-driven performance validation shows consistency with radiologist interpretation by leveraging correct, clinically relevant critical factors. The results are promising and suggest the strong potential of deep neural networks as an effective tool for computer-aided COVID-19 assessment. While not a production-ready solution, we hope the open-source, open-access release of COVID-Net CT-2 and the associated benchmark datasets will continue to enable researchers, clinicians, and citizen data scientists alike to build upon them.
Collapse
Affiliation(s)
- Hayden Gunraj
- Vision and Image Processing Lab, University of Waterloo, Waterloo, ON, Canada
- *Correspondence: Hayden Gunraj
| | - Ali Sabri
- Department of Radiology, McMaster University, Hamilton, ON, Canada
- Niagara Health System, St. Catharines, ON, Canada
| | - David Koff
- Department of Radiology, McMaster University, Hamilton, ON, Canada
- Hamilton Health Sciences, Hamilton, ON, Canada
| | - Alexander Wong
- Vision and Image Processing Lab, University of Waterloo, Waterloo, ON, Canada
- Waterloo Artificial Intelligence Institute, University of Waterloo, Waterloo, ON, Canada
- DarwinAI Corp., Waterloo, ON, Canada
| |
Collapse
|
160
|
Waheed W, Saylan S, Hassan T, Kannout H, Alsafar H, Alazzam A. A deep learning-driven low-power, accurate, and portable platform for rapid detection of COVID-19 using reverse-transcription loop-mediated isothermal amplification. Sci Rep 2022; 12:4132. [PMID: 35260715 PMCID: PMC8903312 DOI: 10.1038/s41598-022-07954-2] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2021] [Accepted: 02/28/2022] [Indexed: 12/24/2022] Open
Abstract
This paper presents a deep learning-driven portable, accurate, low-cost, and easy-to-use device to perform Reverse-Transcription Loop-Mediated Isothermal Amplification (RT-LAMP) to facilitate rapid detection of COVID-19. The 3D-printed device-powered using only a 5 Volt AC-DC adapter-can perform 16 simultaneous RT-LAMP reactions and can be used multiple times. Moreover, the experimental protocol is devised to obviate the need for separate, expensive equipment for RNA extraction in addition to eliminating sample evaporation. The entire process from sample preparation to the qualitative assessment of the LAMP amplification takes only 45 min (10 min for pre-heating and 35 min for RT-LAMP reactions). The completion of the amplification reaction yields a fuchsia color for the negative samples and either a yellow or orange color for the positive samples, based on a pH indicator dye. The device is coupled with a novel deep learning system that automatically analyzes the amplification results and pays attention to the pH indicator dye to screen the COVID-19 subjects. The proposed device has been rigorously tested on 250 RT-LAMP clinical samples, where it achieved an overall specificity and sensitivity of 0.9666 and 0.9722, respectively with a recall of 0.9892 for Ct < 30. Also, the proposed system can be widely used as an accurate, sensitive, rapid, and portable tool to detect COVID-19 in settings where access to a lab is difficult, or the results are urgently required.
Collapse
Affiliation(s)
- Waqas Waheed
- Department of Mechanical Engineering, Khalifa University, Abu Dhabi, UAE
| | - Sueda Saylan
- System on Chip Center (SOCC), Khalifa University, Abu Dhabi, UAE
- Department of Electrical Engineering and Computer Science, Khalifa University, Abu Dhabi, UAE
| | - Taimur Hassan
- Department of Electrical Engineering and Computer Science, Khalifa University, Abu Dhabi, UAE
- Center for Cyber-Physical Systems (C2PS), EECS Department, Khalifa University, Abu Dhabi, UAE
| | - Hussain Kannout
- Center for Biotechnology (BTC), Khalifa University, Abu Dhabi, UAE
| | - Habiba Alsafar
- Center for Biotechnology (BTC), Khalifa University, Abu Dhabi, UAE
- College of Medicine and Health Sciences, Khalifa University, Abu Dhabi, UAE
| | - Anas Alazzam
- Department of Mechanical Engineering, Khalifa University, Abu Dhabi, UAE.
- System on Chip Center (SOCC), Khalifa University, Abu Dhabi, UAE.
| |
Collapse
|
161
|
Mary Shyni H, Chitra E. A COMPARATIVE STUDY OF X-RAY AND CT IMAGES IN COVID-19 DETECTION USING IMAGE PROCESSING AND DEEP LEARNING TECHNIQUES. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE UPDATE 2022; 2:100054. [PMID: 35281724 PMCID: PMC8898857 DOI: 10.1016/j.cmpbup.2022.100054] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/03/2023]
Abstract
The deadly coronavirus has not just devastated the lives of millions but has put the entire healthcare system under tremendous pressure. Early diagnosis of COVID-19 plays a significant role in isolating the positive cases and preventing the further spread of the disease. The medical images along with deep learning models provided faster and more accurate results in the detection of COVID-19. This article extensively reviews the recent deep learning techniques for COVID-19 diagnosis. The research articles discussed reveal that Convolutional Neural Network (CNN) is the most popular deep learning algorithm in detecting COVID-19 from medical images. An overview of the necessity of pre-processing the medical images, transfer learning and data augmentation techniques to deal with data scarcity problems, use of pre-trained models to save time and the role of medical images in the automatic detection of COVID-19 are summarized. This article also provides a sensible outlook for the young researchers to develop highly effective CNN models coupled with medical images in the early detection of the disease.
Collapse
Affiliation(s)
- H Mary Shyni
- Department of Electronics and Communication Engineering, SRM Institute of Science and Technology, Kattankulathur, Chennai, Tamil Nadu, India
| | - E Chitra
- Department of Electronics and Communication Engineering, SRM Institute of Science and Technology, Kattankulathur, Chennai, Tamil Nadu, India
| |
Collapse
|
162
|
Clinical Characteristics of COVID-19 Patients and Application to an Artificial Intelligence System for Disease Surveillance. J Clin Med 2022; 11:jcm11051437. [PMID: 35268531 PMCID: PMC8911292 DOI: 10.3390/jcm11051437] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2022] [Revised: 02/28/2022] [Accepted: 03/03/2022] [Indexed: 01/08/2023] Open
Abstract
During the coronavirus disease (COVID-19) pandemic, we admitted suspected or confirmed COVID-19 patients to our isolation wards between 2 March 2020 and 4 May 2020, following a well-designed and efficient assessment protocol. We included 217 patients suspected of COVID-19, of which 27 had confirmed COVID-19. The clinical characteristics of these patients were used to train artificial intelligence (AI) models such as support vector machine (SVM), decision tree, random forest, and artificial neural network for diagnosing COVID-19. When analyzing the performance of the models, SVM showed the highest sensitivity (SVM vs. decision tree vs. random forest vs. artificial neural network: 100% vs. 42.86% vs. 28.57% vs. 71.43%), while decision tree and random forest had the highest specificity (SVM vs. decision tree vs. random forest vs. artificial neural network: 88.37% vs. 100% vs. 100% vs. 94.74%) in the diagnosis of COVID-19. With the aid of AI models, physicians may identify COVID-19 patients earlier, even with few baseline data available, and segregate infected patients earlier to avoid hospital cluster infections and to ensure the safety of medical professionals and ordinary patients in the hospital.
Collapse
|
163
|
Aslan MF, Sabanci K, Durdu A, Unlersen MF. COVID-19 diagnosis using state-of-the-art CNN architecture features and Bayesian Optimization. Comput Biol Med 2022; 142:105244. [PMID: 35077936 PMCID: PMC8770389 DOI: 10.1016/j.compbiomed.2022.105244] [Citation(s) in RCA: 45] [Impact Index Per Article: 15.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2021] [Revised: 01/17/2022] [Accepted: 01/17/2022] [Indexed: 12/16/2022]
Abstract
The coronavirus outbreak 2019, called COVID-19, which originated in Wuhan, negatively affected the lives of millions of people and many people died from this infection. To prevent the spread of the disease, which is still in effect, various restriction decisions have been taken all over the world. In addition, the number of COVID-19 tests has been increased to quarantine infected people. However, due to the problems encountered in the supply of RT-PCR tests and the ease of obtaining Computed Tomography and X-ray images, imaging-based methods have become very popular in the diagnosis of COVID-19. Therefore, studies using these images to classify COVID-19 have increased. This paper presents a classification method for computed tomography chest images in the COVID-19 Radiography Database using features extracted by popular Convolutional Neural Networks (CNN) models (AlexNet, ResNet18, ResNet50, Inceptionv3, Densenet201, Inceptionresnetv2, MobileNetv2, GoogleNet). The determination of hyperparameters of Machine Learning (ML) algorithms by Bayesian optimization, and ANN-based image segmentation are the two main contributions in this study. First of all, lung segmentation is performed automatically from the raw image with Artificial Neural Networks (ANNs). To ensure data diversity, data augmentation is applied to the COVID-19 classes, which are fewer than the other two classes. Then these images are applied as input to five different CNN models. The features extracted from each CNN model are given as input to four different ML algorithms, namely Support Vector Machine (SVM), k-Nearest Neighbors (k-NN), Naive Bayes (NB), and Decision Tree (DT) for classification. To achieve the most successful classification accuracy, the hyperparameters of each ML algorithm are determined using Bayesian optimization. With the classification made using these hyperparameters, the highest success is obtained as 96.29% with the DenseNet201 model and SVM algorithm. The Sensitivity, Precision, Specificity, MCC, and F1-Score metric values for this structure are 0.9642, 0.9642, 0.9812, 0.9641 and 0.9453, respectively. These results showed that ML methods with the most optimum hyperparameters can produce successful results.
Collapse
Affiliation(s)
- Muhammet Fatih Aslan
- Electrical and Electronics Engineering, Karamanoglu Mehmetbey University, Karaman, Turkey
| | - Kadir Sabanci
- Electrical and Electronics Engineering, Karamanoglu Mehmetbey University, Karaman, Turkey.
| | - Akif Durdu
- Electrical and Electronics Engineering, Konya Technical University, Konya, Turkey
| | | |
Collapse
|
164
|
Nayak J, Naik B, Dinesh P, Vakula K, Dash PB, Pelusi D. Significance of deep learning for Covid-19: state-of-the-art review. RESEARCH ON BIOMEDICAL ENGINEERING 2022. [PMCID: PMC7980106 DOI: 10.1007/s42600-021-00135-6] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 12/20/2022]
Abstract
Purpose The appearance of the 2019 novel coronavirus (Covid-19), for which there is no treatment or a vaccine, formed a sense of necessity for new drug discovery advances. The pandemic of NCOV-19 (novel coronavirus-19) has been engaged as a public health disaster of overall distress by the World Health Organization. Different pandemic models for NCOV-19 are being exploited by researchers all over the world to acquire experienced assessments and impose major control measures. Among the standard techniques for NCOV-19 global outbreak prediction, epidemiological and simple statistical techniques have attained more concern by researchers. Insufficiency and deficiency of health tests for identifying a solution became a major difficulty in controlling the spread of NCOV-19. To solve this problem, deep learning has emerged as a novel solution over a dozen of machine learning techniques. Deep learning has attained advanced performance in medical applications. Deep learning has the capacity of recognizing patterns in large complex datasets. They are identified as an appropriate method for analyzing affected patients of NCOV-19. Conversely, these techniques for disease recognition focus entirely on enhancing the accurateness of forecasts or classifications without the ambiguity measure in a decision. Knowing how much assurance present in a computer-based health analysis is necessary for gaining clinicians’ expectations in the technology and progress treatment consequently. Today, NCOV-19 diseases are the main healthcare confront throughout the world. Detecting NCOV-19 in X-ray images is vital for diagnosis, treatment, and evaluation. Still, analytical ambiguity in a report is a difficult yet predictable task for radiologists. Method In this paper, an in-depth analysis has been performed on the significance of deep learning for Covid-19 and as per the standard search database, this is the first review research work ever made concentrating particularly on Deep Learning for NCOV-19. Conclusion The main aim behind this research work is to inspire the research community and to innovate novel research using deep learning. Moreover, the outcome of this detailed structured review on the impact of deep learning in covid-19 analysis will be helpful for further investigations on various modalities of diseases detection, prevention and finding novel solutions.
Collapse
Affiliation(s)
- Janmenjoy Nayak
- Department of Computer Science and Engineering, Aditya Institute of Technology and Management (AITAM), K Kotturu, Tekkali, AP 532201 India
| | - Bighnaraj Naik
- Department of Computer Application, Veer Surendra Sai University of Technology, Burla, Odisha 768018 India
| | - Paidi Dinesh
- Department of Computer Science and Engineering, Sri Sivani College of Engineering, Srikakulam, AP 532402 India
| | - Kanithi Vakula
- Department of Computer Science and Engineering, Sri Sivani College of Engineering, Srikakulam, AP 532402 India
| | - Pandit Byomakesha Dash
- Department of Computer Application, Veer Surendra Sai University of Technology, Burla, Odisha 768018 India
| | - Danilo Pelusi
- Faculty of Communication Sciences, University of Teramo, Coste Sant', Agostino Campus, Teramo, Italy
| |
Collapse
|
165
|
Alyasseri ZAA, Al‐Betar MA, Doush IA, Awadallah MA, Abasi AK, Makhadmeh SN, Alomari OA, Abdulkareem KH, Adam A, Damasevicius R, Mohammed MA, Zitar RA. Review on COVID-19 diagnosis models based on machine learning and deep learning approaches. EXPERT SYSTEMS 2022; 39:e12759. [PMID: 34511689 PMCID: PMC8420483 DOI: 10.1111/exsy.12759] [Citation(s) in RCA: 61] [Impact Index Per Article: 20.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/29/2021] [Revised: 05/17/2021] [Accepted: 06/07/2021] [Indexed: 05/02/2023]
Abstract
COVID-19 is the disease evoked by a new breed of coronavirus called the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). Recently, COVID-19 has become a pandemic by infecting more than 152 million people in over 216 countries and territories. The exponential increase in the number of infections has rendered traditional diagnosis techniques inefficient. Therefore, many researchers have developed several intelligent techniques, such as deep learning (DL) and machine learning (ML), which can assist the healthcare sector in providing quick and precise COVID-19 diagnosis. Therefore, this paper provides a comprehensive review of the most recent DL and ML techniques for COVID-19 diagnosis. The studies are published from December 2019 until April 2021. In general, this paper includes more than 200 studies that have been carefully selected from several publishers, such as IEEE, Springer and Elsevier. We classify the research tracks into two categories: DL and ML and present COVID-19 public datasets established and extracted from different countries. The measures used to evaluate diagnosis methods are comparatively analysed and proper discussion is provided. In conclusion, for COVID-19 diagnosing and outbreak prediction, SVM is the most widely used machine learning mechanism, and CNN is the most widely used deep learning mechanism. Accuracy, sensitivity, and specificity are the most widely used measurements in previous studies. Finally, this review paper will guide the research community on the upcoming development of machine learning for COVID-19 and inspire their works for future development. This review paper will guide the research community on the upcoming development of ML and DL for COVID-19 and inspire their works for future development.
Collapse
Affiliation(s)
- Zaid Abdi Alkareem Alyasseri
- Center for Artificial Intelligence Technology, Faculty of Information Science and TechnologyUniversiti Kebangsaan MalaysiaBangiMalaysia
- ECE Department‐Faculty of EngineeringUniversity of KufaNajafIraq
| | - Mohammed Azmi Al‐Betar
- Artificial Intelligence Research Center (AIRC)Ajman UniversityAjmanUnited Arab Emirates
- Department of Information TechnologyAl‐Huson University College, Al‐Balqa Applied UniversityIrbidJordan
| | - Iyad Abu Doush
- Computing Department, College of Engineering and Applied SciencesAmerican University of KuwaitSalmiyaKuwait
- Computer Science DepartmentYarmouk UniversityIrbidJordan
| | - Mohammed A. Awadallah
- Artificial Intelligence Research Center (AIRC)Ajman UniversityAjmanUnited Arab Emirates
- Department of Computer ScienceAl‐Aqsa UniversityGazaPalestine
| | - Ammar Kamal Abasi
- Artificial Intelligence Research Center (AIRC)Ajman UniversityAjmanUnited Arab Emirates
- School of Computer SciencesUniversiti Sains MalaysiaPenangMalaysia
| | - Sharif Naser Makhadmeh
- Artificial Intelligence Research Center (AIRC)Ajman UniversityAjmanUnited Arab Emirates
- Faculty of Information TechnologyMiddle East UniversityAmmanJordan
| | | | | | - Afzan Adam
- Center for Artificial Intelligence Technology, Faculty of Information Science and TechnologyUniversiti Kebangsaan MalaysiaBangiMalaysia
| | | | - Mazin Abed Mohammed
- College of Computer Science and Information TechnologyUniversity of AnbarAnbarIraq
| | - Raed Abu Zitar
- Sorbonne Center of Artificial IntelligenceSorbonne University‐Abu DhabiAbu DhabiUnited Arab Emirates
| |
Collapse
|
166
|
Wong PK, Yan T, Wang H, Chan IN, Wang J, Li Y, Ren H, Wong CH. Automatic detection of multiple types of pneumonia: Open dataset and a multi-scale attention network. Biomed Signal Process Control 2022; 73:103415. [PMID: 34909050 PMCID: PMC8660060 DOI: 10.1016/j.bspc.2021.103415] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2021] [Revised: 10/31/2021] [Accepted: 11/28/2021] [Indexed: 12/13/2022]
Abstract
The quick and precise identification of COVID-19 pneumonia, non-COVID-19 viral pneumonia, bacterial pneumonia, mycoplasma pneumonia, and normal lung on chest CT images play a crucial role in timely quarantine and medical treatment. However, manual identification is subject to potential misinterpretations and time-consumption issues owing the visual similarities of pneumonia lesions. In this study, we propose a novel multi-scale attention network (MSANet) based on a bag of advanced deep learning techniques for the automatic classification of COVID-19 and multiple types of pneumonia. The proposed method can automatically pay attention to discriminative information and multi-scale features of pneumonia lesions for better classification. The experimental results show that the proposed MSANet can achieve an overall precision of 97.31%, recall of 96.18%, F1-score of 96.71%, accuracy of 97.46%, and macro-average area under the receiver operating characteristic curve (AUC) of 0.9981 to distinguish between multiple classes of pneumonia. These promising results indicate that the proposed method can significantly assist physicians and radiologists in medical diagnosis. The dataset is publicly available at https://doi.org/10.17632/rf8x3wp6ss.1.
Collapse
Affiliation(s)
- Pak Kin Wong
- Department of Electromechanical Engineering, University of Macau, Taipa 999078, Macau
| | - Tao Yan
- School of Mechanical Engineering, Hubei University of Arts and Science, Xiangyang 441053, China
| | - Huaqiao Wang
- Xiangyang No.1 People's Hospital, Hubei University of Medicine, Xiangyang 441000, China
| | - In Neng Chan
- Department of Electromechanical Engineering, University of Macau, Taipa 999078, Macau
| | - Jiangtao Wang
- Xiangyang Central Hospital, Affiliated Hospital of Hubei University of Arts and Science, Xiangyang 441021, China
| | - Yang Li
- Xiangyang No.1 People's Hospital, Hubei University of Medicine, Xiangyang 441000, China
| | - Hao Ren
- Xiangyang Central Hospital, Affiliated Hospital of Hubei University of Arts and Science, Xiangyang 441021, China
| | - Chi Hong Wong
- Faculty of Medicine, Macau University of Science and Technology, Taipa 999078, Macau
| |
Collapse
|
167
|
A Decision-Level Fusion Method for COVID-19 Patient Health Prediction. BIG DATA RESEARCH 2022; 27:100287. [PMCID: PMC8574072 DOI: 10.1016/j.bdr.2021.100287] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/26/2020] [Revised: 08/11/2021] [Accepted: 10/28/2021] [Indexed: 06/16/2023]
Abstract
With the continuous attempts to develop effective machine learning methods, information fusion approaches play an important role in integrating data from multiple sources and improving these methods' performance. Among the different fusion techniques, decision-level fusion has unique advantages to fuse the decisions of various classifiers and getting an effective outcome. In this paper, we propose a decision-level fusion method that combines three well-calibrated ensemble classifiers, namely, a random forest (RF), gradient boosting (GB), and extreme gradient boosting (XGB) methods. It is used to predict the COVID-19 patient health for early monitoring and efficient treatment. A soft voting technique is used to generate the final decision result from the predictions of these calibrated classifiers. The method uses the COVID-19 patient's health information, travel demographic, and geographical data to predict the possible outcome of the COVID-19 case, recovered, or death. A different set of experiments is conducted on a public novel Corona Virus 2019 dataset using a different ratio of test sets. The experimental results show that the proposed fusion method achieved an accuracy of 97.24% and an F1-score of 0.97, which is higher than the current related work that has an accuracy of 94% and an F1-score 0.86, on 20% test set taken from the dataset.
Collapse
|
168
|
Hafeez U, Umer M, Hameed A, Mustafa H, Sohaib A, Nappi M, Madni HA. A CNN based coronavirus disease prediction system for chest X-rays. JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING 2022; 14:1-15. [PMID: 35251361 PMCID: PMC8882219 DOI: 10.1007/s12652-022-03775-3] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/02/2021] [Accepted: 02/09/2022] [Indexed: 06/14/2023]
Abstract
Coronavirus disease (COVID-19) proliferated globally in early 2020, causing existential dread in the whole world. Radiography is crucial in the clinical staging and diagnosis of COVID-19 and offers high potential to improve healthcare plans for tackling the pandemic. However high variations in infection characteristics and low contrast between normal and infected regions pose great challenges in preparing radiological reports. To address these challenges, this study presents CODISC-CNN (CNN based Coronavirus DIsease Prediction System for Chest X-rays) that can automatically extract the features from chest X-ray images for the disease prediction. However, to get the infected region of X-ray, edges of the images are detected by applying image preprocessing. Furthermore, to attenuate the shortage of labeled datasets data augmentation has been adapted. Extensive experiments have been performed to classify X-ray images into two classes (Normal and COVID), three classes (Normal, COVID, and Virus Bacteria), and four classes (Normal, COVID, and Virus Bacteria, and Virus Pneumonia) with the accuracy of 97%, 89%, and 84% respectively. The proposed CNN-based model outperforms many cutting-edge classification models and boosts state-of-the-art performance.
Collapse
Affiliation(s)
- Umair Hafeez
- Department of Computer Engineering, Khwaja Fareed University of Engineering and Information Technology, Rahim Yar Khan, Pakistan
| | - Muhammad Umer
- Department of Computer Science and Information Technology, The Islamia University of Bahawalpur, Bahawalpur, 63100 Pakistan
| | - Ahmad Hameed
- Department of Computer Engineering, Khwaja Fareed University of Engineering and Information Technology, Rahim Yar Khan, Pakistan
| | - Hassan Mustafa
- Department of Computer Engineering, Khwaja Fareed University of Engineering and Information Technology, Rahim Yar Khan, Pakistan
| | - Ahmed Sohaib
- Department of Computer Engineering, Khwaja Fareed University of Engineering and Information Technology, Rahim Yar Khan, Pakistan
| | - Michele Nappi
- Department of Computer Science, University of Salerno, Fisciano, Italy
| | - Hamza Ahmad Madni
- Department of Computer Engineering, Khwaja Fareed University of Engineering and Information Technology, Rahim Yar Khan, Pakistan
- Faculty of Electronics, Telecommunications and Informatics, Gdansk University of Technology, 80-233 Gdansk, Poland
| |
Collapse
|
169
|
Enshaei N, Oikonomou A, Rafiee MJ, Afshar P, Heidarian S, Mohammadi A, Plataniotis KN, Naderkhani F. COVID-rate: an automated framework for segmentation of COVID-19 lesions from chest CT images. Sci Rep 2022; 12:3212. [PMID: 35217712 PMCID: PMC8881477 DOI: 10.1038/s41598-022-06854-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2021] [Accepted: 01/21/2022] [Indexed: 11/09/2022] Open
Abstract
Novel Coronavirus disease (COVID-19) is a highly contagious respiratory infection that has had devastating effects on the world. Recently, new COVID-19 variants are emerging making the situation more challenging and threatening. Evaluation and quantification of COVID-19 lung abnormalities based on chest Computed Tomography (CT) images can help determining the disease stage, efficiently allocating limited healthcare resources, and making informed treatment decisions. During pandemic era, however, visual assessment and quantification of COVID-19 lung lesions by expert radiologists become expensive and prone to error, which raises an urgent quest to develop practical autonomous solutions. In this context, first, the paper introduces an open-access COVID-19 CT segmentation dataset containing 433 CT images from 82 patients that have been annotated by an expert radiologist. Second, a Deep Neural Network (DNN)-based framework is proposed, referred to as the [Formula: see text], that autonomously segments lung abnormalities associated with COVID-19 from chest CT images. Performance of the proposed [Formula: see text] framework is evaluated through several experiments based on the introduced and external datasets. Third, an unsupervised enhancement approach is introduced that can reduce the gap between the training set and test set and improve the model generalization. The enhanced results show a dice score of 0.8069 and specificity and sensitivity of 0.9969 and 0.8354, respectively. Furthermore, the results indicate that the [Formula: see text] model can efficiently segment COVID-19 lesions in both 2D CT images and whole lung volumes. Results on the external dataset illustrate generalization capabilities of the [Formula: see text] model to CT images obtained from a different scanner.
Collapse
Affiliation(s)
- Nastaran Enshaei
- Concordia Institute for Information Systems Engineering, Concordia University, Montreal, QC, Canada
| | - Anastasia Oikonomou
- Department of Medical Imaging, Sunnybrook Health Sciences Centre, University of Toronto, Toronto, ON, Canada.
| | - Moezedin Javad Rafiee
- Department of Medicine and Diagnostic Radiology, McGill University, Montreal, QC, Canada
| | - Parnian Afshar
- Concordia Institute for Information Systems Engineering, Concordia University, Montreal, QC, Canada
| | - Shahin Heidarian
- Department of Electrical and Computer Engineering, Concordia University, Montreal, QC, Canada
| | - Arash Mohammadi
- Concordia Institute for Information Systems Engineering, Concordia University, Montreal, QC, Canada
| | | | - Farnoosh Naderkhani
- Concordia Institute for Information Systems Engineering, Concordia University, Montreal, QC, Canada
| |
Collapse
|
170
|
Sarv Ahrabi S, Piazzo L, Momenzadeh A, Scarpiniti M, Baccarelli E. Exploiting probability density function of deep convolutional autoencoders' latent space for reliable COVID-19 detection on CT scans. THE JOURNAL OF SUPERCOMPUTING 2022; 78:12024-12045. [PMID: 35228777 PMCID: PMC8867464 DOI: 10.1007/s11227-022-04349-y] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 01/30/2022] [Indexed: 05/04/2023]
Abstract
We present a probabilistic method for classifying chest computed tomography (CT) scans into COVID-19 and non-COVID-19. To this end, we design and train, in an unsupervised manner, a deep convolutional autoencoder (DCAE) on a selected training data set, which is composed only of COVID-19 CT scans. Once the model is trained, the encoder can generate the compact hidden representation (the hidden feature vectors) of the training data set. Afterwards, we exploit the obtained hidden representation to build up the target probability density function (PDF) of the training data set by means of kernel density estimation (KDE). Subsequently, in the test phase, we feed a test CT into the trained encoder to produce the corresponding hidden feature vector, and then, we utilise the target PDF to compute the corresponding PDF value of the test image. Finally, this obtained value is compared to a threshold to assign the COVID-19 label or non-COVID-19 to the test image. We numerically check our approach's performance (i.e. test accuracy and training times) by comparing it with those of some state-of-the-art methods.
Collapse
Affiliation(s)
- Sima Sarv Ahrabi
- Department of Information Engineering, Electronics and Telecommunications, Sapienza University of Rome, Via Eudossiana 18, 00184 Roma, Italy
| | - Lorenzo Piazzo
- Department of Information Engineering, Electronics and Telecommunications, Sapienza University of Rome, Via Eudossiana 18, 00184 Roma, Italy
| | - Alireza Momenzadeh
- Department of Information Engineering, Electronics and Telecommunications, Sapienza University of Rome, Via Eudossiana 18, 00184 Roma, Italy
| | - Michele Scarpiniti
- Department of Information Engineering, Electronics and Telecommunications, Sapienza University of Rome, Via Eudossiana 18, 00184 Roma, Italy
| | - Enzo Baccarelli
- Department of Information Engineering, Electronics and Telecommunications, Sapienza University of Rome, Via Eudossiana 18, 00184 Roma, Italy
| |
Collapse
|
171
|
Vineth Ligi S, Kundu SS, Kumar R, Narayanamoorthi R, Lai KW, Dhanalakshmi S. Radiological Analysis of COVID-19 Using Computational Intelligence: A Broad Gauge Study. JOURNAL OF HEALTHCARE ENGINEERING 2022; 2022:5998042. [PMID: 35251572 PMCID: PMC8890832 DOI: 10.1155/2022/5998042] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/13/2021] [Revised: 12/13/2021] [Accepted: 01/07/2022] [Indexed: 12/20/2022]
Abstract
Pulmonary medical image analysis using image processing and deep learning approaches has made remarkable achievements in the diagnosis, prognosis, and severity check of lung diseases. The epidemic of COVID-19 brought out by the novel coronavirus has triggered a critical need for artificial intelligence assistance in diagnosing and controlling the disease to reduce its effects on people and global economies. This study aimed at identifying the various COVID-19 medical imaging analysis models proposed by different researchers and featured their merits and demerits. It gives a detailed discussion on the existing COVID-19 detection methodologies (diagnosis, prognosis, and severity/risk detection) and the challenges encountered for the same. It also highlights the various preprocessing and post-processing methods involved to enhance the detection mechanism. This work also tries to bring out the different unexplored research areas that are available for medical image analysis and how the vast research done for COVID-19 can advance the field. Despite deep learning methods presenting high levels of efficiency, some limitations have been briefly described in the study. Hence, this review can help understand the utilization and pros and cons of deep learning in analyzing medical images.
Collapse
Affiliation(s)
- S. Vineth Ligi
- Department of Electronics and Communication Engineering, College of Engineering and Technology, Faculty of Engineering and Technology, SRM Institute of Science and Technology, SRM Nagar, Kattankulathur, Chengalpattu, Chennai, TN, India
| | - Soumya Snigdha Kundu
- Department of Computer Science Engineering, College of Engineering and Technology, Faculty of Engineering and Technology, SRM Institute of Science and Technology, SRM Nagar, Kattankulathur, Chengalpattu, Chennai, TN, India
| | - R. Kumar
- Department of Electronics and Communication Engineering, College of Engineering and Technology, Faculty of Engineering and Technology, SRM Institute of Science and Technology, SRM Nagar, Kattankulathur, Chengalpattu, Chennai, TN, India
| | - R. Narayanamoorthi
- Department of Electrical and Electronics Engineering, College of Engineering and Technology, Faculty of Engineering and Technology, SRM Institute of Science and Technology, SRM Nagar, Kattankulathur, Chengalpattu, Chennai, TN, India
| | - Khin Wee Lai
- Department of Biomedical Engineering, Faculty of Engineering, Universiti Malaya, Kuala Lumpur, Malaysia
| | - Samiappan Dhanalakshmi
- Department of Electronics and Communication Engineering, College of Engineering and Technology, Faculty of Engineering and Technology, SRM Institute of Science and Technology, SRM Nagar, Kattankulathur, Chengalpattu, Chennai, TN, India
| |
Collapse
|
172
|
Abstract
Deep learning uses artificial neural networks to recognize patterns and learn from them to make decisions. Deep learning is a type of machine learning that uses artificial neural networks to mimic the human brain. It uses machine learning methods such as supervised, semi-supervised, or unsupervised learning strategies to learn automatically in deep architectures and has gained much popularity due to its superior ability to learn from huge amounts of data. It was found that deep learning approaches can be used for big data analysis successfully. Applications include virtual assistants such as Alexa and Siri, facial recognition, personalization, natural language processing, autonomous cars, automatic handwriting generation, news aggregation, the colorization of black and white images, the addition of sound to silent films, pixel restoration, and deep dreaming. As a review, this paper aims to categorically cover several widely used deep learning algorithms along with their architectures and their practical applications: backpropagation, autoencoders, variational autoencoders, restricted Boltzmann machines, deep belief networks, convolutional neural networks, recurrent neural networks, generative adversarial networks, capsnets, transformer, embeddings from language models, bidirectional encoder representations from transformers, and attention in natural language processing. In addition, challenges of deep learning are also presented in this paper, such as AutoML-Zero, neural architecture search, evolutionary deep learning, and others. The pros and cons of these algorithms and their applications in healthcare are explored, alongside the future direction of this domain. This paper presents a review and a checkpoint to systemize the popular algorithms and to encourage further innovation regarding their applications. For new researchers in the field of deep learning, this review can help them to obtain many details about the advantages, disadvantages, applications, and working mechanisms of a number of deep learning algorithms. In addition, we introduce detailed information on how to apply several deep learning algorithms in healthcare, such as in relation to the COVID-19 pandemic. By presenting many challenges of deep learning in one section, we hope to increase awareness of these challenges, and how they can be dealt with. This could also motivate researchers to find solutions for these challenges.
Collapse
|
173
|
COVID-19 Detection Systems Using Deep-Learning Algorithms Based on Speech and Image Data. MATHEMATICS 2022. [DOI: 10.3390/math10040564] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/27/2023]
Abstract
The global epidemic caused by COVID-19 has had a severe impact on the health of human beings. The virus has wreaked havoc throughout the world since its declaration as a worldwide pandemic and has affected an expanding number of nations in numerous countries around the world. Recently, a substantial amount of work has been done by doctors, scientists, and many others working on the frontlines to battle the effects of the spreading virus. The integration of artificial intelligence, specifically deep- and machine-learning applications, in the health sector has contributed substantially to the fight against COVID-19 by providing a modern innovative approach for detecting, diagnosing, treating, and preventing the virus. In this proposed work, we focus mainly on the role of the speech signal and/or image processing in detecting the presence of COVID-19. Three types of experiments have been conducted, utilizing speech-based, image-based, and speech and image-based models. Long short-term memory (LSTM) has been utilized for the speech classification of the patient’s cough, voice, and breathing, obtaining an accuracy that exceeds 98%. Moreover, CNN models VGG16, VGG19, Densnet201, ResNet50, Inceptionv3, InceptionResNetV2, and Xception have been benchmarked for the classification of chest X-ray images. The VGG16 model outperforms all other CNN models, achieving an accuracy of 85.25% without fine-tuning and 89.64% after performing fine-tuning techniques. Furthermore, the speech–image-based model has been evaluated using the same seven models, attaining an accuracy of 82.22% by the InceptionResNetV2 model. Accordingly, it is inessential for the combined speech–image-based model to be employed for diagnosis purposes since the speech-based and image-based models have each shown higher terms of accuracy than the combined model.
Collapse
|
174
|
Aria M, Nourani E, Golzari Oskouei A. ADA-COVID: Adversarial Deep Domain Adaptation-Based Diagnosis of COVID-19 from Lung CT Scans Using Triplet Embeddings. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:2564022. [PMID: 35154300 PMCID: PMC8826267 DOI: 10.1155/2022/2564022] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/13/2021] [Revised: 12/08/2021] [Accepted: 01/07/2022] [Indexed: 12/12/2022]
Abstract
Rapid diagnosis of COVID-19 with high reliability is essential in the early stages. To this end, recent research often uses medical imaging combined with machine vision methods to diagnose COVID-19. However, the scarcity of medical images and the inherent differences in existing datasets that arise from different medical imaging tools, methods, and specialists may affect the generalization of machine learning-based methods. Also, most of these methods are trained and tested on the same dataset, reducing the generalizability and causing low reliability of the obtained model in real-world applications. This paper introduces an adversarial deep domain adaptation-based approach for diagnosing COVID-19 from lung CT scan images, termed ADA-COVID. Domain adaptation-based training process receives multiple datasets with different input domains to generate domain-invariant representations for medical images. Also, due to the excessive structural similarity of medical images compared to other image data in machine vision tasks, we use the triplet loss function to generate similar representations for samples of the same class (infected cases). The performance of ADA-COVID is evaluated and compared with other state-of-the-art COVID-19 diagnosis algorithms. The obtained results indicate that ADA-COVID achieves classification improvements of at least 3%, 20%, 20%, and 11% in accuracy, precision, recall, and F1 score, respectively, compared to the best results of competitors, even without directly training on the same data. The implementation source code of the ADA-COVID is publicly available at https://github.com/MehradAria/ADA-COVID.
Collapse
Affiliation(s)
- Mehrad Aria
- Faculty of Information Technology and Computer Engineering, Azarbaijan Shahid Madani University, Tabriz, Iran
| | - Esmaeil Nourani
- Faculty of Information Technology and Computer Engineering, Azarbaijan Shahid Madani University, Tabriz, Iran
| | - Amin Golzari Oskouei
- Department of Computer Engineering, Faculty of Electrical and Computer Engineering, University of Tabriz, Tabriz, Iran
| |
Collapse
|
175
|
Mousavi Z, Shahini N, Sheykhivand S, Mojtahedi S, Arshadi A. COVID-19 detection using chest X-ray images based on a developed deep neural network. SLAS Technol 2022; 27:63-75. [PMID: 35058196 PMCID: PMC8545610 DOI: 10.1016/j.slast.2021.10.011] [Citation(s) in RCA: 16] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/19/2023]
Abstract
AIM Currently, a new coronavirus called COVID-19 is the biggest challenge of the human at 21st century. Now, the spread of this virus is such that mortality has risen strongly in all cities of countries. Therefore, it is necessary to think of a solution to handle the disease by fast and timely diagnosis. This paper proposes a method that uses chest X-ray imagery to divide 2-4 classes into 7 different Scenarios, including Bacterial, Viral, Healthy, and COVID-19 classes. The aim of this study is to propose a method that uses chest X-ray imagery to divide 2-4 classes into 7 different Scenarios, including Bacterial, Viral, Healthy, and COVID-19 classes. METHODS 6 different databases from chest X-ray imagery that have been widely used in recent studies have been gathered for this aim. A Convolutional Neural Network-Long Short Time Memory model is designed and developed to extract features from raw data hierarchically. In order to make more realistic assumptions and use the Proposed Method in the practical field, white Gaussian noise is added to the raw chest X-ray imagery. Additionally, the proposed network is tested and investigated not only on 6 expressed databases but also on two additional databases. RESULTS On the test set, the proposed network achieved an accuracy of more than 90% for all Scenarios excluding Scenario V, i.e. Healthy against the COVID-19 against the Viral, and also achieved 99% accuracy for separating the COVID-19 from the Healthy group. The results showed that the proposed network is robust to noise up to 1 dB. It is worth noting that the proposed network for two additional databases, which were only used as test databases, also achieved more than 90% accuracy. In addition, in comparison to the state-of-the-art pneumonia detection approaches, the final results obtained from the proposed network is so promising. CONCLUSIONS The proposed network is effective in detecting COVID-19 and other lung infectious diseases using chest X-ray imagery and can thus assist radiologists in making rapid and accurate detections.
Collapse
Affiliation(s)
- Zohreh Mousavi
- Department of Mechanical Engineering, Faculty of Mechanical Engineering, University of Tabriz, Tabriz, Iran.
| | - Nahal Shahini
- Deparment of Computer Engineering and Information Technology, Amirkabir University of Technology, Tehran, Iran.
| | - Sobhan Sheykhivand
- Department of Biomedical Engineering, Faculty of Electrical and Computer Engineering, University of Tabriz, Tabriz, Iran.
| | - Sina Mojtahedi
- Department of Electrical and Electronics Engineering, Faculty of Engineering, Okan University, Istanbul, Turkey
| | - Afrooz Arshadi
- Department of statiatics, Faculty of Mathematical sciences and computer, University of Allameh Tabataba'i, Tehran, Iran
| |
Collapse
|
176
|
Xu Z, Su C, Xiao Y, Wang F. Artificial intelligence for COVID-19: battling the pandemic with computational intelligence. INTELLIGENT MEDICINE 2022; 2:13-29. [PMID: 34697578 PMCID: PMC8529224 DOI: 10.1016/j.imed.2021.09.001] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/20/2021] [Revised: 09/15/2021] [Accepted: 09/29/2021] [Indexed: 12/15/2022]
Abstract
The new coronavirus disease 2019 (COVID-19) has become a global pandemic leading to over 180 million confirmed cases and nearly 4 million deaths until June 2021, according to the World Health Organization. Since the initial report in December 2019 , COVID-19 has demonstrated a high transmission rate (with an R0 > 2), a diverse set of clinical characteristics (e.g., high rate of hospital and intensive care unit admission rates, multi-organ dysfunction for critically ill patients due to hyperinflammation, thrombosis, etc.), and a tremendous burden on health care systems around the world. To understand the serious and complex diseases and develop effective control, treatment, and prevention strategies, researchers from different disciplines have been making significant efforts from different aspects including epidemiology and public health, biology and genomic medicine, as well as clinical care and patient management. In recent years, artificial intelligence (AI) has been introduced into the healthcare field to aid clinical decision-making for disease diagnosis and treatment such as detecting cancer based on medical images, and has achieved superior performance in multiple data-rich application scenarios. In the COVID-19 pandemic, AI techniques have also been used as a powerful tool to overcome the complex diseases. In this context, the goal of this study is to review existing studies on applications of AI techniques in combating the COVID-19 pandemic. Specifically, these efforts can be grouped into the fields of epidemiology, therapeutics, clinical research, social and behavioral studies and are summarized. Potential challenges, directions, and open questions are discussed accordingly, which may provide new insights into addressing the COVID-19 pandemic and would be helpful for researchers to explore more related topics in the post-pandemic era.
Collapse
Affiliation(s)
- Zhenxing Xu
- Department of Population Health Sciences, Weill Cornell Medicine, Cornell University, New York 10065, United States
| | - Chang Su
- Department of Health Service Administration and Policy, Temple University, Philadelphia 19122, United States
| | - Yunyu Xiao
- Department of Population Health Sciences, Weill Cornell Medicine, Cornell University, New York 10065, United States
| | - Fei Wang
- Department of Population Health Sciences, Weill Cornell Medicine, Cornell University, New York 10065, United States
| |
Collapse
|
177
|
Kogilavani SV, Prabhu J, Sandhiya R, Kumar MS, Subramaniam U, Karthick A, Muhibbullah M, Imam SBS. COVID-19 Detection Based on Lung Ct Scan Using Deep Learning Techniques. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2022; 2022:7672196. [PMID: 35116074 PMCID: PMC8805449 DOI: 10.1155/2022/7672196] [Citation(s) in RCA: 37] [Impact Index Per Article: 12.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/12/2021] [Accepted: 01/07/2022] [Indexed: 12/17/2022]
Abstract
SARS-CoV-2 is a novel virus, responsible for causing the COVID-19 pandemic that has emerged as a pandemic in recent years. Humans are becoming infected with the virus. In 2019, the city of Wuhan reported the first-ever incidence of COVID-19. COVID-19 infected people have symptoms that are related to pneumonia, and the virus affects the body's respiratory organs, making breathing difficult. A real-time reverse transcriptase-polymerase chain reaction (RT-PCR) kit is used to diagnose the disease. Due to a shortage of kits, suspected patients cannot be treated promptly, resulting in disease spread. To develop an alternative, radiologists looked at the changes in radiological imaging, like CT scans, that produce comprehensive pictures of the body of excellent quality. The suspected patient's computed tomography (CT) scan is used to distinguish between a healthy individual and a COVID-19 patient using deep learning algorithms. A lot of deep learning methods have been proposed for COVID-19. The proposed work utilizes CNN architectures like VGG16, DeseNet121, MobileNet, NASNet, Xception, and EfficientNet. The dataset contains 3873 total CT scan images with "COVID" and "Non-COVID." The dataset is divided into train, test, and validation. Accuracies obtained for VGG16 are 97.68%, DenseNet121 is 97.53%, MobileNet is 96.38%, NASNet is 89.51%, Xception is 92.47%, and EfficientNet is 80.19%, respectively. From the obtained analysis, the results show that the VGG16 architecture gives better accuracy compared to other architectures.
Collapse
Affiliation(s)
- S. V. Kogilavani
- . Department of Computer Science and Engineering, Kongu Engineering College, Perundurai, Erode 638060, Tamil Nadu, India
| | - J. Prabhu
- School of Information Technology and Engineering, Vellore Institute of Technology, Vellore, Tamil Nadu, India
| | - R. Sandhiya
- . Department of Computer Science and Engineering, Kongu Engineering College, Perundurai, Erode 638060, Tamil Nadu, India
| | - M. Sandeep Kumar
- School of Information Technology and Engineering, Vellore Institute of Technology, Vellore, Tamil Nadu, India
| | - UmaShankar Subramaniam
- Renewable Energy Lab, College of Engineering, Prince Sultan University, Riyadh, Saudi Arabia 11586
- Department of Energy and Environmental Engineering, Saveetha School of Engineering, Saveetha Institute of Medical and Technical Sciences, Saveetha University, Saveetha Nagar, Thandalam, Chennai-602105, Tamilnadu, India
| | - Alagar Karthick
- Renewable Energy Lab, Department of Electrical and Electronics Engineering, KPR Institute of Engineering and Technology, Coimbatore, 641407 Tamilnadu, India
| | - M. Muhibbullah
- Department of Electrical and Electronic Engineering, Bangladesh University, Dhaka 1207, Bangladesh
| | - Sharmila Banu Sheik Imam
- College of Computer Science & Information Technology (CCSIT), King Faisal University, Alahsa, Saudi Arabia 31982
| |
Collapse
|
178
|
Balaha HM, El-Gendy EM, Saafan MM. A complete framework for accurate recognition and prognosis of COVID-19 patients based on deep transfer learning and feature classification approach. Artif Intell Rev 2022; 55:5063-5108. [PMID: 35125606 PMCID: PMC8799451 DOI: 10.1007/s10462-021-10127-8] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
Abstract
The sudden appearance of COVID-19 has put the world in a serious situation. Due to the rapid spread of the virus and the increase in the number of infected patients and deaths, COVID-19 was declared a pandemic. This pandemic has its destructive effect not only on humans but also on the economy. Despite the development and availability of different vaccines for COVID-19, scientists still warn the citizens of new severe waves of the virus, and as a result, fast diagnosis of COVID-19 is a critical issue. Chest imaging proved to be a powerful tool in the early detection of COVID-19. This study introduces an entire framework for the early detection and early prognosis of COVID-19 severity in the diagnosed patients using laboratory test results. It consists of two phases (1) Early Diagnostic Phase (EDP) and (2) Early Prognostic Phase (EPP). In EDP, COVID-19 patients are diagnosed using CT chest images. In the current study, 5, 159 COVID-19 and 10, 376 normal computed tomography (CT) images of Egyptians were used as a dataset to train 7 different convolutional neural networks using transfer learning. Data augmentation normal techniques and generative adversarial networks (GANs), CycleGAN and CCGAN, were used to increase the images in the dataset to avoid overfitting issues. 28 experiments were applied and multiple performance metrics were captured. Classification with no augmentation yielded \documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$99.61\%$$\end{document}99.61% accuracy by EfficientNetB7 architecture. By applying CycleGAN and CC-GAN Augmentation, the maximum reported accuracies were \documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$99.57\%$$\end{document}99.57% and \documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$99.14\%$$\end{document}99.14% by MobileNetV1 and VGG-16 architectures respectively. In EPP, the prognosis of the severity of COVID-19 in patients is early determined using laboratory test results. In this study, 25 different classification techniques were applied and from the different results, the highest accuracies were \documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$98.70\%$$\end{document}98.70% and \documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$97.40\%$$\end{document}97.40% reported by the Ensemble Bagged Trees and Tree (Fine, Medium, and Coarse) techniques respectively.
Collapse
Affiliation(s)
- Hossam Magdy Balaha
- Computers and Control Systems Department, Faculty of Engineering, Mansoura University, Mansoura, Egypt
| | - Eman M. El-Gendy
- Computers and Control Systems Department, Faculty of Engineering, Mansoura University, Mansoura, Egypt
| | - Mahmoud M. Saafan
- Computers and Control Systems Department, Faculty of Engineering, Mansoura University, Mansoura, Egypt
| |
Collapse
|
179
|
Nivetha S, Inbarani HH. Neighborhood Rough Neural Network Approach for COVID-19 Image Classification. Neural Process Lett 2022; 54:1919-1941. [PMID: 35079228 PMCID: PMC8776386 DOI: 10.1007/s11063-021-10712-6] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 11/30/2021] [Indexed: 12/05/2022]
Abstract
The rapid spread of the new Coronavirus, COVID-19, causes serious symptoms in humans and can lead to fatality. A COVID-19 infected person can experience a dry cough, muscle pain, headache, fever, sore throat, and mild to moderate respiratory illness, according to a clinical report. A chest X-ray (also known as radiography) or a chest CT scan are more effective imaging techniques for diagnosing lung cancer. Computed Tomography (CT) scan images allow for fast and precise COVID-19 screening. In this paper, a novel hybridized approach based on the Neighborhood Rough Set Classification method (NRSC) and Backpropagation Neural Network (BPN) is proposed to classify COVID and NON-COVID images. The proposed novel classification algorithm is compared with other existing benchmark approaches such as Neighborhood Rough Set, Backpropagation Neural Network, Decision Tree, Random Forest Classifier, Naive Bayes Classifier, K- Nearest Neighbor, and Support Vector Machine. Various classification accuracy measures are used to assess the efficacy of the classification algorithms.
Collapse
Affiliation(s)
- S. Nivetha
- Department of Computer Science, Periyar University, Salem, Tamil Nadu India
| | - H. Hannah Inbarani
- Department of Computer Science, Periyar University, Salem, Tamil Nadu India
| |
Collapse
|
180
|
Yousef R, Gupta G, Yousef N, Khari M. A holistic overview of deep learning approach in medical imaging. MULTIMEDIA SYSTEMS 2022; 28:881-914. [PMID: 35079207 PMCID: PMC8776556 DOI: 10.1007/s00530-021-00884-5] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/09/2021] [Accepted: 12/23/2021] [Indexed: 05/07/2023]
Abstract
Medical images are a rich source of invaluable necessary information used by clinicians. Recent technologies have introduced many advancements for exploiting the most of this information and use it to generate better analysis. Deep learning (DL) techniques have been empowered in medical images analysis using computer-assisted imaging contexts and presenting a lot of solutions and improvements while analyzing these images by radiologists and other specialists. In this paper, we present a survey of DL techniques used for variety of tasks along with the different medical image's modalities to provide critical review of the recent developments in this direction. We have organized our paper to provide significant contribution of deep leaning traits and learn its concepts, which is in turn helpful for non-expert in medical society. Then, we present several applications of deep learning (e.g., segmentation, classification, detection, etc.) which are commonly used for clinical purposes for different anatomical site, and we also present the main key terms for DL attributes like basic architecture, data augmentation, transfer learning, and feature selection methods. Medical images as inputs to deep learning architectures will be the mainstream in the coming years, and novel DL techniques are predicted to be the core of medical images analysis. We conclude our paper by addressing some research challenges and the suggested solutions for them found in literature, and also future promises and directions for further developments.
Collapse
Affiliation(s)
- Rammah Yousef
- Yogananda School of AI Computer and Data Sciences, Shoolini University, Solan, 173229 Himachal Pradesh India
| | - Gaurav Gupta
- Yogananda School of AI Computer and Data Sciences, Shoolini University, Solan, 173229 Himachal Pradesh India
| | - Nabhan Yousef
- Electronics and Communication Engineering, Marwadi University, Rajkot, Gujrat India
| | - Manju Khari
- Jawaharlal Nehru University, New Delhi, India
| |
Collapse
|
181
|
Liang H, Guo Y, Chen X, Ang KL, He Y, Jiang N, Du Q, Zeng Q, Lu L, Gao Z, Li L, Li Q, Nie F, Ding G, Huang G, Chen A, Li Y, Guan W, Sang L, Xu Y, Chen H, Chen Z, Li S, Zhang N, Chen Y, Huang D, Li R, Li J, Cheng B, Zhao Y, Li C, Xiong S, Wang R, Liu J, Wang W, Huang J, Cui F, Xu T, Lure FYM, Zhan M, Huang Y, Yang Q, Dai Q, Liang W, He J, Zhong N. Artificial intelligence for stepwise diagnosis and monitoring of COVID-19. Eur Radiol 2022; 32:2235-2245. [PMID: 34988656 PMCID: PMC8731211 DOI: 10.1007/s00330-021-08334-6] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/07/2021] [Revised: 07/06/2021] [Accepted: 08/07/2021] [Indexed: 11/04/2022]
Abstract
BACKGROUND Main challenges for COVID-19 include the lack of a rapid diagnostic test, a suitable tool to monitor and predict a patient's clinical course and an efficient way for data sharing among multicenters. We thus developed a novel artificial intelligence system based on deep learning (DL) and federated learning (FL) for the diagnosis, monitoring, and prediction of a patient's clinical course. METHODS CT imaging derived from 6 different multicenter cohorts were used for stepwise diagnostic algorithm to diagnose COVID-19, with or without clinical data. Patients with more than 3 consecutive CT images were trained for the monitoring algorithm. FL has been applied for decentralized refinement of independently built DL models. RESULTS A total of 1,552,988 CT slices from 4804 patients were used. The model can diagnose COVID-19 based on CT alone with the AUC being 0.98 (95% CI 0.97-0.99), and outperforms the radiologist's assessment. We have also successfully tested the incorporation of the DL diagnostic model with the FL framework. Its auto-segmentation analyses co-related well with those by radiologists and achieved a high Dice's coefficient of 0.77. It can produce a predictive curve of a patient's clinical course if serial CT assessments are available. INTERPRETATION The system has high consistency in diagnosing COVID-19 based on CT, with or without clinical data. Alternatively, it can be implemented on a FL platform, which would potentially encourage the data sharing in the future. It also can produce an objective predictive curve of a patient's clinical course for visualization. KEY POINTS • CoviDet could diagnose COVID-19 based on chest CT with high consistency; this outperformed the radiologist's assessment. Its auto-segmentation analyses co-related well with those by radiologists and could potentially monitor and predict a patient's clinical course if serial CT assessments are available. It can be integrated into the federated learning framework. • CoviDet can be used as an adjunct to aid clinicians with the CT diagnosis of COVID-19 and can potentially be used for disease monitoring; federated learning can potentially open opportunities for global collaboration.
Collapse
Affiliation(s)
- Hengrui Liang
- National Clinical Research Center for Respiratory Disease, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China.,Department of Thoracic Surgery, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China
| | - Yuchen Guo
- Institute for Brain and Cognitive Sciences, Tsinghua University, Beijing, 100084, China.,Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing, 100084, China
| | - Xiangru Chen
- Beijing XiaoBaiShiJi Network Technical Co., Ltd, Beijing, 100084, China
| | - Keng-Leong Ang
- Department of Thoracic Surgery, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China.,Department of Thoracic Surgery, Glenfield Hospital, Leicester, LE3 9QP, UK
| | - Yuwei He
- Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing, 100084, China.,School of Software, Tsinghua University, Beijing, 100084, China
| | - Na Jiang
- Department of Gastroenterology, Wuhan Hankou Hospital, Wuhan, 430000, China
| | - Qiang Du
- Beijing XiaoBaiShiJi Network Technical Co., Ltd, Beijing, 100084, China
| | - Qingsi Zeng
- National Clinical Research Center for Respiratory Disease, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China.,Department of Radiology, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China
| | - Ligong Lu
- Zhuhai Interventional Medical Center, Zhuhai Precision Medical Center, Zhuhai People's Hospital, Zhuhai Hospital Affiliated with Jinan University, Jinan University, Zhuhai, 519000, China
| | - Zebin Gao
- Beijing XiaoBaiShiJi Network Technical Co., Ltd, Beijing, 100084, China
| | - Linduo Li
- College of Engineering, Northeastern University, 360 Huntington Ave., Boston, MA, 02115, USA
| | - Quanzheng Li
- Department of Radiology, Massachusetts General Hospital, White-427 55 Fruit St, Boston, MA, 02114, USA
| | - Fangxing Nie
- Beijing XiaoBaiShiJi Network Technical Co., Ltd, Beijing, 100084, China
| | - Guiguang Ding
- Institute for Brain and Cognitive Sciences, Tsinghua University, Beijing, 100084, China.,Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing, 100084, China.,School of Software, Tsinghua University, Beijing, 100084, China
| | - Gao Huang
- Beijing XiaoBaiShiJi Network Technical Co., Ltd, Beijing, 100084, China.,School of Software, Tsinghua University, Beijing, 100084, China
| | - Ailan Chen
- National Clinical Research Center for Respiratory Disease, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China.,Department of Cardiology, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China
| | - Yimin Li
- National Clinical Research Center for Respiratory Disease, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China.,Department of Intensive Care Unit, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China
| | - Weijie Guan
- National Clinical Research Center for Respiratory Disease, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China
| | - Ling Sang
- National Clinical Research Center for Respiratory Disease, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China.,Department of Intensive Care Unit, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China
| | - Yuanda Xu
- National Clinical Research Center for Respiratory Disease, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China.,Department of Intensive Care Unit, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China
| | - Huai Chen
- National Clinical Research Center for Respiratory Disease, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China.,Department of Radiology, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China
| | - Zisheng Chen
- National Clinical Research Center for Respiratory Disease, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China
| | - Shiyue Li
- National Clinical Research Center for Respiratory Disease, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China
| | - Nuofu Zhang
- National Clinical Research Center for Respiratory Disease, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China
| | - Ying Chen
- National Clinical Research Center for Respiratory Disease, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China
| | - Danxia Huang
- National Clinical Research Center for Respiratory Disease, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China
| | - Run Li
- National Clinical Research Center for Respiratory Disease, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China
| | - Jianfu Li
- National Clinical Research Center for Respiratory Disease, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China.,Department of Thoracic Surgery, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China
| | - Bo Cheng
- National Clinical Research Center for Respiratory Disease, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China.,Department of Thoracic Surgery, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China
| | - Yi Zhao
- National Clinical Research Center for Respiratory Disease, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China.,Department of Thoracic Surgery, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China
| | - Caichen Li
- National Clinical Research Center for Respiratory Disease, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China.,Department of Thoracic Surgery, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China
| | - Shan Xiong
- National Clinical Research Center for Respiratory Disease, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China.,Department of Thoracic Surgery, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China
| | - Runchen Wang
- National Clinical Research Center for Respiratory Disease, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China.,Department of Thoracic Surgery, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China
| | - Jun Liu
- National Clinical Research Center for Respiratory Disease, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China.,Department of Thoracic Surgery, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China
| | - Wei Wang
- National Clinical Research Center for Respiratory Disease, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China.,Department of Thoracic Surgery, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China
| | - Jun Huang
- National Clinical Research Center for Respiratory Disease, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China.,Department of Thoracic Surgery, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China
| | - Fei Cui
- National Clinical Research Center for Respiratory Disease, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China.,Department of Thoracic Surgery, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China
| | - Tao Xu
- Biomanufacturing Center Department of Mechanical Engineering, Tsinghua University, Beijing, 100084, China
| | | | - Meixiao Zhan
- Zhuhai Interventional Medical Center, Zhuhai Precision Medical Center, Zhuhai People's Hospital, Zhuhai Hospital Affiliated with Jinan University, Jinan University, Zhuhai, 519000, China
| | - Yuanyi Huang
- Department of Radiology, Jingzhou Central Hospital, The Second Clinical Medical College, Yangtze University, Jingzhou, Hubei, China
| | - Qiang Yang
- Hong Kong University of Science and Technology and weBank, Hong Kong, China
| | - Qionghai Dai
- Institute for Brain and Cognitive Sciences, Tsinghua University, Beijing, 100084, China. .,Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing, 100084, China.
| | - Wenhua Liang
- National Clinical Research Center for Respiratory Disease, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China. .,Department of Thoracic Surgery, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China.
| | - Jianxing He
- National Clinical Research Center for Respiratory Disease, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China. .,Department of Thoracic Surgery, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China. .,South China Medical University, Guangzhou, 510000, China.
| | - Nanshan Zhong
- National Clinical Research Center for Respiratory Disease, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China
| |
Collapse
|
182
|
Singh D, Kumar V, Kaur M, Kumari R. Early diagnosis of COVID-19 patients using deep learning-based deep forest model. J EXP THEOR ARTIF IN 2022. [DOI: 10.1080/0952813x.2021.2021300] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/30/2022]
Affiliation(s)
- Dilbag Singh
- School of Electrical Engineering and Computer Science, Gwangju Institute of Science and Technology, Gwangju, South Korea
| | - Vijay Kumar
- Department of Computer Science & Engineering National Institute of Technology Hamirpur, Hamirpur, India
| | - Manjit Kaur
- School of Electrical Engineering and Computer Science, Gwangju Institute of Science and Technology, Gwangju, South Korea
| | - Rajani Kumari
- Department of Computer Science, Christ (Deemed to Be University), Bangalore, India
| |
Collapse
|
183
|
Peng Y, Liu E, Peng S, Chen Q, Li D, Lian D. Using artificial intelligence technology to fight COVID-19: a review. Artif Intell Rev 2022; 55:4941-4977. [PMID: 35002010 PMCID: PMC8720541 DOI: 10.1007/s10462-021-10106-z] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 11/12/2021] [Indexed: 02/10/2023]
Abstract
In late December 2019, a new type of coronavirus was discovered, which was later named severe acute respiratory syndrome coronavirus 2(SARS-CoV-2). Since its discovery, the virus has spread globally, with 2,975,875 deaths as of 15 April 2021, and has had a huge impact on our health systems and economy. How to suppress the continued spread of new coronary pneumonia is the main task of many scientists and researchers. The introduction of artificial intelligence technology has provided a huge contribution to the suppression of the new coronavirus. This article discusses the main application of artificial intelligence technology in the suppression of coronavirus from three major aspects of identification, prediction, and development through a large amount of literature research, and puts forward the current main challenges and possible development directions. The results show that it is an effective measure to combine artificial intelligence technology with a variety of new technologies to predict and identify COVID-19 patients.
Collapse
Affiliation(s)
- Yong Peng
- Petroleum Engineering School, Southwest Petroleum University, Chengdu, 610500 China
| | - Enbin Liu
- Petroleum Engineering School, Southwest Petroleum University, Chengdu, 610500 China
| | - Shanbi Peng
- School of Civil Engineering and Geomatics, Southwest Petroleum University, Chengdu, 610500 China
| | - Qikun Chen
- School of Engineering, Cardiff University, Cardiff, CF24 3AA UK
| | - Dangjian Li
- Petroleum Engineering School, Southwest Petroleum University, Chengdu, 610500 China
| | - Dianpeng Lian
- Petroleum Engineering School, Southwest Petroleum University, Chengdu, 610500 China
| |
Collapse
|
184
|
Gour M, Jain S. Uncertainty-aware convolutional neural network for COVID-19 X-ray images classification. Comput Biol Med 2022; 140:105047. [PMID: 34847386 PMCID: PMC8609674 DOI: 10.1016/j.compbiomed.2021.105047] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2021] [Revised: 11/15/2021] [Accepted: 11/15/2021] [Indexed: 12/16/2022]
Abstract
Deep learning (DL) has shown great success in the field of medical image analysis. In the wake of the current pandemic situation of SARS-CoV-2, a few pioneering works based on DL have made significant progress in automated screening of COVID-19 disease from the chest X-ray (CXR) images. But these DL models have no inherent way of expressing uncertainty associated with the model's prediction, which is very important in medical image analysis. Therefore, in this paper, we develop an uncertainty-aware convolutional neural network model, named UA-ConvNet, for the automated detection of COVID-19 disease from CXR images, with an estimation of associated uncertainty in the model's predictions. The proposed approach utilizes the EfficientNet-B3 model and Monte Carlo (MC) dropout, where an EfficientNet-B3 model has been fine-tuned on the CXR images. During inference, MC dropout has been applied for M forward passes to obtain the posterior predictive distribution. After that mean and entropy have been calculated on the obtained predictive distribution to get the mean prediction and model uncertainty. The proposed method is evaluated on the three different datasets of chest X-ray images, namely the COVID19CXr, X-ray image, and Kaggle datasets. The proposed UA-ConvNet model achieves a G-mean of 98.02% (with a Confidence Interval (CI) of 97.99-98.07) and sensitivity of 98.15% for the multi-class classification task on the COVID19CXr dataset. For binary classification, the proposed model achieves a G-mean of 99.16% (with a CI of 98.81-99.19) and a sensitivity of 99.30% on the X-ray Image dataset. Our proposed approach shows its superiority over the existing methods for diagnosing the COVID-19 cases from the CXR images.
Collapse
Affiliation(s)
- Mahesh Gour
- Maulana Azad National Institute of Technology, Bhopal, MP, 462003, India.
| | - Sweta Jain
- Maulana Azad National Institute of Technology, Bhopal, MP, 462003, India
| |
Collapse
|
185
|
Saeedi S, Rezayi S, Ghazisaeedi M, Kalhori SN. Artificial intelligence approaches on X-ray-oriented images process for early detection of COVID-19. JOURNAL OF MEDICAL SIGNALS & SENSORS 2022; 12:233-253. [PMID: 36120399 PMCID: PMC9480507 DOI: 10.4103/jmss.jmss_111_21] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2021] [Revised: 10/28/2021] [Accepted: 01/03/2022] [Indexed: 12/04/2022]
Abstract
Background: COVID-19 is a global public health problem that is crucially important to be diagnosed in the early stages. This study aimed to investigate the use of artificial intelligence (AI) to process X-ray-oriented images to diagnose COVID-19 disease. Methods: A systematic search was conducted in Medline (through PubMed), Scopus, ISI Web of Science, Cochrane Library, and IEEE Xplore Digital Library to identify relevant studies published until 21 September 2020. Results: We identified 208 papers after duplicate removal and filtered them into 60 citations based on inclusion and exclusion criteria. Direct results sufficiently indicated a noticeable increase in the number of published papers in July-2020. The most widely used datasets were, respectively, GitHub repository, hospital-oriented datasets, and Kaggle repository. The Keras library, Tensorflow, and Python had been also widely employed in articles. X-ray images were applied more in the selected articles. The most considerable value of accuracy, sensitivity, specificity, and Area under the ROC Curve was reported for ResNet18 in reviewed techniques; all the mentioned indicators for this mentioned network were equal to one (100%). Conclusion: This review revealed that the application of AI can accelerate the process of diagnosing COVID-19, and these methods are effective for the identification of COVID-19 cases exploiting Chest X-ray images.
Collapse
|
186
|
Sanket S, Vergin Raja Sarobin M, Jani Anbarasi L, Thakor J, Singh U, Narayanan S. Detection of novel coronavirus from chest X-rays using deep convolutional neural networks. MULTIMEDIA TOOLS AND APPLICATIONS 2022; 81:22263-22288. [PMID: 34512112 PMCID: PMC8423603 DOI: 10.1007/s11042-021-11257-5] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/21/2020] [Revised: 06/06/2021] [Accepted: 07/08/2021] [Indexed: 05/11/2023]
Abstract
With over 172 Million people infected with the novel coronavirus (COVID-19) globally and with the numbers increasing exponentially, the dire need of a fast diagnostic system keeps on surging. With shortage of kits, and deadly underlying disease due to its vastly mutating and contagious properties, the tired physicians need a fast diagnostic method to cater the requirements of the soaring number of infected patients. Laboratory testing has turned out to be an arduous, cost-ineffective and requiring a well-equipped laboratory for analysis. This paper proposes a convolutional neural network (CNN) based model for analysis/detection of COVID-19, dubbed as CovCNN, which uses the patient's chest X-ray images for the diagnosis of COVID-19 with an aim to assist the medical practitioners to expedite the diagnostic process amongst high workload conditions. In the proposed CovCNN model, a novel deep-CNN based architecture has been incorporated with multiple folds of CNN. These models utilize depth wise convolution with varying dilation rates for efficiently extracting diversified features from chest X-rays. 657 chest X-rays of which 219 were X-ray images of patients infected from COVID-19 and the remaining were the images of non-COVID-19 (i.e. normal or COVID-19 negative) patients. Further, performance evaluation on the dataset using different pre-trained models has been analyzed based on the loss and accuracy curve. The experimental results show that the highest classification accuracy (98.4%) is achieved using the proposed CovCNN model.
Collapse
Affiliation(s)
- Shashwat Sanket
- School of Computer Science and Engineering, Vellore Institute of Technology, Chennai, India
| | - M. Vergin Raja Sarobin
- School of Computer Science and Engineering, Vellore Institute of Technology, Chennai, India
| | - L. Jani Anbarasi
- School of Computer Science and Engineering, Vellore Institute of Technology, Chennai, India
| | - Jayraj Thakor
- School of Computer Science and Engineering, Vellore Institute of Technology, Chennai, India
| | - Urmila Singh
- School of Computer Science and Engineering, Vellore Institute of Technology, Chennai, India
| | - Sathiya Narayanan
- School of Electronics Engineering, Vellore Institute of Technology, Chennai, India
| |
Collapse
|
187
|
Jawahar M, Prassanna J, Ravi V, Anbarasi LJ, Jasmine SG, Manikandan R, Sekaran R, Kannan S. Computer-aided diagnosis of COVID-19 from chest X-ray images using histogram-oriented gradient features and Random Forest classifier. MULTIMEDIA TOOLS AND APPLICATIONS 2022; 81:40451-40468. [PMID: 35572385 PMCID: PMC9090123 DOI: 10.1007/s11042-022-13183-6] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/05/2021] [Revised: 01/30/2022] [Accepted: 04/28/2022] [Indexed: 05/13/2023]
Abstract
The decision-making process is very crucial in healthcare, which includes quick diagnostic methods to monitor and prevent the COVID-19 pandemic disease from spreading. Computed tomography (CT) is a diagnostic tool used by radiologists to treat COVID patients. COVID x-ray images have inherent texture variations and similarity to other diseases like pneumonia. Manually diagnosing COVID X-ray images is a tedious and challenging process. Extracting the discriminant features and fine-tuning the classifiers using low-resolution images with a limited COVID x-ray dataset is a major challenge in computer aided diagnosis. The present work addresses this issue by proposing and implementing Histogram Oriented Gradient (HOG) features trained with an optimized Random Forest (RF) classifier. The proposed HOG feature extraction method is evaluated with Gray-Level Co-Occurrence Matrix (GLCM) and Hu moments. Results confirm that HOG is found to reflect the local description of edges effectively and provide excellent structural features to discriminate COVID and non-COVID when compared to the other feature extraction techniques. The performance of the RF is compared with other classifiers such as Linear Regression (LR), Linear Discriminant Analysis (LDA), K-nearest neighbor (kNN), Classification and Regression Trees (CART), Random Forest (RF), Support Vector Machine (SVM), and Multi-layer perceptron neural network (MLP). Experimental results show that the highest classification accuracy (99. 73%) is achieved using HOG trained by using the Random Forest (RF) classifier. The proposed work has provided promising results to assist radiologists/physicians in automatic COVID diagnosis using X-ray images.
Collapse
Affiliation(s)
- Malathy Jawahar
- Leather Process Technology Division, CSIR-Central Leather Research Institute, Adyar, Chennai, 600020 India
| | - J. Prassanna
- School of Computer Science and Engineering, Vellore Institute of Technology, 600 127 Chennai, India
| | - Vinayakumar Ravi
- Center for Artificial Intelligence, Prince Mohammad Bin Fahd University, Khobar, Saudi Arabia
| | - L. Jani Anbarasi
- School of Computer Science and Engineering, Vellore Institute of Technology, 600 127 Chennai, India
| | - S. Graceline Jasmine
- School of Computer Science and Engineering, Vellore Institute of Technology, 600 127 Chennai, India
| | - R. Manikandan
- School of Computing, SASTRA Deemed University, Thanjavur, India
| | - Ramesh Sekaran
- Department of Information Technology, Velgapudi Ramakrishna Siddhartha Engineering College, Vijayawada, India
| | - Suthendran Kannan
- Department of Information Technology, Kalasalingam Academy of Research and Education, Srivilliputhur, India
| |
Collapse
|
188
|
Kumar M, Shakya D, Kurup V, Suksatan W. COVID-19 prediction through X-ray images using transfer learning-based hybrid deep learning approach. MATERIALS TODAY: PROCEEDINGS 2022; 51:2520-2524. [PMID: 34926174 PMCID: PMC8666290 DOI: 10.1016/j.matpr.2021.12.123] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Over the past few months, the campaign against COVID-19 has developed into one of the world's most sought anti-toxin treatment scheme. It is fundamental to distinguish cases of COVID-19 precisely and quickly to help avoid this pandemic from taking a wrong turn with a proper medical reasoning and solution. While Reverse-Transcription Polymerase Chain Reaction (RT-PCR) has been useful in detection of corona virus, chest X-Ray techniques has proven to be more successful and beneficial at detection of the effects of virus. With the increase in COVID patients and the X-Rays done, it is currently possible to classify the X-Ray reports with transfer learning. This paper presents a novel approach, i.e., Hybrid Convolutional Neural Network (HDCNN), which integrates Convolutional Neural Network (CNN) and Recurrent Neural Network (RNN) architecture for the finding of COVID-19 using the chest X-Ray. The transfer learning approach, namely slope weighted activation class planning (Grad-CAMs), is used with HDCNN to display images responsible for taking decisions. In this study, HDCNN is compared with other CNNs such as Inception-v3, ShuffleNet, SqueezeNet, VGG-19 and DenseNet. As a result, HDCNN has achieved an accuracy of 98.20%, precision of 97.31%, recall of 97.1% and F1 score of 0.97. Compared to other current deep learning models, the HDCNN has achieved better results, and this can be used for diagnosis purpose after proper approvals.
Collapse
|
189
|
Abstract
In this chapter, we mainly focus on the use of AI-driven tools for COVID-19 predictive modeling, screening, and decision-making. We first discuss prediction models, their merits, and pitfalls. We then review deep learning models for COVID-19 detection and/or screening (with experiments) by taking different dataset sizes into account, which is followed by a conclusive study on how big data is big. The chapter provides a journey of deep neural networks for lung abnormality screening, where we consider COVID-19 as a particular case.
Collapse
|
190
|
Current Advances in Paper-Based Biosensor Technologies for Rapid COVID-19 Diagnosis. BIOCHIP JOURNAL 2022; 16:376-396. [PMID: 35968255 PMCID: PMC9363872 DOI: 10.1007/s13206-022-00078-9] [Citation(s) in RCA: 21] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/12/2022] [Revised: 07/06/2022] [Accepted: 07/22/2022] [Indexed: 12/29/2022]
Abstract
The global coronavirus disease 2019 (COVID-19) pandemic has had significant economic and social impacts on billions of people worldwide since severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) was first reported in Wuhan, China, in November 2019. Although polymerase chain reaction (PCR)-based technology serves as a robust test to detect SARS-CoV-2 in patients with COVID-19, there is a high demand for cost-effective, rapid, comfortable, and accurate point-of-care diagnostic tests in medical facilities. This review introduces the SARS-CoV-2 viral structure and diagnostic biomarkers derived from viral components. A comprehensive introduction of a paper-based diagnostic platform, including detection mechanisms for various target biomarkers and a COVID-19 commercial kit is presented. Intrinsic limitations related to the poor performance of currently developed paper-based devices and unresolved issues are discussed. Furthermore, we provide insight into novel paper-based diagnostic platforms integrated with advanced technologies such as nanotechnology, aptamers, surface-enhanced Raman spectroscopy (SERS), and clustered regularly interspaced short palindromic repeats (CRISPR)-Cas. Finally, we discuss the prospects for the development of highly sensitive, accurate, cost-effective, and easy-to-use point-of-care COVID-19 diagnostic methods.
Collapse
|
191
|
Haq IU, Du X, Jan H. Implementation of smart social distancing for COVID-19 based on deep learning algorithm. MULTIMEDIA TOOLS AND APPLICATIONS 2022; 81:33569-33589. [PMID: 35463218 PMCID: PMC9019287 DOI: 10.1007/s11042-022-13154-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/02/2021] [Revised: 12/22/2021] [Accepted: 04/10/2022] [Indexed: 05/12/2023]
Abstract
The first step to reducing the effect of viral disease is to prevent the spread which could be achieved by implementing social distancing (reducing the number of close physical interactions between peoples). Almost every viral disease whose means of communication is air, and enters through mouth or nose, definitely will affect our vocal organs which cause changes in features of our voice and could be traceable using feature analysis of voice using deep learning. The detection of an affected person using deep neural networks and tracking him would help us in the implementation of the social distancing rule in an area where it is needed. The aim of this paper is to study different solutions which help in enabling, encouraging, and even enforcing social distancing. In this paper, we implemented and analyzed scenarios on the basis of COVID-19 patient detection using cough and tracking him using smart cameras, or emerging wireless technologies with deep learning techniques for prediction and preventing the spread of disease. Thus these techniques are easy to be implemented in the initial stage of any pandemic as well and will help us in the implementation of smart social distancing (apply whenever needed).
Collapse
Affiliation(s)
- Izaz Ul Haq
- College of Electrical and Information Engineering, Lanzhou University of Technology, Lanzhou, 730050 China
| | - Xianjun Du
- College of Electrical and Information Engineering, Lanzhou University of Technology, Lanzhou, 730050 China
| | - Haseeb Jan
- University of Engineering and Technology, Peshawar, Pakistan
| |
Collapse
|
192
|
Hossain MB, Iqbal SMHS, Islam MM, Akhtar MN, Sarker IH. Transfer learning with fine-tuned deep CNN ResNet50 model for classifying COVID-19 from chest X-ray images. INFORMATICS IN MEDICINE UNLOCKED 2022; 30:100916. [PMID: 35342787 PMCID: PMC8933872 DOI: 10.1016/j.imu.2022.100916] [Citation(s) in RCA: 20] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2022] [Revised: 03/07/2022] [Accepted: 03/09/2022] [Indexed: 12/13/2022] Open
Abstract
COVID-19 cases are putting pressure on healthcare systems all around the world. Due to the lack of available testing kits, it is impractical for screening every patient with a respiratory ailment using traditional methods (RT-PCR). In addition, the tests have a high turn-around time and low sensitivity. Detecting suspected COVID-19 infections from the chest X-ray might help isolate high-risk people before the RT-PCR test. Most healthcare systems already have X-ray equipment, and because most current X-ray systems have already been computerized, there is no need to transfer the samples. The use of a chest X-ray to prioritize the selection of patients for subsequent RT-PCR testing is the motivation of this work. Transfer learning (TL) with fine-tuning on deep convolutional neural network-based ResNet50 model has been proposed in this work to classify COVID-19 patients from the COVID-19 Radiography Database. Ten distinct pre-trained weights, trained on varieties of large-scale datasets using various approaches such as supervised learning, self-supervised learning, and others, have been utilized in this work. Our proposed i N a t 2021 _ M i n i _ S w A V _ 1 k model, pre-trained on the iNat2021 Mini dataset using the SwAV algorithm, outperforms the other ResNet50 TL models. For COVID instances in the two-class (Covid and Normal) classification, our work achieved 99.17% validation accuracy, 99.95% train accuracy, 99.31% precision, 99.03% sensitivity, and 99.17% F1-score. Some domain-adapted ( I m a g e N e t _ C h e s t X - r a y 14 ) and in-domain (ChexPert, ChestX-ray14) models looked promising in medical image classification by scoring significantly higher than other models.
Collapse
Affiliation(s)
- Md Belal Hossain
- Department of Computer Science and Engineering, Pabna University of Science and Technology, Pabna 6600, Bangladesh
| | - S M Hasan Sazzad Iqbal
- Department of Computer Science and Engineering, Pabna University of Science and Technology, Pabna 6600, Bangladesh
| | - Md Monirul Islam
- Department of Textile Engineering, Uttara University, Dhaka 1230, Bangladesh
| | - Md Nasim Akhtar
- Department of Computer Science and Engineering, Dhaka University of Engineering Technology, Gazipur, 1707, Bangladesh
| | - Iqbal H Sarker
- Department of Computer Science and Engineering, Chittagong University of Engineering & Technology, Chittagong 4349, Bangladesh
| |
Collapse
|
193
|
Zokaeinikoo M, Kazemian P, Mitra P, Kumara S. AIDCOV: An Interpretable Artificial Intelligence Model for Detection of COVID-19 from Chest Radiography Images. ACM TRANSACTIONS ON MANAGEMENT INFORMATION SYSTEMS 2021. [DOI: 10.1145/3466690] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/10/2023]
Abstract
As the
Coronavirus Disease 2019 (COVID-19)
pandemic continues to grow globally, testing to detect COVID-19 and isolating individuals who test positive remains the primary strategy for preventing community spread of the disease. Therefore, automatic and accurate detection of COVID-19 using medical imaging modalities, which are more widely available and accessible, can be beneficial as an alternative diagnostic tool. In this study, an
Artificial Intelligence model for Detection of COVID-19 (AIDCOV)
is developed to classify chest radiography images as belonging to a person with either COVID-19, other infections, or no pneumonia (i.e., normal). The hierarchical structure in AIDCOV captures the dependencies among features and improves model performance while an attention mechanism makes the model interpretable and transparent. We used several publicly available datasets of both
computed tomography (CT)
and X-ray modalities. The main public dataset for chest X-ray images contains 475 COVID-19 samples, 3949 samples from other viral/bacterial infections, and 1583 normal samples. Our model achieves a mean cross-validation accuracy of 98.4%. AIDCOV has a sensitivity of 99.8%, a specificity of 100%, and an F1-score of 99.8% in detecting COVID-19 from X-ray images on that dataset. Using a large dataset of CT images, our model obtained mean cross-validation accuracy and sensitivity of 98.8% and 99.4%, respectively. Additionally, our interpretable model can distinguish subtle signs of infection within each radiography image. Assuming these results hold up in larger datasets obtained from a variety of patients over the world, AIDCOV can be used in conjunction with or instead of RT-PCR testing (where RT-PCR testing is unavailable) to detect and isolate individuals with COVID-19, prevent onward transmission to the general population and healthcare workers, and highlight the areas in the lungs that show signs of COVID-related damage.
Collapse
Affiliation(s)
- Maryam Zokaeinikoo
- Department of Supply Chain & Information Systems, Smeal College of Business, The Pennsylvania State University, State College, University Park, PA
| | - Pooyan Kazemian
- Department of Operations, Weatherhead School of Management, Case Western Reserve University, Cleveland, OH
| | - Prasenjit Mitra
- College of Information Sciences and Technology, The Pennsylvania State University, State College, University Park, PA
| | - Soundar Kumara
- Department of Industrial and Manufacturing Engineering, The Pennsylvania State University, State College, University Park, PA
| |
Collapse
|
194
|
Balaha HM, El-Gendy EM, Saafan MM. CovH2SD: A COVID-19 detection approach based on Harris Hawks Optimization and stacked deep learning. EXPERT SYSTEMS WITH APPLICATIONS 2021; 186:115805. [PMID: 34511738 PMCID: PMC8418701 DOI: 10.1016/j.eswa.2021.115805] [Citation(s) in RCA: 26] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/26/2021] [Revised: 08/13/2021] [Accepted: 08/23/2021] [Indexed: 05/14/2023]
Abstract
Starting from Wuhan in China at the end of 2019, coronavirus disease (COVID-19) has propagated fast all over the world, affecting the lives of billions of people and increasing the mortality rate worldwide in few months. The golden treatment against the invasive spread of COVID-19 is done by identifying and isolating the infected patients, and as a result, fast diagnosis of COVID-19 is a critical issue. The common laboratory test for confirming the infection of COVID-19 is Reverse Transcription Polymerase Chain Reaction (RT-PCR). However, these tests suffer from some problems in time, accuracy, and availability. Chest images have proven to be a powerful tool in the early detection of COVID-19. In the current study, a hybrid learning and optimization approach named CovH2SD is proposed for the COVID-19 detection from the Chest Computed Tomography (CT) images. CovH2SD uses deep learning and pre-trained models to extract the features from the CT images and learn from them. It uses Harris Hawks Optimization (HHO) algorithm to optimize the hyperparameters. Transfer learning is applied using nine pre-trained convolutional neural networks (i.e. ResNet50, ResNet101, VGG16, VGG19, Xception, MobileNetV1, MobileNetV2, DenseNet121, and DenseNet169). Fast Classification Stage (FCS) and Compact Stacking Stage (CSS) are suggested to stack the best models into a single one. Nine experiments are applied and results are reported based on the Loss, Accuracy, Precision, Recall, F1-Score, and Area Under Curve (AUC) performance metrics. The comparison between combinations is applied using the Weighted Sum Method (WSM). Six experiments report a WSM value above 96.5%. The top WSM and accuracy reported values are 99.31% and 99.33% respectively which are higher than the eleven compared state-of-the-art studies.
Collapse
Affiliation(s)
- Hossam Magdy Balaha
- Computers Engineering and Systems Department, Faculty of Engineering, Mansoura University, Egypt
| | - Eman M El-Gendy
- Computers Engineering and Systems Department, Faculty of Engineering, Mansoura University, Egypt
| | - Mahmoud M Saafan
- Computers Engineering and Systems Department, Faculty of Engineering, Mansoura University, Egypt
| |
Collapse
|
195
|
Mondal AK, Bhattacharjee A, Singla P, Prathosh AP. xViTCOS: Explainable Vision Transformer Based COVID-19 Screening Using Radiography. IEEE JOURNAL OF TRANSLATIONAL ENGINEERING IN HEALTH AND MEDICINE 2021; 10:1100110. [PMID: 34956741 PMCID: PMC8691725 DOI: 10.1109/jtehm.2021.3134096] [Citation(s) in RCA: 39] [Impact Index Per Article: 9.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/26/2021] [Revised: 11/18/2021] [Accepted: 12/06/2021] [Indexed: 12/15/2022]
Abstract
Objective: Since its outbreak, the rapid spread of COrona VIrus Disease 2019 (COVID-19) across the globe has pushed the health care system in many countries to the verge of collapse. Therefore, it is imperative to correctly identify COVID-19 positive patients and isolate them as soon as possible to contain the spread of the disease and reduce the ongoing burden on the healthcare system. The primary COVID-19 screening test, RT-PCR although accurate and reliable, has a long turn-around time. In the recent past, several researchers have demonstrated the use of Deep Learning (DL) methods on chest radiography (such as X-ray and CT) for COVID-19 detection. However, existing CNN based DL methods fail to capture the global context due to their inherent image-specific inductive bias. Methods: Motivated by this, in this work, we propose the use of vision transformers (instead of convolutional networks) for COVID-19 screening using the X-ray and CT images. We employ a multi-stage transfer learning technique to address the issue of data scarcity. Furthermore, we show that the features learned by our transformer networks are explainable. Results: We demonstrate that our method not only quantitatively outperforms the recent benchmarks but also focuses on meaningful regions in the images for detection (as confirmed by Radiologists), aiding not only in accurate diagnosis of COVID-19 but also in localization of the infected area. The code for our implementation can be found here - https://github.com/arnabkmondal/xViTCOS. Conclusion: The proposed method will help in timely identification of COVID-19 and efficient utilization of limited resources.
Collapse
Affiliation(s)
- Arnab Kumar Mondal
- Amar Nath and Shashi Khosla School of Information TechnologyIndian Institute of Technology Delhi New Delhi 110016 India.,Department of Electrical Communication EngineeringIndian Institute of Science (IISc) Bangalore 560 India
| | - Arnab Bhattacharjee
- UQ-IITD Academy of ResearchIndian Institute of Technology Delhi New Delhi 110016 India
| | - Parag Singla
- Department of Computer Science and EngineeringIndian Institute of Technology Delhi New Delhi 110016 India
| | - A P Prathosh
- Department of Electrical Communication EngineeringIndian Institute of Science (IISc) Bangalore 560 India
| |
Collapse
|
196
|
Sabanci K, Aslan MF, Ropelewska E, Unlersen MF. A convolutional neural network
‐based
comparative study for pepper seed classification: Analysis of selected deep features with
support vector machine. J FOOD PROCESS ENG 2021. [DOI: 10.1111/jfpe.13955] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
Affiliation(s)
- Kadir Sabanci
- Department of Electrical‐Electronic Engineering Karamanoglu Mehmetbey University Karaman Turkey
| | - Muhammet Fatih Aslan
- Department of Electrical‐Electronic Engineering Karamanoglu Mehmetbey University Karaman Turkey
| | - Ewa Ropelewska
- Fruit and Vegetable Storage and Processing Department The National Institute of Horticultural Research Skierniewice Poland
| | - Muhammed Fahri Unlersen
- Department of Electrical and Electronics Engineering Necmettin Erbakan University Konya Turkey
| |
Collapse
|
197
|
Ai Z, Huang X, Fan Y, Feng J, Zeng F, Lu Y. DR-IIXRN : Detection Algorithm of Diabetic Retinopathy Based on Deep Ensemble Learning and Attention Mechanism. Front Neuroinform 2021; 15:778552. [PMID: 35002666 PMCID: PMC8740273 DOI: 10.3389/fninf.2021.778552] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2021] [Accepted: 11/16/2021] [Indexed: 11/30/2022] Open
Abstract
Diabetic retinopathy (DR) is one of the common chronic complications of diabetes and the most common blinding eye disease. If not treated in time, it might lead to visual impairment and even blindness in severe cases. Therefore, this article proposes an algorithm for detecting diabetic retinopathy based on deep ensemble learning and attention mechanism. First, image samples were preprocessed and enhanced to obtain high quality image data. Second, in order to improve the adaptability and accuracy of the detection algorithm, we constructed a holistic detection model DR-IIXRN, which consists of Inception V3, InceptionResNet V2, Xception, ResNeXt101, and NASNetLarge. For each base classifier, we modified the network model using transfer learning, fine-tuning, and attention mechanisms to improve its ability to detect DR. Finally, a weighted voting algorithm was used to determine which category (normal, mild, moderate, severe, or proliferative DR) the images belonged to. We also tuned the trained network model on the hospital data, and the real test samples in the hospital also confirmed the advantages of the algorithm in the detection of the diabetic retina. Experiments show that compared with the traditional single network model detection algorithm, the auc, accuracy, and recall rate of the proposed method are improved to 95, 92, and 92%, respectively, which proves the adaptability and correctness of the proposed method.
Collapse
Affiliation(s)
- Zhuang Ai
- Department of Research and Development, Sinopharm Genomics Technology Co., Ltd., Jiangsu, China
| | - Xuan Huang
- Department of Ophthalmology, Beijing Chao-Yang Hospital, Capital Medical University, Beijing, China
- Medical Research Center, Beijing Chao-Yang Hospital, Capital Medical University, Beijing, China
| | - Yuan Fan
- Department of Research and Development, Sinopharm Genomics Technology Co., Ltd., Jiangsu, China
| | - Jing Feng
- Department of Ophthalmology, Beijing Chao-Yang Hospital, Capital Medical University, Beijing, China
| | - Fanxin Zeng
- Department of Clinical Research Center, Dazhou Central Hospital, Sichuan, China
| | - Yaping Lu
- Department of Research and Development, Sinopharm Genomics Technology Co., Ltd., Jiangsu, China
| |
Collapse
|
198
|
Al-Hindawi A, Abdulaal A, Rawson TM, Alqahtani SA, Mughal N, Moore LSP. COVID-19 Prognostic Models: A Pro-con Debate for Machine Learning vs. Traditional Statistics. Front Digit Health 2021; 3:637944. [PMID: 35005694 PMCID: PMC8734592 DOI: 10.3389/fdgth.2021.637944] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2020] [Accepted: 11/15/2021] [Indexed: 01/08/2023] Open
Abstract
The SARS-CoV-2 virus, which causes the COVID-19 pandemic, has had an unprecedented impact on healthcare requiring multidisciplinary innovation and novel thinking to minimize impact and improve outcomes. Wide-ranging disciplines have collaborated including diverse clinicians (radiology, microbiology, and critical care), who are working increasingly closely with data-science. This has been leveraged through the democratization of data-science with the increasing availability of easy to access open datasets, tutorials, programming languages, and hardware which makes it significantly easier to create mathematical models. To address the COVID-19 pandemic, such data-science has enabled modeling of the impact of the virus on the population and individuals for diagnostic, prognostic, and epidemiological ends. This has led to two large systematic reviews on this topic that have highlighted the two different ways in which this feat has been attempted: one using classical statistics and the other using more novel machine learning techniques. In this review, we debate the relative strengths and weaknesses of each method toward the specific task of predicting COVID-19 outcomes.
Collapse
Affiliation(s)
- Ahmed Al-Hindawi
- Chelsea and Westminster NHS Foundation Trust, London, United Kingdom
| | - Ahmed Abdulaal
- Faculty of Medicine, Imperial College London, London, United Kingdom
| | - Timothy M. Rawson
- Health Protection Research Unit for Healthcare Associated Infections and Antimicrobial Resistance, Imperial College London, London, United Kingdom
- Centre for Antimicrobial Optimisation, Imperial College London, London, United Kingdom
| | - Saleh A. Alqahtani
- King Faisal Specialist Hospital and Research Centre, Riyadh, Saudi Arabia
- Johns Hopkins University, Baltimore, MD, United States
| | - Nabeela Mughal
- Chelsea and Westminster NHS Foundation Trust, London, United Kingdom
- Faculty of Medicine, Imperial College London, London, United Kingdom
- North West London Pathology, Imperial College Healthcare NHS Trust, London, United Kingdom
| | - Luke S. P. Moore
- Chelsea and Westminster NHS Foundation Trust, London, United Kingdom
- Faculty of Medicine, Imperial College London, London, United Kingdom
- North West London Pathology, Imperial College Healthcare NHS Trust, London, United Kingdom
| |
Collapse
|
199
|
Djafri L. Dynamic Distributed and Parallel Machine Learning algorithms for big data mining processing. DATA TECHNOLOGIES AND APPLICATIONS 2021. [DOI: 10.1108/dta-06-2021-0153] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/09/2023]
Abstract
PurposeThis work can be used as a building block in other settings such as GPU, Map-Reduce, Spark or any other. Also, DDPML can be deployed on other distributed systems such as P2P networks, clusters, clouds computing or other technologies.Design/methodology/approachIn the age of Big Data, all companies want to benefit from large amounts of data. These data can help them understand their internal and external environment and anticipate associated phenomena, as the data turn into knowledge that can be used for prediction later. Thus, this knowledge becomes a great asset in companies' hands. This is precisely the objective of data mining. But with the production of a large amount of data and knowledge at a faster pace, the authors are now talking about Big Data mining. For this reason, the authors’ proposed works mainly aim at solving the problem of volume, veracity, validity and velocity when classifying Big Data using distributed and parallel processing techniques. So, the problem that the authors are raising in this work is how the authors can make machine learning algorithms work in a distributed and parallel way at the same time without losing the accuracy of classification results. To solve this problem, the authors propose a system called Dynamic Distributed and Parallel Machine Learning (DDPML) algorithms. To build it, the authors divided their work into two parts. In the first, the authors propose a distributed architecture that is controlled by Map-Reduce algorithm which in turn depends on random sampling technique. So, the distributed architecture that the authors designed is specially directed to handle big data processing that operates in a coherent and efficient manner with the sampling strategy proposed in this work. This architecture also helps the authors to actually verify the classification results obtained using the representative learning base (RLB). In the second part, the authors have extracted the representative learning base by sampling at two levels using the stratified random sampling method. This sampling method is also applied to extract the shared learning base (SLB) and the partial learning base for the first level (PLBL1) and the partial learning base for the second level (PLBL2). The experimental results show the efficiency of our solution that the authors provided without significant loss of the classification results. Thus, in practical terms, the system DDPML is generally dedicated to big data mining processing, and works effectively in distributed systems with a simple structure, such as client-server networks.FindingsThe authors got very satisfactory classification results.Originality/valueDDPML system is specially designed to smoothly handle big data mining classification.
Collapse
|
200
|
Gour M, Jain S. Automated COVID-19 detection from X-ray and CT images with stacked ensemble convolutional neural network. Biocybern Biomed Eng 2021; 42:27-41. [PMID: 34908638 PMCID: PMC8654581 DOI: 10.1016/j.bbe.2021.12.001] [Citation(s) in RCA: 18] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2021] [Revised: 12/02/2021] [Accepted: 12/02/2021] [Indexed: 12/21/2022]
Abstract
Automatic and rapid screening of COVID-19 from the radiological (X-ray or CT scan) images has become an urgent need in the current pandemic situation of SARS-CoV-2 worldwide. However, accurate and reliable screening of patients is challenging due to the discrepancy between the radiological images of COVID-19 and other viral pneumonia. So, in this paper, we design a new stacked convolutional neural network model for the automatic diagnosis of COVID-19 disease from the chest X-ray and CT images. In the proposed approach, different sub-models have been obtained from the VGG19 and the Xception models during the training. Thereafter, obtained sub-models are stacked together using softmax classifier. The proposed stacked CNN model combines the discriminating power of the different CNN’s sub-models and detects COVID-19 from the radiological images. In addition, we collect CT images to build a CT image dataset and also generate an X-ray images dataset by combining X-ray images from the three publicly available data repositories. The proposed stacked CNN model achieves a sensitivity of 97.62% for the multi-class classification of X-ray images into COVID-19, Normal and Pneumonia Classes and 98.31% sensitivity for binary classification of CT images into COVID-19 and no-Finding classes. Our proposed approach shows superiority over the existing methods for the detection of the COVID-19 cases from the X-ray radiological images.
Collapse
Affiliation(s)
- Mahesh Gour
- Maulana Azad National Institute of Technology, Bhopal, India
| | - Sweta Jain
- Maulana Azad National Institute of Technology, Bhopal, India
| |
Collapse
|