101
|
Aggarwal P, Mishra NK, Fatimah B, Singh P, Gupta A, Joshi SD. COVID-19 image classification using deep learning: Advances, challenges and opportunities. Comput Biol Med 2022; 144:105350. [PMID: 35305501 PMCID: PMC8890789 DOI: 10.1016/j.compbiomed.2022.105350] [Citation(s) in RCA: 32] [Impact Index Per Article: 10.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2021] [Revised: 02/10/2022] [Accepted: 02/22/2022] [Indexed: 12/16/2022]
Abstract
Corona Virus Disease-2019 (COVID-19), caused by Severe Acute Respiratory Syndrome-Corona Virus-2 (SARS-CoV-2), is a highly contagious disease that has affected the lives of millions around the world. Chest X-Ray (CXR) and Computed Tomography (CT) imaging modalities are widely used to obtain a fast and accurate diagnosis of COVID-19. However, manual identification of the infection through radio images is extremely challenging because it is time-consuming and highly prone to human errors. Artificial Intelligence (AI)-techniques have shown potential and are being exploited further in the development of automated and accurate solutions for COVID-19 detection. Among AI methodologies, Deep Learning (DL) algorithms, particularly Convolutional Neural Networks (CNN), have gained significant popularity for the classification of COVID-19. This paper summarizes and reviews a number of significant research publications on the DL-based classification of COVID-19 through CXR and CT images. We also present an outline of the current state-of-the-art advances and a critical discussion of open challenges. We conclude our study by enumerating some future directions of research in COVID-19 imaging classification.
Collapse
Affiliation(s)
| | | | - Binish Fatimah
- The Department of ECE, CMR Institute of Technology, Bengaluru, India.
| | - Pushpendra Singh
- The Department of ECE, National Institute of Technology Hamirpur, HP, India.
| | - Anubha Gupta
- The Department of ECE, IIIT-Delhi, Delhi, 110020, India.
| | - Shiv Dutt Joshi
- The Department of EE, Indian Institute of Technology Delhi, Delhi 110016, India.
| |
Collapse
|
102
|
Hassan H, Ren Z, Zhou C, Khan MA, Pan Y, Zhao J, Huang B. Supervised and weakly supervised deep learning models for COVID-19 CT diagnosis: A systematic review. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2022; 218:106731. [PMID: 35286874 PMCID: PMC8897838 DOI: 10.1016/j.cmpb.2022.106731] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/01/2021] [Revised: 01/28/2022] [Accepted: 03/03/2022] [Indexed: 05/05/2023]
Abstract
Artificial intelligence (AI) and computer vision (CV) methods become reliable to extract features from radiological images, aiding COVID-19 diagnosis ahead of the pathogenic tests and saving critical time for disease management and control. Thus, this review article focuses on cascading numerous deep learning-based COVID-19 computerized tomography (CT) imaging diagnosis research, providing a baseline for future research. Compared to previous review articles on the topic, this study pigeon-holes the collected literature very differently (i.e., its multi-level arrangement). For this purpose, 71 relevant studies were found using a variety of trustworthy databases and search engines, including Google Scholar, IEEE Xplore, Web of Science, PubMed, Science Direct, and Scopus. We classify the selected literature in multi-level machine learning groups, such as supervised and weakly supervised learning. Our review article reveals that weak supervision has been adopted extensively for COVID-19 CT diagnosis compared to supervised learning. Weakly supervised (conventional transfer learning) techniques can be utilized effectively for real-time clinical practices by reusing the sophisticated features rather than over-parameterizing the standard models. Few-shot and self-supervised learning are the recent trends to address data scarcity and model efficacy. The deep learning (artificial intelligence) based models are mainly utilized for disease management and control. Therefore, it is more appropriate for readers to comprehend the related perceptive of deep learning approaches for the in-progress COVID-19 CT diagnosis research.
Collapse
Affiliation(s)
- Haseeb Hassan
- College of Big data and Internet, Shenzhen Technology University, Shenzhen, 518118, China; Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging, School of Biomedical Engineering, Shenzhen University Health Science Center, Shenzhen, China; College of Applied Sciences, Shenzhen University, Shenzhen, 518060, China
| | - Zhaoyu Ren
- College of Big data and Internet, Shenzhen Technology University, Shenzhen, 518118, China
| | - Chengmin Zhou
- College of Big data and Internet, Shenzhen Technology University, Shenzhen, 518118, China
| | - Muazzam A Khan
- Department of Computer Sciences, Quaid-i-Azam University, Islamabad, Pakistan
| | - Yi Pan
- Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, China
| | - Jian Zhao
- College of Big data and Internet, Shenzhen Technology University, Shenzhen, 518118, China.
| | - Bingding Huang
- College of Big data and Internet, Shenzhen Technology University, Shenzhen, 518118, China.
| |
Collapse
|
103
|
Munera N, Garcia-Gallo E, Gonzalez Á, Zea J, Fuentes YV, Serrano C, Ruiz-Cuartas A, Rodriguez A, Reyes LF. A novel model to predict severe COVID-19 and mortality using an artificial intelligence algorithm to interpret chest X-Rays and clinical variables. ERJ Open Res 2022; 8:00010-2022. [PMID: 35765299 PMCID: PMC9059131 DOI: 10.1183/23120541.00010-2022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/07/2022] [Accepted: 04/19/2022] [Indexed: 11/25/2022] Open
Abstract
Background Patients with coronavirus disease 2019 (COVID-19) could develop severe disease requiring admission to the intensive care unit (ICU). This article presents a novel method that predicts whether a patient will need admission to the ICU and assesses the risk of in-hospital mortality by training a deep-learning model that combines a set of clinical variables and features in chest radiographs. Methods This was a prospective diagnostic test study. Patients with confirmed severe acute respiratory syndrome coronavirus 2 infection between March 2020 and January 2021 were included. This study was designed to build predictive models obtained by training convolutional neural networks for chest radiograph images using an artificial intelligence (AI) tool and a random forest analysis to identify critical clinical variables. Then, both architectures were connected and fine-tuned to provide combined models. Results 2552 patients were included in the clinical cohort. The variables independently associated with ICU admission were age, fraction of inspired oxygen (FiO2) on admission, dyspnoea on admission and obesity. Moreover, the variables associated with hospital mortality were age, FiO2 on admission and dyspnoea. When implementing the AI model to interpret the chest radiographs and the clinical variables identified by random forest, we developed a model that accurately predicts ICU admission (area under the curve (AUC) 0.92±0.04) and hospital mortality (AUC 0.81±0.06) in patients with confirmed COVID-19. Conclusions This automated chest radiograph interpretation algorithm, along with clinical variables, is a reliable alternative to identify patients at risk of developing severe COVID-19 who might require admission to the ICU. In patients with #COVID19, an automated chest radiograph interpretation algorithm, along with clinical variables, is a reliable alternative to identify patients at risk of developing severe COVID-19, who might require admission to the intensive care unithttps://bit.ly/3Kf61TK
Collapse
|
104
|
Leveraging deep learning for COVID-19 diagnosis through chest imaging. Neural Comput Appl 2022; 34:14003-14012. [PMID: 35462631 PMCID: PMC9017721 DOI: 10.1007/s00521-022-07250-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/06/2021] [Accepted: 03/29/2022] [Indexed: 11/30/2022]
Abstract
COVID-19 has taken a toll on the entire world, rendering serious illness and high mortality rate. In the present day, when the globe is hit by a pandemic, those suspected to be infected by the virus need to confirm its presence to seek immediate medical attention to avoid adverse outcomes and also to prevent further transmission of the virus in their close contacts by ensuring timely isolation. The most reliable laboratory testing currently available is the reverse transcription–polymerase chain reaction (RT-PCR) test. Although the test is considered gold standard, 20–25% of results can still be false negatives, which has lately led physicians to recommend medical imaging in specific cases. Our research examines the aspect of chest imaging as a method to diagnose COVID-19. This work is not directed to establish an alternative to RT-PCR, but to aid physicians in determining the presence of virus in medical images. As the disease presents lung involvement, it provides a basis to explore computer vision for classification in radiographic images. In this paper, authors compare the performance of various models, namely ResNet-50, EfficientNetB0, VGG-16 and a custom convolutional neural network (CNN) for detecting the presence of virus in chest computed tomography (CT) scan and chest X-ray images. The most promising results have been derived by using ResNet-50 on CT scans with an accuracy of 98.9% and ResNet-50 on X-rays with an accuracy of 98.7%, which offer an opportunity to further explore these methods for prospective use.
Collapse
|
105
|
Pan L, Ji B, Wang H, Wang L, Liu M, Chongcheawchamnan M, Peng S. MFDNN: multi-channel feature deep neural network algorithm to identify COVID19 chest X-ray images. Health Inf Sci Syst 2022; 10:4. [PMID: 35432950 PMCID: PMC9004212 DOI: 10.1007/s13755-022-00174-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2022] [Accepted: 04/04/2022] [Indexed: 11/23/2022] Open
Abstract
The use of chest X-ray images (CXI) to detect Severe Acute Respiratory Syndrome Coronavirus 2 (SARS CoV-2) caused by Coronavirus Disease 2019 (COVID19) is life-saving important for both patients and doctors. This research proposes a multi-channel feature deep neural network (MFDNN) algorithm to screen people infected with COVID19. The algorithm integrates data over-sampling technology and MFDNN model to carry out the training. The oversampling technique reduces the deviation of the prior probability of the MFDNN algorithm on unbalanced data. Multi-channel feature fusion technology improves the efficiency of feature extraction and the accuracy of model diagnosis. In the experiment, Compared with traditional deep learning models (VGG19, GoogLeNet, Resnet50, Desnet201), the MFDNN model obtains an average test accuracy of 93.19% in all data. Furthermore, in each type of screening, the precision, recall, and F1 Score of the MFDNN model are also better than traditional deep learning networks. Furthermore, through ablation experiments, we proved that a multi-channel convolutional neural network (CNN) is superior to single-channel CNN, additional layer and PSN module, and indirectly proved the sufficiency and necessity of each step of the MFDNN classification method. Finally, our experimental code will be placed at https://github.com/panliangrui/covid19.
Collapse
|
106
|
Let AI Perform Better Next Time—A Systematic Review of Medical Imaging-Based Automated Diagnosis of COVID-19: 2020–2022. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12083895] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
Abstract
The pandemic of COVID-19 has caused millions of infections, which has led to a great loss all over the world, socially and economically. Due to the false-negative rate and the time-consuming characteristic of the Reverse Transcription Polymerase Chain Reaction (RT-PCR) tests, diagnosing based on X-ray images and Computed Tomography (CT) images has been widely adopted to confirm positive COVID-19 RT-PCR tests. Since the very beginning of the pandemic, researchers in the artificial intelligence area have proposed a large number of automatic diagnosing models, hoping to assist radiologists and improve the diagnosing accuracy. However, after two years of development, there are still few models that can actually be applied in real-world scenarios. Numerous problems have emerged in the research of the automated diagnosis of COVID-19. In this paper, we present a systematic review of these diagnosing models. A total of 179 proposed models are involved. First, we compare the medical image modalities (CT or X-ray) for COVID-19 diagnosis from both the clinical perspective and the artificial intelligence perspective. Then, we classify existing methods into two types—image-level diagnosis (i.e., classification-based methods) and pixel-level diagnosis (i.e., segmentation-based models). For both types of methods, we define universal model pipelines and analyze the techniques that have been applied in each step of the pipeline in detail. In addition, we also review some commonly adopted public COVID-19 datasets. More importantly, we present an in-depth discussion of the existing automated diagnosis models and note a total of three significant problems: biased model performance evaluation; inappropriate implementation details; and a low reproducibility, reliability and explainability. For each point, we give corresponding recommendations on how we can avoid making the same mistakes and let AI perform better in the next pandemic.
Collapse
|
107
|
Chamberlin JH, Aquino G, Schoepf UJ, Nance S, Godoy F, Carson L, Giovagnoli VM, Gill CE, McGill LJ, O'Doherty J, Emrich T, Burt JR, Baruah D, Varga-Szemes A, Kabakus IM. An Interpretable Chest CT Deep Learning Algorithm for Quantification of COVID-19 Lung Disease and Prediction of Inpatient Morbidity and Mortality. Acad Radiol 2022; 29:1178-1188. [PMID: 35610114 PMCID: PMC8977389 DOI: 10.1016/j.acra.2022.03.023] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/29/2021] [Revised: 03/17/2022] [Accepted: 03/24/2022] [Indexed: 12/23/2022]
Abstract
Rationale and Objectives The burden of coronavirus disease 2019 (COVID-19) airspace opacities is time consuming and challenging to quantify on computed tomography. The purpose of this study was to evaluate the ability of a deep convolutional neural network (dCNN) to predict inpatient outcomes associated with COVID-19 pneumonia. Materials and Methods A previously trained dCNN was tested on an external validation cohort of 241 patients who presented to the emergency department and received a chest computed tomography scan, 93 with COVID-19 and 168 without. Airspace opacity scoring systems were defined by the extent of airspace opacity in each lobe, totaled across the entire lungs. Expert and dCNN scores were concurrently evaluated for interobserver agreement, while both dCNN identified airspace opacity scoring and raw opacity values were used in the prediction of COVID-19 diagnosis and inpatient outcomes. Results Interobserver agreement for airspace opacity scoring was 0.892 (95% CI 0.834-0.930). Probability of each outcome behaved as a logistic function of the opacity scoring (25% intensive care unit admission at score of 13/25, 25% intubation at 17/25, and 25% mortality at 20/25). Length of hospitalization, intensive care unit stay, and intubation were associated with larger airspace opacity score (p = 0.032, 0.039, 0.036, respectively). Conclusion The tested dCNN was highly predictive of inpatient outcomes, performs at a near expert level, and provides added value for clinicians in terms of prognostication and disease severity.
Collapse
|
108
|
Onnis C, Muscogiuri G, Paolo Bassareo P, Cau R, Mannelli L, Cadeddu C, Suri JS, Cerrone G, Gerosa C, Sironi S, Faa G, Carriero A, Pontone G, Saba L. Non-invasive coronary imaging in patients with COVID-19: A narrative review. Eur J Radiol 2022; 149:110188. [PMID: 35180580 PMCID: PMC8805958 DOI: 10.1016/j.ejrad.2022.110188] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2021] [Revised: 01/20/2022] [Accepted: 01/26/2022] [Indexed: 12/14/2022]
Abstract
SARS-CoV-2 infection, responsible for COVID-19 outbreak, can cause cardiac complications, worsening outcome and prognosis. In particular, it can exacerbate any underlying cardiovascular condition, leading to atherosclerosis and increased plaque vulnerability, which may cause acute coronary syndrome. We review current knowledge on the mechanisms by which SARS-CoV-2 can trigger endothelial/myocardial damage and cause plaque formation, instability and deterioration. The aim of this review is to evaluate current non-invasive diagnostic techniques for coronary arteries evaluation in COVID-19 patients, such as coronary CT angiography and atherosclerotic plaque imaging, and their clinical implications. We also discuss the role of artificial intelligence, deep learning and radiomics in the context of coronary imaging in COVID-19 patients.
Collapse
Affiliation(s)
- Carlotta Onnis
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), di Cagliari - Polo di Monserrato s.s. 554, Monserrato (Cagliari) 09045, Italy
| | - Giuseppe Muscogiuri
- Department of Radiology, IRCCS Istituto Auxologico Italiano, San Luca Hospital, University Milano Bicocca, Milan, Italy
| | - Pier Paolo Bassareo
- Mater Misericordiae University Hospital and Our Lady's Children's Hospital, University College of Dublin, Crumlin, Dublin, Ireland
| | - Riccardo Cau
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), di Cagliari - Polo di Monserrato s.s. 554, Monserrato (Cagliari) 09045, Italy
| | | | - Christian Cadeddu
- Department of Cardiology, Azienda Ospedaliero Universitaria (A.O.U.), di Cagliari - Polo di Monserrato s.s. 554, Monserrato (Cagliari) 09045, Italy
| | - Jasjit S Suri
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA, USA
| | - Giulia Cerrone
- Department of Pathology, Azienda Ospedaliero Universitaria (A.O.U.), di Cagliari - Ospedale San Giovanni di, Dio (Cagliari) 09100, Italy
| | - Clara Gerosa
- Department of Pathology, Azienda Ospedaliero Universitaria (A.O.U.), di Cagliari - Ospedale San Giovanni di, Dio (Cagliari) 09100, Italy
| | - Sandro Sironi
- Department of Radiology, IRCCS Istituto Auxologico Italiano, San Luca Hospital, University Milano Bicocca, Milan, Italy
| | - Gavino Faa
- Department of Pathology, Azienda Ospedaliero Universitaria (A.O.U.), di Cagliari - Ospedale San Giovanni di, Dio (Cagliari) 09100, Italy
| | | | | | - Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), di Cagliari - Polo di Monserrato s.s. 554, Monserrato (Cagliari) 09045, Italy.
| |
Collapse
|
109
|
Alemi F, Vang J, Guralnik E, Roess A. Modeling the Probability of COVID-19 Based on Symptom Screening and Prevalence of Influenza and Influenza-Like Illnesses. Qual Manag Health Care 2022; 31:85-91. [PMID: 35195616 PMCID: PMC8963439 DOI: 10.1097/qmh.0000000000000339] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
BACKGROUND The importance of various patient-reported signs and symptoms to the diagnosis of coronavirus disease 2019 (COVID-19) changes during, and outside, of the flu season. None of the current published studies, which focus on diagnosis of COVID-19, have taken this seasonality into account. OBJECTIVE To develop predictive algorithm, which estimates the probability of having COVID-19 based on symptoms, and which incorporates the seasonality and prevalence of influenza and influenza-like illness data. METHODS Differential diagnosis of COVID-19 and influenza relies on demographic characteristics (age, race, and gender), and respiratory (eg, fever, cough, and runny nose), gastrointestinal (eg, diarrhea, nausea, and loss of appetite), and neurological (eg, anosmia and headache) signs and symptoms. The analysis was based on the symptoms reported by COVID-19 patients, 774 patients in China and 273 patients in the United States. The analysis also included 2885 influenza and 884 influenza-like illnesses in US patients. Accuracy of the predictions was calculated using the average area under the receiver operating characteristic (AROC) curves. RESULTS The likelihood ratio for symptoms, such as cough, depended on the flu season-sometimes indicating COVID-19 and other times indicating the reverse. In 30-fold cross-validated data, the symptoms accurately predicted COVID-19 (AROC of 0.79), showing that symptoms can be used to screen patients in the community and prior to testing. CONCLUSION Community-based health care providers should follow different signs and symptoms for diagnosing COVID-19 during, and outside of, influenza season.
Collapse
Affiliation(s)
- Farrokh Alemi
- Departments of Health Administration and Policy (Dr Alemi and Ms Guralnik) and Global and Community Health (Dr Roess), George Mason University, Fairfax, Virginia; and Health Administration and Policy, George Mason University College of Health, Fairfax, Virginia (Dr Vang)
| | - Jee Vang
- Departments of Health Administration and Policy (Dr Alemi and Ms Guralnik) and Global and Community Health (Dr Roess), George Mason University, Fairfax, Virginia; and Health Administration and Policy, George Mason University College of Health, Fairfax, Virginia (Dr Vang)
| | - Elina Guralnik
- Departments of Health Administration and Policy (Dr Alemi and Ms Guralnik) and Global and Community Health (Dr Roess), George Mason University, Fairfax, Virginia; and Health Administration and Policy, George Mason University College of Health, Fairfax, Virginia (Dr Vang)
| | - Amira Roess
- Departments of Health Administration and Policy (Dr Alemi and Ms Guralnik) and Global and Community Health (Dr Roess), George Mason University, Fairfax, Virginia; and Health Administration and Policy, George Mason University College of Health, Fairfax, Virginia (Dr Vang)
| |
Collapse
|
110
|
de Vente C, Boulogne LH, Venkadesh KV, Sital C, Lessmann N, Jacobs C, Sanchez CI, van Ginneken B. Automated COVID-19 Grading With Convolutional Neural Networks in Computed Tomography Scans: A Systematic Comparison. IEEE TRANSACTIONS ON ARTIFICIAL INTELLIGENCE 2022; 3:129-138. [PMID: 35582210 PMCID: PMC9014473 DOI: 10.1109/tai.2021.3115093] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/28/2021] [Revised: 06/02/2021] [Accepted: 09/18/2021] [Indexed: 11/08/2022]
Abstract
Amidst the ongoing pandemic, the assessment of computed tomography (CT) images for COVID-19 presence can exceed the workload capacity of radiologists. Several studies addressed this issue by automating COVID-19 classification and grading from CT images with convolutional neural networks (CNNs). Many of these studies reported initial results of algorithms that were assembled from commonly used components. However, the choice of the components of these algorithms was often pragmatic rather than systematic and systems were not compared to each other across papers in a fair manner. We systematically investigated the effectiveness of using 3-D CNNs instead of 2-D CNNs for seven commonly used architectures, including DenseNet, Inception, and ResNet variants. For the architecture that performed best, we furthermore investigated the effect of initializing the network with pretrained weights, providing automatically computed lesion maps as additional network input, and predicting a continuous instead of a categorical output. A 3-D DenseNet-201 with these components achieved an area under the receiver operating characteristic curve of 0.930 on our test set of 105 CT scans and an AUC of 0.919 on a publicly available set of 742 CT scans, a substantial improvement in comparison with a previously published 2-D CNN. This article provides insights into the performance benefits of various components for COVID-19 classification and grading systems. We have created a challenge on grand-challenge.org to allow for a fair comparison between the results of this and future research.
Collapse
Affiliation(s)
- Coen de Vente
- Radboud University Medical Center, Donders Institute for Brain, Cognition and BehaviourDepartment of Medical Imaging6525GANijmegenThe Netherlands.,Informatics Institute, Faculty of ScienceUniversity of Amsterdam 1012 WX Amsterdam The Netherlands
| | - Luuk H Boulogne
- Radboud University Medical Center, Radboud Institute for Health SciencesDepartment of Medical Imaging 6525 GA Nijmegen The Netherlands
| | - Kiran Vaidhya Venkadesh
- Radboud University Medical Center, Radboud Institute for Health SciencesDepartment of Medical Imaging 6525 GA Nijmegen The Netherlands
| | - Cheryl Sital
- Radboud University Medical Center, Radboud Institute for Health SciencesDepartment of Medical Imaging 6525 GA Nijmegen The Netherlands
| | - Nikolas Lessmann
- Radboud University Medical Center, Radboud Institute for Health SciencesDepartment of Medical Imaging 6525 GA Nijmegen The Netherlands
| | - Colin Jacobs
- Radboud University Medical Center, Radboud Institute for Health SciencesDepartment of Medical Imaging 6525 GA Nijmegen The Netherlands
| | - Clara I Sanchez
- Informatics Institute, Faculty of ScienceUniversity of Amsterdam 1012 WX Amsterdam The Netherlands
| | - Bram van Ginneken
- Radboud University Medical Center, Radboud Institute for Health SciencesDepartment of Medical Imaging 6525 GA Nijmegen The Netherlands
| |
Collapse
|
111
|
Liu M, Wang S, Yu H, Zhu Y, Wang L, Zhang M, Wu Z, Li X, Li W, Tian J. A Lung-Parenchyma-Contrast Hybrid Network For EGFR Gene Mutation Prediction In Lung Cancer. 2022 IEEE 19TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI) 2022. [DOI: 10.1109/isbi52829.2022.9761614] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/05/2023]
Affiliation(s)
- Meili Liu
- Beihang University,Beijing Advanced Innovation Center for Big Data-Based Precision Medicine, School of Engineering Medicine,Beijing,China
| | - Shuo Wang
- Beihang University,Beijing Advanced Innovation Center for Big Data-Based Precision Medicine, School of Engineering Medicine,Beijing,China
| | - He Yu
- Sichuan University,West China Hospital,Department of Respiratory and Critical Care Medicine,Chengdu,China
| | - Yongbei Zhu
- Beihang University,Beijing Advanced Innovation Center for Big Data-Based Precision Medicine, School of Engineering Medicine,Beijing,China
| | - Liusu Wang
- Beihang University,Beijing Advanced Innovation Center for Big Data-Based Precision Medicine, School of Engineering Medicine,Beijing,China
| | - Mingyu Zhang
- Beihang University,Beijing Advanced Innovation Center for Big Data-Based Precision Medicine, School of Engineering Medicine,Beijing,China
| | - Zhangjie Wu
- Beihang University,Beijing Advanced Innovation Center for Big Data-Based Precision Medicine, School of Engineering Medicine,Beijing,China
| | - Xiaohu Li
- Anhui Medical University,First Affiliated Hospital,Department of Radiology
| | - Weimin Li
- Sichuan University,West China Hospital,Department of Respiratory and Critical Care Medicine,Chengdu,China
| | - Jie Tian
- Beihang University,Beijing Advanced Innovation Center for Big Data-Based Precision Medicine, School of Engineering Medicine,Beijing,China
| |
Collapse
|
112
|
Ortiz S, Rojas F, Valenzuela O, Herrera LJ, Rojas I. Determination of the Severity and Percentage of COVID-19 Infection through a Hierarchical Deep Learning System. J Pers Med 2022; 12:535. [PMID: 35455654 PMCID: PMC9027976 DOI: 10.3390/jpm12040535] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/23/2022] [Revised: 03/21/2022] [Accepted: 03/24/2022] [Indexed: 12/18/2022] Open
Abstract
The coronavirus disease 2019 (COVID-19) has caused millions of deaths and one of the greatest health crises of all time. In this disease, one of the most important aspects is the early detection of the infection to avoid the spread. In addition to this, it is essential to know how the disease progresses in patients, to improve patient care. This contribution presents a novel method based on a hierarchical intelligent system, that analyzes the application of deep learning models to detect and classify patients with COVID-19 using both X-ray and chest computed tomography (CT). The methodology was divided into three phases, the first being the detection of whether or not a patient suffers from COVID-19, the second step being the evaluation of the percentage of infection of this disease and the final phase is to classify the patients according to their severity. Stratification of patients suffering from COVID-19 according to their severity using automatic systems based on machine learning on medical images (especially X-ray and CT of the lungs) provides a powerful tool to help medical experts in decision making. In this article, a new contribution is made to a stratification system with three severity levels (mild, moderate and severe) using a novel histogram database (which defines how the infection is in the different CT slices for a patient suffering from COVID-19). The first two phases use CNN Densenet-161 pre-trained models, and the last uses SVM with LDA supervised learning algorithms as classification models. The initial stage detects the presence of COVID-19 through X-ray multi-class (COVID-19 vs. No-Findings vs. Pneumonia) and the results obtained for accuracy, precision, recall, and F1-score values are 88%, 91%, 87%, and 89%, respectively. The following stage manifested the percentage of COVID-19 infection in the slices of the CT-scans for a patient and the results in the metrics evaluation are 0.95 in Pearson Correlation coefficient, 5.14 in MAE and 8.47 in RMSE. The last stage finally classifies a patient in three degrees of severity as a function of global infection of the lungs and the results achieved are 95% accurate.
Collapse
Affiliation(s)
- Sergio Ortiz
- School of Technology and Telecommunications Engineering, University of Granada, 18071 Granada, Spain; (F.R.); (L.J.H.)
| | - Fernando Rojas
- School of Technology and Telecommunications Engineering, University of Granada, 18071 Granada, Spain; (F.R.); (L.J.H.)
| | - Olga Valenzuela
- Department of Applied Mathematics, University of Granada, 18071 Granada, Spain;
| | - Luis Javier Herrera
- School of Technology and Telecommunications Engineering, University of Granada, 18071 Granada, Spain; (F.R.); (L.J.H.)
| | - Ignacio Rojas
- School of Technology and Telecommunications Engineering, University of Granada, 18071 Granada, Spain; (F.R.); (L.J.H.)
| |
Collapse
|
113
|
Vaidyanathan A, Guiot J, Zerka F, Belmans F, Van Peufflik I, Deprez L, Danthine D, Canivet G, Lambin P, Walsh S, Occchipinti M, Meunier P, Vos W, Lovinfosse P, Leijenaar RT. An externally validated fully automated deep learning algorithm to classify COVID-19 and other pneumonias on chest CT. ERJ Open Res 2022; 8:00579-2021. [PMID: 35509437 PMCID: PMC8958945 DOI: 10.1183/23120541.00579-2021] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/08/2021] [Accepted: 03/04/2022] [Indexed: 01/08/2023] Open
Abstract
Purpose In this study, we propose an artificial intelligence (AI) framework based on three-dimensional convolutional neural networks to classify computed tomography (CT) scans of patients with coronavirus disease 2019 (COVID-19), influenza/community-acquired pneumonia (CAP), and no infection, after automatic segmentation of the lungs and lung abnormalities. Methods The AI classification model is based on inflated three-dimensional Inception architecture and was trained and validated on retrospective data of CT images of 667 adult patients (no infection n=188, COVID-19 n=230, influenza/CAP n=249) and 210 adult patients (no infection n=70, COVID-19 n=70, influenza/CAP n=70), respectively. The model's performance was independently evaluated on an internal test set of 273 adult patients (no infection n=55, COVID-19 n= 94, influenza/CAP n=124) and an external validation set from a different centre (305 adult patients: COVID-19 n=169, no infection n=76, influenza/CAP n=60). Results The model showed excellent performance in the external validation set with area under the curve of 0.90, 0.92 and 0.92 for COVID-19, influenza/CAP and no infection, respectively. The selection of the input slices based on automatic segmentation of the abnormalities in the lung reduces analysis time (56 s per scan) and computational burden of the model. The Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis (TRIPOD) score of the proposed model is 47% (15 out of 32 TRIPOD items). Conclusion This AI solution provides rapid and accurate diagnosis in patients suspected of COVID-19 infection and influenza. A fully automated artificial intelligence-based network is proposed to classify CT volumes of patients affected with COVID-19 or influenza/CAP, and in the uninfectedhttps://bit.ly/3MJrVRi
Collapse
|
114
|
EDNC: Ensemble Deep Neural Network for COVID-19 Recognition. Tomography 2022; 8:869-890. [PMID: 35314648 PMCID: PMC8938826 DOI: 10.3390/tomography8020071] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/05/2022] [Revised: 03/15/2022] [Accepted: 03/16/2022] [Indexed: 12/24/2022] Open
Abstract
The automatic recognition of COVID-19 diseases is critical in the present pandemic since it relieves healthcare staff of the burden of screening for infection with COVID-19. Previous studies have proven that deep learning algorithms can be utilized to aid in the diagnosis of patients with potential COVID-19 infection. However, the accuracy of current COVID-19 recognition models is relatively low. Motivated by this fact, we propose three deep learning architectures, F-EDNC, FC-EDNC, and O-EDNC, to quickly and accurately detect COVID-19 infections from chest computed tomography (CT) images. Sixteen deep learning neural networks have been modified and trained to recognize COVID-19 patients using transfer learning and 2458 CT chest images. The proposed EDNC has then been developed using three of sixteen modified pre-trained models to improve the performance of COVID-19 recognition. The results suggested that the F-EDNC method significantly enhanced the recognition of COVID-19 infections with 97.75% accuracy, followed by FC-EDNC and O-EDNC (97.55% and 96.12%, respectively), which is superior to most of the current COVID-19 recognition models. Furthermore, a localhost web application has been built that enables users to easily upload their chest CT scans and obtain their COVID-19 results automatically. This accurate, fast, and automatic COVID-19 recognition system will relieve the stress of medical professionals for screening COVID-19 infections.
Collapse
|
115
|
Waheed W, Saylan S, Hassan T, Kannout H, Alsafar H, Alazzam A. A deep learning-driven low-power, accurate, and portable platform for rapid detection of COVID-19 using reverse-transcription loop-mediated isothermal amplification. Sci Rep 2022; 12:4132. [PMID: 35260715 PMCID: PMC8903312 DOI: 10.1038/s41598-022-07954-2] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2021] [Accepted: 02/28/2022] [Indexed: 12/24/2022] Open
Abstract
This paper presents a deep learning-driven portable, accurate, low-cost, and easy-to-use device to perform Reverse-Transcription Loop-Mediated Isothermal Amplification (RT-LAMP) to facilitate rapid detection of COVID-19. The 3D-printed device-powered using only a 5 Volt AC-DC adapter-can perform 16 simultaneous RT-LAMP reactions and can be used multiple times. Moreover, the experimental protocol is devised to obviate the need for separate, expensive equipment for RNA extraction in addition to eliminating sample evaporation. The entire process from sample preparation to the qualitative assessment of the LAMP amplification takes only 45 min (10 min for pre-heating and 35 min for RT-LAMP reactions). The completion of the amplification reaction yields a fuchsia color for the negative samples and either a yellow or orange color for the positive samples, based on a pH indicator dye. The device is coupled with a novel deep learning system that automatically analyzes the amplification results and pays attention to the pH indicator dye to screen the COVID-19 subjects. The proposed device has been rigorously tested on 250 RT-LAMP clinical samples, where it achieved an overall specificity and sensitivity of 0.9666 and 0.9722, respectively with a recall of 0.9892 for Ct < 30. Also, the proposed system can be widely used as an accurate, sensitive, rapid, and portable tool to detect COVID-19 in settings where access to a lab is difficult, or the results are urgently required.
Collapse
Affiliation(s)
- Waqas Waheed
- Department of Mechanical Engineering, Khalifa University, Abu Dhabi, UAE
| | - Sueda Saylan
- System on Chip Center (SOCC), Khalifa University, Abu Dhabi, UAE
- Department of Electrical Engineering and Computer Science, Khalifa University, Abu Dhabi, UAE
| | - Taimur Hassan
- Department of Electrical Engineering and Computer Science, Khalifa University, Abu Dhabi, UAE
- Center for Cyber-Physical Systems (C2PS), EECS Department, Khalifa University, Abu Dhabi, UAE
| | - Hussain Kannout
- Center for Biotechnology (BTC), Khalifa University, Abu Dhabi, UAE
| | - Habiba Alsafar
- Center for Biotechnology (BTC), Khalifa University, Abu Dhabi, UAE
- College of Medicine and Health Sciences, Khalifa University, Abu Dhabi, UAE
| | - Anas Alazzam
- Department of Mechanical Engineering, Khalifa University, Abu Dhabi, UAE.
- System on Chip Center (SOCC), Khalifa University, Abu Dhabi, UAE.
| |
Collapse
|
116
|
Clinical Characteristics of COVID-19 Patients and Application to an Artificial Intelligence System for Disease Surveillance. J Clin Med 2022; 11:jcm11051437. [PMID: 35268531 PMCID: PMC8911292 DOI: 10.3390/jcm11051437] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2022] [Revised: 02/28/2022] [Accepted: 03/03/2022] [Indexed: 01/08/2023] Open
Abstract
During the coronavirus disease (COVID-19) pandemic, we admitted suspected or confirmed COVID-19 patients to our isolation wards between 2 March 2020 and 4 May 2020, following a well-designed and efficient assessment protocol. We included 217 patients suspected of COVID-19, of which 27 had confirmed COVID-19. The clinical characteristics of these patients were used to train artificial intelligence (AI) models such as support vector machine (SVM), decision tree, random forest, and artificial neural network for diagnosing COVID-19. When analyzing the performance of the models, SVM showed the highest sensitivity (SVM vs. decision tree vs. random forest vs. artificial neural network: 100% vs. 42.86% vs. 28.57% vs. 71.43%), while decision tree and random forest had the highest specificity (SVM vs. decision tree vs. random forest vs. artificial neural network: 88.37% vs. 100% vs. 100% vs. 94.74%) in the diagnosis of COVID-19. With the aid of AI models, physicians may identify COVID-19 patients earlier, even with few baseline data available, and segregate infected patients earlier to avoid hospital cluster infections and to ensure the safety of medical professionals and ordinary patients in the hospital.
Collapse
|
117
|
Alrajhi AA, Alswailem OA, Wali G, Alnafee K, AlGhamdi S, Alarifi J, AlMuhaideb S, ElMoaqet H, AbuSalah A. Data-Driven Prediction for COVID-19 Severity in Hospitalized Patients. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2022; 19:ijerph19052958. [PMID: 35270653 PMCID: PMC8910504 DOI: 10.3390/ijerph19052958] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/15/2021] [Revised: 02/24/2022] [Accepted: 02/25/2022] [Indexed: 02/01/2023]
Abstract
Clinicians urgently need reliable and stable tools to predict the severity of COVID-19 infection for hospitalized patients to enhance the utilization of hospital resources and supplies. Published COVID-19 related guidelines are frequently being updated, which impacts its utilization as a stable go-to resource for informing clinical and operational decision-making processes. In addition, many COVID-19 patient-level severity prediction tools that were developed during the early stages of the pandemic failed to perform well in the hospital setting due to many challenges including data availability, model generalization, and clinical validation. This study describes the experience of a large tertiary hospital system network in the Middle East in developing a real-time severity prediction tool that can assist clinicians in matching patients with appropriate levels of needed care for better management of limited health care resources during COVID-19 surges. It also provides a new perspective for predicting patients’ COVID-19 severity levels at the time of hospital admission using comprehensive data collected during the first year of the pandemic in the hospital. Unlike many previous studies for a similar population in the region, this study evaluated 4 machine learning models using a large training data set of 1386 patients collected between March 2020 and April 2021. The study uses comprehensive COVID-19 patient-level clinical data from the hospital electronic medical records (EMR), vital sign monitoring devices, and Polymerase Chain Reaction (PCR) machines. The data were collected, prepared, and leveraged by a panel of clinical and data experts to develop a multi-class data-driven framework to predict severity levels for COVID-19 infections at admission time. Finally, this study provides results from a prospective validation test conducted by clinical experts in the hospital. The proposed prediction framework shows excellent performance in concurrent validation (n=462 patients, March 2020–April 2021) with highest discrimination obtained with the random forest classification model, achieving a macro- and micro-average area under receiver operating characteristics curve (AUC) of 0.83 and 0.87, respectively. The prospective validation conducted by clinical experts (n=185 patients, April–May 2021) showed a promising overall prediction performance with a recall of 78.4–90.0% and a precision of 75.0–97.8% for different severity classes.
Collapse
Affiliation(s)
- Abdulrahman A. Alrajhi
- Department of Medicine, King Faisal Specialist Hospital & Research Centre, Riyadh 11211, Saudi Arabia
- Correspondence: (A.A.A.); (O.A.A.); (H.E.)
| | - Osama A. Alswailem
- Healthcare Information & Technology Affairs, King Faisal Specialist Hospital & Research Centre, Riyadh 11211, Saudi Arabia
- Correspondence: (A.A.A.); (O.A.A.); (H.E.)
| | - Ghassan Wali
- Department of Medicine, King Faisal Specialist Hospital & Research Centre, Jeddah 21561, Saudi Arabia;
| | - Khalid Alnafee
- Infection Control & Hospital Epidemiology Department, King Faisal Specialist Hospital & Research Centre, Riyadh 11211, Saudi Arabia;
| | - Sarah AlGhamdi
- Center of Healthcare Intelligence, Health Information & Technology Affairs, King Faisal Specialist Hospital & Research Centre, Riyadh 11211, Saudi Arabia; (S.A.); (J.A.); (A.A.)
| | - Jhan Alarifi
- Center of Healthcare Intelligence, Health Information & Technology Affairs, King Faisal Specialist Hospital & Research Centre, Riyadh 11211, Saudi Arabia; (S.A.); (J.A.); (A.A.)
| | - Sarab AlMuhaideb
- Computer Science Department, College of Computer & Information Sciences, King Saud University, Riyadh 11451, Saudi Arabia;
| | - Hisham ElMoaqet
- Department of Mechatronics Engineering, German Jordanian University, Amman 11180, Jordan
- Correspondence: (A.A.A.); (O.A.A.); (H.E.)
| | - Ahmad AbuSalah
- Center of Healthcare Intelligence, Health Information & Technology Affairs, King Faisal Specialist Hospital & Research Centre, Riyadh 11211, Saudi Arabia; (S.A.); (J.A.); (A.A.)
| |
Collapse
|
118
|
Mining whole-lung information by artificial intelligence for predicting EGFR genotype and targeted therapy response in lung cancer: a multicohort study. Lancet Digit Health 2022; 4:e309-e319. [DOI: 10.1016/s2589-7500(22)00024-3] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2021] [Revised: 11/18/2021] [Accepted: 01/28/2022] [Indexed: 01/02/2023]
|
119
|
Dialameh M, Hamzeh A, Rahmani H, Radmard AR, Dialameh S. Proposing a novel deep network for detecting COVID-19 based on chest images. Sci Rep 2022; 12:3116. [PMID: 35210447 PMCID: PMC8873454 DOI: 10.1038/s41598-022-06802-7] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2021] [Accepted: 01/24/2022] [Indexed: 11/29/2022] Open
Abstract
The rapid outbreak of coronavirus threatens humans' life all around the world. Due to the insufficient diagnostic infrastructures, developing an accurate, efficient, inexpensive, and quick diagnostic tool is of great importance. To date, researchers have proposed several detection models based on chest imaging analysis, primarily based on deep neural networks; however, none of which could achieve a reliable and highly sensitive performance yet. Therefore, the nature of this study is primary epidemiological research that aims to overcome the limitations mentioned above by proposing a large-scale publicly available dataset of chest computed tomography scan (CT-scan) images consisting of more than 13k samples. Secondly, we propose a more sensitive deep neural networks model for CT-scan images of the lungs, providing a pixel-wise attention layer on top of the high-level features extracted from the network. Moreover, the proposed model is extended through a transfer learning approach for being applicable in the case of chest X-Ray (CXR) images. The proposed model and its extension have been trained and evaluated through several experiments. The inclusion criteria were patients with suspected PE and positive real-time reverse-transcription polymerase chain reaction (RT-PCR) for SARS-CoV-2. The exclusion criteria were negative or inconclusive RT-PCR and other chest CT indications. Our model achieves an AUC score of 0.886, significantly better than its closest competitor, whose AUC is 0.843. Moreover, the obtained results on another commonly-used benchmark show an AUC of 0.899, outperforming related models. Additionally, the sensitivity of our model is 0.858, while that of its closest competitor is 0.81, explaining the efficiency of pixel-wise attention strategy in detecting coronavirus. Our promising results and the efficiency of the models imply that the proposed models can be considered reliable tools for assisting doctors in detecting coronavirus.
Collapse
Affiliation(s)
- Maryam Dialameh
- Department of Computer Science, Shiraz University, Shiraz, Iran.
| | - Ali Hamzeh
- Department of Computer Science, Shiraz University, Shiraz, Iran
| | - Hossein Rahmani
- School of Computing and Communications, Lancaster University, Lancaster, UK
| | - Amir Reza Radmard
- Department of Radiology, Tehran University of Medical Sciences, Tehran, Iran
| | - Safoura Dialameh
- School of Paramedical Sciences, Bushehr University of Medical Sciences, Bushehr, Iran
| |
Collapse
|
120
|
Abstract
Recognition of COVID-19 is a challenging task which consistently requires taking a gander at clinical images of patients. In this paper, the transfer learning technique has been applied to clinical images of different types of pulmonary diseases, including COVID-19. It is found that COVID-19 is very much similar to pneumonia lung disease. Further findings are made to identify the type of pneumonia similar to COVID-19. Transfer Learning makes it possible for us to find out that viral pneumonia is same as COVID-19. This shows the knowledge gained by model trained for detecting viral pneumonia can be transferred for identifying COVID-19. Transfer Learning shows significant difference in results when compared with the outcome from conventional classifications. It is obvious that we need not create separate model for classifying COVID-19 as done by conventional classifications. This makes the herculean work easier by using existing model for determining COVID-19. Second, it is difficult to detect the abnormal features from images due to the noise impedance from lesions and tissues. For this reason, texture feature extraction is accomplished using Haralick features which focus only on the area of interest to detect COVID-19 using statistical analyses. Hence, there is a need to propose a model to predict the COVID-19 cases at the earliest possible to control the spread of disease. We propose a transfer learning model to quicken the prediction process and assist the medical professionals. The proposed model outperforms the other existing models. This makes the time-consuming process easier and faster for radiologists and this reduces the spread of virus and save lives.
Collapse
|
121
|
Vineth Ligi S, Kundu SS, Kumar R, Narayanamoorthi R, Lai KW, Dhanalakshmi S. Radiological Analysis of COVID-19 Using Computational Intelligence: A Broad Gauge Study. JOURNAL OF HEALTHCARE ENGINEERING 2022; 2022:5998042. [PMID: 35251572 PMCID: PMC8890832 DOI: 10.1155/2022/5998042] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/13/2021] [Revised: 12/13/2021] [Accepted: 01/07/2022] [Indexed: 12/20/2022]
Abstract
Pulmonary medical image analysis using image processing and deep learning approaches has made remarkable achievements in the diagnosis, prognosis, and severity check of lung diseases. The epidemic of COVID-19 brought out by the novel coronavirus has triggered a critical need for artificial intelligence assistance in diagnosing and controlling the disease to reduce its effects on people and global economies. This study aimed at identifying the various COVID-19 medical imaging analysis models proposed by different researchers and featured their merits and demerits. It gives a detailed discussion on the existing COVID-19 detection methodologies (diagnosis, prognosis, and severity/risk detection) and the challenges encountered for the same. It also highlights the various preprocessing and post-processing methods involved to enhance the detection mechanism. This work also tries to bring out the different unexplored research areas that are available for medical image analysis and how the vast research done for COVID-19 can advance the field. Despite deep learning methods presenting high levels of efficiency, some limitations have been briefly described in the study. Hence, this review can help understand the utilization and pros and cons of deep learning in analyzing medical images.
Collapse
Affiliation(s)
- S. Vineth Ligi
- Department of Electronics and Communication Engineering, College of Engineering and Technology, Faculty of Engineering and Technology, SRM Institute of Science and Technology, SRM Nagar, Kattankulathur, Chengalpattu, Chennai, TN, India
| | - Soumya Snigdha Kundu
- Department of Computer Science Engineering, College of Engineering and Technology, Faculty of Engineering and Technology, SRM Institute of Science and Technology, SRM Nagar, Kattankulathur, Chengalpattu, Chennai, TN, India
| | - R. Kumar
- Department of Electronics and Communication Engineering, College of Engineering and Technology, Faculty of Engineering and Technology, SRM Institute of Science and Technology, SRM Nagar, Kattankulathur, Chengalpattu, Chennai, TN, India
| | - R. Narayanamoorthi
- Department of Electrical and Electronics Engineering, College of Engineering and Technology, Faculty of Engineering and Technology, SRM Institute of Science and Technology, SRM Nagar, Kattankulathur, Chengalpattu, Chennai, TN, India
| | - Khin Wee Lai
- Department of Biomedical Engineering, Faculty of Engineering, Universiti Malaya, Kuala Lumpur, Malaysia
| | - Samiappan Dhanalakshmi
- Department of Electronics and Communication Engineering, College of Engineering and Technology, Faculty of Engineering and Technology, SRM Institute of Science and Technology, SRM Nagar, Kattankulathur, Chengalpattu, Chennai, TN, India
| |
Collapse
|
122
|
Abstract
Deep learning uses artificial neural networks to recognize patterns and learn from them to make decisions. Deep learning is a type of machine learning that uses artificial neural networks to mimic the human brain. It uses machine learning methods such as supervised, semi-supervised, or unsupervised learning strategies to learn automatically in deep architectures and has gained much popularity due to its superior ability to learn from huge amounts of data. It was found that deep learning approaches can be used for big data analysis successfully. Applications include virtual assistants such as Alexa and Siri, facial recognition, personalization, natural language processing, autonomous cars, automatic handwriting generation, news aggregation, the colorization of black and white images, the addition of sound to silent films, pixel restoration, and deep dreaming. As a review, this paper aims to categorically cover several widely used deep learning algorithms along with their architectures and their practical applications: backpropagation, autoencoders, variational autoencoders, restricted Boltzmann machines, deep belief networks, convolutional neural networks, recurrent neural networks, generative adversarial networks, capsnets, transformer, embeddings from language models, bidirectional encoder representations from transformers, and attention in natural language processing. In addition, challenges of deep learning are also presented in this paper, such as AutoML-Zero, neural architecture search, evolutionary deep learning, and others. The pros and cons of these algorithms and their applications in healthcare are explored, alongside the future direction of this domain. This paper presents a review and a checkpoint to systemize the popular algorithms and to encourage further innovation regarding their applications. For new researchers in the field of deep learning, this review can help them to obtain many details about the advantages, disadvantages, applications, and working mechanisms of a number of deep learning algorithms. In addition, we introduce detailed information on how to apply several deep learning algorithms in healthcare, such as in relation to the COVID-19 pandemic. By presenting many challenges of deep learning in one section, we hope to increase awareness of these challenges, and how they can be dealt with. This could also motivate researchers to find solutions for these challenges.
Collapse
|
123
|
Aydemir E, Yalcinkaya MA, Barua PD, Baygin M, Faust O, Dogan S, Chakraborty S, Tuncer T, Acharya UR. Hybrid Deep Feature Generation for Appropriate Face Mask Use Detection. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2022; 19:1939. [PMID: 35206124 PMCID: PMC8871993 DOI: 10.3390/ijerph19041939] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/01/2022] [Revised: 01/29/2022] [Accepted: 01/30/2022] [Indexed: 12/04/2022]
Abstract
Mask usage is one of the most important precautions to limit the spread of COVID-19. Therefore, hygiene rules enforce the correct use of face coverings. Automated mask usage classification might be used to improve compliance monitoring. This study deals with the problem of inappropriate mask use. To address that problem, 2075 face mask usage images were collected. The individual images were labeled as either mask, no masked, or improper mask. Based on these labels, the following three cases were created: Case 1: mask versus no mask versus improper mask, Case 2: mask versus no mask + improper mask, and Case 3: mask versus no mask. This data was used to train and test a hybrid deep feature-based masked face classification model. The presented method comprises of three primary stages: (i) pre-trained ResNet101 and DenseNet201 were used as feature generators; each of these generators extracted 1000 features from an image; (ii) the most discriminative features were selected using an improved RelieF selector; and (iii) the chosen features were used to train and test a support vector machine classifier. That resulting model attained 95.95%, 97.49%, and 100.0% classification accuracy rates on Case 1, Case 2, and Case 3, respectively. Having achieved these high accuracy values indicates that the proposed model is fit for a practical trial to detect appropriate face mask use in real time.
Collapse
Affiliation(s)
- Emrah Aydemir
- Department of Management Information, College of Management, Sakarya University, Sakarya 54050, Turkey;
| | - Mehmet Ali Yalcinkaya
- Department of Computer Engineering, Engineering Faculty, Kirsehir Ahi Evran University, Kirsehir 40100, Turkey;
| | - Prabal Datta Barua
- School of Management & Enterprise, University of Southern Queensland, Toowoomba, QLD 4350, Australia;
- Faculty of Engineering and Information Technology, University of Technology Sydney, Sydney, NSW 2007, Australia
- Cogninet Brain Team, Cogninet Australia, Sydney, NSW 2010, Australia
| | - Mehmet Baygin
- Department of Computer Engineering, Faculty of Engineering, Ardahan University, Ardahan 75000, Turkey;
| | - Oliver Faust
- Department of Engineering and Mathematics, Sheffield Hallam University, Sheffield S1 1WB, UK
| | - Sengul Dogan
- Department of Digital Forensics Engineering, College of Technology, Firat University, Elazig 23119, Turkey; (S.D.); (T.T.)
| | - Subrata Chakraborty
- School of Science and Technology, Faculty of Science, Agriculture, Business and Law, University of New England, Armidale, NSW 2351, Australia;
- Centre for Advanced Modelling and Geospatial lnformation Systems (CAMGIS), Faculty of Engineering and Information Technology, University of Technology Sydney, Sydney, NSW 2007, Australia
| | - Turker Tuncer
- Department of Digital Forensics Engineering, College of Technology, Firat University, Elazig 23119, Turkey; (S.D.); (T.T.)
| | - U. Rajendra Acharya
- Department of Electronics and Computer Engineering, Ngee Ann Polytechnic, Singapore 599489, Singapore;
- Department of Biomedical Engineering, School of Science and Technology, Singapore University of Social Sciences, Singapore 599494, Singapore
- Department of Biomedical Informatics and Medical Engineering, Asia University, Taichung 41354, Taiwan
| |
Collapse
|
124
|
Ortiz A, Trivedi A, Desbiens J, Blazes M, Robinson C, Gupta S, Dodhia R, Bhatraju PK, Liles WC, Lee A, Ferres JML. Effective deep learning approaches for predicting COVID-19 outcomes from chest computed tomography volumes. Sci Rep 2022; 12:1716. [PMID: 35110593 PMCID: PMC8810911 DOI: 10.1038/s41598-022-05532-0] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/15/2021] [Accepted: 01/13/2022] [Indexed: 12/23/2022] Open
Abstract
The rapid evolution of the novel coronavirus disease (COVID-19) pandemic has resulted in an urgent need for effective clinical tools to reduce transmission and manage severe illness. Numerous teams are quickly developing artificial intelligence approaches to these problems, including using deep learning to predict COVID-19 diagnosis and prognosis from chest computed tomography (CT) imaging data. In this work, we assess the value of aggregated chest CT data for COVID-19 prognosis compared to clinical metadata alone. We develop a novel patient-level algorithm to aggregate the chest CT volume into a 2D representation that can be easily integrated with clinical metadata to distinguish COVID-19 pneumonia from chest CT volumes from healthy participants and participants with other viral pneumonia. Furthermore, we present a multitask model for joint segmentation of different classes of pulmonary lesions present in COVID-19 infected lungs that can outperform individual segmentation models for each task. We directly compare this multitask segmentation approach to combining feature-agnostic volumetric CT classification feature maps with clinical metadata for predicting mortality. We show that the combination of features derived from the chest CT volumes improve the AUC performance to 0.80 from the 0.52 obtained by using patients' clinical data alone. These approaches enable the automated extraction of clinically relevant features from chest CT volumes for risk stratification of COVID-19 patients.
Collapse
Affiliation(s)
- Anthony Ortiz
- AI for Good Research Lab, Microsoft, Seattle, WA, USA
| | | | | | - Marian Blazes
- Department of Ophthalmology, University of Washington, Seattle, WA, USA
| | | | - Sunil Gupta
- Intelligent Retinal Imaging Systems, Pensacola, FL, USA
| | - Rahul Dodhia
- AI for Good Research Lab, Microsoft, Seattle, WA, USA
| | - Pavan K Bhatraju
- Department of Medicine and Sepsis Center of Research Excellence, University of Washington (SCORE-UW), Seattle, WA, USA
| | - W Conrad Liles
- Department of Medicine and Sepsis Center of Research Excellence, University of Washington (SCORE-UW), Seattle, WA, USA
| | - Aaron Lee
- Department of Ophthalmology, University of Washington, Seattle, WA, USA.
| | | |
Collapse
|
125
|
Hassan H, Ren Z, Zhao H, Huang S, Li D, Xiang S, Kang Y, Chen S, Huang B. Review and classification of AI-enabled COVID-19 CT imaging models based on computer vision tasks. Comput Biol Med 2022; 141:105123. [PMID: 34953356 PMCID: PMC8684223 DOI: 10.1016/j.compbiomed.2021.105123] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2021] [Revised: 12/03/2021] [Accepted: 12/03/2021] [Indexed: 01/12/2023]
Abstract
This article presents a systematic overview of artificial intelligence (AI) and computer vision strategies for diagnosing the coronavirus disease of 2019 (COVID-19) using computerized tomography (CT) medical images. We analyzed the previous review works and found that all of them ignored classifying and categorizing COVID-19 literature based on computer vision tasks, such as classification, segmentation, and detection. Most of the COVID-19 CT diagnosis methods comprehensively use segmentation and classification tasks. Moreover, most of the review articles are diverse and cover CT as well as X-ray images. Therefore, we focused on the COVID-19 diagnostic methods based on CT images. Well-known search engines and databases such as Google, Google Scholar, Kaggle, Baidu, IEEE Xplore, Web of Science, PubMed, ScienceDirect, and Scopus were utilized to collect relevant studies. After deep analysis, we collected 114 studies and reported highly enriched information for each selected research. According to our analysis, AI and computer vision have substantial potential for rapid COVID-19 diagnosis as they could significantly assist in automating the diagnosis process. Accurate and efficient models will have real-time clinical implications, though further research is still required. Categorization of literature based on computer vision tasks could be helpful for future research; therefore, this review article will provide a good foundation for conducting such research.
Collapse
Affiliation(s)
- Haseeb Hassan
- College of Big Data and Internet, Shenzhen Technology University, Shenzhen, China; Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging, School of Biomedical Engineering, Shenzhen University Health Science Center, Shenzhen, China
| | - Zhaoyu Ren
- College of Big Data and Internet, Shenzhen Technology University, Shenzhen, China
| | - Huishi Zhao
- College of Big Data and Internet, Shenzhen Technology University, Shenzhen, China
| | - Shoujin Huang
- College of Big Data and Internet, Shenzhen Technology University, Shenzhen, China
| | - Dan Li
- College of Big Data and Internet, Shenzhen Technology University, Shenzhen, China
| | - Shaohua Xiang
- College of Big Data and Internet, Shenzhen Technology University, Shenzhen, China
| | - Yan Kang
- Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging, School of Biomedical Engineering, Shenzhen University Health Science Center, Shenzhen, China; Medical Device Innovation Research Center, Shenzhen Technology University, Shenzhen, China
| | - Sifan Chen
- Guangdong Provincial Key Laboratory of Malignant Tumor Epigenetics and Gene Regulation, Guangdong-Hong Kong Joint Laboratory for RNA Medicine, Sun Yat-Sen Memorial Hospital, Sun Yat-Sen University, Guangzhou, China; Medical Research Center, Sun Yat-Sen Memorial Hospital, Sun Yat-Sen University, Guangzhou, China
| | - Bingding Huang
- College of Big Data and Internet, Shenzhen Technology University, Shenzhen, China.
| |
Collapse
|
126
|
Liuzzi P, Campagnini S, Fanciullacci C, Arienti C, Patrini M, Carrozza MC, Mannini A. Predicting SARS-CoV-2 infection duration at hospital admission:a deep learning solution. Med Biol Eng Comput 2022; 60:459-470. [PMID: 34993693 PMCID: PMC8739354 DOI: 10.1007/s11517-021-02479-8] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2021] [Accepted: 11/24/2021] [Indexed: 11/25/2022]
Abstract
COVID-19 cases are increasing around the globe with almost 5 million of deaths. We propose here a deep learning model capable of predicting the duration of the infection by means of information available at hospital admission. A total of 222 patients were enrolled in our observational study. Anagraphical and anamnestic data, COVID-19 signs and symptoms, COVID-19 therapy, hematochemical test results, and prior therapies administered to patients are used as predictors. A set of 55 features, all of which can be taken in the first hours of the patient's hospitalization, was considered. Different solutions were compared achieving the best performance with a sequential convolutional neural network-based model merged in an ensemble with two different meta-learners linked in cascade. We obtained a median absolute error of 2.7 days (IQR = 3.0) in predicting the duration of the infection; the error was equally distributed in the infection duration range. This tool could preemptively give an outlook of the COVID-19 patients' expected path and the associated hospitalization effort. The proposed solution could be viable in tackling the huge burden and the logistics complexity of hospitals or rehabilitation centers during the pandemic waves. With data taken ad admission, entering a PCA-based feature selection, a k-fold cross-validated CNN-based model was implemented. After external texting, a median absolute error of 2.7 days [IQR = 3 days].
Collapse
Affiliation(s)
- Piergiuseppe Liuzzi
- Scuola Superiore Sant'Anna, The BioRobotics Institute, Viale Rinaldo Piaggio 34, 56025, Pontedera, PI, Italy
- IRCCS Fondazione Don Carlo Gnocchi, via di Scandicci 269, 50143, Firenze, FI, Italy
| | - Silvia Campagnini
- Scuola Superiore Sant'Anna, The BioRobotics Institute, Viale Rinaldo Piaggio 34, 56025, Pontedera, PI, Italy.
- IRCCS Fondazione Don Carlo Gnocchi, via di Scandicci 269, 50143, Firenze, FI, Italy.
| | - Chiara Fanciullacci
- IRCCS Fondazione Don Carlo Gnocchi, via di Scandicci 269, 50143, Firenze, FI, Italy
| | - Chiara Arienti
- IRCCS Fondazione Don Carlo Gnocchi, via Alfonso Capecelatro 66, 20148, Milano, FI, Italy
| | - Michele Patrini
- IRCCS Fondazione Don Carlo Gnocchi, via Alfonso Capecelatro 66, 20148, Milano, FI, Italy
| | - Maria Chiara Carrozza
- Scuola Superiore Sant'Anna, The BioRobotics Institute, Viale Rinaldo Piaggio 34, 56025, Pontedera, PI, Italy
| | - Andrea Mannini
- Scuola Superiore Sant'Anna, The BioRobotics Institute, Viale Rinaldo Piaggio 34, 56025, Pontedera, PI, Italy
- IRCCS Fondazione Don Carlo Gnocchi, via di Scandicci 269, 50143, Firenze, FI, Italy
| |
Collapse
|
127
|
Xu Z, Su C, Xiao Y, Wang F. Artificial intelligence for COVID-19: battling the pandemic with computational intelligence. INTELLIGENT MEDICINE 2022; 2:13-29. [PMID: 34697578 PMCID: PMC8529224 DOI: 10.1016/j.imed.2021.09.001] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/20/2021] [Revised: 09/15/2021] [Accepted: 09/29/2021] [Indexed: 12/15/2022]
Abstract
The new coronavirus disease 2019 (COVID-19) has become a global pandemic leading to over 180 million confirmed cases and nearly 4 million deaths until June 2021, according to the World Health Organization. Since the initial report in December 2019 , COVID-19 has demonstrated a high transmission rate (with an R0 > 2), a diverse set of clinical characteristics (e.g., high rate of hospital and intensive care unit admission rates, multi-organ dysfunction for critically ill patients due to hyperinflammation, thrombosis, etc.), and a tremendous burden on health care systems around the world. To understand the serious and complex diseases and develop effective control, treatment, and prevention strategies, researchers from different disciplines have been making significant efforts from different aspects including epidemiology and public health, biology and genomic medicine, as well as clinical care and patient management. In recent years, artificial intelligence (AI) has been introduced into the healthcare field to aid clinical decision-making for disease diagnosis and treatment such as detecting cancer based on medical images, and has achieved superior performance in multiple data-rich application scenarios. In the COVID-19 pandemic, AI techniques have also been used as a powerful tool to overcome the complex diseases. In this context, the goal of this study is to review existing studies on applications of AI techniques in combating the COVID-19 pandemic. Specifically, these efforts can be grouped into the fields of epidemiology, therapeutics, clinical research, social and behavioral studies and are summarized. Potential challenges, directions, and open questions are discussed accordingly, which may provide new insights into addressing the COVID-19 pandemic and would be helpful for researchers to explore more related topics in the post-pandemic era.
Collapse
Affiliation(s)
- Zhenxing Xu
- Department of Population Health Sciences, Weill Cornell Medicine, Cornell University, New York 10065, United States
| | - Chang Su
- Department of Health Service Administration and Policy, Temple University, Philadelphia 19122, United States
| | - Yunyu Xiao
- Department of Population Health Sciences, Weill Cornell Medicine, Cornell University, New York 10065, United States
| | - Fei Wang
- Department of Population Health Sciences, Weill Cornell Medicine, Cornell University, New York 10065, United States
| |
Collapse
|
128
|
The application of a deep learning system developed to reduce the time for RT-PCR in COVID-19 detection. Sci Rep 2022; 12:1234. [PMID: 35075153 PMCID: PMC8786863 DOI: 10.1038/s41598-022-05069-2] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2021] [Accepted: 01/06/2022] [Indexed: 01/02/2023] Open
Abstract
Reducing the time to diagnose COVID-19 helps to manage insufficient isolation-bed resources and adequately accommodate critically ill patients. There is currently no alternative method to real-time reverse transcriptase polymerase chain reaction (RT-PCR), which requires 40 cycles to diagnose COVID-19. We propose a deep learning (DL) model to improve the speed of COVID-19 RT-PCR diagnosis. We developed and tested a DL model using the long short-term memory method with a dataset of fluorescence values measured in each cycle of 5810 RT-PCR tests. Among the DL models developed here, the diagnostic performance of the 21st model showed an area under the receiver operating characteristic (AUROC), sensitivity, and specificity of 84.55%, 93.33%, and 75.72%, respectively. The diagnostic performance of the 24th model showed an AUROC, sensitivity, and specificity of 91.27%, 90.00%, and 92.54%, respectively.
Collapse
|
129
|
Thomas S, Abraham A, Baldwin J, Piplani S, Petrovsky N. Artificial Intelligence in Vaccine and Drug Design. METHODS IN MOLECULAR BIOLOGY (CLIFTON, N.J.) 2022; 2410:131-146. [PMID: 34914045 DOI: 10.1007/978-1-0716-1884-4_6] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [Subscribe] [Scholar Register] [Indexed: 12/20/2022]
Abstract
Knowledge in the fields of biochemistry, structural biology, immunological principles, microbiology, and genomics has all increased dramatically in recent years. There has also been tremendous growth in the fields of data science, informatics, and artificial intelligence needed to handle this immense data flow. At the intersection of wet lab and data science is the field of bioinformatics, which seeks to apply computational tools to better understanding of the biological sciences. Like so many other areas of biology, bioinformatics has transformed immunology research leading to the discipline of immunoinformatics. Within this field, many new databases and computational tools have been created that increasingly drive immunology research, in many cases drawing upon artificial intelligence and machine learning to predict complex immune system behaviors, for example, prediction of B cell and T cell epitopes. In this book chapter, we provide an overview of computational tools and artificial intelligence being used for protein modeling, drug screening, vaccine design, and highlight how these tools are being used to transform approaches to pandemic countermeasure development, by reference to the current COVID-19 pandemic.
Collapse
Affiliation(s)
- Sunil Thomas
- Lankenau Institute for Medical Research, Wynnewood, PA, USA.
| | - Ann Abraham
- Lankenau Institute for Medical Research, Wynnewood, PA, USA
| | | | - Sakshi Piplani
- Vaxine Pty Ltd, Adelaide, SA, Australia.,College of Medicine and Public Health, Flinders University, Adelaide, SA, Australia
| | - Nikolai Petrovsky
- Vaxine Pty Ltd, Adelaide, SA, Australia.,College of Medicine and Public Health, Flinders University, Adelaide, SA, Australia
| |
Collapse
|
130
|
Fathi M, Markazi Moghaddam N, Kheyrati L. Development and validation of models for two‐week mortality of inpatients with
COVID
‐19 infection: A large prospective cohort study. Stat Anal Data Min 2022. [DOI: 10.1002/sam.11572] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/15/2022]
Affiliation(s)
- Mohammad Fathi
- Critical Care Quality Improvement Research Center, Shahid Modarres Hospital Shahid Beheshti University of Medical Sciences Tehran Iran
- Department of Anesthesiology, Faculty of Medicine Shahid Beheshti University of Medical Sciences Tehran Iran
| | - Nader Markazi Moghaddam
- Critical Care Quality Improvement Research Center, Shahid Modarres Hospital Shahid Beheshti University of Medical Sciences Tehran Iran
- Department of Health Management and Economics, Faculty of Medicine AJA University of Medical Sciences Tehran Iran
| | - Leila Kheyrati
- Critical Care Quality Improvement Research Center, Shahid Modarres Hospital Shahid Beheshti University of Medical Sciences Tehran Iran
| |
Collapse
|
131
|
Zhang Q, Gao J, Wu JT, Cao Z, Dajun Zeng D. Data science approaches to confronting the COVID-19 pandemic: a narrative review. PHILOSOPHICAL TRANSACTIONS. SERIES A, MATHEMATICAL, PHYSICAL, AND ENGINEERING SCIENCES 2022; 380:20210127. [PMID: 34802267 PMCID: PMC8607150 DOI: 10.1098/rsta.2021.0127] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/31/2021] [Accepted: 09/22/2021] [Indexed: 05/07/2023]
Abstract
During the COVID-19 pandemic, more than ever, data science has become a powerful weapon in combating an infectious disease epidemic and arguably any future infectious disease epidemic. Computer scientists, data scientists, physicists and mathematicians have joined public health professionals and virologists to confront the largest pandemic in the century by capitalizing on the large-scale 'big data' generated and harnessed for combating the COVID-19 pandemic. In this paper, we review the newly born data science approaches to confronting COVID-19, including the estimation of epidemiological parameters, digital contact tracing, diagnosis, policy-making, resource allocation, risk assessment, mental health surveillance, social media analytics, drug repurposing and drug development. We compare the new approaches with conventional epidemiological studies, discuss lessons we learned from the COVID-19 pandemic, and highlight opportunities and challenges of data science approaches to confronting future infectious disease epidemics. This article is part of the theme issue 'Data science approaches to infectious disease surveillance'.
Collapse
Affiliation(s)
- Qingpeng Zhang
- School of Data Science, City University of Hong Kong, Hong Kong
| | - Jianxi Gao
- Department of Computer Science, Rensselaer Polytechnic Institute, Troy, NY 12180, USA
| | - Joseph T. Wu
- WHO Collaborating Centre for Infectious Disease Epidemiology and Control, School of Public Health, LKS Faculty of Medicine, The University of Hong Kong, Hong Kong
| | - Zhidong Cao
- The State Key Laboratory of Management and Control for Complex Systems, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, People’s Republic of China
- School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100190, People’s Republic of China
| | - Daniel Dajun Zeng
- The State Key Laboratory of Management and Control for Complex Systems, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, People’s Republic of China
- School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100190, People’s Republic of China
| |
Collapse
|
132
|
Liang H, Guo Y, Chen X, Ang KL, He Y, Jiang N, Du Q, Zeng Q, Lu L, Gao Z, Li L, Li Q, Nie F, Ding G, Huang G, Chen A, Li Y, Guan W, Sang L, Xu Y, Chen H, Chen Z, Li S, Zhang N, Chen Y, Huang D, Li R, Li J, Cheng B, Zhao Y, Li C, Xiong S, Wang R, Liu J, Wang W, Huang J, Cui F, Xu T, Lure FYM, Zhan M, Huang Y, Yang Q, Dai Q, Liang W, He J, Zhong N. Artificial intelligence for stepwise diagnosis and monitoring of COVID-19. Eur Radiol 2022; 32:2235-2245. [PMID: 34988656 PMCID: PMC8731211 DOI: 10.1007/s00330-021-08334-6] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/07/2021] [Revised: 07/06/2021] [Accepted: 08/07/2021] [Indexed: 11/04/2022]
Abstract
BACKGROUND Main challenges for COVID-19 include the lack of a rapid diagnostic test, a suitable tool to monitor and predict a patient's clinical course and an efficient way for data sharing among multicenters. We thus developed a novel artificial intelligence system based on deep learning (DL) and federated learning (FL) for the diagnosis, monitoring, and prediction of a patient's clinical course. METHODS CT imaging derived from 6 different multicenter cohorts were used for stepwise diagnostic algorithm to diagnose COVID-19, with or without clinical data. Patients with more than 3 consecutive CT images were trained for the monitoring algorithm. FL has been applied for decentralized refinement of independently built DL models. RESULTS A total of 1,552,988 CT slices from 4804 patients were used. The model can diagnose COVID-19 based on CT alone with the AUC being 0.98 (95% CI 0.97-0.99), and outperforms the radiologist's assessment. We have also successfully tested the incorporation of the DL diagnostic model with the FL framework. Its auto-segmentation analyses co-related well with those by radiologists and achieved a high Dice's coefficient of 0.77. It can produce a predictive curve of a patient's clinical course if serial CT assessments are available. INTERPRETATION The system has high consistency in diagnosing COVID-19 based on CT, with or without clinical data. Alternatively, it can be implemented on a FL platform, which would potentially encourage the data sharing in the future. It also can produce an objective predictive curve of a patient's clinical course for visualization. KEY POINTS • CoviDet could diagnose COVID-19 based on chest CT with high consistency; this outperformed the radiologist's assessment. Its auto-segmentation analyses co-related well with those by radiologists and could potentially monitor and predict a patient's clinical course if serial CT assessments are available. It can be integrated into the federated learning framework. • CoviDet can be used as an adjunct to aid clinicians with the CT diagnosis of COVID-19 and can potentially be used for disease monitoring; federated learning can potentially open opportunities for global collaboration.
Collapse
Affiliation(s)
- Hengrui Liang
- National Clinical Research Center for Respiratory Disease, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China.,Department of Thoracic Surgery, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China
| | - Yuchen Guo
- Institute for Brain and Cognitive Sciences, Tsinghua University, Beijing, 100084, China.,Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing, 100084, China
| | - Xiangru Chen
- Beijing XiaoBaiShiJi Network Technical Co., Ltd, Beijing, 100084, China
| | - Keng-Leong Ang
- Department of Thoracic Surgery, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China.,Department of Thoracic Surgery, Glenfield Hospital, Leicester, LE3 9QP, UK
| | - Yuwei He
- Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing, 100084, China.,School of Software, Tsinghua University, Beijing, 100084, China
| | - Na Jiang
- Department of Gastroenterology, Wuhan Hankou Hospital, Wuhan, 430000, China
| | - Qiang Du
- Beijing XiaoBaiShiJi Network Technical Co., Ltd, Beijing, 100084, China
| | - Qingsi Zeng
- National Clinical Research Center for Respiratory Disease, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China.,Department of Radiology, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China
| | - Ligong Lu
- Zhuhai Interventional Medical Center, Zhuhai Precision Medical Center, Zhuhai People's Hospital, Zhuhai Hospital Affiliated with Jinan University, Jinan University, Zhuhai, 519000, China
| | - Zebin Gao
- Beijing XiaoBaiShiJi Network Technical Co., Ltd, Beijing, 100084, China
| | - Linduo Li
- College of Engineering, Northeastern University, 360 Huntington Ave., Boston, MA, 02115, USA
| | - Quanzheng Li
- Department of Radiology, Massachusetts General Hospital, White-427 55 Fruit St, Boston, MA, 02114, USA
| | - Fangxing Nie
- Beijing XiaoBaiShiJi Network Technical Co., Ltd, Beijing, 100084, China
| | - Guiguang Ding
- Institute for Brain and Cognitive Sciences, Tsinghua University, Beijing, 100084, China.,Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing, 100084, China.,School of Software, Tsinghua University, Beijing, 100084, China
| | - Gao Huang
- Beijing XiaoBaiShiJi Network Technical Co., Ltd, Beijing, 100084, China.,School of Software, Tsinghua University, Beijing, 100084, China
| | - Ailan Chen
- National Clinical Research Center for Respiratory Disease, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China.,Department of Cardiology, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China
| | - Yimin Li
- National Clinical Research Center for Respiratory Disease, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China.,Department of Intensive Care Unit, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China
| | - Weijie Guan
- National Clinical Research Center for Respiratory Disease, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China
| | - Ling Sang
- National Clinical Research Center for Respiratory Disease, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China.,Department of Intensive Care Unit, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China
| | - Yuanda Xu
- National Clinical Research Center for Respiratory Disease, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China.,Department of Intensive Care Unit, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China
| | - Huai Chen
- National Clinical Research Center for Respiratory Disease, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China.,Department of Radiology, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China
| | - Zisheng Chen
- National Clinical Research Center for Respiratory Disease, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China
| | - Shiyue Li
- National Clinical Research Center for Respiratory Disease, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China
| | - Nuofu Zhang
- National Clinical Research Center for Respiratory Disease, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China
| | - Ying Chen
- National Clinical Research Center for Respiratory Disease, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China
| | - Danxia Huang
- National Clinical Research Center for Respiratory Disease, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China
| | - Run Li
- National Clinical Research Center for Respiratory Disease, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China
| | - Jianfu Li
- National Clinical Research Center for Respiratory Disease, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China.,Department of Thoracic Surgery, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China
| | - Bo Cheng
- National Clinical Research Center for Respiratory Disease, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China.,Department of Thoracic Surgery, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China
| | - Yi Zhao
- National Clinical Research Center for Respiratory Disease, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China.,Department of Thoracic Surgery, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China
| | - Caichen Li
- National Clinical Research Center for Respiratory Disease, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China.,Department of Thoracic Surgery, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China
| | - Shan Xiong
- National Clinical Research Center for Respiratory Disease, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China.,Department of Thoracic Surgery, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China
| | - Runchen Wang
- National Clinical Research Center for Respiratory Disease, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China.,Department of Thoracic Surgery, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China
| | - Jun Liu
- National Clinical Research Center for Respiratory Disease, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China.,Department of Thoracic Surgery, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China
| | - Wei Wang
- National Clinical Research Center for Respiratory Disease, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China.,Department of Thoracic Surgery, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China
| | - Jun Huang
- National Clinical Research Center for Respiratory Disease, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China.,Department of Thoracic Surgery, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China
| | - Fei Cui
- National Clinical Research Center for Respiratory Disease, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China.,Department of Thoracic Surgery, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China
| | - Tao Xu
- Biomanufacturing Center Department of Mechanical Engineering, Tsinghua University, Beijing, 100084, China
| | | | - Meixiao Zhan
- Zhuhai Interventional Medical Center, Zhuhai Precision Medical Center, Zhuhai People's Hospital, Zhuhai Hospital Affiliated with Jinan University, Jinan University, Zhuhai, 519000, China
| | - Yuanyi Huang
- Department of Radiology, Jingzhou Central Hospital, The Second Clinical Medical College, Yangtze University, Jingzhou, Hubei, China
| | - Qiang Yang
- Hong Kong University of Science and Technology and weBank, Hong Kong, China
| | - Qionghai Dai
- Institute for Brain and Cognitive Sciences, Tsinghua University, Beijing, 100084, China. .,Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing, 100084, China.
| | - Wenhua Liang
- National Clinical Research Center for Respiratory Disease, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China. .,Department of Thoracic Surgery, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China.
| | - Jianxing He
- National Clinical Research Center for Respiratory Disease, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China. .,Department of Thoracic Surgery, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China. .,South China Medical University, Guangzhou, 510000, China.
| | - Nanshan Zhong
- National Clinical Research Center for Respiratory Disease, the First Affiliated Hospital of Guangzhou Medical University, Guangzhou, 510120, China
| |
Collapse
|
133
|
Cengil E, Çınar A. The effect of deep feature concatenation in the classification problem: An approach on COVID-19 disease detection. INTERNATIONAL JOURNAL OF IMAGING SYSTEMS AND TECHNOLOGY 2022; 32:26-40. [PMID: 34898851 PMCID: PMC8653237 DOI: 10.1002/ima.22659] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/08/2021] [Revised: 08/04/2021] [Accepted: 09/16/2021] [Indexed: 06/01/2023]
Abstract
In image classification applications, the most important thing is to obtain useful features. Convolutional neural networks automatically learn the extracted features during training. The classification process is carried out with the obtained features. Therefore, obtaining successful features is critical to achieving high classification success. This article focuses on providing effective features to enhance classification performance. For this purpose, the success of the process of concatenating features in classification is taken as basis. At first, the features acquired by feature transfer method are extracted from AlexNet, Xception, NASNETLarge, and EfficientNet-B0 architectures, which are known to be successful in classification problems. Concatenating the features results in the creation of a new feature set. The method is completed by subjecting the features to various classification algorithms. The proposed pipeline is applied to the three datasets: "COVID-19 Image Dataset," "COVID-19 Pneumonia Normal Chest X-ray (PA) Dataset," and "COVID-19 Radiography Database" for COVID-19 disease detection. The whole datasets contain three classes (normal, COVID, and pneumonia). The best classification accuracies for the three datasets are 98.8%, 95.9%, and 99.6%, respectively. Performance metrics are given such as: sensitivity, precision, specificity, and F1-score values, as well. Contribution of paper is as follows: COVID-19 disease is similar to other lung infections. This situation makes diagnosis difficult. Furthermore, the virus's rapid spread necessitates the need to detect cases as soon as possible. There has been an increased curiosity in computer-aided deep learning models to provide the requirements. The use of the proposed method will be beneficial as it provides high accuracy.
Collapse
Affiliation(s)
- Emine Cengil
- Department of Computer Engineering, Faculty of EngineeringFirat UniversityElazigTurkey
| | - Ahmet Çınar
- Department of Computer Engineering, Faculty of EngineeringFirat UniversityElazigTurkey
| |
Collapse
|
134
|
Huang Z, Lei H, Chen G, Li H, Li C, Gao W, Chen Y, Wang Y, Xu H, Ma G, Lei B. Multi-center sparse learning and decision fusion for automatic COVID-19 diagnosis. Appl Soft Comput 2022; 115:108088. [PMID: 34840541 PMCID: PMC8611958 DOI: 10.1016/j.asoc.2021.108088] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2021] [Revised: 10/18/2021] [Accepted: 11/07/2021] [Indexed: 12/30/2022]
Abstract
The coronavirus disease 2019 (COVID-19) pandemic caused by the novel severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) has led to a sharp increase in hospitalized patients with multi-organ disease pneumonia. Early and automatic diagnosis of COVID-19 is essential to slow down the spread of this epidemic and reduce the mortality of patients infected with SARS-CoV-2. In this paper, we propose a joint multi-center sparse learning (MCSL) and decision fusion scheme exploiting chest CT images for automatic COVID-19 diagnosis. Specifically, considering the inconsistency of data in multiple centers, we first convert CT images into histogram of oriented gradient (HOG) images to reduce the structural differences between multi-center data and enhance the generalization performance. We then exploit a 3-dimensional convolutional neural network (3D-CNN) model to learn the useful information between and within 3D HOG image slices and extract multi-center features. Furthermore, we employ the proposed MCSL method that learns the intrinsic structure between multiple centers and within each center, which selects discriminative features to jointly train multi-center classifiers. Finally, we fuse these decisions made by these classifiers. Extensive experiments are performed on chest CT images from five centers to validate the effectiveness of the proposed method. The results demonstrate that the proposed method can improve COVID-19 diagnosis performance and outperform the state-of-the-art methods.
Collapse
Affiliation(s)
- Zhongwei Huang
- Key Laboratory of Service Computing and Applications, Guangdong Province Key Laboratory of Popular High Performance Computers, Guangdong Province Engineering Center of China-made High Performance Data Computing System, Guangdong Laboratory of Artificial-Intelligence and Cyber-Economics, College of Computer Science and Software Engineering, Shenzhen University, Shenzhen, China
| | - Haijun Lei
- Key Laboratory of Service Computing and Applications, Guangdong Province Key Laboratory of Popular High Performance Computers, Guangdong Province Engineering Center of China-made High Performance Data Computing System, Guangdong Laboratory of Artificial-Intelligence and Cyber-Economics, College of Computer Science and Software Engineering, Shenzhen University, Shenzhen, China
| | - Guoliang Chen
- Key Laboratory of Service Computing and Applications, Guangdong Province Key Laboratory of Popular High Performance Computers, Guangdong Province Engineering Center of China-made High Performance Data Computing System, Guangdong Laboratory of Artificial-Intelligence and Cyber-Economics, College of Computer Science and Software Engineering, Shenzhen University, Shenzhen, China
| | - Haimei Li
- Department of Radiology, Fu Xing Hospital, Capital Medical University, Beijing, China
| | - Chuandong Li
- Department of Radiology, China-Japan Friendship Hospital, Beijing, China
| | - Wenwen Gao
- Department of Radiology, China-Japan Friendship Hospital, Beijing, China
| | - Yue Chen
- Department of Radiology, China-Japan Friendship Hospital, Beijing, China
| | - Yaofa Wang
- Minfound Medical Systems Co., Ltd., Hangzhou, China
| | - Haibo Xu
- Department of Radiology, Zhongnan Hospital of Wuhan University, Wuhan, China
| | - Guolin Ma
- Department of Radiology, China-Japan Friendship Hospital, Beijing, China
| | - Baiying Lei
- National- Regional Key Technology Engineering Laboratory for Medical Ultrasound, Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging, School of Biomedical Engineering, Health Science Center, Shenzhen University, Shenzhen, China
| |
Collapse
|
135
|
Saeedi S, Rezayi S, Ghazisaeedi M, Kalhori SN. Artificial intelligence approaches on X-ray-oriented images process for early detection of COVID-19. JOURNAL OF MEDICAL SIGNALS & SENSORS 2022; 12:233-253. [PMID: 36120399 PMCID: PMC9480507 DOI: 10.4103/jmss.jmss_111_21] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2021] [Revised: 10/28/2021] [Accepted: 01/03/2022] [Indexed: 12/04/2022]
Abstract
Background: COVID-19 is a global public health problem that is crucially important to be diagnosed in the early stages. This study aimed to investigate the use of artificial intelligence (AI) to process X-ray-oriented images to diagnose COVID-19 disease. Methods: A systematic search was conducted in Medline (through PubMed), Scopus, ISI Web of Science, Cochrane Library, and IEEE Xplore Digital Library to identify relevant studies published until 21 September 2020. Results: We identified 208 papers after duplicate removal and filtered them into 60 citations based on inclusion and exclusion criteria. Direct results sufficiently indicated a noticeable increase in the number of published papers in July-2020. The most widely used datasets were, respectively, GitHub repository, hospital-oriented datasets, and Kaggle repository. The Keras library, Tensorflow, and Python had been also widely employed in articles. X-ray images were applied more in the selected articles. The most considerable value of accuracy, sensitivity, specificity, and Area under the ROC Curve was reported for ResNet18 in reviewed techniques; all the mentioned indicators for this mentioned network were equal to one (100%). Conclusion: This review revealed that the application of AI can accelerate the process of diagnosing COVID-19, and these methods are effective for the identification of COVID-19 cases exploiting Chest X-ray images.
Collapse
|
136
|
Nagaoka T, Kozuka T, Yamada T, Habe H, Nemoto M, Tada M, Abe K, Handa H, Yoshida H, Ishii K, Kimura Y. A Deep Learning System to Diagnose COVID-19 Pneumonia Using Masked Lung CT Images to Avoid AI-generated COVID-19 Diagnoses that Include Data outside the Lungs. ADVANCED BIOMEDICAL ENGINEERING 2022. [DOI: 10.14326/abe.11.76] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022] Open
Affiliation(s)
- Takashi Nagaoka
- Department of Computational Systems Biology, Faculty of Biology-Oriented Science and Technology, Kindai University
| | - Takenori Kozuka
- Department of Radiology, Kindai University Faculty of Medicine
| | - Takahiro Yamada
- Institute of Advanced Clinical Medicine, Kindai University Hospital
| | - Hitoshi Habe
- Department of Informatics, Faculty of Science and Technology, Kindai University
| | - Mitsutaka Nemoto
- Department of Biomedical Engineering, Faculty of Biology-Oriented Science and Technology, Kindai University
| | - Masahiro Tada
- Department of Informatics, Faculty of Science and Technology, Kindai University
| | - Koji Abe
- Department of Informatics, Faculty of Science and Technology, Kindai University
| | - Hisashi Handa
- Department of Informatics, Faculty of Science and Technology, Kindai University
| | - Hisashi Yoshida
- Department of Computational Systems Biology, Faculty of Biology-Oriented Science and Technology, Kindai University
| | - Kazunari Ishii
- Institute of Advanced Clinical Medicine, Kindai University Hospital
| | - Yuichi Kimura
- Department of Computational Systems Biology, Faculty of Biology-Oriented Science and Technology, Kindai University
| |
Collapse
|
137
|
Kumari M, Singla M, Sobti RC. Animal models and their substitutes in biomedical research. ADVANCES IN ANIMAL EXPERIMENTATION AND MODELING 2022:87-101. [DOI: 10.1016/b978-0-323-90583-1.00014-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/05/2025]
|
138
|
Bali A, Bali N. Role of artificial intelligence in fast-track drug discovery and vaccine development for COVID-19. NOVEL AI AND DATA SCIENCE ADVANCEMENTS FOR SUSTAINABILITY IN THE ERA OF COVID-19 2022. [PMCID: PMC9069021 DOI: 10.1016/b978-0-323-90054-6.00006-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 12/02/2022]
Abstract
COVID-19 is a global pandemic spread across more than 200 countries and several measures are being taken to control it. Researchers in pharmaceutical academia/industry are incessantly targeting this disease through vaccine and drug development protocols. Artificial intelligence is being extensively explored for surveillance, diagnostics, contact tracing, and for clinical management of COVID-19. The most common application has been for repurposing of existing drugs through various AI tools. Successful training of artificial neural networks based on identification of specific patterns in binding of known antiviral drugs with protein sequences from diverse virus species have generated models giving good predictions for molecules against SARS-CoV-2 virus, in sync with clinical studies. ML tools have also been used to investigate immunogenic components of the virus to be exploited as vaccine candidates. In this chapter, the utilization of artificial intelligence to accelerate drug-design and vaccine design research for COVID-19 has been reviewed.
Collapse
|
139
|
Deep learning-based hybrid models for prediction of COVID-19 using chest X-ray. NOVEL AI AND DATA SCIENCE ADVANCEMENTS FOR SUSTAINABILITY IN THE ERA OF COVID-19 2022. [PMCID: PMC9069059 DOI: 10.1016/b978-0-323-90054-6.00001-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
Abstract
The ongoing COVID-19 virus infection has ended up being the biggest pandemic to hit mankind in the last century. It has infected in excess of 50 Million across the globe and has taken in excess of 1.5 Million lives. It has posed problems even to the best healthcare systems across the globe. The best way to reduce the spread and damage of COVID-19 is by early detection of the infection and quarantining the infected patients with necessary medical care. COVID-19 infection can be detected by a chest X-ray. With limited rapid COVID-19 testing kits, this approach of detection with the aid of deep learning can be adopted. The only problem being, the side effects of COVID-19 infection imitate those of conventional Pneumonia, which adds some complexity in utilizing the Chest X-rays for its prediction. In this investigation, we attempt to investigate four approaches i.e., Feature Ensemble, Feature Extraction, Layer Modification and weighted Max voting utilizing State of the Art pre-trained models to accurately identify between COVID-19 Pneumonia, Non-COVID-19 Pneumonia, and Healthy Chest X-ray images. Since very few images of patients with COVID-19 are publicly available, we utilized combinations of image processing and data augmentation methods to build more samples to improve the quality of predictions. Our best model i.e., Modified VGG-16, has achieved an accuracy of 99.5216%. More importantly, this model did not predict a False Negative Normal (i.e., infected case predicted as normal), making it the most attractive feature of the study. The establishment of such an approach will be useful to predict the outbreak early, which in turn can aid in controlling it effectively.
Collapse
|
140
|
Mahanty C, Kumar R, Patro SGK. Internet of Medical Things-Based COVID-19 Detection in CT Images Fused with Fuzzy Ensemble and Transfer Learning Models. NEW GENERATION COMPUTING 2022; 40:1125-1141. [PMID: 35730008 PMCID: PMC9202670 DOI: 10.1007/s00354-022-00176-0] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/29/2022] [Accepted: 05/24/2022] [Indexed: 05/12/2023]
Abstract
One of the most difficult research areas in today's healthcare industry to combat the coronavirus pandemic is accurate COVID-19 detection. Because of its low infection miss rate and high sensitivity, chest computed tomography (CT) imaging has been recommended as a viable technique for COVID-19 diagnosis in a number of recent clinical investigations. This article presents an Internet of Medical Things (IoMT)-based platform for improving and speeding up COVID-19 identification. Clinical devices are connected to network resources in the suggested IoMT platform using cloud computing. The method enables patients and healthcare experts to work together in real time to diagnose and treat COVID-19, potentially saving time and effort for both patients and physicians. In this paper, we introduce a technique for classifying chest CT scan images into COVID, pneumonia, and normal classes that use a Sugeno fuzzy integral ensemble across three transfer learning models, namely SqueezeNet, DenseNet-201, and MobileNetV2. The suggested fuzzy ensemble techniques outperform each individual transfer learning methodology as well as trainable ensemble strategies in terms of accuracy. The suggested MobileNetV2 fused with Sugeno fuzzy integral ensemble model has a 99.15% accuracy rate. In the present research, this framework was utilized to identify COVID-19, but it may also be implemented and used for medical imaging analyses of other disorders.
Collapse
Affiliation(s)
| | - Raghvendra Kumar
- Department of Computer Science and Engineering, GIET University, Gunupur, India
| | - S. Gopal Krishna Patro
- Department of Computer Science and Engineering, Koneru Lakshmaiah Education Foundation, Vaddeswaram, Andhra Pradesh India
| |
Collapse
|
141
|
Attallah O. A computer-aided diagnostic framework for coronavirus diagnosis using texture-based radiomics images. Digit Health 2022; 8:20552076221092543. [PMID: 35433024 PMCID: PMC9005822 DOI: 10.1177/20552076221092543] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2022] [Accepted: 03/21/2022] [Indexed: 12/14/2022] Open
Abstract
The accurate and rapid detection of the novel coronavirus infection, coronavirus is very important to prevent the fast spread of such disease. Thus, reducing negative effects that influenced many industrial sectors, especially healthcare. Artificial intelligence techniques in particular deep learning could help in the fast and precise diagnosis of coronavirus from computed tomography images. Most artificial intelligence-based studies used the original computed tomography images to build their models; however, the integration of texture-based radiomics images and deep learning techniques could improve the diagnostic accuracy of the novel coronavirus diseases. This study proposes a computer-assisted diagnostic framework based on multiple deep learning and texture-based radiomics approaches. It first trains three Residual Networks (ResNets) deep learning techniques with two texture-based radiomics images including discrete wavelet transform and gray-level covariance matrix instead of the original computed tomography images. Then, it fuses the texture-based radiomics deep features sets extracted from each using discrete cosine transform. Thereafter, it further combines the fused texture-based radiomics deep features obtained from the three convolutional neural networks. Finally, three support vector machine classifiers are utilized for the classification procedure. The proposed method is validated experimentally on the benchmark severe respiratory syndrome coronavirus 2 computed tomography image dataset. The accuracies attained indicate that using texture-based radiomics (gray-level covariance matrix, discrete wavelet transform) images for training the ResNet-18 (83.22%, 74.9%), ResNet-50 (80.94%, 78.39%), and ResNet-101 (80.54%, 77.99%) is better than using the original computed tomography images (70.34%, 76.51%, and 73.42%) for ResNet-18, ResNet-50, and ResNet-101, respectively. Furthermore, the sensitivity, specificity, accuracy, precision, and F1-score achieved using the proposed computer-assisted diagnostic after the two fusion steps are 99.47%, 99.72%, 99.60%, 99.72%, and 99.60% which proves that combining texture-based radiomics deep features obtained from the three ResNets has boosted its performance. Thus, fusing multiple texture-based radiomics deep features mined from several convolutional neural networks is better than using only one type of radiomics approach and a single convolutional neural network. The performance of the proposed computer-assisted diagnostic framework allows it to be used by radiologists in attaining fast and accurate diagnosis.
Collapse
Affiliation(s)
- Omneya Attallah
- Department of Electronics and Communications Engineering, College of Engineering and Technology, Arab Academy for Science, Technology and Maritime Transport, Alexandria, Egypt
| |
Collapse
|
142
|
Shiri I, Arabi H, Salimi Y, Sanaat A, Akhavanallaf A, Hajianfar G, Askari D, Moradi S, Mansouri Z, Pakbin M, Sandoughdaran S, Abdollahi H, Radmard AR, Rezaei‐Kalantari K, Ghelich Oghli M, Zaidi H. COLI-Net: Deep learning-assisted fully automated COVID-19 lung and infection pneumonia lesion detection and segmentation from chest computed tomography images. INTERNATIONAL JOURNAL OF IMAGING SYSTEMS AND TECHNOLOGY 2022; 32:12-25. [PMID: 34898850 PMCID: PMC8652855 DOI: 10.1002/ima.22672] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/10/2021] [Revised: 09/18/2021] [Accepted: 10/17/2021] [Indexed: 05/17/2023]
Abstract
We present a deep learning (DL)-based automated whole lung and COVID-19 pneumonia infectious lesions (COLI-Net) detection and segmentation from chest computed tomography (CT) images. This multicenter/multiscanner study involved 2368 (347'259 2D slices) and 190 (17 341 2D slices) volumetric CT exams along with their corresponding manual segmentation of lungs and lesions, respectively. All images were cropped, resized, and the intensity values clipped and normalized. A residual network with non-square Dice loss function built upon TensorFlow was employed. The accuracy of lung and COVID-19 lesions segmentation was evaluated on an external reverse transcription-polymerase chain reaction positive COVID-19 dataset (7'333 2D slices) collected at five different centers. To evaluate the segmentation performance, we calculated different quantitative metrics, including radiomic features. The mean Dice coefficients were 0.98 ± 0.011 (95% CI, 0.98-0.99) and 0.91 ± 0.038 (95% CI, 0.90-0.91) for lung and lesions segmentation, respectively. The mean relative Hounsfield unit differences were 0.03 ± 0.84% (95% CI, -0.12 to 0.18) and -0.18 ± 3.4% (95% CI, -0.8 to 0.44) for the lung and lesions, respectively. The relative volume difference for lung and lesions were 0.38 ± 1.2% (95% CI, 0.16-0.59) and 0.81 ± 6.6% (95% CI, -0.39 to 2), respectively. Most radiomic features had a mean relative error less than 5% with the highest mean relative error achieved for the lung for the range first-order feature (-6.95%) and least axis length shape feature (8.68%) for lesions. We developed an automated DL-guided three-dimensional whole lung and infected regions segmentation in COVID-19 patients to provide fast, consistent, robust, and human error immune framework for lung and pneumonia lesion detection and quantification.
Collapse
Affiliation(s)
- Isaac Shiri
- Division of Nuclear Medicine and Molecular ImagingGeneva University HospitalGenevaSwitzerland
| | - Hossein Arabi
- Division of Nuclear Medicine and Molecular ImagingGeneva University HospitalGenevaSwitzerland
| | - Yazdan Salimi
- Division of Nuclear Medicine and Molecular ImagingGeneva University HospitalGenevaSwitzerland
| | - Amirhossein Sanaat
- Division of Nuclear Medicine and Molecular ImagingGeneva University HospitalGenevaSwitzerland
| | - Azadeh Akhavanallaf
- Division of Nuclear Medicine and Molecular ImagingGeneva University HospitalGenevaSwitzerland
| | - Ghasem Hajianfar
- Rajaie Cardiovascular Medical and Research CenterIran University of Medical SciencesTehranIran
| | - Dariush Askari
- Department of Radiology TechnologyShahid Beheshti University of Medical SciencesTehranIran
| | - Shakiba Moradi
- Research and Development DepartmentMed Fanavaran Plus Co.KarajIran
| | - Zahra Mansouri
- Division of Nuclear Medicine and Molecular ImagingGeneva University HospitalGenevaSwitzerland
| | - Masoumeh Pakbin
- Clinical Research Development CenterQom University of Medical SciencesQomIran
| | - Saleh Sandoughdaran
- Men's Health and Reproductive Health Research CenterShahid Beheshti University of Medical SciencesTehranIran
| | - Hamid Abdollahi
- Department of Radiologic Technology, Faculty of Allied MedicineKerman University of Medical SciencesKermanIran
| | - Amir Reza Radmard
- Department of RadiologyShariati Hospital, Tehran University of Medical SciencesTehranIran
| | - Kiara Rezaei‐Kalantari
- Rajaie Cardiovascular Medical and Research CenterIran University of Medical SciencesTehranIran
| | - Mostafa Ghelich Oghli
- Research and Development DepartmentMed Fanavaran Plus Co.KarajIran
- Department of Cardiovascular SciencesKU LeuvenLeuvenBelgium
| | - Habib Zaidi
- Division of Nuclear Medicine and Molecular ImagingGeneva University HospitalGenevaSwitzerland
- Geneva University NeurocenterGeneva UniversityGenevaSwitzerland
- Department of Nuclear Medicine and Molecular ImagingUniversity of Groningen, University Medical Center GroningenGroningenNetherlands
- Department of Nuclear MedicineUniversity of Southern DenmarkOdenseDenmark
| |
Collapse
|
143
|
Moujahid H, Cherradi B, Al-Sarem M, Bahatti L, Bakr Assedik Mohammed Yahya Eljialy A, Alsaeedi A, Saeed F. Combining CNN and Grad-Cam for COVID-19 Disease Prediction and Visual Explanation. INTELLIGENT AUTOMATION & SOFT COMPUTING 2022; 32:723-745. [DOI: 10.32604/iasc.2022.022179] [Citation(s) in RCA: 16] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/30/2021] [Accepted: 09/02/2021] [Indexed: 06/15/2023]
|
144
|
AIM in Respiratory Disorders. Artif Intell Med 2022. [DOI: 10.1007/978-3-030-64573-1_178] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
|
145
|
Mansour NA, Saleh AI, Badawy M, Ali HA. Accurate detection of Covid-19 patients based on Feature Correlated Naïve Bayes (FCNB) classification strategy. JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING 2022; 13:41-73. [PMID: 33469467 PMCID: PMC7809685 DOI: 10.1007/s12652-020-02883-2] [Citation(s) in RCA: 26] [Impact Index Per Article: 8.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/22/2020] [Accepted: 12/23/2020] [Indexed: 05/03/2023]
Abstract
The outbreak of Coronavirus (COVID-19) has spread between people around the world at a rapid rate so that the number of infected people and deaths is increasing quickly every day. Accordingly, it is a vital process to detect positive cases at an early stage for treatment and controlling the disease from spreading. Several medical tests had been applied for COVID-19 detection in certain injuries, but with limited efficiency. In this study, a new COVID-19 diagnosis strategy called Feature Correlated Naïve Bayes (FCNB) has been introduced. The FCNB consists of four phases, which are; Feature Selection Phase (FSP), Feature Clustering Phase (FCP), Master Feature Weighting Phase (MFWP), and Feature Correlated Naïve Bayes Phase (FCNBP). The FSP selects only the most effective features among the extracted features from laboratory tests for both COVID-19 patients and non-COVID-19 people by using the Genetic Algorithm as a wrapper method. The FCP constructs many clusters of features based on the selected features from FSP by using a novel clustering technique. These clusters of features are called Master Features (MFs) in which each MF contains a set of dependent features. The MFWP assigns a weight value to each MF by using a new weight calculation method. The FCNBP is used to classify patients based on the weighted Naïve Bayes algorithm with many modifications as the correlation between features. The proposed FCNB strategy has been compared to recent competitive techniques. Experimental results have proven the effectiveness of the FCNB strategy in which it outperforms recent competitive techniques because it achieves the maximum (99%) detection accuracy.
Collapse
Affiliation(s)
- Nehal A. Mansour
- Nile Higher Institute for Engineering and Technology, Mansoura, Egypt
| | - Ahmed I. Saleh
- Computers and Control Department, Faculty of Engineering, Mansoura University, Mansoura, Egypt
| | - Mahmoud Badawy
- Computers and Control Department, Faculty of Engineering, Mansoura University, Mansoura, Egypt
| | - Hesham A. Ali
- Computers and Control Department, Faculty of Engineering, Mansoura University, Mansoura, Egypt
| |
Collapse
|
146
|
Kardos AS, Simon J, Nardocci C, Szabó IV, Nagy N, Abdelrahman RH, Zsarnóczay E, Fejér B, Futácsi B, Müller V, Merkely B, Maurovich-Horvat P. The diagnostic performance of deep-learning-based CT severity score to identify COVID-19 pneumonia. Br J Radiol 2022; 95:20210759. [PMID: 34889645 PMCID: PMC8722241 DOI: 10.1259/bjr.20210759] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/01/2023] Open
Abstract
Objective: To determine the diagnostic accuracy of a deep-learning (DL)-based algorithm using chest computed tomography (CT) scans for the rapid diagnosis of coronavirus disease 2019 (COVID-19), as compared to the reference standard reverse-transcription polymerase chain reaction (RT-PCR) test. Methods: In this retrospective analysis, data of COVID-19 suspected patients who underwent RT-PCR and chest CT examination for the diagnosis of COVID-19 were assessed. By quantifying the affected area of the lung parenchyma, severity score was evaluated for each lobe of the lung with the DL-based algorithm. The diagnosis was based on the total lung severity score ranging from 0 to 25. The data were randomly split into a 40% training set and a 60% test set. Optimal cut-off value was determined using Youden-index method on the training cohort. Results: A total of 1259 patients were enrolled in this study. The prevalence of RT-PCR positivity in the overall investigated period was 51.5%. As compared to RT-PCR, sensitivity, specificity, positive predictive value, negative predictive value and accuracy on the test cohort were 39.0%, 80.2%, 68.0%, 55.0% and 58.9%, respectively. Regarding the whole data set, when adding those with positive RT-PCR test at any time during hospital stay or “COVID-19 without virus detection”, as final diagnosis to the true positive cases, specificity increased from 80.3% to 88.1% and the positive predictive value increased from 68.4% to 81.7%. Conclusion: DL-based CT severity score was found to have a good specificity and positive predictive value, as compared to RT-PCR. This standardized scoring system can aid rapid diagnosis and clinical decision making. Advances in knowledge: DL-based CT severity score can detect COVID-19-related lung alterations even at early stages, when RT-PCR is not yet positive.
Collapse
Affiliation(s)
- Anna Sára Kardos
- Medical Imaging Centre, Semmelweis University, Budapest, Hungary.,MTA-SE Cardiovascular Imaging Research Group, Heart and Vascular Center, Semmelweis University, Budapest, Hungary
| | - Judit Simon
- Medical Imaging Centre, Semmelweis University, Budapest, Hungary.,MTA-SE Cardiovascular Imaging Research Group, Heart and Vascular Center, Semmelweis University, Budapest, Hungary
| | - Chiara Nardocci
- Medical Imaging Centre, Semmelweis University, Budapest, Hungary
| | | | - Norbert Nagy
- Medical Imaging Centre, Semmelweis University, Budapest, Hungary
| | | | - Emese Zsarnóczay
- Medical Imaging Centre, Semmelweis University, Budapest, Hungary.,MTA-SE Cardiovascular Imaging Research Group, Heart and Vascular Center, Semmelweis University, Budapest, Hungary
| | - Bence Fejér
- Medical Imaging Centre, Semmelweis University, Budapest, Hungary
| | - Balázs Futácsi
- Medical Imaging Centre, Semmelweis University, Budapest, Hungary
| | - Veronika Müller
- Department of Pulmonology, Semmelweis University, Budapest, Hungary
| | - Béla Merkely
- MTA-SE Cardiovascular Imaging Research Group, Heart and Vascular Center, Semmelweis University, Budapest, Hungary
| | - Pál Maurovich-Horvat
- Medical Imaging Centre, Semmelweis University, Budapest, Hungary.,MTA-SE Cardiovascular Imaging Research Group, Heart and Vascular Center, Semmelweis University, Budapest, Hungary
| |
Collapse
|
147
|
Wang L, Yin Z, Puppala M, Ezeana C, Wong K, He T, Gotur D, Wong S. A Time-Series Feature-based Recursive Classification Model to Optimize Treatment Strategies for Improving Outcomes and Resource Allocations of COVID-19 Patients. IEEE J Biomed Health Inform 2021; 26:3323-3329. [PMID: 34971548 DOI: 10.1109/jbhi.2021.3139773] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/08/2023]
Abstract
This paper presents a novel Lasso Logistic Regression model based on feature-based time series data to determine disease severity and when to administer drugs or escalate intervention procedures in patients with coronavirus disease 2019 (COVID-19). Advanced features were extracted from highly enriched and time series vital sign data of hospitalized COVID-19 patients, including oxygen saturation readings, and with a combination of patient demographic and comorbidity information, as inputs into the dynamic feature-based classification model. Such dynamic combinations brought deep insights to guide clinical decision-making of complex COVID-19 cases, including prognosis prediction, timing of drug administration, admission to intensive care units, and application of intervention procedures like ventilation and intubation. The COVID-19 patient classification model was developed utilizing 900 hospitalized COVID-19 patients in a leading multi-hospital system in Texas, United States. By providing mortality prediction based on time-series physiologic data, demographics, and clinical records of individual COVID-19 patients, the dynamic feature-based classification model can be used to improve efficacy of the COVID-19 patient treatment, prioritize medical resources, and reduce casualties. The uniqueness of our model is that it is based on just the first 24 hours of vital sign data such that clinical interventions can be decided early and applied effectively. Such a strategy could be extended to prioritize resource allocations and drug treatment for future pandemic events.
Collapse
|
148
|
Ragab M, Eljaaly K, Alhakamy NA, Alhadrami HA, Bahaddad AA, Abo-Dahab SM, Khalil EM. Deep Ensemble Model for COVID-19 Diagnosis and Classification Using Chest CT Images. BIOLOGY 2021; 11:43. [PMID: 35053041 PMCID: PMC8773139 DOI: 10.3390/biology11010043] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/19/2021] [Revised: 12/09/2021] [Accepted: 12/21/2021] [Indexed: 01/04/2023]
Abstract
Coronavirus disease 2019 (COVID-19) has spread worldwide, and medicinal resources have become inadequate in several regions. Computed tomography (CT) scans are capable of achieving precise and rapid COVID-19 diagnosis compared to the RT-PCR test. At the same time, artificial intelligence (AI) techniques, including machine learning (ML) and deep learning (DL), find it useful to design COVID-19 diagnoses using chest CT scans. In this aspect, this study concentrates on the design of an artificial intelligence-based ensemble model for the detection and classification (AIEM-DC) of COVID-19. The AIEM-DC technique aims to accurately detect and classify the COVID-19 using an ensemble of DL models. In addition, Gaussian filtering (GF)-based preprocessing technique is applied for the removal of noise and improve image quality. Moreover, a shark optimization algorithm (SOA) with an ensemble of DL models, namely recurrent neural networks (RNN), long short-term memory (LSTM), and gated recurrent unit (GRU), is employed for feature extraction. Furthermore, an improved bat algorithm with a multiclass support vector machine (IBA-MSVM) model is applied for the classification of CT scans. The design of the ensemble model with optimal parameter tuning of the MSVM model for COVID-19 classification shows the novelty of the work. The effectiveness of the AIEM-DC technique take place on benchmark CT image data set, and the results reported the promising classification performance of the AIEM-DC technique over the recent state-of-the-art approaches.
Collapse
Affiliation(s)
- Mahmoud Ragab
- Information Technology Department, Faculty of Computing and Information Technology, King Abdulaziz University, Jeddah 21589, Saudi Arabia
- Centre of Artificial Intelligence for Precision Medicines, King Abdulaziz University, Jeddah 21589, Saudi Arabia
| | - Khalid Eljaaly
- Department of Pharmacy Practice, Faculty of Pharmacy, King Abdulaziz University, Jeddah 21589, Saudi Arabia;
| | - Nabil A. Alhakamy
- Department of Pharmaceutics, Faculty of Pharmacy, King Abdulaziz University, Jeddah 21589, Saudi Arabia;
- Center of Excellence for Drug Research and Pharmaceutical Industries, King Abdulaziz University, Jeddah 21589, Saudi Arabia
- Mohamed Saeed Tamer Chair for Pharmaceutical Industries, King Abdulaziz University, Jeddah 21589, Saudi Arabia
| | - Hani A. Alhadrami
- Department of Medical Laboratory Technology, Faculty of Applied Medical Sciences, King Abdulaziz University, Jeddah 21589, Saudi Arabia;
- Molecular Diagnostic Lab, King Abdulaziz University Hospital, King Abdulaziz University, Jeddah 21589, Saudi Arabia
- Special Infectious Agent Unit, King Fahd Medical Research Center, King Abdulaziz University, Jeddah 21589, Saudi Arabia
| | - Adel A. Bahaddad
- Information Systems Department, Faculty of Computing and Information Technology, King Abdulaziz University, Jeddah 21589, Saudi Arabia;
| | - Sayed M. Abo-Dahab
- Mathematics Department, Faculty of Science, South Valley University, Qena 83523, Egypt;
| | - Eied M. Khalil
- Department of Mathematics, Faculty of Science, Al-Azhar University, Cairo 11884, Egypt;
- Department of Mathematics, College of Science, Taif University, Taif 21944, Saudi Arabia
| |
Collapse
|
149
|
Khan M, Mehran MT, Haq ZU, Ullah Z, Naqvi SR, Ihsan M, Abbass H. Applications of artificial intelligence in COVID-19 pandemic: A comprehensive review. EXPERT SYSTEMS WITH APPLICATIONS 2021; 185:115695. [PMID: 34400854 PMCID: PMC8359727 DOI: 10.1016/j.eswa.2021.115695] [Citation(s) in RCA: 60] [Impact Index Per Article: 15.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/02/2021] [Revised: 05/14/2021] [Accepted: 07/28/2021] [Indexed: 05/06/2023]
Abstract
During the current global public health emergency caused by novel coronavirus disease 19 (COVID-19), researchers and medical experts started working day and night to search for new technologies to mitigate the COVID-19 pandemic. Recent studies have shown that artificial intelligence (AI) has been successfully employed in the health sector for various healthcare procedures. This study comprehensively reviewed the research and development on state-of-the-art applications of artificial intelligence for combating the COVID-19 pandemic. In the process of literature retrieval, the relevant literature from citation databases including ScienceDirect, Google Scholar, and Preprints from arXiv, medRxiv, and bioRxiv was selected. Recent advances in the field of AI-based technologies are critically reviewed and summarized. Various challenges associated with the use of these technologies are highlighted and based on updated studies and critical analysis, research gaps and future recommendations are identified and discussed. The comparison between various machine learning (ML) and deep learning (DL) methods, the dominant AI-based technique, mostly used ML and DL methods for COVID-19 detection, diagnosis, screening, classification, drug repurposing, prediction, and forecasting, and insights about where the current research is heading are highlighted. Recent research and development in the field of artificial intelligence has greatly improved the COVID-19 screening, diagnostics, and prediction and results in better scale-up, timely response, most reliable, and efficient outcomes, and sometimes outperforms humans in certain healthcare tasks. This review article will help researchers, healthcare institutes and organizations, government officials, and policymakers with new insights into how AI can control the COVID-19 pandemic and drive more research and studies for mitigating the COVID-19 outbreak.
Collapse
Affiliation(s)
- Muzammil Khan
- School of Chemical & Materials Engineering, National University of Sciences & Technology, H-12, Islamabad 44000, Pakistan
| | - Muhammad Taqi Mehran
- School of Chemical & Materials Engineering, National University of Sciences & Technology, H-12, Islamabad 44000, Pakistan
| | - Zeeshan Ul Haq
- School of Chemical & Materials Engineering, National University of Sciences & Technology, H-12, Islamabad 44000, Pakistan
| | - Zahid Ullah
- School of Chemical & Materials Engineering, National University of Sciences & Technology, H-12, Islamabad 44000, Pakistan
| | - Salman Raza Naqvi
- School of Chemical & Materials Engineering, National University of Sciences & Technology, H-12, Islamabad 44000, Pakistan
| | - Mehreen Ihsan
- Peshawar Medical College, Peshawar, Khyber Pakhtunkhwa 25000, Pakistan
| | - Haider Abbass
- National Cyber Security Auditing and Evaluation LAb, National University of Sciences & Technology, MCS Campus, Rawalpindi 43600, Pakistan
| |
Collapse
|
150
|
Verma AK, Vamsi I, Saurabh P, Sudha R, G R S, S R. Wavelet and deep learning-based detection of SARS-nCoV from thoracic X-ray images for rapid and efficient testing. EXPERT SYSTEMS WITH APPLICATIONS 2021; 185:115650. [PMID: 34366576 PMCID: PMC8327617 DOI: 10.1016/j.eswa.2021.115650] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/21/2021] [Revised: 06/02/2021] [Accepted: 07/20/2021] [Indexed: 05/07/2023]
Abstract
This paper proposes a wavelet and artificial intelligence-enabled rapid and efficient testing procedure for patients with Severe Acute Respiratory Coronavirus Syndrome (SARS-nCoV) through a deep learning approach from thoracic X-ray images. Presently, the virus infection is diagnosed primarily by a process called the real-time Reverse Transcriptase-Polymerase Chain Reaction (rRT-PCR) based on its genetic prints. This whole procedure takes a substantial amount of time to identify and diagnose the patients infected by the virus. The proposed research uses a wavelet-based convolution neural network architectures to detect SARS-nCoV. CNN is pre-trained on the ImageNet and trained end-to-end using thoracic X-ray images. To execute Discrete Wavelet Transforms (DWT), the available mother wavelet functions from different families, namely Haar, Daubechies, Symlet, Biorthogonal, Coiflet, and Discrete Meyer, were considered. Two-level decomposition via DWT is adopted to extract prominent features peripheral and subpleural ground-glass opacities, often in the lower lobes explicitly from thoracic X-ray images to suppress noise effect, further enhancing the signal to noise ratio. The proposed wavelet-based deep learning models of both, two-class instances (COVID vs. Normal) and four-class instances (COVID-19 vs. PNA bacterial vs. PNA viral vs. Normal) were validated from publicly available databases using k-Fold Cross Validation (k-Fold CV) technique. In addition to these X-ray images, images of recent COVID-19 patients were further used to examine the model's practicality and real-time feasibility in combating the current pandemic situation. It was observed that the Symlet 7 approximation component with two-level manifested the highest test accuracy of 98.87%, followed by Biorthogonal 2.6 with an efficiency of 98.73%. While the test accuracy for Symlet 7 and Biorthogonal 2.6 is high, Haar and Daubechies with two levels have demonstrated excellent validation accuracy on unseen data. It was also observed that the precision, the recall rate, and the dice similarity coefficient for four-class instances were 98%, 98%, and 99%, respectively, using the proposed algorithm.
Collapse
Affiliation(s)
- Amar Kumar Verma
- Department of Electrical and Electronics, Birla Institute of Technology and Science-Pilani, Hyderabad Campus, 500078, India
| | - Inturi Vamsi
- Department of Mechanical Engineering, Birla Institute of Technology and Science-Pilani, Hyderabad Campus, 500078, India
| | - Prerna Saurabh
- Department of Computer Science and Engineering, Vellore Institute of Technology-Vellore Campus, Tamil Nadu, 632014, India
| | - Radhika Sudha
- Department of Electrical and Electronics, Birla Institute of Technology and Science-Pilani, Hyderabad Campus, 500078, India
| | - Sabareesh G R
- Department of Mechanical Engineering, Birla Institute of Technology and Science-Pilani, Hyderabad Campus, 500078, India
| | - Rajkumar S
- Department of Computer Science and Engineering, Vellore Institute of Technology-Vellore Campus, Tamil Nadu, 632014, India
| |
Collapse
|