1
|
Asteris PG, Gandomi AH, Armaghani DJ, Kokoris S, Papandreadi AT, Roumelioti A, Papanikolaou S, Tsoukalas MZ, Triantafyllidis L, Koutras EI, Bardhan A, Mohammed AS, Naderpour H, Paudel S, Samui P, Ntanasis-Stathopoulos I, Dimopoulos MA, Terpos E. Prognosis of COVID-19 severity using DERGA, a novel machine learning algorithm. Eur J Intern Med 2024:S0953-6205(24)00094-3. [PMID: 38458880 DOI: 10.1016/j.ejim.2024.02.037] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/04/2023] [Revised: 02/23/2024] [Accepted: 02/29/2024] [Indexed: 03/10/2024]
Abstract
It is important to determine the risk for admission to the intensive care unit (ICU) in patients with COVID-19 presenting at the emergency department. Using artificial neural networks, we propose a new Data Ensemble Refinement Greedy Algorithm (DERGA) based on 15 easily accessible hematological indices. A database of 1596 patients with COVID-19 was used; it was divided into 1257 training datasets (80 % of the database) for training the algorithms and 339 testing datasets (20 % of the database) to check the reliability of the algorithms. The optimal combination of hematological indicators that gives the best prediction consists of only four hematological indicators as follows: neutrophil-to-lymphocyte ratio (NLR), lactate dehydrogenase, ferritin, and albumin. The best prediction corresponds to a particularly high accuracy of 97.12 %. In conclusion, our novel approach provides a robust model based only on basic hematological parameters for predicting the risk for ICU admission and optimize COVID-19 patient management in the clinical practice.
Collapse
Affiliation(s)
- Panagiotis G Asteris
- Computational Mechanics Laboratory, School of Pedagogical and Technological Education, Athens, Greece
| | - Amir H Gandomi
- Faculty of Engineering & IT, University of Technology Sydney, Sydney, NSW 2007, Australia; University Research and Innovation Center (EKIK), Óbuda University, 1034 Budapest, Hungary
| | - Danial J Armaghani
- School of Civil and Environmental Engineering, University of Technology Sydney, NSW 2007, Australia
| | - Styliani Kokoris
- Laboratory of Hematology and Hospital Blood Transfusion Department, University General Hospital "Attikon", National and Kapodistrian University of Athens, Medical School, Greece
| | - Anastasia T Papandreadi
- Software and Applications Department, University General Hospital "Attikon", National and Kapodistrian University of Athens, Medical School, Greece
| | - Anna Roumelioti
- Department of Hematology and Lymphoma BMTU, Evangelismos General Hospital, Athens, Greece
| | - Stefanos Papanikolaou
- NOMATEN Centre of Excellence, National Center for Nuclear Research, ulica A. Sołtana 7, 05-400 Swierk/Otwock, Poland
| | - Markos Z Tsoukalas
- Computational Mechanics Laboratory, School of Pedagogical and Technological Education, Athens, Greece
| | - Leonidas Triantafyllidis
- Computational Mechanics Laboratory, School of Pedagogical and Technological Education, Athens, Greece
| | - Evangelos I Koutras
- Computational Mechanics Laboratory, School of Pedagogical and Technological Education, Athens, Greece
| | - Abidhan Bardhan
- Civil Engineering Department, National Institute of Technology Patna, Bihar, India
| | - Ahmed Salih Mohammed
- Engineering Department, American University of Iraq, Sulaimani, Kurdistan-Region, Iraq
| | - Hosein Naderpour
- Institute of Industrial Science, University of Tokyo, Tokyo, Japan
| | - Satish Paudel
- Department of Civil and Environmental Engineering, University of Nevada, Reno, US
| | - Pijush Samui
- Civil Engineering Department, National Institute of Technology Patna, Bihar, India
| | - Ioannis Ntanasis-Stathopoulos
- Department of Clinical Therapeutics, Medical School, Faculty of Medicine, National Kapodistrian University of Athens, Athens, Greece
| | - Meletios A Dimopoulos
- Department of Clinical Therapeutics, Medical School, Faculty of Medicine, National Kapodistrian University of Athens, Athens, Greece
| | - Evangelos Terpos
- Department of Clinical Therapeutics, Medical School, Faculty of Medicine, National Kapodistrian University of Athens, Athens, Greece.
| |
Collapse
|
2
|
Ghnemat R, Alodibat S, Abu Al-Haija Q. Explainable Artificial Intelligence (XAI) for Deep Learning Based Medical Imaging Classification. J Imaging 2023; 9:177. [PMID: 37754941 PMCID: PMC10532018 DOI: 10.3390/jimaging9090177] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/06/2023] [Revised: 08/19/2023] [Accepted: 08/23/2023] [Indexed: 09/28/2023] Open
Abstract
Recently, deep learning has gained significant attention as a noteworthy division of artificial intelligence (AI) due to its high accuracy and versatile applications. However, one of the major challenges of AI is the need for more interpretability, commonly referred to as the black-box problem. In this study, we introduce an explainable AI model for medical image classification to enhance the interpretability of the decision-making process. Our approach is based on segmenting the images to provide a better understanding of how the AI model arrives at its results. We evaluated our model on five datasets, including the COVID-19 and Pneumonia Chest X-ray dataset, Chest X-ray (COVID-19 and Pneumonia), COVID-19 Image Dataset (COVID-19, Viral Pneumonia, Normal), and COVID-19 Radiography Database. We achieved testing and validation accuracy of 90.6% on a relatively small dataset of 6432 images. Our proposed model improved accuracy and reduced time complexity, making it more practical for medical diagnosis. Our approach offers a more interpretable and transparent AI model that can enhance the accuracy and efficiency of medical diagnosis.
Collapse
Affiliation(s)
- Rawan Ghnemat
- Department of Computer Science, Princess Sumaya University for Technology, Amman 11941, Jordan
| | - Sawsan Alodibat
- Department of Computer Science, Princess Sumaya University for Technology, Amman 11941, Jordan
| | - Qasem Abu Al-Haija
- Department of Cybersecurity, Princess Sumaya University for Technology, Amman 11941, Jordan
| |
Collapse
|
3
|
Subramaniam K, Palanisamy N, Sinnaswamy RA, Muthusamy S, Mishra OP, Loganathan AK, Ramamoorthi P, Gnanakkan CARC, Thangavel G, Sundararajan SCM. A comprehensive review of analyzing the chest X-ray images to detect COVID-19 infections using deep learning techniques. Soft comput 2023; 27:1-22. [PMID: 37362273 PMCID: PMC10220331 DOI: 10.1007/s00500-023-08561-7] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/18/2023] [Indexed: 06/28/2023]
Abstract
COVID-19, a highly infectious respiratory disease a used by SARS virus, has killed millions of people across many countries. To enhance quick and accurate diagnosis of COVID-19, chest X-ray (CXR) imaging methods were commonly utilized. Identifying the infection manually by radio imaging, on the other hand, was considered, extremely difficult due to the time commitment and significant risk of human error. Emerging artificial intelligence (AI) techniques promised exploration in the development of precise and as well as automated COVID-19 detection tools. Convolution neural networks (CNN), a well performing deep learning strategy tends to gain substantial favors among AI approaches for COVID-19 classification. The preprints and published studies to diagnose COVID-19 with CXR pictures using CNN and other deep learning methodologies are reviewed and critically assessed in this research. This study focused on the methodology, algorithms, and preprocessing techniques used in various deep learning architectures, as well as datasets and performance studies of several deep learning architectures used in prediction and diagnosis. Our research concludes with a list of future research directions in COVID-19 imaging categorization.
Collapse
Affiliation(s)
- Kavitha Subramaniam
- Department of Computer Science and Engineering, Kongu Engineering College (Autonomous), Perundurai, Erode, Tamil Nadu India
| | - Natesan Palanisamy
- Department of Computer Science and Engineering, Kongu Engineering College (Autonomous), Perundurai, Erode, Tamil Nadu India
| | - Renugadevi Ammapalayam Sinnaswamy
- Department of Electronics and Communication Engineering, Kongu Engineering College (Autonomous), Perundurai, Erode, Tamil Nadu India
| | - Suresh Muthusamy
- Department of Electronics and Communication Engineering, Kongu Engineering College (Autonomous), Perundurai, Erode, Tamil Nadu India
| | - Om Prava Mishra
- Department of Electronics and Communication Engineering, Vel Tech Rangarajan Dr. Sagunthala R&D Institute of Science and Technology, Avadi, Chennai, Tamil Nadu India
| | - Ashok Kumar Loganathan
- Department of Electrical and Electronics Engineering, PSG College of Technology, Coimbatore, Tamil Nadu India
| | - Ponarun Ramamoorthi
- Department of Electrical and Electronics Engineering, Theni Kammavar Sangam College of Technology, Theni, Tamil Nadu India
| | | | - Gunasekaran Thangavel
- Department of Engineering, University of Technology and Applied Sciences, Muscat, Sultanate of Oman
| | | |
Collapse
|
4
|
Wali A, Ahmad M, Naseer A, Tamoor M, Gilani S. StynMedGAN: Medical images augmentation using a new GAN model for improved diagnosis of diseases. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS 2023. [DOI: 10.3233/jifs-223996] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/07/2023]
Abstract
Deep networks require a considerable amount of training data otherwise these networks generalize poorly. Data Augmentation techniques help the network generalize better by providing more variety in the training data. Standard data augmentation techniques such as flipping, and scaling, produce new data that is a modified version of the original data. Generative Adversarial networks (GANs) have been designed to generate new data that can be exploited. In this paper, we propose a new GAN model, named StynMedGAN for synthetically generating medical images to improve the performance of classification models. StynMedGAN builds upon the state-of-the-art styleGANv2 that has produced remarkable results generating all kinds of natural images. We introduce a regularization term that is a normalized loss factor in the existing discriminator loss of styleGANv2. It is used to force the generator to produce normalized images and penalize it if it fails. Medical imaging modalities, such as X-Rays, CT-Scans, and MRIs are different in nature, we show that the proposed GAN extends the capacity of styleGANv2 to handle medical images in a better way. This new GAN model (StynMedGAN) is applied to three types of medical imaging: X-Rays, CT scans, and MRI to produce more data for the classification tasks. To validate the effectiveness of the proposed model for the classification, 3 classifiers (CNN, DenseNet121, and VGG-16) are used. Results show that the classifiers trained with StynMedGAN-augmented data outperform other methods that only used the original data. The proposed model achieved 100%, 99.6%, and 100% for chest X-Ray, Chest CT-Scans, and Brain MRI respectively. The results are promising and favor a potentially important resource that can be used by practitioners and radiologists to diagnose different diseases.
Collapse
Affiliation(s)
- Aamir Wali
- Department of Computer Science, National University of Computer and Emerging Science, Faisal Town, Lahore, Pakistan
| | - Muzammil Ahmad
- Department of Computer Science, National University of Computer and Emerging Science, Faisal Town, Lahore, Pakistan
| | - Asma Naseer
- Department of Computer Science, National University of Computer and Emerging Science, Faisal Town, Lahore, Pakistan
| | - Maria Tamoor
- Department of Computer Science, Forman Christian College University, Zahoor Ilahi Road, Lahore, Pakistan
| | - S.A.M. Gilani
- Department of Computer Science, National University of Computer and Emerging Science, Faisal Town, Lahore, Pakistan
| |
Collapse
|
5
|
Almuayqil S, Abd El-Ghany S, Shehab A. Multimodality Imaging of COVID-19 Using Fine-Tuned Deep Learning Models. Diagnostics (Basel) 2023; 13:diagnostics13071268. [PMID: 37046486 PMCID: PMC10093688 DOI: 10.3390/diagnostics13071268] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2023] [Revised: 03/22/2023] [Accepted: 03/23/2023] [Indexed: 03/30/2023] Open
Abstract
In the face of the COVID-19 pandemic, many studies have been undertaken to provide assistive recommendations to patients to help overcome the burden of the expected shortage in clinicians. Thus, this study focused on diagnosing the COVID-19 virus using a set of fine-tuned deep learning models to overcome the latency in virus checkups. Five recent deep learning algorithms (EfficientB0, VGG-19, DenseNet121, EfficientB7, and MobileNetV2) were utilized to label both CT scan and chest X-ray images as positive or negative for COVID-19. The experimental results showed the superiority of the proposed method compared to state-of-the-art methods in terms of precision, sensitivity, specificity, F1 score, accuracy, and data access time.
Collapse
|
6
|
Fet-Net Algorithm for Automatic Detection of Fetal Orientation in Fetal MRI. Bioengineering (Basel) 2023; 10:bioengineering10020140. [PMID: 36829634 PMCID: PMC9952178 DOI: 10.3390/bioengineering10020140] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/20/2022] [Revised: 01/06/2023] [Accepted: 01/13/2023] [Indexed: 01/22/2023] Open
Abstract
Identifying fetal orientation is essential for determining the mode of delivery and for sequence planning in fetal magnetic resonance imaging (MRI). This manuscript describes a deep learning algorithm named Fet-Net, composed of convolutional neural networks (CNNs), which allows for the automatic detection of fetal orientation from a two-dimensional (2D) MRI slice. The architecture consists of four convolutional layers, which feed into a simple artificial neural network. Compared with eleven other prominent CNNs (different versions of ResNet, VGG, Xception, and Inception), Fet-Net has fewer architectural layers and parameters. From 144 3D MRI datasets indicative of vertex, breech, oblique and transverse fetal orientations, 6120 2D MRI slices were extracted to train, validate and test Fet-Net. Despite its simpler architecture, Fet-Net demonstrated an average accuracy and F1 score of 97.68% and a loss of 0.06828 on the 6120 2D MRI slices during a 5-fold cross-validation experiment. This architecture outperformed all eleven prominent architectures (p < 0.05). An ablation study proved each component's statistical significance and contribution to Fet-Net's performance. Fet-Net demonstrated robustness in classification accuracy even when noise was introduced to the images, outperforming eight of the 11 prominent architectures. Fet-Net's ability to automatically detect fetal orientation can profoundly decrease the time required for fetal MRI acquisition.
Collapse
|
7
|
Noaman I, El Fattah El Atik A, Medhat T, E. Ali M. Mathematical Morphology View of Topological Rough Sets and Its Applications. COMPUTERS, MATERIALS & CONTINUA 2023; 74:6893-6908. [DOI: 10.32604/cmc.2023.033539] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/20/2022] [Accepted: 10/20/2022] [Indexed: 09/01/2023]
|
8
|
Hasija S, Akash P, Bhargav Hemanth M, Kumar A, Sharma S. A novel approach for detection of COVID-19 and Pneumonia using only binary classification from chest CT-scans. NEUROSCIENCE INFORMATICS 2022; 2:100069. [PMID: 36741276 PMCID: PMC8958781 DOI: 10.1016/j.neuri.2022.100069] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/15/2022] [Accepted: 03/22/2022] [Indexed: 02/07/2023]
Abstract
The novel Coronavirus, Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2) spread all over the world, causing a dramatic shift in circumstances that resulted in a massive pandemic, affecting the world's well-being and stability. It is an RNA virus that can infect both humans as well as animals. Diagnosis of the virus as soon as possible could contain and avoid a serious COVID-19 outbreak. Current pharmaceutical techniques and diagnostic methods tests such as Reverse Transcription-Polymerase Chain Reaction (RT-PCR) and Serology tests are time-consuming, expensive, and require a well-equipped laboratory for analysis, making them restrictive and inaccessible to everyone. Deep Learning has grown in popularity in recent years, and it now plays a crucial role in Image Classification, which also involves Medical Imaging. Using chest CT scans, this study explores the problem statement automation of differentiating COVID-19 contaminated individuals from healthy individuals. Convolutional Neural Networks (CNNs) can be trained to detect patterns in computed tomography scans (CT scans). Hence, different CNN models were used in the current study to identify variations in chest CT scans, with accuracies ranging from 91% to 98%. The Multiclass Classification method is used to build these architectures. This study also proposes a new approach for classifying CT images that use two binary classifications combined to work together, achieving 98.38% accuracy. All of these architectures' performances are compared using different classification metrics.
Collapse
|
9
|
Karthik R, Menaka R, Hariharan M, Kathiresan GS. AI for COVID-19 Detection from Radiographs: Incisive Analysis of State of the Art Techniques, Key Challenges and Future Directions. Ing Rech Biomed 2022; 43:486-510. [PMID: 34336141 PMCID: PMC8312058 DOI: 10.1016/j.irbm.2021.07.002] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2021] [Revised: 06/14/2021] [Accepted: 07/19/2021] [Indexed: 12/24/2022]
Abstract
Background and objective In recent years, Artificial Intelligence has had an evident impact on the way research addresses challenges in different domains. It has proven to be a huge asset, especially in the medical field, allowing for time-efficient and reliable solutions. This research aims to spotlight the impact of deep learning and machine learning models in the detection of COVID-19 from medical images. This is achieved by conducting a review of the state-of-the-art approaches proposed by the recent works in this field. Methods The main focus of this study is the recent developments of classification and segmentation approaches to image-based COVID-19 detection. The study reviews 140 research papers published in different academic research databases. These papers have been screened and filtered based on specified criteria, to acquire insights prudent to image-based COVID-19 detection. Results The methods discussed in this review include different types of imaging modality, predominantly X-rays and CT scans. These modalities are used for classification and segmentation tasks as well. This review seeks to categorize and discuss the different deep learning and machine learning architectures employed for these tasks, based on the imaging modality utilized. It also hints at other possible deep learning and machine learning architectures that can be proposed for better results towards COVID-19 detection. Along with that, a detailed overview of the emerging trends and breakthroughs in Artificial Intelligence-based COVID-19 detection has been discussed as well. Conclusion This work concludes by stipulating the technical and non-technical challenges faced by researchers and illustrates the advantages of image-based COVID-19 detection with Artificial Intelligence techniques.
Collapse
Affiliation(s)
- R Karthik
- Centre for Cyber Physical Systems, Vellore Institute of Technology, Chennai, India
| | - R Menaka
- Centre for Cyber Physical Systems, Vellore Institute of Technology, Chennai, India
| | - M Hariharan
- School of Computing Sciences and Engineering, Vellore Institute of Technology, Chennai, India
| | - G S Kathiresan
- School of Electronics Engineering, Vellore Institute of Technology, Chennai, India
| |
Collapse
|
10
|
Ibrahim DA, Zebari DA, Mohammed HJ, Mohammed MA. Effective hybrid deep learning model for COVID-19 patterns identification using CT images. EXPERT SYSTEMS 2022; 39:e13010. [PMID: 35942177 PMCID: PMC9348188 DOI: 10.1111/exsy.13010] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/12/2021] [Revised: 03/08/2022] [Accepted: 03/23/2022] [Indexed: 05/31/2023]
Abstract
Coronavirus disease 2019 (COVID-19) has attracted significant attention of researchers from various disciplines since the end of 2019. Although the global epidemic situation is stabilizing due to vaccination, new COVID-19 cases are constantly being discovered around the world. As a result, lung computed tomography (CT) examination, an aggregated identification technique, has been used to ameliorate diagnosis. It helps reveal missed diagnoses due to the ambiguity of nucleic acid polymerase chain reaction. Therefore, this study investigated how quickly and accurately hybrid deep learning (DL) methods can identify infected individuals with COVID-19 on the basis of their lung CT images. In addition, this study proposed a developed system to create a reliable COVID-19 prediction network using various layers starting with the segmentation of the lung CT scan image and ending with disease prediction. The initial step of the system starts with a proposed technique for lung segmentation that relies on a no-threshold histogram-based image segmentation method. Afterward, the GrabCut method was used as a post-segmentation method to enhance segmentation outcomes and avoid over-and under-segmentation problems. Then, three pre-trained models of standard DL methods, including Visual Geometry Group Network, convolutional deep belief network, and high-resolution network, were utilized to extract the most affective features from the segmented images that can help to identify COVID-19. These three described pre-trained models were combined as a new mechanism to increase the system's overall prediction capabilities. A publicly available dataset, namely, COVID-19 CT, was used to test the performance of the proposed model, which obtained a 95% accuracy rate. On the basis of comparison, the proposed model outperformed several state-of-the-art studies. Because of its effectiveness in accurately screening COVID-19 CT images, the developed model will potentially be valuable as an additional diagnostic tool for leading clinical professionals.
Collapse
Affiliation(s)
- Dheyaa Ahmed Ibrahim
- Communications Engineering Techniques Department, Information Technology CollageImam Ja'afar Al‐Sadiq UniversityBaghdadIraq
| | - Dilovan Asaad Zebari
- Department of Computer Science, College of ScienceNawroz UniversityDuhok Kurdistan RegionIraq
| | | | - Mazin Abed Mohammed
- Information systems Department, College of Computer Science and Information TechnologyUniversity of AnbarAl AnbarIraq
| |
Collapse
|
11
|
Li Z, Li Z, Yao L, Chen Q, Zhang J, Li X, Feng JM, Li Y, Xu J. Multiple-inputs convolutional neural network: A novel design for classification and screening the critical regions of COVID-19 chest X-ray radiography (Preprint). JMIR BIOINFORMATICS AND BIOTECHNOLOGY 2022; 3:e36660. [PMID: 36277075 PMCID: PMC9578294 DOI: 10.2196/36660] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/19/2022] [Revised: 08/23/2022] [Accepted: 08/29/2022] [Indexed: 12/02/2022]
Abstract
Background The COVID-19 pandemic is becoming one of the largest, unprecedented health crises, and chest X-ray radiography (CXR) plays a vital role in diagnosing COVID-19. However, extracting and finding useful image features from CXRs demand a heavy workload for radiologists. Objective The aim of this study was to design a novel multiple-inputs (MI) convolutional neural network (CNN) for the classification of COVID-19 and extraction of critical regions from CXRs. We also investigated the effect of the number of inputs on the performance of our new MI-CNN model. Methods A total of 6205 CXR images (including 3021 COVID-19 CXRs and 3184 normal CXRs) were used to test our MI-CNN models. CXRs could be evenly segmented into different numbers (2, 4, and 16) of individual regions. Each region could individually serve as one of the MI-CNN inputs. The CNN features of these MI-CNN inputs would then be fused for COVID-19 classification. More importantly, the contributions of each CXR region could be evaluated through assessing the number of images that were accurately classified by their corresponding regions in the testing data sets. Results In both the whole-image and left- and right-lung region of interest (LR-ROI) data sets, MI-CNNs demonstrated good efficiency for COVID-19 classification. In particular, MI-CNNs with more inputs (2-, 4-, and 16-input MI-CNNs) had better efficiency in recognizing COVID-19 CXRs than the 1-input CNN. Compared to the whole-image data sets, the efficiency of LR-ROI data sets showed approximately 4% lower accuracy, sensitivity, specificity, and precision (over 91%). In considering the contributions of each region, one of the possible reasons for this reduced performance was that nonlung regions (eg, region 16) provided false-positive contributions to COVID-19 classification. The MI-CNN with the LR-ROI data set could provide a more accurate evaluation of the contribution of each region and COVID-19 classification. Additionally, the right-lung regions had higher contributions to the classification of COVID-19 CXRs, whereas the left-lung regions had higher contributions to identifying normal CXRs. Conclusions Overall, MI-CNNs could achieve higher accuracy with an increasing number of inputs (eg, 16-input MI-CNN). This approach could assist radiologists in identifying COVID-19 CXRs and in screening the critical regions related to COVID-19 classifications.
Collapse
Affiliation(s)
- Zhongqiang Li
- Division of Electrical and Computer Engineering College of Engineering Louisiana State University Baton Rouge, LA United States
| | - Zheng Li
- Division of Electrical and Computer Engineering College of Engineering Louisiana State University Baton Rouge, LA United States
| | - Luke Yao
- Division of Electrical and Computer Engineering College of Engineering Louisiana State University Baton Rouge, LA United States
| | - Qing Chen
- Division of Computer Science and Engineering College of Engineering Louisiana State University Baton Rouge, LA United States
| | - Jian Zhang
- Division of Computer Science and Engineering College of Engineering Louisiana State University Baton Rouge, LA United States
| | - Xin Li
- Department of Visualization Texas A & M University College Station, TX United States
| | - Ji-Ming Feng
- Department of Comparative Biomedical Science School of Veterinary Medicine Louisiana State University Baton Rouge, LA United States
| | - Yanping Li
- School of Environment and Sustainability University of Saskatchewan Saskatoon, SK Canada
| | - Jian Xu
- Division of Electrical and Computer Engineering College of Engineering Louisiana State University Baton Rouge, LA United States
| |
Collapse
|
12
|
Kumar M, Shakya D, Kurup V, Suksatan W. COVID-19 prediction through X-ray images using transfer learning-based hybrid deep learning approach. MATERIALS TODAY: PROCEEDINGS 2022; 51:2520-2524. [PMID: 34926174 PMCID: PMC8666290 DOI: 10.1016/j.matpr.2021.12.123] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Over the past few months, the campaign against COVID-19 has developed into one of the world's most sought anti-toxin treatment scheme. It is fundamental to distinguish cases of COVID-19 precisely and quickly to help avoid this pandemic from taking a wrong turn with a proper medical reasoning and solution. While Reverse-Transcription Polymerase Chain Reaction (RT-PCR) has been useful in detection of corona virus, chest X-Ray techniques has proven to be more successful and beneficial at detection of the effects of virus. With the increase in COVID patients and the X-Rays done, it is currently possible to classify the X-Ray reports with transfer learning. This paper presents a novel approach, i.e., Hybrid Convolutional Neural Network (HDCNN), which integrates Convolutional Neural Network (CNN) and Recurrent Neural Network (RNN) architecture for the finding of COVID-19 using the chest X-Ray. The transfer learning approach, namely slope weighted activation class planning (Grad-CAMs), is used with HDCNN to display images responsible for taking decisions. In this study, HDCNN is compared with other CNNs such as Inception-v3, ShuffleNet, SqueezeNet, VGG-19 and DenseNet. As a result, HDCNN has achieved an accuracy of 98.20%, precision of 97.31%, recall of 97.1% and F1 score of 0.97. Compared to other current deep learning models, the HDCNN has achieved better results, and this can be used for diagnosis purpose after proper approvals.
Collapse
|
13
|
Jalali Moghaddam M, Ghavipour M. Towards smart diagnostic methods for COVID-19: Review of deep learning for medical imaging. IPEM-TRANSLATION 2022; 3:100008. [PMID: 36312890 PMCID: PMC9597575 DOI: 10.1016/j.ipemt.2022.100008] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/01/2022] [Revised: 10/20/2022] [Accepted: 10/24/2022] [Indexed: 11/08/2022]
Abstract
The infectious disease known as COVID-19 has spread dramatically all over the world since December 2019. The fast diagnosis and isolation of infected patients are key factors in slowing down the spread of this virus and better management of the pandemic. Although the CT and X-ray modalities are commonly used for the diagnosis of COVID-19, identifying COVID-19 patients from medical images is a time-consuming and error-prone task. Artificial intelligence has shown to have great potential to speed up and optimize the prognosis and diagnosis process of COVID-19. Herein, we review publications on the application of deep learning (DL) techniques for diagnostics of patients with COVID-19 using CT and X-ray chest images for a period from January 2020 to October 2021. Our review focuses solely on peer-reviewed, well-documented articles. It provides a comprehensive summary of the technical details of models developed in these articles and discusses the challenges in the smart diagnosis of COVID-19 using DL techniques. Based on these challenges, it seems that the effectiveness of the developed models in clinical use needs to be further investigated. This review provides some recommendations to help researchers develop more accurate prediction models.
Collapse
|
14
|
Feature extraction with capsule network for the COVID-19 disease prediction though X-ray images. MATERIALS TODAY. PROCEEDINGS 2021; 56:3556-3560. [PMID: 34900608 PMCID: PMC8649785 DOI: 10.1016/j.matpr.2021.11.512] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 11/20/2022]
Abstract
Past couple of years, the world is going through one of the biggest pandemic named COVID-19. In the mid of year 2019, it is a very difficult process to predict the COVID-19 just by viewing the images. Later on AI based technology has done a significant role in the prediction of COVID-19 through biomedical images such as CT scan, X ray etc. This study also implemented the deep learning model for the prediction of COVID-19 through X-ray images. The implemented model is termed as XR-CAPS which consist of two models such as U-Net model and the capsule network. The U Net model is used for performing the segmentation of the images and the capsule networks are applied for performing the feature extraction. The XR-CAPS model is applied on the X-ray images for the prediction of COVID-19 and the evaluation of the model is done by three parameters that are accuracy, sensitivity and specificity. The model is compared with other existing models like ResNet50, DenseNet121 and DenseCapsNet, this has achieved an accuracy of 93.2%, sensitivity of 94% and specificity of 97.1% which is better than other states of the art algorithms.
Collapse
|
15
|
COVID-19 Patient Detection Based on Fusion of Transfer Learning and Fuzzy Ensemble Models Using CXR Images. APPLIED SCIENCES-BASEL 2021. [DOI: 10.3390/app112311423] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
Abstract
The COVID-19 pandemic has claimed the lives of millions of people and put a significant strain on healthcare facilities. To combat this disease, it is necessary to monitor affected patients in a timely and cost-effective manner. In this work, CXR images were used to identify COVID-19 patients. We compiled a CXR dataset with equal number of 2313 COVID positive, pneumonia and normal CXR images and utilized various transfer learning models as base classifiers, including VGG16, GoogleNet, and Xception. The proposed methodology combines fuzzy ensemble techniques, such as Majority Voting, Sugeno Integral, and Choquet Fuzzy, and adaptively combines the decision scores of the transfer learning models to identify coronavirus infection from CXR images. The proposed fuzzy ensemble methods outperformed each individual transfer learning technique and several state-of-the-art ensemble techniques in terms of accuracy and prediction. Specifically, VGG16 + Choquet Fuzzy, GoogleNet + Choquet Fuzzy, and Xception + Choquet Fuzzy achieved accuracies of 97.04%, 98.48%, and 99.57%, respectively. The results of this work are intended to help medical practitioners achieve an earlier detection of coronavirus compared to other detection strategies, which can further save millions of lives and advantageously influence society.
Collapse
|
16
|
Gudigar A, Raghavendra U, Nayak S, Ooi CP, Chan WY, Gangavarapu MR, Dharmik C, Samanth J, Kadri NA, Hasikin K, Barua PD, Chakraborty S, Ciaccio EJ, Acharya UR. Role of Artificial Intelligence in COVID-19 Detection. SENSORS (BASEL, SWITZERLAND) 2021; 21:8045. [PMID: 34884045 PMCID: PMC8659534 DOI: 10.3390/s21238045] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/05/2021] [Revised: 11/26/2021] [Accepted: 11/26/2021] [Indexed: 12/15/2022]
Abstract
The global pandemic of coronavirus disease (COVID-19) has caused millions of deaths and affected the livelihood of many more people. Early and rapid detection of COVID-19 is a challenging task for the medical community, but it is also crucial in stopping the spread of the SARS-CoV-2 virus. Prior substantiation of artificial intelligence (AI) in various fields of science has encouraged researchers to further address this problem. Various medical imaging modalities including X-ray, computed tomography (CT) and ultrasound (US) using AI techniques have greatly helped to curb the COVID-19 outbreak by assisting with early diagnosis. We carried out a systematic review on state-of-the-art AI techniques applied with X-ray, CT, and US images to detect COVID-19. In this paper, we discuss approaches used by various authors and the significance of these research efforts, the potential challenges, and future trends related to the implementation of an AI system for disease detection during the COVID-19 pandemic.
Collapse
Affiliation(s)
- Anjan Gudigar
- Department of Instrumentation and Control Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal 576104, India; (A.G.); (S.N.); (M.R.G.); (C.D.)
| | - U Raghavendra
- Department of Instrumentation and Control Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal 576104, India; (A.G.); (S.N.); (M.R.G.); (C.D.)
| | - Sneha Nayak
- Department of Instrumentation and Control Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal 576104, India; (A.G.); (S.N.); (M.R.G.); (C.D.)
| | - Chui Ping Ooi
- School of Science and Technology, Singapore University of Social Sciences, Singapore 599494, Singapore;
| | - Wai Yee Chan
- Department of Biomedical Imaging, Faculty of Medicine, University of Malaya, Kuala Lumpur 50603, Malaysia;
| | - Mokshagna Rohit Gangavarapu
- Department of Instrumentation and Control Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal 576104, India; (A.G.); (S.N.); (M.R.G.); (C.D.)
| | - Chinmay Dharmik
- Department of Instrumentation and Control Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal 576104, India; (A.G.); (S.N.); (M.R.G.); (C.D.)
| | - Jyothi Samanth
- Department of Cardiovascular Technology, Manipal College of Health Professions, Manipal Academy of Higher Education, Manipal 576104, India;
| | - Nahrizul Adib Kadri
- Department of Biomedical Engineering, Faculty of Engineering, University of Malaya, Kuala Lumpur 50603, Malaysia; (N.A.K.); (K.H.)
| | - Khairunnisa Hasikin
- Department of Biomedical Engineering, Faculty of Engineering, University of Malaya, Kuala Lumpur 50603, Malaysia; (N.A.K.); (K.H.)
| | - Prabal Datta Barua
- Cogninet Brain Team, Cogninet Australia, Sydney, NSW 2010, Australia;
- School of Business (Information Systems), Faculty of Business, Education, Law & Arts, University of Southern Queensland, Toowoomba, QLD 4350, Australia
- Faculty of Engineering and Information Technology, University of Technology Sydney, Sydney, NSW 2007, Australia;
| | - Subrata Chakraborty
- Faculty of Engineering and Information Technology, University of Technology Sydney, Sydney, NSW 2007, Australia;
- Faculty of Science, Agriculture, Business and Law, University of New England, Armidale, NSW 2351, Australia
| | - Edward J. Ciaccio
- Department of Medicine, Columbia University Medical Center, New York, NY 10032, USA;
| | - U. Rajendra Acharya
- School of Engineering, Ngee Ann Polytechnic, Singapore 599489, Singapore;
- Department of Biomedical Informatics and Medical Engineering, Asia University, Taichung 41354, Taiwan
- International Research Organization for Advanced Science and Technology (IROAST), Kumamoto University, Kumamoto 860-8555, Japan
| |
Collapse
|
17
|
Shorfuzzaman M, Masud M, Alhumyani H, Anand D, Singh A. Artificial Neural Network-Based Deep Learning Model for COVID-19 Patient Detection Using X-Ray Chest Images. JOURNAL OF HEALTHCARE ENGINEERING 2021; 2021:5513679. [PMID: 34194681 PMCID: PMC8184332 DOI: 10.1155/2021/5513679] [Citation(s) in RCA: 16] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/17/2021] [Revised: 04/18/2021] [Accepted: 05/16/2021] [Indexed: 12/24/2022]
Abstract
The world is experiencing an unprecedented crisis due to the coronavirus disease (COVID-19) outbreak that has affected nearly 216 countries and territories across the globe. Since the pandemic outbreak, there is a growing interest in computational model-based diagnostic technologies to support the screening and diagnosis of COVID-19 cases using medical imaging such as chest X-ray (CXR) scans. It is discovered in initial studies that patients infected with COVID-19 show abnormalities in their CXR images that represent specific radiological patterns. Still, detection of these patterns is challenging and time-consuming even for skilled radiologists. In this study, we propose a novel convolutional neural network- (CNN-) based deep learning fusion framework using the transfer learning concept where parameters (weights) from different models are combined into a single model to extract features from images which are then fed to a custom classifier for prediction. We use gradient-weighted class activation mapping to visualize the infected areas of CXR images. Furthermore, we provide feature representation through visualization to gain a deeper understanding of the class separability of the studied models with respect to COVID-19 detection. Cross-validation studies are used to assess the performance of the proposed models using open-access datasets containing healthy and both COVID-19 and other pneumonia infected CXR images. Evaluation results show that the best performing fusion model can attain a classification accuracy of 95.49% with a high level of sensitivity and specificity.
Collapse
Affiliation(s)
- Mohammad Shorfuzzaman
- Department of Computer Science, College of Computers and Information Technology, Taif University, Taif 21974, Saudi Arabia
| | - Mehedi Masud
- Department of Computer Science, College of Computers and Information Technology, Taif University, Taif 21974, Saudi Arabia
| | - Hesham Alhumyani
- Department of Computer Engineering, College of Computers and Information Technology, Taif University, Taif 21974, Saudi Arabia
| | - Divya Anand
- Department of Computer Science and Engineering, Lovely Professional University, Phagwara, Punjab 144411, India
| | - Aman Singh
- Department of Computer Science and Engineering, Lovely Professional University, Phagwara, Punjab 144411, India
| |
Collapse
|
18
|
Maior CBS, Santana JMM, Lins ID, Moura MJC. Convolutional neural network model based on radiological images to support COVID-19 diagnosis: Evaluating database biases. PLoS One 2021; 16:e0247839. [PMID: 33647062 PMCID: PMC7920391 DOI: 10.1371/journal.pone.0247839] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2020] [Accepted: 02/13/2021] [Indexed: 01/08/2023] Open
Abstract
As SARS-CoV-2 has spread quickly throughout the world, the scientific community has spent major efforts on better understanding the characteristics of the virus and possible means to prevent, diagnose, and treat COVID-19. A valid approach presented in the literature is to develop an image-based method to support COVID-19 diagnosis using convolutional neural networks (CNN). Because the availability of radiological data is rather limited due to the novelty of COVID-19, several methodologies consider reduced datasets, which may be inadequate, biasing the model. Here, we performed an analysis combining six different databases using chest X-ray images from open datasets to distinguish images of infected patients while differentiating COVID-19 and pneumonia from 'no-findings' images. In addition, the performance of models created from fewer databases, which may imperceptibly overestimate their results, is discussed. Two CNN-based architectures were created to process images of different sizes (512 × 512, 768 × 768, 1024 × 1024, and 1536 × 1536). Our best model achieved a balanced accuracy (BA) of 87.7% in predicting one of the three classes ('no-findings', 'COVID-19', and 'pneumonia') and a specific balanced precision of 97.0% for 'COVID-19' class. We also provided binary classification with a precision of 91.0% for detection of sick patients (i.e., with COVID-19 or pneumonia) and 98.4% for COVID-19 detection (i.e., differentiating from 'no-findings' or 'pneumonia'). Indeed, despite we achieved an unrealistic 97.2% BA performance for one specific case, the proposed methodology of using multiple databases achieved better and less inflated results than from models with specific image datasets for training. Thus, this framework is promising for a low-cost, fast, and noninvasive means to support the diagnosis of COVID-19.
Collapse
Affiliation(s)
- Caio B. S. Maior
- CEERMA - Center for Risk Analysis, Reliability Engineering and Environmental Modeling, Universidade Federal de Pernambuco, Recife, Brazil
- Department of Production Engineering, Universidade Federal de Pernambuco, Recife, Brazil
| | - João M. M. Santana
- CEERMA - Center for Risk Analysis, Reliability Engineering and Environmental Modeling, Universidade Federal de Pernambuco, Recife, Brazil
- Department of Production Engineering, Universidade Federal de Pernambuco, Recife, Brazil
| | - Isis D. Lins
- CEERMA - Center for Risk Analysis, Reliability Engineering and Environmental Modeling, Universidade Federal de Pernambuco, Recife, Brazil
- Department of Production Engineering, Universidade Federal de Pernambuco, Recife, Brazil
| | - Márcio J. C. Moura
- CEERMA - Center for Risk Analysis, Reliability Engineering and Environmental Modeling, Universidade Federal de Pernambuco, Recife, Brazil
- Department of Production Engineering, Universidade Federal de Pernambuco, Recife, Brazil
| |
Collapse
|
19
|
Osman AH, Aljahdali HM, Altarrazi SM, Ahmed A. SOM-LWL method for identification of COVID-19 on chest X-rays. PLoS One 2021; 16:e0247176. [PMID: 33626053 PMCID: PMC7904146 DOI: 10.1371/journal.pone.0247176] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2020] [Accepted: 02/02/2021] [Indexed: 12/21/2022] Open
Abstract
The outbreak of coronavirus disease 2019 (COVID-19) has had an immense impact on world health and daily life in many countries. Sturdy observing of the initial site of infection in patients is crucial to gain control in the struggle with COVID-19. The early automated detection of the recent coronavirus disease (COVID-19) will help to limit its dissemination worldwide. Many initial studies have focused on the identification of the genetic material of coronavirus and have a poor detection rate for long-term surgery. The first imaging procedure that played an important role in COVID-19 treatment was the chest X-ray. Radiological imaging is often used as a method that emphasizes the performance of chest X-rays. Recent findings indicate the presence of COVID-19 in patients with irregular findings on chest X-rays. There are many reports on this topic that include machine learning strategies for the identification of COVID-19 using chest X-rays. Other current studies have used non-public datasets and complex artificial intelligence (AI) systems. In our research, we suggested a new COVID-19 identification technique based on the locality-weighted learning and self-organization map (LWL-SOM) strategy for detecting and capturing COVID-19 cases. We first grouped images from chest X-ray datasets based on their similar features in different clusters using the SOM strategy in order to discriminate between the COVID-19 and non-COVID-19 cases. Then, we built our intelligent learning model based on the LWL algorithm to diagnose and detect COVID-19 cases. The proposed SOM-LWL model improved the correlation coefficient performance results between the Covid19, no-finding, and pneumonia cases; pneumonia and no-finding cases; Covid19 and pneumonia cases; and Covid19 and no-finding cases from 0.9613 to 0.9788, 0.6113 to 1 0.8783 to 0.9999, and 0.8894 to 1, respectively. The proposed LWL-SOM had better results for discriminating COVID-19 and non-COVID-19 patients than the current machine learning-based solutions using AI evaluation measures.
Collapse
Affiliation(s)
- Ahmed Hamza Osman
- Department of Information System, Faculty of Computing and Information Technology, King Abdulaziz University, Rabigh, Saudi Arabia
| | - Hani Moetque Aljahdali
- Department of Information System, Faculty of Computing and Information Technology, King Abdulaziz University, Rabigh, Saudi Arabia
| | - Sultan Menwer Altarrazi
- Department of Computer Science, Faculty of Computing and Information Technology, King Abdulaziz University, Rabigh, Saudi Arabia
| | - Ali Ahmed
- Department of Computer Science, Faculty of Computing and Information Technology, King Abdulaziz University, Rabigh, Saudi Arabia
| |
Collapse
|
20
|
Bose P, Roy S, Ghosh P. A Comparative NLP-Based Study on the Current Trends and Future Directions in COVID-19 Research. IEEE ACCESS : PRACTICAL INNOVATIONS, OPEN SOLUTIONS 2021; 9:78341-78355. [PMID: 34786315 PMCID: PMC8545210 DOI: 10.1109/access.2021.3082108] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/10/2021] [Accepted: 05/15/2021] [Indexed: 05/03/2023]
Abstract
COVID-19 is a global health crisis that has altered human life and still promises to create ripples of death and destruction in its wake. The sea of scientific literature published over a short time-span to understand and mitigate this global phenomenon necessitates concerted efforts to organize our findings and focus on the unexplored facets of the disease. In this work, we applied natural language processing (NLP) based approaches on scientific literature published on COVID-19 to infer significant keywords that have contributed to our social, economic, demographic, psychological, epidemiological, clinical, and medical understanding of this pandemic. We identify key terms appearing in COVID literature that vary in representation when compared to other virus-borne diseases such as MERS, Ebola, and Influenza. We also identify countries, topics, and research articles that demonstrate that the scientific community is still reacting to the short-term threats such as transmissibility, health risks, treatment plans, and public policies, underpinning the need for collective international efforts towards long-term immunization and drug-related challenges. Furthermore, our study highlights several long-term research directions that are urgently needed for COVID-19 such as: global collaboration to create international open-access data repositories, policymaking to curb future outbreaks, psychological repercussions of COVID-19, vaccine development for SARS-CoV-2 variants and their long-term efficacy studies, and mental health issues in both children and elderly.
Collapse
Affiliation(s)
- Priyankar Bose
- Department of Computer ScienceVirginia Commonwealth University Richmond VA 23284 USA
| | - Satyaki Roy
- Department of GeneticsUniversity of North Carolina at Chapel Hill Chapel Hill NC 27515 USA
| | - Preetam Ghosh
- Department of Computer ScienceVirginia Commonwealth University Richmond VA 23284 USA
| |
Collapse
|