301
|
Redie DK, Sirko AE, Demissie TM, Teferi SS, Shrivastava VK, Verma OP, Sharma TK. Diagnosis of COVID-19 using chest X-ray images based on modified DarkCovidNet model. EVOLUTIONARY INTELLIGENCE 2022; 16:729-738. [PMID: 35281292 PMCID: PMC8904169 DOI: 10.1007/s12065-021-00679-7] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/25/2021] [Revised: 09/08/2021] [Accepted: 11/01/2021] [Indexed: 12/15/2022]
Abstract
Coronavirus disease, also known as COVID-19, is an infectious disease caused by SARS-CoV-2. It has a direct impact on the upper and lower respiratory tract and threatened the health of many people around the world. The latest statistics show that the number of people diagnosed with COVID-19 is growing exponentially. Diagnosing positive cases of COVID-19 is important for preventing further spread of the disease. Currently, Coronavirus is a serious threat to scientists, medical experts and researchers around the world from its detection to its treatment. It is currently detected using reverse transcription polymerase chain reaction (RT-PCR) analysis at the most test centers around the world. Yet, knowing the reliability of a deep learning based medical diagnosis is important for doctors to build confidence in the technology and improve treatment. The goal of this study is to develop a model that automatically identifies COVID-19 by using chest X-ray images. To achieve this, we modified the DarkCovidNet model which is based on a convolutional neural network (CNN) and plotted the experimental results for two scenarios: binary classification (COVID-19 versus No-findings) and multi-class classification (COVID-19 versus pneumonia versus No-findings). The model is trained on more than 10 thousand X-ray images and achieved an average accuracy of 99.53% and 94.18% for binary and multi-class classification, respectively. Therefore, the proposed method demonstrates the effectiveness of COVID-19 detection using X-ray images. Our model can be used to test the patient via cloud and also be used in situations where RT-PCR tests and other options aren't available.
Collapse
Affiliation(s)
- Dawit Kiros Redie
- School of Electronics Engineering, Kalinga Institute of Industrial Technology (KIIT), Bhubaneswar, India
| | - Abdulhakim Edao Sirko
- School of Electronics Engineering, Kalinga Institute of Industrial Technology (KIIT), Bhubaneswar, India
| | - Tensaie Melkamu Demissie
- School of Electronics Engineering, Kalinga Institute of Industrial Technology (KIIT), Bhubaneswar, India
| | - Semagn Sisay Teferi
- School of Electronics Engineering, Kalinga Institute of Industrial Technology (KIIT), Bhubaneswar, India
| | - Vimal Kumar Shrivastava
- School of Electronics Engineering, Kalinga Institute of Industrial Technology (KIIT), Bhubaneswar, India
| | - Om Prakash Verma
- Department of Instrumentation and Control Engineering, Dr. B R Ambedkar National Institute of Technology Jalandhar, Punjab, India
| | - Tarun Kumar Sharma
- Department of Computer Science Engineering, Shobhit University, Gangoh, Saharanpur India
| |
Collapse
|
302
|
Waheed W, Saylan S, Hassan T, Kannout H, Alsafar H, Alazzam A. A deep learning-driven low-power, accurate, and portable platform for rapid detection of COVID-19 using reverse-transcription loop-mediated isothermal amplification. Sci Rep 2022; 12:4132. [PMID: 35260715 PMCID: PMC8903312 DOI: 10.1038/s41598-022-07954-2] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2021] [Accepted: 02/28/2022] [Indexed: 12/24/2022] Open
Abstract
This paper presents a deep learning-driven portable, accurate, low-cost, and easy-to-use device to perform Reverse-Transcription Loop-Mediated Isothermal Amplification (RT-LAMP) to facilitate rapid detection of COVID-19. The 3D-printed device-powered using only a 5 Volt AC-DC adapter-can perform 16 simultaneous RT-LAMP reactions and can be used multiple times. Moreover, the experimental protocol is devised to obviate the need for separate, expensive equipment for RNA extraction in addition to eliminating sample evaporation. The entire process from sample preparation to the qualitative assessment of the LAMP amplification takes only 45 min (10 min for pre-heating and 35 min for RT-LAMP reactions). The completion of the amplification reaction yields a fuchsia color for the negative samples and either a yellow or orange color for the positive samples, based on a pH indicator dye. The device is coupled with a novel deep learning system that automatically analyzes the amplification results and pays attention to the pH indicator dye to screen the COVID-19 subjects. The proposed device has been rigorously tested on 250 RT-LAMP clinical samples, where it achieved an overall specificity and sensitivity of 0.9666 and 0.9722, respectively with a recall of 0.9892 for Ct < 30. Also, the proposed system can be widely used as an accurate, sensitive, rapid, and portable tool to detect COVID-19 in settings where access to a lab is difficult, or the results are urgently required.
Collapse
Affiliation(s)
- Waqas Waheed
- Department of Mechanical Engineering, Khalifa University, Abu Dhabi, UAE
| | - Sueda Saylan
- System on Chip Center (SOCC), Khalifa University, Abu Dhabi, UAE
- Department of Electrical Engineering and Computer Science, Khalifa University, Abu Dhabi, UAE
| | - Taimur Hassan
- Department of Electrical Engineering and Computer Science, Khalifa University, Abu Dhabi, UAE
- Center for Cyber-Physical Systems (C2PS), EECS Department, Khalifa University, Abu Dhabi, UAE
| | - Hussain Kannout
- Center for Biotechnology (BTC), Khalifa University, Abu Dhabi, UAE
| | - Habiba Alsafar
- Center for Biotechnology (BTC), Khalifa University, Abu Dhabi, UAE
- College of Medicine and Health Sciences, Khalifa University, Abu Dhabi, UAE
| | - Anas Alazzam
- Department of Mechanical Engineering, Khalifa University, Abu Dhabi, UAE.
- System on Chip Center (SOCC), Khalifa University, Abu Dhabi, UAE.
| |
Collapse
|
303
|
Mary Shyni H, Chitra E. A COMPARATIVE STUDY OF X-RAY AND CT IMAGES IN COVID-19 DETECTION USING IMAGE PROCESSING AND DEEP LEARNING TECHNIQUES. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE UPDATE 2022; 2:100054. [PMID: 35281724 PMCID: PMC8898857 DOI: 10.1016/j.cmpbup.2022.100054] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/03/2023]
Abstract
The deadly coronavirus has not just devastated the lives of millions but has put the entire healthcare system under tremendous pressure. Early diagnosis of COVID-19 plays a significant role in isolating the positive cases and preventing the further spread of the disease. The medical images along with deep learning models provided faster and more accurate results in the detection of COVID-19. This article extensively reviews the recent deep learning techniques for COVID-19 diagnosis. The research articles discussed reveal that Convolutional Neural Network (CNN) is the most popular deep learning algorithm in detecting COVID-19 from medical images. An overview of the necessity of pre-processing the medical images, transfer learning and data augmentation techniques to deal with data scarcity problems, use of pre-trained models to save time and the role of medical images in the automatic detection of COVID-19 are summarized. This article also provides a sensible outlook for the young researchers to develop highly effective CNN models coupled with medical images in the early detection of the disease.
Collapse
Affiliation(s)
- H Mary Shyni
- Department of Electronics and Communication Engineering, SRM Institute of Science and Technology, Kattankulathur, Chennai, Tamil Nadu, India
| | - E Chitra
- Department of Electronics and Communication Engineering, SRM Institute of Science and Technology, Kattankulathur, Chennai, Tamil Nadu, India
| |
Collapse
|
304
|
Nillmani, Jain PK, Sharma N, Kalra MK, Viskovic K, Saba L, Suri JS. Four Types of Multiclass Frameworks for Pneumonia Classification and Its Validation in X-ray Scans Using Seven Types of Deep Learning Artificial Intelligence Models. Diagnostics (Basel) 2022; 12:652. [PMID: 35328205 PMCID: PMC8946935 DOI: 10.3390/diagnostics12030652] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2022] [Revised: 03/04/2022] [Accepted: 03/04/2022] [Indexed: 12/31/2022] Open
Abstract
Background and Motivation: The novel coronavirus causing COVID-19 is exceptionally contagious, highly mutative, decimating human health and life, as well as the global economy, by consistent evolution of new pernicious variants and outbreaks. The reverse transcriptase polymerase chain reaction currently used for diagnosis has major limitations. Furthermore, the multiclass lung classification X-ray systems having viral, bacterial, and tubercular classes—including COVID-19—are not reliable. Thus, there is a need for a robust, fast, cost-effective, and easily available diagnostic method. Method: Artificial intelligence (AI) has been shown to revolutionize all walks of life, particularly medical imaging. This study proposes a deep learning AI-based automatic multiclass detection and classification of pneumonia from chest X-ray images that are readily available and highly cost-effective. The study has designed and applied seven highly efficient pre-trained convolutional neural networks—namely, VGG16, VGG19, DenseNet201, Xception, InceptionV3, NasnetMobile, and ResNet152—for classification of up to five classes of pneumonia. Results: The database consisted of 18,603 scans with two, three, and five classes. The best results were using DenseNet201, VGG16, and VGG16, respectively having accuracies of 99.84%, 96.7%, 92.67%; sensitivity of 99.84%, 96.63%, 92.70%; specificity of 99.84, 96.63%, 92.41%; and AUC of 1.0, 0.97, 0.92 (p < 0.0001 for all), respectively. Our system outperformed existing methods by 1.2% for the five-class model. The online system takes <1 s while demonstrating reliability and stability. Conclusions: Deep learning AI is a powerful paradigm for multiclass pneumonia classification.
Collapse
Affiliation(s)
- Nillmani
- School of Biomedical Engineering, Indian Institute of Technology (BHU), Varanasi 221005, India; (N.); (P.K.J.); (N.S.)
| | - Pankaj K. Jain
- School of Biomedical Engineering, Indian Institute of Technology (BHU), Varanasi 221005, India; (N.); (P.K.J.); (N.S.)
| | - Neeraj Sharma
- School of Biomedical Engineering, Indian Institute of Technology (BHU), Varanasi 221005, India; (N.); (P.K.J.); (N.S.)
| | - Mannudeep K. Kalra
- Department of Radiology, Massachusetts General Hospital, Boston, MA 02115, USA;
| | - Klaudija Viskovic
- Department of Radiology and Ultrasound, University Hospital for Infectious Diseases, 10000 Zagreb, Croatia;
| | - Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), 10015 Cagliari, Italy;
| | - Jasjit S. Suri
- Stroke Diagnostic and Monitoring Division, AtheroPoint, Roseville, CA 95661, USA
- Knowledge Engineering Center, Global Biomedical Technologies, Inc., Roseville, CA 95661, USA
| |
Collapse
|
305
|
Kanwal S, Khan F, Alamri S, Dashtipur K, Gogate M. COVID-opt-aiNet: A clinical decision support system for COVID-19 detection. INTERNATIONAL JOURNAL OF IMAGING SYSTEMS AND TECHNOLOGY 2022; 32:444-461. [PMID: 35465215 PMCID: PMC9015255 DOI: 10.1002/ima.22695] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/20/2021] [Revised: 12/05/2021] [Accepted: 12/11/2021] [Indexed: 05/08/2023]
Abstract
Coronavirus disease (COVID-19) has had a major and sometimes lethal effect on global public health. COVID-19 detection is a difficult task that necessitates the use of intelligent diagnosis algorithms. Numerous studies have suggested the use of artificial intelligence (AI) and machine learning (ML) techniques to detect COVID-19 infection in patients through chest X-ray image analysis. The use of medical imaging with different modalities for COVID-19 detection has become an important means of containing the spread of this disease. However, medical images are not sufficiently adequate for routine clinical use; there is, therefore, an increasing need for AI to be applied to improve the diagnostic performance of medical image analysis. Regrettably, due to the evolving nature of the COVID-19 global epidemic, the systematic collection of a large data set for deep neural network (DNN)/ML training is problematic. Inspired by these studies, and to aid in the medical diagnosis and control of this contagious disease, we suggest a novel approach that ensembles the feature selection capability of the optimized artificial immune networks (opt-aiNet) algorithm with deep learning (DL) and ML techniques for better prediction of the disease. In this article, we experimented with a DNN, a convolutional neural network (CNN), bidirectional long-short-term memory, a support vector machine (SVM), and logistic regression for the effective detection of COVID-19 in patients. We illustrate the effectiveness of this proposed technique by using COVID-19 image datasets with a variety of modalities. An empirical study using the COVID-19 image dataset demonstrates that the proposed hybrid approaches, named COVID-opt-aiNet, improve classification accuracy by up to 98%-99% for SVM, 96%-97% for DNN, and 70.85%-71% for CNN, to name a few examples. Furthermore, statistical analysis ensures the validity of our proposed algorithms. The source code can be downloaded from Github: https://github.com/faizakhan1925/COVID-opt-aiNet.
Collapse
Affiliation(s)
- Summrina Kanwal
- Department of Computing and InformaticsSaudi Electronic UniversityRiyadhSaudi Arabia
| | - Faiza Khan
- Faculty of ComputingRiphah International UniversityIslamabadPakistan
| | - Sultan Alamri
- Department of Computing and InformaticsSaudi Electronic UniversityRiyadhSaudi Arabia
| | - Kia Dashtipur
- James Watt School of EngineeringUniversity of GlasgowGlasgowUK
| | - Mandar Gogate
- School of Computing, Merchiston Campus, Edinburgh Napier UniversityEdinburghUK
| |
Collapse
|
306
|
Panahi A, Askari Moghadam R, Akrami M, Madani K. Deep Residual Neural Network for COVID-19 Detection from Chest X-ray Images. SN COMPUTER SCIENCE 2022; 3:169. [PMID: 35224513 PMCID: PMC8860458 DOI: 10.1007/s42979-022-01067-3] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/17/2021] [Accepted: 11/27/2021] [Indexed: 12/22/2022]
Abstract
The COVID-19 diffused quickly throughout the world and converted as a pandemic. It has caused a destructive effect on both regular lives, common health and global business. It is crucial to identify positive patients as shortly as desirable to limit this epidemic’s further diffusion and to manage immediately affected cases. The demand for quick assistant distinguishing devices has developed. Recent findings achieved utilizing radiology imaging systems propose that such images include salient data about the COVID-19. The utilization of progressive artificial intelligence (AI) methods linked by radiological imaging can help the reliable diagnosis of COVID-19. As radiography images can recognize pneumonia infections, this research brings an accurate and automatic technique based on a deep residual network to analyze chest X-ray images to monitor COVID-19 and diagnose verified patients. The physician states that it is significantly challenging to separate COVID-19 from common viral and bacterial pneumonia, while COVID-19 is additionally a variety of viruses. The proposed network is expanded to perform detailed diagnostics for two multi-class classification (COVID-19, Normal, Viral Pneumonia) and (COVID-19, Normal, Viral Pneumonia, Bacterial Pneumonia) and binary classification. By comparing the proposed network with the popular methods on public databases, the results show that the proposed algorithm can provide an accuracy of 92.1% in classifying multi-classes of COVID-19, normal, viral pneumonia, and bacterial pneumonia cases. It can be applied to support radiologists in verifying their first viewpoint.
Collapse
Affiliation(s)
- Amirhossein Panahi
- Faculty of New Sciences and Technologies, University of Tehran, Tehran, Iran
| | | | - Mohammadreza Akrami
- Faculty of New Sciences and Technologies, University of Tehran, Tehran, Iran
| | - Kurosh Madani
- LISSI Lab, Senart-FB Institute of Technology, University Paris Est-Creteil (UPEC), Lieusaint, France
| |
Collapse
|
307
|
Alyasseri ZAA, Al‐Betar MA, Doush IA, Awadallah MA, Abasi AK, Makhadmeh SN, Alomari OA, Abdulkareem KH, Adam A, Damasevicius R, Mohammed MA, Zitar RA. Review on COVID-19 diagnosis models based on machine learning and deep learning approaches. EXPERT SYSTEMS 2022; 39:e12759. [PMID: 34511689 PMCID: PMC8420483 DOI: 10.1111/exsy.12759] [Citation(s) in RCA: 61] [Impact Index Per Article: 20.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/29/2021] [Revised: 05/17/2021] [Accepted: 06/07/2021] [Indexed: 05/02/2023]
Abstract
COVID-19 is the disease evoked by a new breed of coronavirus called the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). Recently, COVID-19 has become a pandemic by infecting more than 152 million people in over 216 countries and territories. The exponential increase in the number of infections has rendered traditional diagnosis techniques inefficient. Therefore, many researchers have developed several intelligent techniques, such as deep learning (DL) and machine learning (ML), which can assist the healthcare sector in providing quick and precise COVID-19 diagnosis. Therefore, this paper provides a comprehensive review of the most recent DL and ML techniques for COVID-19 diagnosis. The studies are published from December 2019 until April 2021. In general, this paper includes more than 200 studies that have been carefully selected from several publishers, such as IEEE, Springer and Elsevier. We classify the research tracks into two categories: DL and ML and present COVID-19 public datasets established and extracted from different countries. The measures used to evaluate diagnosis methods are comparatively analysed and proper discussion is provided. In conclusion, for COVID-19 diagnosing and outbreak prediction, SVM is the most widely used machine learning mechanism, and CNN is the most widely used deep learning mechanism. Accuracy, sensitivity, and specificity are the most widely used measurements in previous studies. Finally, this review paper will guide the research community on the upcoming development of machine learning for COVID-19 and inspire their works for future development. This review paper will guide the research community on the upcoming development of ML and DL for COVID-19 and inspire their works for future development.
Collapse
Affiliation(s)
- Zaid Abdi Alkareem Alyasseri
- Center for Artificial Intelligence Technology, Faculty of Information Science and TechnologyUniversiti Kebangsaan MalaysiaBangiMalaysia
- ECE Department‐Faculty of EngineeringUniversity of KufaNajafIraq
| | - Mohammed Azmi Al‐Betar
- Artificial Intelligence Research Center (AIRC)Ajman UniversityAjmanUnited Arab Emirates
- Department of Information TechnologyAl‐Huson University College, Al‐Balqa Applied UniversityIrbidJordan
| | - Iyad Abu Doush
- Computing Department, College of Engineering and Applied SciencesAmerican University of KuwaitSalmiyaKuwait
- Computer Science DepartmentYarmouk UniversityIrbidJordan
| | - Mohammed A. Awadallah
- Artificial Intelligence Research Center (AIRC)Ajman UniversityAjmanUnited Arab Emirates
- Department of Computer ScienceAl‐Aqsa UniversityGazaPalestine
| | - Ammar Kamal Abasi
- Artificial Intelligence Research Center (AIRC)Ajman UniversityAjmanUnited Arab Emirates
- School of Computer SciencesUniversiti Sains MalaysiaPenangMalaysia
| | - Sharif Naser Makhadmeh
- Artificial Intelligence Research Center (AIRC)Ajman UniversityAjmanUnited Arab Emirates
- Faculty of Information TechnologyMiddle East UniversityAmmanJordan
| | | | | | - Afzan Adam
- Center for Artificial Intelligence Technology, Faculty of Information Science and TechnologyUniversiti Kebangsaan MalaysiaBangiMalaysia
| | | | - Mazin Abed Mohammed
- College of Computer Science and Information TechnologyUniversity of AnbarAnbarIraq
| | - Raed Abu Zitar
- Sorbonne Center of Artificial IntelligenceSorbonne University‐Abu DhabiAbu DhabiUnited Arab Emirates
| |
Collapse
|
308
|
Deep multi-view feature learning for detecting COVID-19 based on chest X-ray images. Biomed Signal Process Control 2022; 75:103595. [PMID: 35222680 PMCID: PMC8864146 DOI: 10.1016/j.bspc.2022.103595] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/26/2021] [Revised: 02/04/2022] [Accepted: 02/20/2022] [Indexed: 12/14/2022]
Abstract
Aim COVID-19 is a pandemic infectious disease which has influenced the life and health of many communities since December 2019. Due to the rapid worldwide spread of this highly contagious disease, making its early detection with high accuracy important for breaking the chain of transition. X-ray images of COVID-19 patients, reveal specific abnormalities associated with this disease. Methods In this study, a multi-view feature learning method for detecting COVID-19 based on chest X-ray images is presented. This method provides a framework for exploiting the multiple types of deep features, which is able to preserve both the correlative and the complementary information, and achieve accurate detection at the classification phase. Deep features are extracted using pre-trained deep CNN models of AlexNet, GoogleNet, ResNet50, SqueezeNet, and VGG19. The learned feature representation of X-ray images are then classified using ELM. Results The experiments show that our method achieves accuracy scores of 100%, 99.82%, and 99.82% in detecting three classes of COVID-19, normal, and pneumonia, respectively. The sensitivities of three classes are 100%, 100%, and 99.45%, respectively. The specificities of three classes are 100%, 99.73%, and 100%, respectively. The precision values of three classes are 100%, 99.45%, and 100%, respectively. The F-scores of three classes are 100%, 99.73%, and 99.72%, respectively. The overall accuracy score of our method is 99.82%. Conclusions The results demonstrate the effectiveness of our method in detecting COVID-19 cases and can therefore assist experts in early diagnosis based on X-ray images.
Collapse
|
309
|
Shah PM, Ullah H, Ullah R, Shah D, Wang Y, Islam SU, Gani A, Rodrigues JJPC. DC-GAN-based synthetic X-ray images augmentation for increasing the performance of EfficientNet for COVID-19 detection. EXPERT SYSTEMS 2022; 39:e12823. [PMID: 34898799 PMCID: PMC8646497 DOI: 10.1111/exsy.12823] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 04/15/2021] [Revised: 06/30/2021] [Accepted: 08/13/2021] [Indexed: 06/14/2023]
Abstract
Currently, many deep learning models are being used to classify COVID-19 and normal cases from chest X-rays. However, the available data (X-rays) for COVID-19 is limited to train a robust deep-learning model. Researchers have used data augmentation techniques to tackle this issue by increasing the numbers of samples through flipping, translation, and rotation. However, by adopting this strategy, the model compromises for the learning of high-dimensional features for a given problem. Hence, there are high chances of overfitting. In this paper, we used deep-convolutional generative adversarial networks algorithm to address this issue, which generates synthetic images for all the classes (Normal, Pneumonia, and COVID-19). To validate whether the generated images are accurate, we used the k-mean clustering technique with three clusters (Normal, Pneumonia, and COVID-19). We only selected the X-ray images classified in the correct clusters for training. In this way, we formed a synthetic dataset with three classes. The generated dataset was then fed to The EfficientNetB4 for training. The experiments achieved promising results of 95% in terms of area under the curve (AUC). To validate that our network has learned discriminated features associated with lung in the X-rays, we used the Grad-CAM technique to visualize the underlying pattern, which leads the network to its final decision.
Collapse
Affiliation(s)
- Pir Masoom Shah
- School of Computer ScienceWuhan UniversityWuhanChina
- Department of Computer ScienceBacha Khan UniversityCharsaddaPakistan
| | - Hamid Ullah
- Department of Computer ScienceKohat University of Science and TechnologyKohatPakistan
| | - Rahim Ullah
- Department of Computer ScienceUniversity of MalakandMalakandPakistan
| | - Dilawar Shah
- Department of Computer ScienceBacha Khan UniversityCharsaddaPakistan
| | - Yulin Wang
- School of Computer ScienceWuhan UniversityWuhanChina
| | - Saif ul Islam
- Department of Computer ScienceKICSIT, Institute of Space TechnologyIslamabadPakistan
| | - Abdullah Gani
- Faculty of Computing and InformaticsUniversity Malaysia SabahLabuanMalaysia
| | | |
Collapse
|
310
|
Ghayvat H, Awais M, Bashir AK, Pandya S, Zuhair M, Rashid M, Nebhen J. AI-enabled radiologist in the loop: novel AI-based framework to augment radiologist performance for COVID-19 chest CT medical image annotation and classification from pneumonia. Neural Comput Appl 2022; 35:14591-14609. [PMID: 35250181 PMCID: PMC8886865 DOI: 10.1007/s00521-022-07055-1] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2021] [Accepted: 01/31/2022] [Indexed: 12/16/2022]
Abstract
A SARS-CoV-2 virus-specific reverse transcriptase-polymerase chain reaction (RT-PCR) test is usually used to diagnose COVID-19. However, this test requires up to 2 days for completion. Moreover, to avoid false-negative outcomes, serial testing may be essential. The availability of RT-PCR test kits is currently limited, highlighting the need for alternative approaches for the precise and rapid diagnosis of COVID-19. Patients suspected to be infected with SARS-CoV-2 can be assessed using chest CT scan images. However, CT images alone cannot be used for ruling out SARS-CoV-2 infection because individual patients may exhibit normal radiological results in the primary phases of the disease. A machine learning (ML)-based recognition and segmentation system was developed to spontaneously discover and compute infection areas in CT scans of COVID-19 patients. The computable assessment exhibited suitable performance for automatic infection region allocation. The ML models developed were suitable for the direct detection of COVID-19 (+). ML was confirmed to be a complementary diagnostic technique for diagnosing COVID-19(+) by forefront medical specialists. The complete manual delineation of COVID-19 often requires up to 225.5 min; however, the proposed RILML method decreases the delineation time to 7 min after four iterations of model updating.
Collapse
Affiliation(s)
- Hemant Ghayvat
- Innovation Division, Technical University of Denmark, Lyngby, Denmark
- Department of Computer Science and Media Technology, E-health Unit (Improved Data to and from Patients), Linnaeus University, Vaxjo, Sweden
- Building Realization and Robotics, Technical University of Munich, Munich, Germany
| | - Muhammad Awais
- Center for Intelligent Medical Electronics, Department of Electronic Engineering, School of Information Science and Technology, Fudan University, Shanghai, 200433 China
| | - A. K. Bashir
- Department of Computing and Mathematics, Manchester Metropolitan University, Manchester, UK
- School of Information and Communication Engineering, University of Electronics Science and Technology of China (UESTC), Chengdu, China
| | - Sharnil Pandya
- Symbiosis Centre for Applied Artificial Intelligence, Symbiosis International (Deemed University), Pune, Maharashtra India
| | - Mohd Zuhair
- Department of Computer Science and Engineering, Nirma University, Ahmedabad, Gujarat India
| | - Mamoon Rashid
- Department of Computer Engineering, Faculty of Science and Technology, Vishwakarma University, Pune, India
| | - Jamel Nebhen
- College of Computer Engineering and Sciences, Prince Sattam Bin Abdulaziz University, Al-kharj, Saudi Arabia
| |
Collapse
|
311
|
Riahi A, Elharrouss O, Al-Maadeed S. BEMD-3DCNN-based method for COVID-19 detection. Comput Biol Med 2022; 142:105188. [PMID: 34998222 PMCID: PMC8717690 DOI: 10.1016/j.compbiomed.2021.105188] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2021] [Revised: 12/27/2021] [Accepted: 12/27/2021] [Indexed: 12/23/2022]
Abstract
The coronavirus outbreak continues to spread around the world and no one knows when it will stop. Therefore, from the first day of the identification of the virus in Wuhan, China, scientists have launched numerous research projects to understand the nature of the virus, how to detect it, and search for the most effective medicine to help and protect patients. Importantly, a rapid diagnostic and detection system is a priority and should be developed to stop COVID-19 from spreading. Medical imaging techniques have been used for this purpose. Current research is focused on exploiting different backbones like VGG, ResNet, DenseNet, or combining them to detect COVID-19. By using these backbones many aspects cannot be analyzed like the spatial and contextual information in the images, although this information can be useful for more robust detection performance. In this paper, we used 3D representation of the data as input for the proposed 3DCNN-based deep learning model. The process includes using the Bi-dimensional Empirical Mode Decomposition (BEMD) technique to decompose the original image into IMFs, and then building a video of these IMF images. The formed video is used as input for the 3DCNN model to classify and detect the COVID-19 virus. The 3DCNN model consists of a 3D VGG-16 backbone followed by a Context-aware attention (CAA) module, and then fully connected layers for classification. Each CAA module takes the feature maps of different blocks of the backbone, which allows learning from different feature maps. In our experiments, we used 6484 X-ray images, of which 1802 were COVID-19 positive cases, 1910 normal cases, and 2772 pneumonia cases. The experiment results showed that our proposed technique achieved the desired results on the selected dataset. Additionally, the use of the 3DCNN model with contextual information processing exploited CAA networks to achieve better performance.
Collapse
Affiliation(s)
- Ali Riahi
- Department of Computer Science and Engineering, Department of Computer Science and Engineering, Qatar University, Doha, Qatar.
| | - Omar Elharrouss
- Department of Computer Science and Engineering, Department of Computer Science and Engineering, Qatar University, Doha, Qatar.
| | - Somaya Al-Maadeed
- Department of Computer Science and Engineering, Department of Computer Science and Engineering, Qatar University, Doha, Qatar.
| |
Collapse
|
312
|
Awassa L, Jdey I, Dhahri H, Hcini G, Mahmood A, Othman E, Haneef M. Study of Different Deep Learning Methods for Coronavirus (COVID-19) Pandemic: Taxonomy, Survey and Insights. SENSORS (BASEL, SWITZERLAND) 2022; 22:1890. [PMID: 35271037 PMCID: PMC8915023 DOI: 10.3390/s22051890] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/05/2022] [Revised: 02/12/2022] [Accepted: 02/21/2022] [Indexed: 12/15/2022]
Abstract
COVID-19 has evolved into one of the most severe and acute illnesses. The number of deaths continues to climb despite the development of vaccines and new strains of the virus have appeared. The early and precise recognition of COVID-19 are key in viably treating patients and containing the pandemic on the whole. Deep learning technology has been shown to be a significant tool in diagnosing COVID-19 and in assisting radiologists to detect anomalies and numerous diseases during this epidemic. This research seeks to provide an overview of novel deep learning-based applications for medical imaging modalities, computer tomography (CT) and chest X-rays (CXR), for the detection and classification COVID-19. First, we give an overview of the taxonomy of medical imaging and present a summary of types of deep learning (DL) methods. Then, utilizing deep learning techniques, we present an overview of systems created for COVID-19 detection and classification. We also give a rundown of the most well-known databases used to train these networks. Finally, we explore the challenges of using deep learning algorithms to detect COVID-19, as well as future research prospects in this field.
Collapse
Affiliation(s)
- Lamia Awassa
- Faculty of Sciences and Technology of Sidi Bouzid, University of Kairouan, Kairouan 3100, Tunisia; (L.A.); (I.J.); (G.H.)
| | - Imen Jdey
- Faculty of Sciences and Technology of Sidi Bouzid, University of Kairouan, Kairouan 3100, Tunisia; (L.A.); (I.J.); (G.H.)
| | - Habib Dhahri
- Faculty of Sciences and Technology of Sidi Bouzid, University of Kairouan, Kairouan 3100, Tunisia; (L.A.); (I.J.); (G.H.)
- Department of Information Science, College of Applied Computer Sciences, King Saud University, Riyadh 11451, Saudi Arabia; (A.M.); (E.O.)
| | - Ghazala Hcini
- Faculty of Sciences and Technology of Sidi Bouzid, University of Kairouan, Kairouan 3100, Tunisia; (L.A.); (I.J.); (G.H.)
| | - Awais Mahmood
- Department of Information Science, College of Applied Computer Sciences, King Saud University, Riyadh 11451, Saudi Arabia; (A.M.); (E.O.)
| | - Esam Othman
- Department of Information Science, College of Applied Computer Sciences, King Saud University, Riyadh 11451, Saudi Arabia; (A.M.); (E.O.)
| | - Muhammad Haneef
- Department of Electrical Engineering, Foundation University Islamabad, Islamabad 44000, Pakistan;
| |
Collapse
|
313
|
Bozkurt F. A deep and handcrafted features-based framework for diagnosis of COVID-19 from chest x-ray images. CONCURRENCY AND COMPUTATION : PRACTICE & EXPERIENCE 2022; 34:e6725. [PMID: 34899079 PMCID: PMC8646664 DOI: 10.1002/cpe.6725] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/02/2021] [Revised: 09/24/2021] [Accepted: 10/29/2021] [Indexed: 05/07/2023]
Abstract
Automatic early diagnosis of COVID-19 with computer-aided tools is crucial for disease treatment and control. Radiology images of COVID-19 and other lung diseases like bacterial pneumonia, viral pneumonia have common features. Thus, this similarity makes it difficult for radiologists to detect COVID-19 cases. A reliable method for classifying non-COVID-19 and COVID-19 chest x-ray images could be useful to reduce triage process and diagnose. In this study, we develop an original framework (HANDEFU) that supports handcrafted, deep, and fusion-based feature extraction techniques for feature engineering. The user interactively builds any model by selecting feature extraction technique and classification method through the framework. Any feature extraction technique and model could then be added dynamically to the library of software at a later time upon request. The novelty of this study is that image preprocessing and diverse feature extraction and classification techniques are assembled under an original framework. In this study, this framework is utilized for diagnosing COVID-19 from chest x-ray images on an open-access dataset. All of the experimental results and performance evaluations on this dataset are performed with this software. In experimental studies, COVID-19 prediction is performed by 27 different models through software. The superior performance with accuracy of 99.36% is obtained by LBP+SVM model.
Collapse
Affiliation(s)
- Ferhat Bozkurt
- Department of Computer Engineering, Faculty of EngineeringAtatürk UniversityErzurumTurkey
| |
Collapse
|
314
|
Kini AS, Gopal Reddy AN, Kaur M, Satheesh S, Singh J, Martinetz T, Alshazly H. Ensemble Deep Learning and Internet of Things-Based Automated COVID-19 Diagnosis Framework. CONTRAST MEDIA & MOLECULAR IMAGING 2022; 2022:7377502. [PMID: 35280708 PMCID: PMC8896964 DOI: 10.1155/2022/7377502] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/29/2021] [Accepted: 01/24/2022] [Indexed: 12/17/2022]
Abstract
Coronavirus disease (COVID-19) is a viral infection caused by SARS-CoV-2. The modalities such as computed tomography (CT) have been successfully utilized for the early stage diagnosis of COVID-19 infected patients. Recently, many researchers have utilized deep learning models for the automated screening of COVID-19 suspected cases. An ensemble deep learning and Internet of Things (IoT) based framework is proposed for screening of COVID-19 suspected cases. Three well-known pretrained deep learning models are ensembled. The medical IoT devices are utilized to collect the CT scans, and automated diagnoses are performed on IoT servers. The proposed framework is compared with thirteen competitive models over a four-class dataset. Experimental results reveal that the proposed ensembled deep learning model yielded 98.98% accuracy. Moreover, the model outperforms all competitive models in terms of other performance metrics achieving 98.56% precision, 98.58% recall, 98.75% F-score, and 98.57% AUC. Therefore, the proposed framework can improve the acceleration of COVID-19 diagnosis.
Collapse
Affiliation(s)
- Anita S. Kini
- Manipal Institute of Technology MAHE, Manipal, Karnataka 576104, India
| | - A. Nanda Gopal Reddy
- Department of IT, Mahaveer Institute of Science and Technology, Hyderabad, Telangana 500005, India
| | - Manjit Kaur
- School of Electrical Engineering and Computer Science, Gwangju Institute of Science and Technology, Gwangju 61005, Republic of Korea
| | - S. Satheesh
- Department of Electronics and Communication Engineering, Malineni Lakshmaiah Women's Engineering College, Guntur, Andhra Pradesh 522017, India
| | - Jagendra Singh
- School of Computer Science Engineering and Technology, Bennett University, Greater Noida-203206, India
| | - Thomas Martinetz
- Institute for Neuro- and Bioinformatics, University of Lübeck, Lübeck 23562, Germany
| | - Hammam Alshazly
- Faculty of Computers and Information, South Valley University, Qena 83523, Egypt
| |
Collapse
|
315
|
Thermal Change Index-Based Diabetic Foot Thermogram Image Classification Using Machine Learning Techniques. SENSORS 2022; 22:s22051793. [PMID: 35270938 PMCID: PMC8915003 DOI: 10.3390/s22051793] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/09/2022] [Revised: 02/15/2022] [Accepted: 02/17/2022] [Indexed: 12/31/2022]
Abstract
Diabetes mellitus (DM) can lead to plantar ulcers, amputation and death. Plantar foot thermogram images acquired using an infrared camera have been shown to detect changes in temperature distribution associated with a higher risk of foot ulceration. Machine learning approaches applied to such infrared images may have utility in the early diagnosis of diabetic foot complications. In this work, a publicly available dataset was categorized into different classes, which were corroborated by domain experts, based on a temperature distribution parameter—the thermal change index (TCI). We then explored different machine-learning approaches for classifying thermograms of the TCI-labeled dataset. Classical machine learning algorithms with feature engineering and the convolutional neural network (CNN) with image enhancement techniques were extensively investigated to identify the best performing network for classifying thermograms. The multilayer perceptron (MLP) classifier along with the features extracted from thermogram images showed an accuracy of 90.1% in multi-class classification, which outperformed the literature-reported performance metrics on this dataset.
Collapse
|
316
|
Vineth Ligi S, Kundu SS, Kumar R, Narayanamoorthi R, Lai KW, Dhanalakshmi S. Radiological Analysis of COVID-19 Using Computational Intelligence: A Broad Gauge Study. JOURNAL OF HEALTHCARE ENGINEERING 2022; 2022:5998042. [PMID: 35251572 PMCID: PMC8890832 DOI: 10.1155/2022/5998042] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/13/2021] [Revised: 12/13/2021] [Accepted: 01/07/2022] [Indexed: 12/20/2022]
Abstract
Pulmonary medical image analysis using image processing and deep learning approaches has made remarkable achievements in the diagnosis, prognosis, and severity check of lung diseases. The epidemic of COVID-19 brought out by the novel coronavirus has triggered a critical need for artificial intelligence assistance in diagnosing and controlling the disease to reduce its effects on people and global economies. This study aimed at identifying the various COVID-19 medical imaging analysis models proposed by different researchers and featured their merits and demerits. It gives a detailed discussion on the existing COVID-19 detection methodologies (diagnosis, prognosis, and severity/risk detection) and the challenges encountered for the same. It also highlights the various preprocessing and post-processing methods involved to enhance the detection mechanism. This work also tries to bring out the different unexplored research areas that are available for medical image analysis and how the vast research done for COVID-19 can advance the field. Despite deep learning methods presenting high levels of efficiency, some limitations have been briefly described in the study. Hence, this review can help understand the utilization and pros and cons of deep learning in analyzing medical images.
Collapse
Affiliation(s)
- S. Vineth Ligi
- Department of Electronics and Communication Engineering, College of Engineering and Technology, Faculty of Engineering and Technology, SRM Institute of Science and Technology, SRM Nagar, Kattankulathur, Chengalpattu, Chennai, TN, India
| | - Soumya Snigdha Kundu
- Department of Computer Science Engineering, College of Engineering and Technology, Faculty of Engineering and Technology, SRM Institute of Science and Technology, SRM Nagar, Kattankulathur, Chengalpattu, Chennai, TN, India
| | - R. Kumar
- Department of Electronics and Communication Engineering, College of Engineering and Technology, Faculty of Engineering and Technology, SRM Institute of Science and Technology, SRM Nagar, Kattankulathur, Chengalpattu, Chennai, TN, India
| | - R. Narayanamoorthi
- Department of Electrical and Electronics Engineering, College of Engineering and Technology, Faculty of Engineering and Technology, SRM Institute of Science and Technology, SRM Nagar, Kattankulathur, Chengalpattu, Chennai, TN, India
| | - Khin Wee Lai
- Department of Biomedical Engineering, Faculty of Engineering, Universiti Malaya, Kuala Lumpur, Malaysia
| | - Samiappan Dhanalakshmi
- Department of Electronics and Communication Engineering, College of Engineering and Technology, Faculty of Engineering and Technology, SRM Institute of Science and Technology, SRM Nagar, Kattankulathur, Chengalpattu, Chennai, TN, India
| |
Collapse
|
317
|
Nneji GU, Deng J, Monday HN, Hossin MA, Obiora S, Nahar S, Cai J. COVID-19 Identification from Low-Quality Computed Tomography Using a Modified Enhanced Super-Resolution Generative Adversarial Network Plus and Siamese Capsule Network. Healthcare (Basel) 2022; 10:healthcare10020403. [PMID: 35207017 PMCID: PMC8871692 DOI: 10.3390/healthcare10020403] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2022] [Revised: 02/09/2022] [Accepted: 02/17/2022] [Indexed: 12/22/2022] Open
Abstract
Computed Tomography has become a vital screening method for the detection of coronavirus 2019 (COVID-19). With the high mortality rate and overload for domain experts, radiologists, and clinicians, there is a need for the application of a computerized diagnostic technique. To this effect, we have taken into consideration improving the performance of COVID-19 identification by tackling the issue of low quality and resolution of computed tomography images by introducing our method. We have reported about a technique named the modified enhanced super resolution generative adversarial network for a better high resolution of computed tomography images. Furthermore, in contrast to the fashion of increasing network depth and complexity to beef up imaging performance, we incorporated a Siamese capsule network that extracts distinct features for COVID-19 identification.The qualitative and quantitative results establish that the proposed model is effective, accurate, and robust for COVID-19 screening. We demonstrate the proposed model for COVID-19 identification on a publicly available dataset COVID-CT, which contains 349 COVID-19 and 463 non-COVID-19 computed tomography images. The proposed method achieves an accuracy of 97.92%, sensitivity of 98.85%, specificity of 97.21%, AUC of 98.03%, precision of 98.44%, and F1 score of 97.52%. Our approach obtained state-of-the-art performance, according to experimental results, which is helpful for COVID-19 screening. This new conceptual framework is proposed to play an influential task in the issue facing COVID-19 and related ailments, with the availability of few datasets.
Collapse
Affiliation(s)
- Grace Ugochi Nneji
- School of Information and Software Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China; (G.U.N.); (J.D.)
| | - Jianhua Deng
- School of Information and Software Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China; (G.U.N.); (J.D.)
| | - Happy Nkanta Monday
- School of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China;
| | - Md Altab Hossin
- School of Management and Economics, University of Electronic Science and Technology of China, Chengdu 611731, China; (M.A.H.); (S.O.)
| | - Sandra Obiora
- School of Management and Economics, University of Electronic Science and Technology of China, Chengdu 611731, China; (M.A.H.); (S.O.)
| | - Saifun Nahar
- Department of Information System and Technology, University of Missouri St. Louis, St. Louis 63121, MO, USA;
| | - Jingye Cai
- School of Information and Software Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China; (G.U.N.); (J.D.)
- Correspondence:
| |
Collapse
|
318
|
Chharia A, Upadhyay R, Kumar V, Cheng C, Zhang J, Wang T, Xu M. Deep-Precognitive Diagnosis: Preventing Future Pandemics by Novel Disease Detection With Biologically-Inspired Conv-Fuzzy Network. IEEE ACCESS : PRACTICAL INNOVATIONS, OPEN SOLUTIONS 2022; 10:23167-23185. [PMID: 35360503 PMCID: PMC8967064 DOI: 10.1109/access.2022.3153059] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/29/2022] [Accepted: 02/12/2022] [Indexed: 05/07/2023]
Abstract
Deep learning-based Computer-Aided Diagnosis has gained immense attention in recent years due to its capability to enhance diagnostic performance and elucidate complex clinical tasks. However, conventional supervised deep learning models are incapable of recognizing novel diseases that do not exist in the training dataset. Automated early-stage detection of novel infectious diseases can be vital in controlling their rapid spread. Moreover, the development of a conventional CAD model is only possible after disease outbreaks and datasets become available for training (viz. COVID-19 outbreak). Since novel diseases are unknown and cannot be included in training data, it is challenging to recognize them through existing supervised deep learning models. Even after data becomes available, recognizing new classes with conventional models requires a complete extensive re-training. The present study is the first to report this problem and propose a novel solution to it. In this study, we propose a new class of CAD models, i.e., Deep-Precognitive Diagnosis, wherein artificial agents are enabled to identify unknown diseases that have the potential to cause a pandemic in the future. A de novo biologically-inspired Conv-Fuzzy network is developed. Experimental results show that the model trained to classify Chest X-Ray (CXR) scans into normal and bacterial pneumonia detected a novel disease during testing, unseen by it in the training sample and confirmed to be COVID-19 later. The model is also tested on SARS-CoV-1 and MERS-CoV samples as unseen diseases and achieved state-of-the-art accuracy. The proposed model eliminates the need for model re-training by creating a new class in real-time for the detected novel disease, thus classifying it on all subsequent occurrences. Second, the model addresses the challenge of limited labeled data availability, which renders most supervised learning techniques ineffective and establishes that modified fuzzy classifiers can achieve high accuracy on image classification tasks.
Collapse
Affiliation(s)
- Aviral Chharia
- Mechanical Engineering DepartmentThapar Institute of Engineering and TechnologyPatialaPunjab147004India
| | - Rahul Upadhyay
- Electronics and Communication Engineering DepartmentThapar Institute of Engineering and TechnologyPatialaPunjab147004India
| | - Vinay Kumar
- Electronics and Communication Engineering DepartmentThapar Institute of Engineering and TechnologyPatialaPunjab147004India
| | - Chao Cheng
- Department of MedicineBaylor College of MedicineHoustonTX77030USA
| | - Jing Zhang
- Department of Computer ScienceUniversity of California at IrvineIrvineCA92697USA
| | - Tianyang Wang
- Department of Computer Science and Information TechnologyAustin Peay State UniversityClarksvilleTN37044USA
| | - Min Xu
- Computational Biology DepartmentSchool of Computer ScienceCarnegie Mellon UniversityPittsburghPA15213USA
- Computer Vision DepartmentMohamed bin Zayed University of Artificial IntelligenceAbu DhabiUnited Arab Emirates
| |
Collapse
|
319
|
Yao HY, Wan WG, Li X. A deep adversarial model for segmentation-assisted COVID-19 diagnosis using CT images. EURASIP JOURNAL ON ADVANCES IN SIGNAL PROCESSING 2022; 2022:10. [PMID: 35194421 PMCID: PMC8830991 DOI: 10.1186/s13634-022-00842-x] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/07/2021] [Accepted: 01/27/2022] [Indexed: 06/14/2023]
Abstract
The outbreak of coronavirus disease 2019 (COVID-19) is spreading rapidly around the world, resulting in a global pandemic. Imaging techniques such as computed tomography (CT) play an essential role in the diagnosis and treatment of the disease since lung infection or pneumonia is a common complication. However, training a deep network to learn how to diagnose COVID-19 rapidly and accurately in CT images and segment the infected regions like a radiologist is challenging. Since the infectious area is difficult to distinguish manually annotation, the segmentation results are time-consuming. To tackle these problems, we propose an efficient method based on a deep adversarial network to segment the infection regions automatically. Then, the predicted segment results can assist the diagnostic network in identifying the COVID-19 samples from the CT images. On the other hand, a radiologist-like segmentation network provides detailed information of the infectious regions by separating areas of ground-glass, consolidation, and pleural effusion, respectively. Our method can accurately predict the COVID-19 infectious probability and provide lesion regions in CT images with limited training data. Additionally, we have established a public dataset for multitask learning. Extensive experiments on diagnosis and segmentation show superior performance over state-of-the-art methods.
Collapse
Affiliation(s)
- Hai-yan Yao
- School of Communication and Information Engineering, Shanghai University, Shanghai, China
- Anyang Institute of Technology, Anyang, China
| | - Wang-gen Wan
- School of Communication and Information Engineering, Shanghai University, Shanghai, China
| | - Xiang Li
- School of Communication and Information Engineering, Shanghai University, Shanghai, China
| |
Collapse
|
320
|
Aydemir E, Yalcinkaya MA, Barua PD, Baygin M, Faust O, Dogan S, Chakraborty S, Tuncer T, Acharya UR. Hybrid Deep Feature Generation for Appropriate Face Mask Use Detection. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2022; 19:1939. [PMID: 35206124 PMCID: PMC8871993 DOI: 10.3390/ijerph19041939] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/01/2022] [Revised: 01/29/2022] [Accepted: 01/30/2022] [Indexed: 12/04/2022]
Abstract
Mask usage is one of the most important precautions to limit the spread of COVID-19. Therefore, hygiene rules enforce the correct use of face coverings. Automated mask usage classification might be used to improve compliance monitoring. This study deals with the problem of inappropriate mask use. To address that problem, 2075 face mask usage images were collected. The individual images were labeled as either mask, no masked, or improper mask. Based on these labels, the following three cases were created: Case 1: mask versus no mask versus improper mask, Case 2: mask versus no mask + improper mask, and Case 3: mask versus no mask. This data was used to train and test a hybrid deep feature-based masked face classification model. The presented method comprises of three primary stages: (i) pre-trained ResNet101 and DenseNet201 were used as feature generators; each of these generators extracted 1000 features from an image; (ii) the most discriminative features were selected using an improved RelieF selector; and (iii) the chosen features were used to train and test a support vector machine classifier. That resulting model attained 95.95%, 97.49%, and 100.0% classification accuracy rates on Case 1, Case 2, and Case 3, respectively. Having achieved these high accuracy values indicates that the proposed model is fit for a practical trial to detect appropriate face mask use in real time.
Collapse
Affiliation(s)
- Emrah Aydemir
- Department of Management Information, College of Management, Sakarya University, Sakarya 54050, Turkey;
| | - Mehmet Ali Yalcinkaya
- Department of Computer Engineering, Engineering Faculty, Kirsehir Ahi Evran University, Kirsehir 40100, Turkey;
| | - Prabal Datta Barua
- School of Management & Enterprise, University of Southern Queensland, Toowoomba, QLD 4350, Australia;
- Faculty of Engineering and Information Technology, University of Technology Sydney, Sydney, NSW 2007, Australia
- Cogninet Brain Team, Cogninet Australia, Sydney, NSW 2010, Australia
| | - Mehmet Baygin
- Department of Computer Engineering, Faculty of Engineering, Ardahan University, Ardahan 75000, Turkey;
| | - Oliver Faust
- Department of Engineering and Mathematics, Sheffield Hallam University, Sheffield S1 1WB, UK
| | - Sengul Dogan
- Department of Digital Forensics Engineering, College of Technology, Firat University, Elazig 23119, Turkey; (S.D.); (T.T.)
| | - Subrata Chakraborty
- School of Science and Technology, Faculty of Science, Agriculture, Business and Law, University of New England, Armidale, NSW 2351, Australia;
- Centre for Advanced Modelling and Geospatial lnformation Systems (CAMGIS), Faculty of Engineering and Information Technology, University of Technology Sydney, Sydney, NSW 2007, Australia
| | - Turker Tuncer
- Department of Digital Forensics Engineering, College of Technology, Firat University, Elazig 23119, Turkey; (S.D.); (T.T.)
| | - U. Rajendra Acharya
- Department of Electronics and Computer Engineering, Ngee Ann Polytechnic, Singapore 599489, Singapore;
- Department of Biomedical Engineering, School of Science and Technology, Singapore University of Social Sciences, Singapore 599494, Singapore
- Department of Biomedical Informatics and Medical Engineering, Asia University, Taichung 41354, Taiwan
| |
Collapse
|
321
|
Chest X-ray Classification for the Detection of COVID-19 Using Deep Learning Techniques. SENSORS 2022; 22:s22031211. [PMID: 35161958 PMCID: PMC8838072 DOI: 10.3390/s22031211] [Citation(s) in RCA: 27] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/10/2022] [Revised: 01/31/2022] [Accepted: 02/02/2022] [Indexed: 01/27/2023]
Abstract
Recent technological developments pave the path for deep learning-based techniques to be used in almost every domain of life. The precision of deep learning techniques make it possible for these to be used in the medical field for the classification and detection of various diseases. Recently, the coronavirus (COVID-19) pandemic has put a lot of pressure on the health system all around the world. The diagnosis of COVID-19 is possible by PCR testing and medical imagining. Since COVID-19 is highly contagious, diagnosis using chest X-ray is considered safe in various situations. In this study, a deep learning-based technique is proposed to classify COVID-19 infection from other non-COVID-19 infections. To classify COVID-19, three different pre-trained models named EfficientNetB1, NasNetMobile and MobileNetV2 are used. The augmented dataset is used for training deep learning models while two different training strategies have been used for classification. In this study, not only are the deep learning model fine-tuned but also the hyperparameters are fine-tuned, which significantly improves the performance of the fine-tuned deep learning models. Moreover, the classification head is regularized to improve the performance. For the evaluation of the proposed techniques, several performance parameters are used to gauge the performance. EfficientNetB1 with regularized classification head outperforms the other models. The proposed technique successfully classifies four classes that include COVID-19, viral pneumonia, lung opacity, and normal, with an accuracy of 96.13%. The proposed technique shows superiority in terms of accuracy when compared with recent techniques present in the literature.
Collapse
|
322
|
Das D, Ghosal S, Mohanty SP. CoviLearn: A Machine Learning Integrated Smart X-Ray Device in Healthcare Cyber-Physical System for Automatic Initial Screening of COVID-19. SN COMPUTER SCIENCE 2022; 3:150. [PMID: 35132394 PMCID: PMC8811348 DOI: 10.1007/s42979-022-01035-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/02/2021] [Accepted: 01/03/2022] [Indexed: 11/09/2022]
Abstract
The pandemic of novel Coronavirus Disease 2019 (COVID-19) is widespread all over the world causing serious health problems as well as serious impact on the global economy. Reliable and fast testing of the COVID-19 has been a challenge for researchers and healthcare practitioners. In this work, we present a novel machine learning (ML) integrated X-ray device in Healthcare Cyber-Physical System (H-CPS) or smart healthcare framework (called "CoviLearn") to allow healthcare practitioners to perform automatic initial screening of COVID-19 patients. We propose convolutional neural network (CNN) models of X-ray images integrated into an X-ray device for automatic COVID-19 detection. The proposed CoviLearn device will be useful in detecting if a person is COVID-19 positive or negative by considering the chest X-ray image of individuals. CoviLearn will be useful tool doctors to detect potential COVID-19 infections instantaneously without taking more intrusive healthcare data samples, such as saliva and blood. COVID-19 attacks the endothelium tissues that support respiratory tract, and X-rays images can be used to analyze the health of a patient's lungs. As all healthcare centers have X-ray machines, it could be possible to use proposed CoviLearn X-rays to test for COVID-19 without the especial test kits. Our proposed automated analysis system CoviLearn which has 98.98% accuracy will be able to save valuable time of medical professionals as the X-ray machines come with a drawback as it needed a radiology expert.
Collapse
Affiliation(s)
- Debanjan Das
- Department of Electronics and Communication Engineering, IIIT, Naya Raipur, India
| | - Sagnik Ghosal
- Department of Electrical Engineering, Jadavpur University, Kolkata, India
| | - Saraju P. Mohanty
- Department of Computer Science and Engineering, University of North Texas, Denton, USA
| |
Collapse
|
323
|
Dhont J, Wolfs C, Verhaegen F. Automatic coronavirus disease 2019 diagnosis based on chest radiography and deep learning - Success story or dataset bias? Med Phys 2022; 49:978-987. [PMID: 34951033 PMCID: PMC9015341 DOI: 10.1002/mp.15419] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2021] [Revised: 12/03/2021] [Accepted: 12/03/2021] [Indexed: 11/11/2022] Open
Abstract
PURPOSE Over the last 2 years, the artificial intelligence (AI) community has presented several automatic screening tools for coronavirus disease 2019 (COVID-19) based on chest radiography (CXR), with reported accuracies often well over 90%. However, it has been noted that many of these studies have likely suffered from dataset bias, leading to overly optimistic results. The purpose of this study was to thoroughly investigate to what extent biases have influenced the performance of a range of previously proposed and promising convolutional neural networks (CNNs), and to determine what performance can be expected with current CNNs on a realistic and unbiased dataset. METHODS Five CNNs for COVID-19 positive/negative classification were implemented for evaluation, namely VGG19, ResNet50, InceptionV3, DenseNet201, and COVID-Net. To perform both internal and cross-dataset evaluations, four datasets were created. The first dataset Valencian Region Medical Image Bank (BIMCV) followed strict reverse transcriptase-polymerase chain reaction (RT-PCR) test criteria and was created from a single reliable open access databank, while the second dataset (COVIDxB8) was created through a combination of six online CXR repositories. The third and fourth datasets were created by combining the opposing classes from the BIMCV and COVIDxB8 datasets. To decrease inter-dataset variability, a pre-processing workflow of resizing, normalization, and histogram equalization were applied to all datasets. Classification performance was evaluated on unseen test sets using precision and recall. A qualitative sanity check was performed by evaluating saliency maps displaying the top 5%, 10%, and 20% most salient segments in the input CXRs, to evaluate whether the CNNs were using relevant information for decision making. In an additional experiment and to further investigate the origin of potential dataset bias, all pixel values outside the lungs were set to zero through automatic lung segmentation before training and testing. RESULTS When trained and evaluated on the single online source dataset (BIMCV), the performance of all CNNs is relatively low (precision: 0.65-0.72, recall: 0.59-0.71), but remains relatively consistent during external evaluation (precision: 0.58-0.82, recall: 0.57-0.72). On the contrary, when trained and internally evaluated on the combinatory datasets, all CNNs performed well across all metrics (precision: 0.94-1.00, recall: 0.77-1.00). However, when subsequently evaluated cross-dataset, results dropped substantially (precision: 0.10-0.61, recall: 0.04-0.80). For all datasets, saliency maps revealed the CNNs rarely focus on areas inside the lungs for their decision-making. However, even when setting all pixel values outside the lungs to zero, classification performance does not change and dataset bias remains. CONCLUSIONS Results in this study confirm that when trained on a combinatory dataset, CNNs tend to learn the origin of the CXRs rather than the presence or absence of disease, a behavior known as short-cut learning. The bias is shown to originate from differences in overall pixel values rather than embedded text or symbols, despite consistent image pre-processing. When trained on a reliable, and realistic single-source dataset in which non-lung pixels have been masked, CNNs currently show limited sensitivity (<70%) for COVID-19 infection in CXR, questioning their use as a reliable automatic screening tool.
Collapse
Affiliation(s)
- Jennifer Dhont
- Department of Radiation Oncology (Maastro)GROW School for OncologyMaastricht University Medical Centre+Maastrichtthe Netherlands
| | - Cecile Wolfs
- Department of Radiation Oncology (Maastro)GROW School for OncologyMaastricht University Medical Centre+Maastrichtthe Netherlands
| | - Frank Verhaegen
- Department of Radiation Oncology (Maastro)GROW School for OncologyMaastricht University Medical Centre+Maastrichtthe Netherlands
| |
Collapse
|
324
|
Lu S, Zhu Z, Gorriz JM, Wang S, Zhang Y. NAGNN: Classification of COVID-19 based on neighboring aware representation from deep graph neural network. INT J INTELL SYST 2022; 37:1572-1598. [PMID: 38607823 PMCID: PMC8652936 DOI: 10.1002/int.22686] [Citation(s) in RCA: 32] [Impact Index Per Article: 10.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/23/2021] [Revised: 08/30/2021] [Accepted: 09/09/2021] [Indexed: 12/12/2022]
Abstract
COVID-19 pneumonia started in December 2019 and caused large casualties and huge economic losses. In this study, we intended to develop a computer-aided diagnosis system based on artificial intelligence to automatically identify the COVID-19 in chest computed tomography images. We utilized transfer learning to obtain the image-level representation (ILR) based on the backbone deep convolutional neural network. Then, a novel neighboring aware representation (NAR) was proposed to exploit the neighboring relationships between the ILR vectors. To obtain the neighboring information in the feature space of the ILRs, an ILR graph was generated based on the k-nearest neighbors algorithm, in which the ILRs were linked with their k-nearest neighboring ILRs. Afterward, the NARs were computed by the fusion of the ILRs and the graph. On the basis of this representation, a novel end-to-end COVID-19 classification architecture called neighboring aware graph neural network (NAGNN) was proposed. The private and public data sets were used for evaluation in the experiments. Results revealed that our NAGNN outperformed all the 10 state-of-the-art methods in terms of generalization ability. Therefore, the proposed NAGNN is effective in detecting COVID-19, which can be used in clinical diagnosis.
Collapse
Affiliation(s)
- Siyuan Lu
- School of InformaticsUniversity of LeicesterLeicesterUK
| | - Ziquan Zhu
- Science in Civil EngineeringUniversity of FloridaGainesvilleFLUSA
| | - Juan Manuel Gorriz
- Department of Signal Theory, Networking and CommunicationsUniversity of GranadaGranadaSpain
| | - Shui‐Hua Wang
- School of Mathematics and Actuarial ScienceUniversity of LeicesterLeicesterUK
| | - Yu‐Dong Zhang
- School of InformaticsUniversity of LeicesterLeicesterUK
| |
Collapse
|
325
|
Balaha HM, El-Gendy EM, Saafan MM. A complete framework for accurate recognition and prognosis of COVID-19 patients based on deep transfer learning and feature classification approach. Artif Intell Rev 2022; 55:5063-5108. [PMID: 35125606 PMCID: PMC8799451 DOI: 10.1007/s10462-021-10127-8] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
Abstract
The sudden appearance of COVID-19 has put the world in a serious situation. Due to the rapid spread of the virus and the increase in the number of infected patients and deaths, COVID-19 was declared a pandemic. This pandemic has its destructive effect not only on humans but also on the economy. Despite the development and availability of different vaccines for COVID-19, scientists still warn the citizens of new severe waves of the virus, and as a result, fast diagnosis of COVID-19 is a critical issue. Chest imaging proved to be a powerful tool in the early detection of COVID-19. This study introduces an entire framework for the early detection and early prognosis of COVID-19 severity in the diagnosed patients using laboratory test results. It consists of two phases (1) Early Diagnostic Phase (EDP) and (2) Early Prognostic Phase (EPP). In EDP, COVID-19 patients are diagnosed using CT chest images. In the current study, 5, 159 COVID-19 and 10, 376 normal computed tomography (CT) images of Egyptians were used as a dataset to train 7 different convolutional neural networks using transfer learning. Data augmentation normal techniques and generative adversarial networks (GANs), CycleGAN and CCGAN, were used to increase the images in the dataset to avoid overfitting issues. 28 experiments were applied and multiple performance metrics were captured. Classification with no augmentation yielded \documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$99.61\%$$\end{document}99.61% accuracy by EfficientNetB7 architecture. By applying CycleGAN and CC-GAN Augmentation, the maximum reported accuracies were \documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$99.57\%$$\end{document}99.57% and \documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$99.14\%$$\end{document}99.14% by MobileNetV1 and VGG-16 architectures respectively. In EPP, the prognosis of the severity of COVID-19 in patients is early determined using laboratory test results. In this study, 25 different classification techniques were applied and from the different results, the highest accuracies were \documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$98.70\%$$\end{document}98.70% and \documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$97.40\%$$\end{document}97.40% reported by the Ensemble Bagged Trees and Tree (Fine, Medium, and Coarse) techniques respectively.
Collapse
Affiliation(s)
- Hossam Magdy Balaha
- Computers and Control Systems Department, Faculty of Engineering, Mansoura University, Mansoura, Egypt
| | - Eman M. El-Gendy
- Computers and Control Systems Department, Faculty of Engineering, Mansoura University, Mansoura, Egypt
| | - Mahmoud M. Saafan
- Computers and Control Systems Department, Faculty of Engineering, Mansoura University, Mansoura, Egypt
| |
Collapse
|
326
|
Karacı A. VGGCOV19-NET: automatic detection of COVID-19 cases from X-ray images using modified VGG19 CNN architecture and YOLO algorithm. Neural Comput Appl 2022; 34:8253-8274. [PMID: 35095212 PMCID: PMC8785935 DOI: 10.1007/s00521-022-06918-x] [Citation(s) in RCA: 16] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/15/2021] [Accepted: 01/04/2022] [Indexed: 01/09/2023]
Abstract
X-ray images are an easily accessible, fast, and inexpensive method of diagnosing COVID-19, widely used in health centers around the world. In places where there is a shortage of specialist doctors and radiologists, there is need for a system that can direct patients to advanced health centers by pre-diagnosing COVID-19 from X-ray images. Also, smart computer-aided systems that automatically detect COVID-19 positive cases will support daily clinical applications. The study aimed to classify COVID-19 via X-ray images in high precision ratios with pre-trained VGG19 deep CNN architecture and the YOLOv3 detection algorithm. For this purpose, VGG19, VGGCOV19-NET models, and the original Cascade models were created by feeding these models with the YOLOv3 algorithm. Cascade models are the original models fed with the lung zone X-ray images detected with the YOLOv3 algorithm. Model performances were evaluated using fivefold cross-validation according to recall, specificity, precision, f1-score, confusion matrix, and ROC analysis performance metrics. While the accuracy of the Cascade VGGCOV19-NET model was 99.84% for the binary class (COVID vs. no-findings) data set, it was 97.16% for the three-class (COVID vs. no-findings vs. pneumonia) data set. The Cascade VGGCOV19-NET model has a higher classification performance than VGG19, Cascade VGG19, VGGCOV19-NET and previous studies. Feeding the CNN models with the YOLOv3 detection algorithm decreases the training test time while increasing the classification performance. The results indicate that the proposed Cascade VGGCOV19-NET architecture was highly successful in detecting COVID-19. Therefore, this study contributes to the literature in terms of both YOLO-aided deep architecture and classification success.
Collapse
Affiliation(s)
- Abdulkadir Karacı
- Faculty of Engineering and Architecture, Computer Engineering, Kastamonu University, 37200 Kastamonu, Turkey
| |
Collapse
|
327
|
COVID-19 Detection in Chest X-ray Images Using a New Channel Boosted CNN. Diagnostics (Basel) 2022; 12:diagnostics12020267. [PMID: 35204358 PMCID: PMC8871483 DOI: 10.3390/diagnostics12020267] [Citation(s) in RCA: 33] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2021] [Revised: 01/07/2022] [Accepted: 01/16/2022] [Indexed: 02/01/2023] Open
Abstract
COVID-19 is a respiratory illness that has affected a large population worldwide and continues to have devastating consequences. It is imperative to detect COVID-19 at the earliest opportunity to limit the span of infection. In this work, we developed a new CNN architecture STM-RENet to interpret the radiographic patterns from X-ray images. The proposed STM-RENet is a block-based CNN that employs the idea of split–transform–merge in a new way. In this regard, we have proposed a new convolutional block STM that implements the region and edge-based operations separately, as well as jointly. The systematic use of region and edge implementations in combination with convolutional operations helps in exploring region homogeneity, intensity inhomogeneity, and boundary-defining features. The learning capacity of STM-RENet is further enhanced by developing a new CB-STM-RENet that exploits channel boosting and learns textural variations to effectively screen the X-ray images of COVID-19 infection. The idea of channel boosting is exploited by generating auxiliary channels from the two additional CNNs using Transfer Learning, which are then concatenated to the original channels of the proposed STM-RENet. A significant performance improvement is shown by the proposed CB-STM-RENet in comparison to the standard CNNs on three datasets, especially on the stringent CoV-NonCoV-15k dataset. The good detection rate (97%), accuracy (96.53%), and reasonable F-score (95%) of the proposed technique suggest that it can be adapted to detect COVID-19 infected patients.
Collapse
|
328
|
Tahir AM, Qiblawey Y, Khandakar A, Rahman T, Khurshid U, Musharavati F, Islam MT, Kiranyaz S, Al-Maadeed S, Chowdhury MEH. Deep Learning for Reliable Classification of COVID-19, MERS, and SARS from Chest X-ray Images. Cognit Comput 2022; 14:1752-1772. [PMID: 35035591 PMCID: PMC8747861 DOI: 10.1007/s12559-021-09955-1] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2020] [Accepted: 04/09/2021] [Indexed: 12/29/2022]
Abstract
Novel coronavirus disease (COVID-19) is an extremely contagious and quickly spreading coronavirus infestation. Severe acute respiratory syndrome (SARS) and Middle East respiratory syndrome (MERS), which outbreak in 2002 and 2011, and the current COVID-19 pandemic are all from the same family of coronavirus. This work aims to classify COVID-19, SARS, and MERS chest X-ray (CXR) images using deep convolutional neural networks (CNNs). To the best of our knowledge, this classification scheme has never been investigated in the literature. A unique database was created, so-called QU-COVID-family, consisting of 423 COVID-19, 144 MERS, and 134 SARS CXR images. Besides, a robust COVID-19 recognition system was proposed to identify lung regions using a CNN segmentation model (U-Net), and then classify the segmented lung images as COVID-19, MERS, or SARS using a pre-trained CNN classifier. Furthermore, the Score-CAM visualization method was utilized to visualize classification output and understand the reasoning behind the decision of deep CNNs. Several deep learning classifiers were trained and tested; four outperforming algorithms were reported: SqueezeNet, ResNet18, InceptionV3, and DenseNet201. Original and preprocessed images were used individually and all together as the input(s) to the networks. Two recognition schemes were considered: plain CXR classification and segmented CXR classification. For plain CXRs, it was observed that InceptionV3 outperforms other networks with a 3-channel scheme and achieves sensitivities of 99.5%, 93.1%, and 97% for classifying COVID-19, MERS, and SARS images, respectively. In contrast, for segmented CXRs, InceptionV3 outperformed using the original CXR dataset and achieved sensitivities of 96.94%, 79.68%, and 90.26% for classifying COVID-19, MERS, and SARS images, respectively. The classification performance degrades with segmented CXRs compared to plain CXRs. However, the results are more reliable as the network learns from the main region of interest, avoiding irrelevant non-lung areas (heart, bones, or text), which was confirmed by the Score-CAM visualization. All networks showed high COVID-19 detection sensitivity (> 96%) with the segmented lung images. This indicates the unique radiographic signature of COVID-19 cases in the eyes of AI, which is often a challenging task for medical doctors.
Collapse
Affiliation(s)
- Anas M. Tahir
- Department of Electrical Engineering, Qatar University, 2713 Doha, Qatar
| | - Yazan Qiblawey
- Department of Electrical Engineering, Qatar University, 2713 Doha, Qatar
| | - Amith Khandakar
- Department of Electrical Engineering, Qatar University, 2713 Doha, Qatar
| | - Tawsifur Rahman
- Department of Electrical Engineering, Qatar University, 2713 Doha, Qatar
| | - Uzair Khurshid
- Department of Electrical Engineering, Qatar University, 2713 Doha, Qatar
| | - Farayi Musharavati
- Mechanical & Industrial Engineering Department, Qatar University, 2713 Doha, Qatar
| | - M. T. Islam
- Department of Electrical, Electronic & Systems Engineering, Universiti Kebangsaan Malaysia, 43600 Bangi, Selangor Malaysia
| | - Serkan Kiranyaz
- Department of Electrical Engineering, Qatar University, 2713 Doha, Qatar
| | - Somaya Al-Maadeed
- Department of Computer Science and Engineering, Qatar University, 2713 Doha, Qatar
| | | |
Collapse
|
329
|
De Falco I, De Pietro G, Sannino G. Classification of Covid-19 chest X-ray images by means of an interpretable evolutionary rule-based approach. Neural Comput Appl 2022; 35:1-11. [PMID: 35035108 PMCID: PMC8741589 DOI: 10.1007/s00521-021-06806-w] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2021] [Accepted: 11/26/2021] [Indexed: 10/26/2022]
Abstract
In medical practice, all decisions, as for example the diagnosis based on the classification of images, must be made reliably and effectively. The possibility of having automatic tools helping doctors in performing these important decisions is highly welcome. Artificial Intelligence techniques, and in particular Deep Learning methods, have proven very effective on these tasks, with excellent performance in terms of classification accuracy. The problem with such methods is that they represent black boxes, so they do not provide users with an explanation of the reasons for their decisions. Confidence from medical experts in clinical decisions can increase if they receive from Artificial Intelligence tools interpretable output under the form of, e.g., explanations in natural language or visualized information. This way, the system outcome can be critically assessed by them, and they can evaluate the trustworthiness of the results. In this paper, we propose a new general-purpose method that relies on interpretability ideas. The approach is based on two successive steps, the former being a filtering scheme typically used in Content-Based Image Retrieval, whereas the latter is an evolutionary algorithm able to classify and, at the same time, automatically extract explicit knowledge under the form of a set of IF-THEN rules. This approach is tested on a set of chest X-ray images aiming at assessing the presence of COVID-19.
Collapse
|
330
|
Abou-Kreisha MT, Yaseen HK, Fathy KA, Ebeid EA, ElDahshan KA. Multisource Smart Computer-Aided System for Mining COVID-19 Infection Data. Healthcare (Basel) 2022; 10:109. [PMID: 35052273 PMCID: PMC8775247 DOI: 10.3390/healthcare10010109] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2021] [Revised: 12/25/2021] [Accepted: 12/29/2021] [Indexed: 11/16/2022] Open
Abstract
In this paper, we approach the problem of detecting and diagnosing COVID-19 infections using multisource scan images including CT and X-ray scans to assist the healthcare system during the COVID-19 pandemic. Here, a computer-aided diagnosis (CAD) system is proposed that utilizes analysis of the CT or X-ray to diagnose the impact of damage in the respiratory system per infected case. The CAD was utilized and optimized by hyper-parameters for shallow learning, e.g., SVM and deep learning. For the deep learning, mini-batch stochastic gradient descent was used to overcome fitting problems during transfer learning. The optimal parameter list values were found using the naïve Bayes technique. Our contributions are (i) a comparison among the detection rates of pre-trained CNN models, (ii) a suggested hybrid deep learning with shallow machine learning, (iii) an extensive analysis of the results of COVID-19 transition and informative conclusions through developing various transfer techniques, and (iv) a comparison of the accuracy of the previous models with the systems of the present study. The effectiveness of the proposed CAD is demonstrated using three datasets, either using an intense learning model as a fully end-to-end solution or using a hybrid deep learning model. Six experiments were designed to illustrate the superior performance of our suggested CAD when compared to other similar approaches. Our system achieves 99.94, 99.6, 100, 97.41, 99.23, and 98.94 accuracy for binary and three-class labels for the CT and two CXR datasets.
Collapse
Affiliation(s)
| | - Humam K. Yaseen
- Mathematics Department, Faculty of Science, Al-Azhar University, Cairo 11651, Egypt; (M.T.A.-K.); (K.A.F.); (E.A.E.); (K.A.E.)
| | | | | | | |
Collapse
|
331
|
Singh D, Kumar V, Kaur M, Kumari R. Early diagnosis of COVID-19 patients using deep learning-based deep forest model. J EXP THEOR ARTIF IN 2022. [DOI: 10.1080/0952813x.2021.2021300] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/30/2022]
Affiliation(s)
- Dilbag Singh
- School of Electrical Engineering and Computer Science, Gwangju Institute of Science and Technology, Gwangju, South Korea
| | - Vijay Kumar
- Department of Computer Science & Engineering National Institute of Technology Hamirpur, Hamirpur, India
| | - Manjit Kaur
- School of Electrical Engineering and Computer Science, Gwangju Institute of Science and Technology, Gwangju, South Korea
| | - Rajani Kumari
- Department of Computer Science, Christ (Deemed to Be University), Bangalore, India
| |
Collapse
|
332
|
Loey M, El-Sappagh S, Mirjalili S. Bayesian-based optimized deep learning model to detect COVID-19 patients using chest X-ray image data. Comput Biol Med 2022; 142:105213. [PMID: 35026573 PMCID: PMC8730711 DOI: 10.1016/j.compbiomed.2022.105213] [Citation(s) in RCA: 27] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2021] [Revised: 12/21/2021] [Accepted: 01/02/2022] [Indexed: 12/12/2022]
Abstract
Coronavirus Disease 2019 (COVID-19) is extremely infectious and rapidly spreading around the globe. As a result, rapid and precise identification of COVID-19 patients is critical. Deep Learning has shown promising performance in a variety of domains and emerged as a key technology in Artificial Intelligence. Recent advances in visual recognition are based on image classification and artefacts detection within these images. The purpose of this study is to classify chest X-ray images of COVID-19 artefacts in changed real-world situations. A novel Bayesian optimization-based convolutional neural network (CNN) model is proposed for the recognition of chest X-ray images. The proposed model has two main components. The first one utilizes CNN to extract and learn deep features. The second component is a Bayesian-based optimizer that is used to tune the CNN hyperparameters according to an objective function. The used large-scale and balanced dataset comprises 10,848 images (i.e., 3616 COVID-19, 3616 normal cases, and 3616 Pneumonia). In the first ablation investigation, we compared Bayesian optimization to three distinct ablation scenarios. We used convergence charts and accuracy to compare the three scenarios. We noticed that the Bayesian search-derived optimal architecture achieved 96% accuracy. To assist qualitative researchers, address their research questions in a methodologically sound manner, a comparison of research method and theme analysis methods was provided. The suggested model is shown to be more trustworthy and accurate in real world.
Collapse
Affiliation(s)
- Mohamed Loey
- Department of Computer Science, Faculty of Computers and Artificial Intelligence, Benha University, Benha, 13518, Egypt; Information Technology Program, New Cairo Technological University, New Cairo, Egypt; Computer Engineering Department, Cybersecurity Department, Engineering and Information Technology College, Buraydah Colleges, Buraydah, Al-Qassim, Saudi Arabia.
| | - Shaker El-Sappagh
- Department of Information Systems, Faculty of Computers and Artificial Intelligence, Benha University, Benha, 13518, Egypt; Faculty of Computer Science and Engineering, Galala University, Suez 435611, Egypt.
| | - Seyedali Mirjalili
- Center for Artificial Intelligence Research and Optimization, Torrens University Australia, Fortitude Valley, Brisbane, QLD, 4006, Australia; Yonsei Frontier Lab, Yonsei University, Seoul, South Korea.
| |
Collapse
|
333
|
Paul A, Basu A, Mahmud M, Kaiser MS, Sarkar R. Inverted bell-curve-based ensemble of deep learning models for detection of COVID-19 from chest X-rays. Neural Comput Appl 2022; 35:1-15. [PMID: 35013650 PMCID: PMC8729326 DOI: 10.1007/s00521-021-06737-6] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2021] [Accepted: 09/21/2021] [Indexed: 12/20/2022]
Abstract
Novel Coronavirus 2019 disease or COVID-19 is a viral disease caused by severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). The use of chest X-rays (CXRs) has become an important practice to assist in the diagnosis of COVID-19 as they can be used to detect the abnormalities developed in the infected patients' lungs. With the fast spread of the disease, many researchers across the world are striving to use several deep learning-based systems to identify the COVID-19 from such CXR images. To this end, we propose an inverted bell-curve-based ensemble of deep learning models for the detection of COVID-19 from CXR images. We first use a selection of models pretrained on ImageNet dataset and use the concept of transfer learning to retrain them with CXR datasets. Then the trained models are combined with the proposed inverted bell curve weighted ensemble method, where the output of each classifier is assigned a weight, and the final prediction is done by performing a weighted average of those outputs. We evaluate the proposed method on two publicly available datasets: the COVID-19 Radiography Database and the IEEE COVID Chest X-ray Dataset. The accuracy, F1 score and the AUC ROC achieved by the proposed method are 99.66%, 99.75% and 99.99%, respectively, in the first dataset, and, 99.84%, 99.81% and 99.99%, respectively, in the other dataset. Experimental results ensure that the use of transfer learning-based models and their combination using the proposed ensemble method result in improved predictions of COVID-19 in CXRs.
Collapse
Affiliation(s)
- Ashis Paul
- Department of Computer Science and Engineering, Jadavpur University, Kolkata, 700032 India
| | - Arpan Basu
- Department of Computer Science and Engineering, Jadavpur University, Kolkata, 700032 India
| | - Mufti Mahmud
- Department of Computer Science, Nottingham Trent University, Clifton, Nottingham NG11 8NS UK
- Medical Technologies Innovation Facility, Nottingham Trent University, Clifton, Nottingham NG11 8NS UK
- Computing and Informatics Research Centre, Nottingham Trent University, Clifton, Nottingham NG11 8NS UK
| | - M. Shamim Kaiser
- Institute of Information Technology, Jahangirnagar University, Dhaka, 1342 Bangladesh
| | - Ram Sarkar
- Department of Computer Science and Engineering, Jadavpur University, Kolkata, 700032 India
| |
Collapse
|
334
|
Arman SE, Rahman S, Deowan SA. COVIDXception-Net: A Bayesian Optimization-Based Deep Learning Approach to Diagnose COVID-19 from X-Ray Images. SN COMPUTER SCIENCE 2022; 3:115. [PMID: 34981040 PMCID: PMC8717305 DOI: 10.1007/s42979-021-00980-3] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/08/2021] [Accepted: 11/29/2021] [Indexed: 12/20/2022]
Abstract
COVID-19 is spreading around the world like wildfire. Chest X-rays are used as one of the primary tools for diagnosing COVID-19. However, about two-thirds of the world population do not have access to sufficient radiological services. In this work, we propose a deep learning-driven automated system, COVIDXception-Net, for diagnosing COVID-19 from chest X-rays. A primary challenge in any data-driven COVID-19 detection is the scarcity of COVID-19 data, which heavily deteriorates a deep learning model’s performance. To address this issue, we incorporate a weighted-loss function that ensures the COVID-19 cases are given more importance during the training process. We also propose using Bayesian Optimization to find the best architecture for detecting COVID-19. Extensive experimentation on four publicly available COVID-19 datasets shows that our proposed model achieves an accuracy of 0.94, precision 0.95, recall 0.94, specificity 0.997, F1-score 0.94, and Matthews correlation coefficient 0.992 outperforming three widely used architectures—VGG16, MobileNetV2, and InceptionV3. It also surpasses the performance of several state-of-the-art COVID-19 detection methods. We also performed two ablation studies that show our model’s accuracy degrades from 0.994 to 0.950 when a random search is used and to 0.983 when a regular loss function is employed instead of the Bayesian and weighted loss, respectively.
Collapse
Affiliation(s)
- Shifat E Arman
- Department of Robotics and Mechatronics Engineering, University of Dhaka, Dhaka, Bangladesh
| | - Sejuti Rahman
- Department of Robotics and Mechatronics Engineering, University of Dhaka, Dhaka, Bangladesh
| | - Shamim Ahmed Deowan
- Department of Robotics and Mechatronics Engineering, University of Dhaka, Dhaka, Bangladesh
| |
Collapse
|
335
|
Bayram F, Eleyan A. COVID-19 detection on chest radiographs using feature fusion based deep learning. SIGNAL, IMAGE AND VIDEO PROCESSING 2022; 16:1455-1462. [PMID: 35096182 PMCID: PMC8784235 DOI: 10.1007/s11760-021-02098-8] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/26/2021] [Revised: 08/10/2021] [Accepted: 11/17/2021] [Indexed: 05/17/2023]
Abstract
The year 2020 will certainly be remembered in human history as the year in which humans faced a global pandemic that drastically affected every living soul on planet earth. The COVID-19 pandemic certainly had a massive impact on human's social and daily lives. The economy and relations of all countries were also radically impacted. Due to such unexpected situations, healthcare systems either collapsed or failed under colossal pressure to cope with the overwhelming numbers of patients arriving at emergency rooms and intensive care units. The COVID -19 tests used for diagnosis were expensive, slow, and gave indecisive results. Unfortunately, such a hindered diagnosis of the infection prevented abrupt isolation of the infected people which, in turn, caused the rapid spread of the virus. In this paper, we proposed the use of cost-effective X-ray images in diagnosing COVID-19 patients. Compared to other imaging modalities, X-ray imaging is available in most healthcare units. Deep learning was used for feature extraction and classification by implementing a multi-stream convolutional neural network model. The model extracts and concatenates features from its three inputs, namely; grayscale, local binary patterns, and histograms of oriented gradients images. Extensive experiments using fivefold cross-validation were carried out on a publicly available X-ray database with 3886 images of three classes. Obtained results outperform the results of other algorithms with an accuracy of 97.76%. The results also show that the proposed model can make a significant contribution to the rapidly increasing workload in health systems with an artificial intelligence-based automatic diagnosis tool.
Collapse
Affiliation(s)
- Fatih Bayram
- Mechatronics Engineering Department, Faculty of Technology, Afyon Kocatepe University, Afyonkarahisar, Turkey
| | - Alaa Eleyan
- College of Engineering and Technology, American University of the Middle East, Egaila, Kuwait
| |
Collapse
|
336
|
Ben Atitallah S, Driss M, Boulila W, Ben Ghézala H. Randomly initialized convolutional neural network for the recognition of COVID-19 using X-ray images. INTERNATIONAL JOURNAL OF IMAGING SYSTEMS AND TECHNOLOGY 2022; 32:55-73. [PMID: 34898852 PMCID: PMC8653328 DOI: 10.1002/ima.22654] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/21/2021] [Revised: 08/28/2021] [Accepted: 09/05/2021] [Indexed: 06/14/2023]
Abstract
By the start of 2020, the novel coronavirus (COVID-19) had been declared a worldwide pandemic, and because of its infectiousness and severity, several strands of research have focused on combatting its ongoing spread. One potential solution to detecting COVID-19 rapidly and effectively is by analyzing chest X-ray images using Deep Learning (DL) models. Convolutional Neural Networks (CNNs) have been presented as particularly efficient techniques for early diagnosis, but most still include limitations. In this study, we propose a novel randomly initialized CNN (RND-CNN) architecture for the recognition of COVID-19. This network consists of a set of differently-sized hidden layers all created from scratch. The performance of this RND-CNN is evaluated using two public datasets: the COVIDx and the enhanced COVID-19 datasets. Each of these datasets consists of medical images (X-rays) in one of three different classes: chests with COVID-19, with pneumonia, or in a normal state. The proposed RND-CNN model yields encouraging results for its accuracy in detecting COVID-19 results, achieving 94% accuracy for the COVIDx dataset and 99% accuracy on the enhanced COVID-19 dataset.
Collapse
Affiliation(s)
| | - Maha Driss
- RIADI LaboratoryUniversity of ManoubaTunisia
- Security Engineering LabPrince Sultan UniversitySaudi Arabia
| | - Wadii Boulila
- RIADI LaboratoryUniversity of ManoubaTunisia
- Robotics and Internet‐of‐Things LabPrince Sultan UniversitySaudi Arabia
| | | |
Collapse
|
337
|
Cengil E, Çınar A. The effect of deep feature concatenation in the classification problem: An approach on COVID-19 disease detection. INTERNATIONAL JOURNAL OF IMAGING SYSTEMS AND TECHNOLOGY 2022; 32:26-40. [PMID: 34898851 PMCID: PMC8653237 DOI: 10.1002/ima.22659] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/08/2021] [Revised: 08/04/2021] [Accepted: 09/16/2021] [Indexed: 06/01/2023]
Abstract
In image classification applications, the most important thing is to obtain useful features. Convolutional neural networks automatically learn the extracted features during training. The classification process is carried out with the obtained features. Therefore, obtaining successful features is critical to achieving high classification success. This article focuses on providing effective features to enhance classification performance. For this purpose, the success of the process of concatenating features in classification is taken as basis. At first, the features acquired by feature transfer method are extracted from AlexNet, Xception, NASNETLarge, and EfficientNet-B0 architectures, which are known to be successful in classification problems. Concatenating the features results in the creation of a new feature set. The method is completed by subjecting the features to various classification algorithms. The proposed pipeline is applied to the three datasets: "COVID-19 Image Dataset," "COVID-19 Pneumonia Normal Chest X-ray (PA) Dataset," and "COVID-19 Radiography Database" for COVID-19 disease detection. The whole datasets contain three classes (normal, COVID, and pneumonia). The best classification accuracies for the three datasets are 98.8%, 95.9%, and 99.6%, respectively. Performance metrics are given such as: sensitivity, precision, specificity, and F1-score values, as well. Contribution of paper is as follows: COVID-19 disease is similar to other lung infections. This situation makes diagnosis difficult. Furthermore, the virus's rapid spread necessitates the need to detect cases as soon as possible. There has been an increased curiosity in computer-aided deep learning models to provide the requirements. The use of the proposed method will be beneficial as it provides high accuracy.
Collapse
Affiliation(s)
- Emine Cengil
- Department of Computer Engineering, Faculty of EngineeringFirat UniversityElazigTurkey
| | - Ahmet Çınar
- Department of Computer Engineering, Faculty of EngineeringFirat UniversityElazigTurkey
| |
Collapse
|
338
|
Gour M, Jain S. Uncertainty-aware convolutional neural network for COVID-19 X-ray images classification. Comput Biol Med 2022; 140:105047. [PMID: 34847386 PMCID: PMC8609674 DOI: 10.1016/j.compbiomed.2021.105047] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2021] [Revised: 11/15/2021] [Accepted: 11/15/2021] [Indexed: 12/16/2022]
Abstract
Deep learning (DL) has shown great success in the field of medical image analysis. In the wake of the current pandemic situation of SARS-CoV-2, a few pioneering works based on DL have made significant progress in automated screening of COVID-19 disease from the chest X-ray (CXR) images. But these DL models have no inherent way of expressing uncertainty associated with the model's prediction, which is very important in medical image analysis. Therefore, in this paper, we develop an uncertainty-aware convolutional neural network model, named UA-ConvNet, for the automated detection of COVID-19 disease from CXR images, with an estimation of associated uncertainty in the model's predictions. The proposed approach utilizes the EfficientNet-B3 model and Monte Carlo (MC) dropout, where an EfficientNet-B3 model has been fine-tuned on the CXR images. During inference, MC dropout has been applied for M forward passes to obtain the posterior predictive distribution. After that mean and entropy have been calculated on the obtained predictive distribution to get the mean prediction and model uncertainty. The proposed method is evaluated on the three different datasets of chest X-ray images, namely the COVID19CXr, X-ray image, and Kaggle datasets. The proposed UA-ConvNet model achieves a G-mean of 98.02% (with a Confidence Interval (CI) of 97.99-98.07) and sensitivity of 98.15% for the multi-class classification task on the COVID19CXr dataset. For binary classification, the proposed model achieves a G-mean of 99.16% (with a CI of 98.81-99.19) and a sensitivity of 99.30% on the X-ray Image dataset. Our proposed approach shows its superiority over the existing methods for diagnosing the COVID-19 cases from the CXR images.
Collapse
Affiliation(s)
- Mahesh Gour
- Maulana Azad National Institute of Technology, Bhopal, MP, 462003, India.
| | - Sweta Jain
- Maulana Azad National Institute of Technology, Bhopal, MP, 462003, India
| |
Collapse
|
339
|
Abumalloh RA, Nilashi M, Yousoof Ismail M, Alhargan A, Alghamdi A, Alzahrani AO, Saraireh L, Osman R, Asadi S. Medical image processing and COVID-19: A literature review and bibliometric analysis. J Infect Public Health 2022; 15:75-93. [PMID: 34836799 PMCID: PMC8596659 DOI: 10.1016/j.jiph.2021.11.013] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/19/2021] [Revised: 11/09/2021] [Accepted: 11/10/2021] [Indexed: 01/07/2023] Open
Abstract
COVID-19 crisis has placed medical systems over the world under unprecedented and growing pressure. Medical imaging processing can help in the diagnosis, treatment, and early detection of diseases. It has been considered as one of the modern technologies applied to fight against the COVID-19 crisis. Although several artificial intelligence, machine learning, and deep learning techniques have been deployed in medical image processing in the context of COVID-19 disease, there is a lack of research considering systematic literature review and categorization of published studies in this field. A systematic review locates, assesses, and interprets research outcomes to address a predetermined research goal to present evidence-based practical and theoretical insights. The main goal of this study is to present a literature review of the deployed methods of medical image processing in the context of the COVID-19 crisis. With this in mind, the studies available in reliable databases were retrieved, studied, evaluated, and synthesized. Based on the in-depth review of literature, this study structured a conceptual map that outlined three multi-layered folds: data gathering and description, main steps of image processing, and evaluation metrics. The main research themes were elaborated in each fold, allowing the authors to recommend upcoming research paths for scholars. The outcomes of this review highlighted that several methods have been adopted to classify the images related to the diagnosis and detection of COVID-19. The adopted methods have presented promising outcomes in terms of accuracy, cost, and detection speed.
Collapse
Affiliation(s)
- Rabab Ali Abumalloh
- Computer Department, Applied College, Imam Abdulrahman Bin Faisal University, P.O. Box. 1982, Dammam, Saudi Arabia
| | - Mehrbakhsh Nilashi
- Centre for Global Sustainability Studies (CGSS), Universiti Sains Malaysia, 11800, USM Penang, Malaysia.
| | | | - Ashwaq Alhargan
- Computer Science Department, College of Computing and Informatics, Saudi Electronic University, Saudi Arabia
| | - Abdullah Alghamdi
- Information Systems Dept., College of Computer Science and Information Systems, Najran University, Najran, Saudi Arabia
| | - Ahmed Omar Alzahrani
- College of Computer Science and Engineering, University of Jeddah, 21959 Jeddah, Saudi Arabia
| | - Linah Saraireh
- Management Information System Department, College of Business, Imam Abdulrahman Bin Faisal University, P.O. Box 1982, Dammam, Saudi Arabia
| | - Reem Osman
- Computer Department, Applied College, Imam Abdulrahman Bin Faisal University, P.O. Box. 1982, Dammam, Saudi Arabia
| | - Shahla Asadi
- Centre of Software Technology and Management, Faculty of Information Science and Technology, Universiti Kebangsaan Malaysia, 43600 Bangi, Selangor, Malaysia
| |
Collapse
|
340
|
Islam MK, Habiba SU, Khan TA, Tasnim F. COV-RadNet: A Deep Convolutional Neural Network for Automatic Detection of COVID-19 from Chest X-Rays and CT Scans. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE UPDATE 2022; 2:100064. [PMID: 36039092 PMCID: PMC9404230 DOI: 10.1016/j.cmpbup.2022.100064] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/31/2021] [Revised: 08/19/2022] [Accepted: 08/23/2022] [Indexed: 05/07/2023]
Abstract
With the increase in severity of COVID-19 pandemic situation, the world is facing a critical fight to cope up with the impacts on human health, education and economy. The ongoing battle with the novel corona virus, is showing much priority to diagnose and provide rapid treatment to the patients. The rapid growth of COVID-19 has broken the healthcare system of the affected countries, creating a shortage in ICUs, test kits, ventilation support system. etc. This paper aims at finding an automatic COVID-19 detection approach which will assist the medical practitioners to diagnose the disease quickly and effectively. In this paper, a deep convolutional neural network, 'COV-RadNet' is proposed to detect COVID positive, viral pneumonia, lung opacity and normal, healthy people by analyzing their Chest Radiographic (X-ray and CT scans) images. Data augmentation technique is applied to balance the dataset 'COVID 19 Radiography Dataset' to make the classifier more robust to the classification task. We have applied transfer learning approach using four deep learning based models: VGG16, VGG19, ResNet152 and ResNext 101 to detect COVID-19 from chest X-ray images. We have achieved 97% classification accuracy using our proposed COV-RadNet model for COVID/Viral Pneumonia/Lungs Opacity/Normal, 99.5% accuracy to detect COVID/Viral Pneumonia/Normal and 99.72% accuracy to detect COVID and non-COVID people. Using chest CT scan images, we have found 99.25% accuracy to classify between COVID and non-COVID classes. Among the performance of the pre-trained models, ResNext 101 has shown the highest accuracy of 98.5% for multiclass classification (COVID, viral pneumonia, Lungs opacity and normal).
Collapse
Affiliation(s)
- Md Khairul Islam
- Khulna University of Engineering & Technology, Khulna, 9203, Khulna, Bangladesh
| | - Sultana Umme Habiba
- Khulna University of Engineering & Technology, Khulna, 9203, Khulna, Bangladesh
| | - Tahsin Ahmed Khan
- Khulna University of Engineering & Technology, Khulna, 9203, Khulna, Bangladesh
| | - Farzana Tasnim
- International Islamic University Chittagong, Kumira, 4318, Chittagong, Bangladesh
| |
Collapse
|
341
|
Li Z, Li Z, Yao L, Chen Q, Zhang J, Li X, Feng JM, Li Y, Xu J. Multiple-Inputs Convolutional Neural Network for COVID-19 Classification and Critical Region Screening From Chest X-ray Radiographs: Model Development and Performance Evaluation. JMIR BIOINFORMATICS AND BIOTECHNOLOGY 2022; 3:e36660. [PMID: 36277075 PMCID: PMC9578294 DOI: 10.2196/36660] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/19/2022] [Revised: 08/23/2022] [Accepted: 08/29/2022] [Indexed: 12/02/2022]
Abstract
Background The COVID-19 pandemic is becoming one of the largest, unprecedented health crises, and chest X-ray radiography (CXR) plays a vital role in diagnosing COVID-19. However, extracting and finding useful image features from CXRs demand a heavy workload for radiologists. Objective The aim of this study was to design a novel multiple-inputs (MI) convolutional neural network (CNN) for the classification of COVID-19 and extraction of critical regions from CXRs. We also investigated the effect of the number of inputs on the performance of our new MI-CNN model. Methods A total of 6205 CXR images (including 3021 COVID-19 CXRs and 3184 normal CXRs) were used to test our MI-CNN models. CXRs could be evenly segmented into different numbers (2, 4, and 16) of individual regions. Each region could individually serve as one of the MI-CNN inputs. The CNN features of these MI-CNN inputs would then be fused for COVID-19 classification. More importantly, the contributions of each CXR region could be evaluated through assessing the number of images that were accurately classified by their corresponding regions in the testing data sets. Results In both the whole-image and left- and right-lung region of interest (LR-ROI) data sets, MI-CNNs demonstrated good efficiency for COVID-19 classification. In particular, MI-CNNs with more inputs (2-, 4-, and 16-input MI-CNNs) had better efficiency in recognizing COVID-19 CXRs than the 1-input CNN. Compared to the whole-image data sets, the efficiency of LR-ROI data sets showed approximately 4% lower accuracy, sensitivity, specificity, and precision (over 91%). In considering the contributions of each region, one of the possible reasons for this reduced performance was that nonlung regions (eg, region 16) provided false-positive contributions to COVID-19 classification. The MI-CNN with the LR-ROI data set could provide a more accurate evaluation of the contribution of each region and COVID-19 classification. Additionally, the right-lung regions had higher contributions to the classification of COVID-19 CXRs, whereas the left-lung regions had higher contributions to identifying normal CXRs. Conclusions Overall, MI-CNNs could achieve higher accuracy with an increasing number of inputs (eg, 16-input MI-CNN). This approach could assist radiologists in identifying COVID-19 CXRs and in screening the critical regions related to COVID-19 classifications.
Collapse
Affiliation(s)
- Zhongqiang Li
- Division of Electrical and Computer Engineering College of Engineering Louisiana State University Baton Rouge, LA United States
| | - Zheng Li
- Division of Electrical and Computer Engineering College of Engineering Louisiana State University Baton Rouge, LA United States
| | - Luke Yao
- Division of Electrical and Computer Engineering College of Engineering Louisiana State University Baton Rouge, LA United States
| | - Qing Chen
- Division of Computer Science and Engineering College of Engineering Louisiana State University Baton Rouge, LA United States
| | - Jian Zhang
- Division of Computer Science and Engineering College of Engineering Louisiana State University Baton Rouge, LA United States
| | - Xin Li
- Department of Visualization Texas A & M University College Station, TX United States
| | - Ji-Ming Feng
- Department of Comparative Biomedical Science School of Veterinary Medicine Louisiana State University Baton Rouge, LA United States
| | - Yanping Li
- School of Environment and Sustainability University of Saskatchewan Saskatoon, SK Canada
| | - Jian Xu
- Division of Electrical and Computer Engineering College of Engineering Louisiana State University Baton Rouge, LA United States
| |
Collapse
|
342
|
Design of deep ensemble classifier with fuzzy decision method for biomedical image classification. Appl Soft Comput 2022. [DOI: 10.1016/j.asoc.2021.108178] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/03/2023]
|
343
|
Banerjee A, Bhattacharya R, Bhateja V, Singh PK, Lay-Ekuakille A, Sarkar R. COFE-Net: An ensemble strategy for Computer-Aided Detection for COVID-19. MEASUREMENT : JOURNAL OF THE INTERNATIONAL MEASUREMENT CONFEDERATION 2022; 187:110289. [PMID: 34663998 PMCID: PMC8516129 DOI: 10.1016/j.measurement.2021.110289] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/29/2021] [Revised: 09/29/2021] [Accepted: 10/03/2021] [Indexed: 05/26/2023]
Abstract
Biomedical images contain a large volume of sensor measurements, which can reveal the descriptors of the disease under investigation. Computer-based analysis of such measurements helps detect the disease, and thereby swiftly aid medical professionals to choose adequate therapy. In this paper, we propose a robust deep learning ensemble framework known as COVID Fuzzy Ensemble Network, or COFE-Net. This strategy is proposed for the task of COVID-19 screening from chest X-rays (CXR) and CT Scans, as a part of Computer-Aided Detection (CADe) for medical practitioners. We leverage the strategy of Transfer Learning for Convolutional Neural Networks (CNNs) widely adopted in recent literature, and further propose an efficient ensemble network for their combination. The principles of fuzzy logic have been leveraged to combine the measured decision scores generated by three state-of-the-art CNNs - Inception V3, Inception ResNet V2 and DenseNet 201 - through the Choquet fuzzy integral. Experimental results support the efficacy of our approach over empirical ensembling, as the fuzzy ensembling strategy for biomedical measurement consists of dynamic refactoring of the classifier ensemble weights on the fly, based upon the confidence scores for coalitions of inputs. This is the chief advantage of our biomedical measurement strategy over others as other methods do not adjust to the multiple generated measurements dynamically unlike ours.Impressive results on multiple datasets demonstrate the effectiveness of the proposed method. The source code of our proposed method is made available at: https://github.com/theavicaster/covid-cade-ensemble.
Collapse
Affiliation(s)
- Avinandan Banerjee
- Department of Information Technology, Jadavpur University, Kolkata 700106, India
| | - Rajdeep Bhattacharya
- Department of Computer Science and Engineering, Jadavpur University, Kolkata 700032, India
| | - Vikrant Bhateja
- Department of Electronics and Communication Engineering, Shri Ramswaroop Memorial Group of Professional Colleges (SRMGPC), Lucknow 226028, Uttar Pradesh, India
- Dr. A.P.J. Abdul Kalam Technical University, Lucknow, Uttar Pradesh, India
| | - Pawan Kumar Singh
- Department of Information Technology, Jadavpur University, Kolkata 700106, India
| | - Aime' Lay-Ekuakille
- Dipartimento d'Ingegneria dell'Innovazione (DII), Università del Salento (Dept of Innovation Engineering, University of Salento) Via Monteroni, Ed. "Corpo O" 73100 Lecce (IT), Italy
| | - Ram Sarkar
- Department of Computer Science and Engineering, Jadavpur University, Kolkata 700032, India
| |
Collapse
|
344
|
An optimized CNN based automated COVID-19 lung infection identification technique from C.T. images. NOVEL AI AND DATA SCIENCE ADVANCEMENTS FOR SUSTAINABILITY IN THE ERA OF COVID-19 2022. [PMCID: PMC9068981 DOI: 10.1016/b978-0-323-90054-6.00010-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 11/20/2022]
Abstract
The Novel Coronavirus, commonly known as COVID-19, is a highly contagious disease that spreads all over the globe has brought great suffering. The symptoms have made all ages suffer a lot. The diagnostics of COVID-19 is an excellent challenge for the medical field as the mutated form of the virus gives out its symptoms in different forms. The main diagnostics to be involved in this infection of COVID-19 is the Lung operation. Especially the automatic detection of the lungs' infection using chest X-rays provides the comprehensive possibility for healthcare professionals to develop hospital procedures to handle this COVID-19. Computed tomography scans are used to diagnose the lungs' infection caused by the Coronavirus, whereas the C.T. scans break the infected region from lung lesions. It is imperative to measure the disease progression, which is challenging to track down and treat accurately. Currently, Segmenting the contaminated regions from the C.T. slices can create loads of problems, which involves more alteration in contamination nature and minor power disagreement in the center of the infected tissues and the typical material. This chapter aims to segment the infection in the lungs using SqueezeNet as the Convolutional Neural Network (CNN) to recognize the contaminated regions automatically. This approach may be useful to help in the accuracy of the C.T more accurately. It has been ensured based on Dice scores, sensitivity, and high precision, specificity. The results achieved with the proposed model are low for the former and directly proportional to the latter compared with existing methods.
Collapse
|
345
|
Guarrasi V, D'Amico NC, Sicilia R, Cordelli E, Soda P. Pareto optimization of deep networks for COVID-19 diagnosis from chest X-rays. PATTERN RECOGNITION 2022; 121:108242. [PMID: 34393277 PMCID: PMC8351284 DOI: 10.1016/j.patcog.2021.108242] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/31/2021] [Revised: 07/26/2021] [Accepted: 08/08/2021] [Indexed: 05/05/2023]
Abstract
The year 2020 was characterized by the COVID-19 pandemic that has caused, by the end of March 2021, more than 2.5 million deaths worldwide. Since the beginning, besides the laboratory test, used as the gold standard, many applications have been applying deep learning algorithms to chest X-ray images to recognize COVID-19 infected patients. In this context, we found out that convolutional neural networks perform well on a single dataset but struggle to generalize to other data sources. To overcome this limitation, we propose a late fusion approach where we combine the outputs of several state-of-the-art CNNs, introducing a novel method that allows us to construct an optimum ensemble determining which and how many base learners should be aggregated. This choice is driven by a two-objective function that maximizes, on a validation set, the accuracy and the diversity of the ensemble itself. A wide set of experiments on several publicly available datasets, accounting for more than 92,000 images, shows that the proposed approach provides average recognition rates up to 93.54% when tested on external datasets.
Collapse
Affiliation(s)
- Valerio Guarrasi
- Unit of Computer Systems and Bioinformatics, Department of Engineering, University Campus Bio-Medico of Rome, Italy
- Department of Computer, Control, and Management Engineering, Sapienza University of Rome, Italy
| | - Natascha Claudia D'Amico
- Department of Diagnostic Imaging and Stereotactic Radiosurgery, Centro Diagnostico Italiano S.p.A., Milan, Italy
- Unit of Computer Systems and Bioinformatics, Department of Engineering, University Campus Bio-Medico of Rome, Italy
| | - Rosa Sicilia
- Unit of Computer Systems and Bioinformatics, Department of Engineering, University Campus Bio-Medico of Rome, Italy
| | - Ermanno Cordelli
- Unit of Computer Systems and Bioinformatics, Department of Engineering, University Campus Bio-Medico of Rome, Italy
| | - Paolo Soda
- Unit of Computer Systems and Bioinformatics, Department of Engineering, University Campus Bio-Medico of Rome, Italy
| |
Collapse
|
346
|
Hossain MB, Iqbal SMHS, Islam MM, Akhtar MN, Sarker IH. Transfer learning with fine-tuned deep CNN ResNet50 model for classifying COVID-19 from chest X-ray images. INFORMATICS IN MEDICINE UNLOCKED 2022; 30:100916. [PMID: 35342787 PMCID: PMC8933872 DOI: 10.1016/j.imu.2022.100916] [Citation(s) in RCA: 20] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2022] [Revised: 03/07/2022] [Accepted: 03/09/2022] [Indexed: 12/13/2022] Open
Abstract
COVID-19 cases are putting pressure on healthcare systems all around the world. Due to the lack of available testing kits, it is impractical for screening every patient with a respiratory ailment using traditional methods (RT-PCR). In addition, the tests have a high turn-around time and low sensitivity. Detecting suspected COVID-19 infections from the chest X-ray might help isolate high-risk people before the RT-PCR test. Most healthcare systems already have X-ray equipment, and because most current X-ray systems have already been computerized, there is no need to transfer the samples. The use of a chest X-ray to prioritize the selection of patients for subsequent RT-PCR testing is the motivation of this work. Transfer learning (TL) with fine-tuning on deep convolutional neural network-based ResNet50 model has been proposed in this work to classify COVID-19 patients from the COVID-19 Radiography Database. Ten distinct pre-trained weights, trained on varieties of large-scale datasets using various approaches such as supervised learning, self-supervised learning, and others, have been utilized in this work. Our proposed i N a t 2021 _ M i n i _ S w A V _ 1 k model, pre-trained on the iNat2021 Mini dataset using the SwAV algorithm, outperforms the other ResNet50 TL models. For COVID instances in the two-class (Covid and Normal) classification, our work achieved 99.17% validation accuracy, 99.95% train accuracy, 99.31% precision, 99.03% sensitivity, and 99.17% F1-score. Some domain-adapted ( I m a g e N e t _ C h e s t X - r a y 14 ) and in-domain (ChexPert, ChestX-ray14) models looked promising in medical image classification by scoring significantly higher than other models.
Collapse
Affiliation(s)
- Md Belal Hossain
- Department of Computer Science and Engineering, Pabna University of Science and Technology, Pabna 6600, Bangladesh
| | - S M Hasan Sazzad Iqbal
- Department of Computer Science and Engineering, Pabna University of Science and Technology, Pabna 6600, Bangladesh
| | - Md Monirul Islam
- Department of Textile Engineering, Uttara University, Dhaka 1230, Bangladesh
| | - Md Nasim Akhtar
- Department of Computer Science and Engineering, Dhaka University of Engineering Technology, Gazipur, 1707, Bangladesh
| | - Iqbal H Sarker
- Department of Computer Science and Engineering, Chittagong University of Engineering & Technology, Chittagong 4349, Bangladesh
| |
Collapse
|
347
|
Bhargava A, Bansal A, Goyal V. Machine learning-based automatic detection of novel coronavirus (COVID-19) disease. MULTIMEDIA TOOLS AND APPLICATIONS 2022; 81:13731-13750. [PMID: 35221781 PMCID: PMC8864211 DOI: 10.1007/s11042-022-12508-9] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/20/2021] [Revised: 09/06/2021] [Accepted: 01/25/2022] [Indexed: 05/03/2023]
Abstract
The pandemic was announced by the world health organization coronavirus (COVID-19) universal health dilemma. Any scientific appliance which contributes expeditious detection of coronavirus with a huge recognition rate may be excessively fruitful to doctors. In this environment, innovative automation like deep learning, machine learning, image processing and medical image like chest radiography (CXR), computed tomography (CT) has been refined promising solution contrary to COVID-19. Currently, a reverse transcription-polymerase chain reaction (RT-PCR) test has been used to detect the coronavirus. Due to the moratorium period is high on results tested and huge false negative estimates, substitute solutions are desired. Thus, an automated machine learning-based algorithm is proposed for the detection of COVID-19 and the grading of nine different datasets. This research impacts the grant of image processing and machine learning to expeditious and definite coronavirus detection using CXR and CT medical imaging. This results in early detection, diagnosis, and cure for the accomplishment of COVID-19 as early as possible. Firstly, images are preprocessed by normalization to enhance the quality of the image and removing of noise. Secondly, segmentation of images is done by fuzzy c-means clustering. Then various features namely, statistical, textural, histogram of gradients, and discrete wavelet transform are extracted (92) and selected from the feature vector by principle component analysis. Lastly, k-NN, SRC, ANN, and SVM are used to make decisions for normal, pneumonia, COVID-19 positive patients. The performance of the system has been validated by the k (5) fold cross-validation technique. The proposed algorithm achieves 91.70% (k-Nearest Neighbor), 94.40% (Sparse Representation Classifier), 96.16% (Artificial Neural Network), and 99.14% (Support Vector Machine) for COVID detection. The proposed results show feature combination and selection improves the performance in 14.34 s with machine learning and image processing techniques. Among k-NN, SRC, ANN, and SVM classifiers, SVM shows more efficient results that are promising and comparable with the literature. The proposed approach results in an improved recognition rate as compared to the literature review. Therefore, the algorithm proposed shows immense potential to benefit the radiologist for their findings. Also, fruitful in prior virus diagnosis and discriminate pneumonia between COVID-19 and other pandemics.
Collapse
|
348
|
Pohjonen J, Stürenberg C, Rannikkoy A, Mirtti T, Pitkänen E. Spectral decoupling for training transferable neural networks in medical imaging. iScience 2022; 25:103767. [PMID: 35146385 PMCID: PMC8816718 DOI: 10.1016/j.isci.2022.103767] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/09/2021] [Revised: 12/14/2021] [Accepted: 01/10/2022] [Indexed: 12/03/2022] Open
Abstract
Many neural networks for medical imaging generalize poorly to data unseen during training. Such behavior can be caused by overfitting easy-to-learn features while disregarding other potentially informative features. A recent implicit bias mitigation technique called spectral decoupling provably encourages neural networks to learn more features by regularizing the networks' unnormalized prediction scores with an L2 penalty. We show that spectral decoupling increases the networks′ robustness for data distribution shifts and prevents overfitting on easy-to-learn features in medical images. To validate our findings, we train networks with and without spectral decoupling to detect prostate cancer on tissue slides and COVID-19 in chest radiographs. Networks trained with spectral decoupling achieve up to 9.5 percent point higher performance on external datasets. Spectral decoupling alleviates generalization issues associated with neural networks and can be used to complement or replace computationally expensive explicit bias mitigation methods, such as stain normalization in histological images. We evaluate the first implicit bias mitigation method in medical imaging Spectral decoupling increases robustness for distribution shifts and shortcut learning Complement or replace explicit mitigation methods, such as color normalization Up to 9.5% point higher accuracy on external datasets with one line of code
Collapse
|
349
|
Coronavirus Pneumonia Classification using X-Ray and CT Scan Images with Deep Convolutional Neural Networks Models. JOURNAL OF INFORMATION TECHNOLOGY RESEARCH 2022. [DOI: 10.4018/jitr.299391] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Pneumonia is a life-threatening infectious disease affecting one or both lungs in humans. There are mainly two types of pneumonia: bacterial and viral. Likewise, patients with coronavirus can develop symptoms that belong to the common flu, pneumonia, and other respiratory diseases. Chest X-rays are the common method used to diagnose coronavirus pneumonia and it needs a medical expert to evaluate the result of X-ray. Furthermore, DL has garnered great attention among researchers in recent years in a variety of application domains such as medical image processing, computer vision, bioinformatics, and many others. In this paper, we present a comparison of Deep Convolutional Neural Networks models for automatically binary classification query chest X-ray & CT images dataset with the goal of taking precision tools to health professionals based on fined recent versions of ResNet50, InceptionV3, and VGGNet. The experiments were conducted using a chest X-ray & CT open dataset of 5856 images and confusion matrices are used to evaluate model performances.
Collapse
|
350
|
Mohbey KK, Sharma S, Kumar S, Sharma M. COVID-19 identification and analysis using CT scan images: Deep transfer learning-based approach. BLOCKCHAIN APPLICATIONS FOR HEALTHCARE INFORMATICS 2022. [PMCID: PMC9212254 DOI: 10.1016/b978-0-323-90615-9.00011-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 12/03/2022]
Abstract
Due to this epidemic of COVID-19, the everyday lives, welfare, and wealth of a country are affected. Inefficiency, a lack of medical diagnostics, and inadequately trained healthcare professionals are among the most significant barriers to arresting the development of this disease. Blockchain offers enormous promise for providing consistent and reliable real time and smart health facilities offsite. The infected patients with COVID-19 have shown they often have a lung infection upon arrival. It can be detected and analyzed using CT scan images. Unfortunately, though, it is time-consuming and liable to error. Thus, the assessment of chest CT scans must be automated. The proposed method uses transfer deep learning techniques to analyze CT scan images automatically. Transfer deep learning can improve the parameters of networks on huge databases, and pretrained networks can be used effectively on small datasets. We proposed a model built on VGGNet19, a convolutional neural network to classify individuals infected with coronavirus utilizing images of CT radiographs. We have used a globally accessible CT scan database that included 2500 CT pictures with COVID-19 infection and 2500 CT images without COVID-19 infection. An extensive experiment has been conducted using three deep learning methods such as VGG19, Xception Net, and CNN. Experiment findings indicate that the proposed model outperforms the other Xception Net and CNN models considerably. The results demonstrate that the proposed models have an accuracy of up to 95% and area under the receiver operating characteristic curve up to 95%.
Collapse
|