201
|
Al-Azawi RJ, Al-Saidi NM, Jalab HA, Kahtan H, Ibrahim RW. Efficient classification of COVID-19 CT scans by using q-transform model for feature extraction. PeerJ Comput Sci 2021; 7:e553. [PMID: 39545145 PMCID: PMC11563183 DOI: 10.7717/peerj-cs.553] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/19/2021] [Accepted: 04/29/2021] [Indexed: 11/17/2024]
Abstract
The exponential growth in computer technology throughout the past two decades has facilitated the development of advanced image analysis techniques which aid the field of medical imaging. CT is a widely used medical screening method used to obtain high resolution images of the human body. CT has been proven useful in the screening of the virus that is responsible for the COVID-19 pandemic by allowing physicians to rule out suspected infections based on the appearance of the lungs from the CT scan. Based on this, we hereby propose an intelligent yet efficient CT scan-based COVID-19 classification algorithm that is able to discriminate negative from positive cases by evaluating the appearance of lungs. The algorithm is comprised of four main steps: preprocessing, features extraction, features reduction, and classification. In preprocessing, we employ the contrast limited adaptive histogram equalization (CLAHE) to adjust the contrast of the image to enhance the details of the input image. We then apply the q-transform method to extract features from the CT scan. This method measures the grey level intensity of the pixels which reflects the features of the image. In the feature reduction step, we measure the mean, skewness and standard deviation to reduce overhead and improve the efficiency of the algorithm. Finally, "k-nearest neighbor", "decision tree", and "support vector machine" are used as classifiers to classify the cases. The experimental results show accuracy rates of 98%, 98%, and 98.25% for each of the classifiers, respectively. It is therefore concluded that the proposed method is efficient, accurate, and flexible. Overall, we are confident that the proposed algorithm is capable of achieving a high classification accuracy under different scenarios, which makes it suitable for implementation in real-world applications.
Collapse
Affiliation(s)
- Razi J. Al-Azawi
- Department of Laser and Optoelectronics
Engineering, University of Technology, University of
Technology, Baghdad, Iraq,
Iraq
| | - Nadia M.G. Al-Saidi
- Department of Applied Sciences, University of
Technology, University of Technology, Baghdad,
Iraq, Iraq
| | - Hamid A. Jalab
- Department of Computer System and Technology,
Faculty of Computer Science and Information Technology,
University of Malaya, Kuala Lumpur,
Malaysia
| | - Hasan Kahtan
- Department of Software Engineering, Faculty of
Computer Science and Information Technology,
University of Malaya, Kuala Lumpur,
Malaysia
| | | |
Collapse
|
202
|
Singh G, Yow KC. An Interpretable Deep Learning Model for Covid-19 Detection With Chest X-Ray Images. IEEE ACCESS : PRACTICAL INNOVATIONS, OPEN SOLUTIONS 2021; 9:85198-85208. [PMID: 35256923 PMCID: PMC8864958 DOI: 10.1109/access.2021.3087583] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/20/2021] [Accepted: 06/05/2021] [Indexed: 05/28/2023]
Abstract
Timely and accurate detection of an epidemic/pandemic is always desired to prevent its spread. For the detection of any disease, there can be more than one approach including deep learning models. However, transparency/interpretability of the reasoning process of a deep learning model related to health science is a necessity. Thus, we introduce an interpretable deep learning model: Gen-ProtoPNet. Gen-ProtoPNet is closely related to two interpretable deep learning models: ProtoPNet and NP-ProtoPNet The latter two models use prototypes of spacial dimension [Formula: see text] and the distance function [Formula: see text]. In our model, we use a generalized version of the distance function [Formula: see text] that enables us to use prototypes of any type of spacial dimensions, that is, square spacial dimensions and rectangular spacial dimensions to classify an input image. The accuracy and precision that our model receives is on par with the best performing non-interpretable deep learning models when we tested the models on the dataset of [Formula: see text]-ray images. Our model attains the highest accuracy of 87.27% on classification of three classes of images, that is close to the accuracy of 88.42% attained by a non-interpretable model on the classification of the given dataset.
Collapse
Affiliation(s)
- Gurmail Singh
- Faculty of Engineering and Applied SciencesUniversity of ReginaReginaSKS4S 0A2Canada
| | - Kin-Choong Yow
- Faculty of Engineering and Applied SciencesUniversity of ReginaReginaSKS4S 0A2Canada
| |
Collapse
|
203
|
Shorfuzzaman M, Masud M, Alhumyani H, Anand D, Singh A. Artificial Neural Network-Based Deep Learning Model for COVID-19 Patient Detection Using X-Ray Chest Images. JOURNAL OF HEALTHCARE ENGINEERING 2021; 2021:5513679. [PMID: 34194681 PMCID: PMC8184332 DOI: 10.1155/2021/5513679] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/17/2021] [Revised: 04/18/2021] [Accepted: 05/16/2021] [Indexed: 12/24/2022]
Abstract
The world is experiencing an unprecedented crisis due to the coronavirus disease (COVID-19) outbreak that has affected nearly 216 countries and territories across the globe. Since the pandemic outbreak, there is a growing interest in computational model-based diagnostic technologies to support the screening and diagnosis of COVID-19 cases using medical imaging such as chest X-ray (CXR) scans. It is discovered in initial studies that patients infected with COVID-19 show abnormalities in their CXR images that represent specific radiological patterns. Still, detection of these patterns is challenging and time-consuming even for skilled radiologists. In this study, we propose a novel convolutional neural network- (CNN-) based deep learning fusion framework using the transfer learning concept where parameters (weights) from different models are combined into a single model to extract features from images which are then fed to a custom classifier for prediction. We use gradient-weighted class activation mapping to visualize the infected areas of CXR images. Furthermore, we provide feature representation through visualization to gain a deeper understanding of the class separability of the studied models with respect to COVID-19 detection. Cross-validation studies are used to assess the performance of the proposed models using open-access datasets containing healthy and both COVID-19 and other pneumonia infected CXR images. Evaluation results show that the best performing fusion model can attain a classification accuracy of 95.49% with a high level of sensitivity and specificity.
Collapse
Affiliation(s)
- Mohammad Shorfuzzaman
- Department of Computer Science, College of Computers and Information Technology, Taif University, Taif 21974, Saudi Arabia
| | - Mehedi Masud
- Department of Computer Science, College of Computers and Information Technology, Taif University, Taif 21974, Saudi Arabia
| | - Hesham Alhumyani
- Department of Computer Engineering, College of Computers and Information Technology, Taif University, Taif 21974, Saudi Arabia
| | - Divya Anand
- Department of Computer Science and Engineering, Lovely Professional University, Phagwara, Punjab 144411, India
| | - Aman Singh
- Department of Computer Science and Engineering, Lovely Professional University, Phagwara, Punjab 144411, India
| |
Collapse
|
204
|
Zhou C, Song J, Zhou S, Zhang Z, Xing J. COVID-19 Detection Based on Image Regrouping and Resnet-SVM Using Chest X-Ray Images. IEEE ACCESS : PRACTICAL INNOVATIONS, OPEN SOLUTIONS 2021; 9:81902-81912. [PMID: 34812395 PMCID: PMC8545189 DOI: 10.1109/access.2021.3086229] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/19/2021] [Accepted: 05/31/2021] [Indexed: 06/01/2023]
Abstract
As the COVID-19 spread worldwide, countries around the world are actively taking measures to fight against the epidemic. To prevent the spread of it, a high sensitivity and efficient method for COVID-19 detection is necessary. By analyzing the COVID-19 chest X-ray images, a combination method of image regrouping and ResNet-SVM was proposed in this study. The lung region was segmented from the original chest X-ray images and divided into small pieces, and then the small pieces of lung region were regrouped into a regular image randomly. Furthermore the regrouped images were fed into the deep residual encoder block for feature extraction. Finally the extracted features were as input into support vector machine for recognition. The visual attention was introduced in the novel method, which paid more attention to the features of COVID-19 without the interference of shapes, rib and other related noises. The experimental results showed that the proposed method achieved 93% accuracy without large number of training data, outperformed the existing COVID-19 detection models.
Collapse
Affiliation(s)
- Changjian Zhou
- Key Laboratory of Agricultural Microbiology of Heilongjiang ProvinceNortheast Agricultural UniversityHarbin150030China
- Department of Modern Educational TechnologyNortheast Agricultural UniversityHarbin150030China
| | - Jia Song
- Key Laboratory of Agricultural Microbiology of Heilongjiang ProvinceNortheast Agricultural UniversityHarbin150030China
| | - Sihan Zhou
- College of Electrical and InformationNortheast Agricultural UniversityHarbin150030China
| | - Zhiyao Zhang
- College of Electrical and InformationNortheast Agricultural UniversityHarbin150030China
| | - Jinge Xing
- Department of Modern Educational TechnologyNortheast Agricultural UniversityHarbin150030China
| |
Collapse
|
205
|
Chan JH, Li C. Learning from imbalanced COVID-19 chest X-ray (CXR) medical imaging data. Methods 2021; 202:31-39. [PMID: 34090971 DOI: 10.1016/j.ymeth.2021.06.002] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2021] [Revised: 05/07/2021] [Accepted: 06/01/2021] [Indexed: 12/24/2022] Open
Abstract
The trendy task of digital medical image analysis has been continually evolving. It has been an area of prominent and growing importance from both research and deployment perspectives. Nonetheless, it is necessary to realize that the use of algorithms, methodology, as well as the source of medical image data, must be strictly scrutinized. As the COVID-19 pandemic has been gripping much of the world recently, there has been much efforts gone into developing affordable testing for the masses, and it has been shown that the established and widely available chest X-rays (CXR) images may be used as a screening criteria for assistive diagnosis purpose. Thanks to the dedicated work by various individuals and organizations, publicly available CXR of COVID-19 subjects are available for analytic usage. We have also provided a publicly available CXR dataset on the Kaggle platform. As a case study, this paper presents a systematic approach to learn from a typically imbalanced set of CXR images, which consists of a limited number of publicly available COVID-19 images. Our results show that we are able to outperform the top finishers in a related Kaggle multi-class CXR challenge. The proposed methodology should be able to help guide medical personnel in obtaining a robust diagnosis model to discern COVID-19 from other conditions confidently.
Collapse
Affiliation(s)
- Jonathan H Chan
- Innovative Cognitive Computing (IC2) Research Center, School of Information Technology, King Mongkut's University of Technology Thonburi, Bangkok, Thailand.
| | - Chenqi Li
- Division of Engineering Science, Faculty of Applied Science and Engineering, University of Toronto, Toronto, Canada.
| |
Collapse
|
206
|
Rasheed J, Jamil A, Hameed AA, Al-Turjman F, Rasheed A. COVID-19 in the Age of Artificial Intelligence: A Comprehensive Review. Interdiscip Sci 2021; 13:153-175. [PMID: 33886097 PMCID: PMC8060789 DOI: 10.1007/s12539-021-00431-w] [Citation(s) in RCA: 21] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2020] [Revised: 04/03/2021] [Accepted: 04/09/2021] [Indexed: 12/23/2022]
Abstract
The recent COVID-19 pandemic, which broke at the end of the year 2019 in Wuhan, China, has infected more than 98.52 million people by today (January 23, 2021) with over 2.11 million deaths across the globe. To combat the growing pandemic on urgent basis, there is need to design effective solutions using new techniques that could exploit recent technology, such as machine learning, deep learning, big data, artificial intelligence, Internet of Things, for identification and tracking of COVID-19 cases in near real time. These technologies have offered inexpensive and rapid solution for proper screening, analyzing, prediction and tracking of COVID-19 positive cases. In this paper, a detailed review of the role of AI as a decisive tool for prognosis, analyze, and tracking the COVID-19 cases is performed. We searched various databases including Google Scholar, IEEE Library, Scopus and Web of Science using a combination of different keywords consisting of COVID-19 and AI. We have identified various applications, where AI can help healthcare practitioners in the process of identification and monitoring of COVID-19 cases. A compact summary of the corona virus cases are first highlighted, followed by the application of AI. Finally, we conclude the paper by highlighting new research directions and discuss the research challenges. Even though scientists and researchers have gathered and exchanged sufficient knowledge over last couple of months, but this structured review also examined technological perspectives while encompassing the medical aspect to help the healthcare practitioners, policymakers, decision makers, policymakers, AI scientists and virologists to quell this infectious COVID-19 pandemic outbreak.
Collapse
Affiliation(s)
- Jawad Rasheed
- Department of Computer Engineering, Istanbul Aydin University, Istanbul, 34295, Turkey.
| | - Akhtar Jamil
- Department of Computer Engineering, Istanbul Sabahattin Zaim University, Istanbul, 34303, Turkey
| | - Alaa Ali Hameed
- Department of Computer Engineering, Istanbul Sabahattin Zaim University, Istanbul, 34303, Turkey
| | - Fadi Al-Turjman
- Artificial Intelligence Engineering Department, Research Center for AI and IoT, Near East University, Nicosia, Mersin 10, Turkey
| | - Ahmad Rasheed
- Department of Electrical and Electronics Engineering, Eastern Mediterranean University, Famagusta, Mersin 10, Turkey
| |
Collapse
|
207
|
Chen RJ, Lu MY, Chen TY, Williamson DFK, Mahmood F. Synthetic data in machine learning for medicine and healthcare. Nat Biomed Eng 2021; 5:493-497. [PMID: 34131324 PMCID: PMC9353344 DOI: 10.1038/s41551-021-00751-8] [Citation(s) in RCA: 211] [Impact Index Per Article: 52.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/30/2023]
Abstract
The proliferation of synthetic data in artificial intelligence for medicine and healthcare raises concerns about the vulnerabilities of the software and the challenges of current policy.
Collapse
Affiliation(s)
- Richard J Chen
- Department of Pathology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA
- Cancer Program, Broad Institute of Harvard and MIT, Cambridge, MA, USA
- Cancer Data Science Program, Dana-Farber Cancer Institute, Boston, MA, USA
| | - Ming Y Lu
- Department of Pathology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA
- Cancer Program, Broad Institute of Harvard and MIT, Cambridge, MA, USA
- Cancer Data Science Program, Dana-Farber Cancer Institute, Boston, MA, USA
| | - Tiffany Y Chen
- Department of Pathology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA
- Cancer Program, Broad Institute of Harvard and MIT, Cambridge, MA, USA
| | - Drew F K Williamson
- Department of Pathology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA
- Cancer Program, Broad Institute of Harvard and MIT, Cambridge, MA, USA
| | - Faisal Mahmood
- Department of Pathology, Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA.
- Cancer Program, Broad Institute of Harvard and MIT, Cambridge, MA, USA.
- Cancer Data Science Program, Dana-Farber Cancer Institute, Boston, MA, USA.
| |
Collapse
|
208
|
Iskanderani AI, Mehedi IM, Aljohani AJ, Shorfuzzaman M, Akther F, Palaniswamy T, Latif SA, Latif A, Alam A. Artificial Intelligence and Medical Internet of Things Framework for Diagnosis of Coronavirus Suspected Cases. JOURNAL OF HEALTHCARE ENGINEERING 2021; 2021:3277988. [PMID: 34150188 PMCID: PMC8197673 DOI: 10.1155/2021/3277988] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/29/2021] [Revised: 05/06/2021] [Accepted: 05/18/2021] [Indexed: 11/25/2022]
Abstract
The world has been facing the COVID-19 pandemic since December 2019. Timely and efficient diagnosis of COVID-19 suspected patients plays a significant role in medical treatment. The deep transfer learning-based automated COVID-19 diagnosis on chest X-ray is required to counter the COVID-19 outbreak. This work proposes a real-time Internet of Things (IoT) framework for early diagnosis of suspected COVID-19 patients by using ensemble deep transfer learning. The proposed framework offers real-time communication and diagnosis of COVID-19 suspected cases. The proposed IoT framework ensembles four deep learning models such as InceptionResNetV2, ResNet152V2, VGG16, and DenseNet201. The medical sensors are utilized to obtain the chest X-ray modalities and diagnose the infection by using the deep ensemble model stored on the cloud server. The proposed deep ensemble model is compared with six well-known transfer learning models over the chest X-ray dataset. Comparative analysis revealed that the proposed model can help radiologists to efficiently and timely diagnose the COVID-19 suspected patients.
Collapse
Affiliation(s)
- Ahmed I. Iskanderani
- Department of Electrical and Computer Engineering (ECE), King Abdulaziz University, Jeddah 21589, Saudi Arabia
| | - Ibrahim M. Mehedi
- Department of Electrical and Computer Engineering (ECE), King Abdulaziz University, Jeddah 21589, Saudi Arabia
- Center of Excellence in Intelligent Engineering Systems (CEIES), King Abdulaziz University, Jeddah 21589, Saudi Arabia
| | - Abdulah Jeza Aljohani
- Department of Electrical and Computer Engineering (ECE), King Abdulaziz University, Jeddah 21589, Saudi Arabia
- Center of Excellence in Intelligent Engineering Systems (CEIES), King Abdulaziz University, Jeddah 21589, Saudi Arabia
| | - Mohammad Shorfuzzaman
- Department of Computer Science, College of Computers and Information Technology, Taif University, Taif, Saudi Arabia
| | | | - Thangam Palaniswamy
- Department of Electrical and Computer Engineering (ECE), King Abdulaziz University, Jeddah 21589, Saudi Arabia
| | - Shaikh Abdul Latif
- Department of Nuclear Engineering, King Abdulaziz University, Jeddah 21589, Saudi Arabia
| | - Abdul Latif
- Department of Mathematics, King Abdulaziz University, Jeddah 21589, Saudi Arabia
| | - Aftab Alam
- CIT Department, Faculty of Studies, King Abdulaziz University, Jeddah 21589, Saudi Arabia
| |
Collapse
|
209
|
Hertel R, Benlamri R. COV-SNET: A deep learning model for X-ray-based COVID-19 classification. INFORMATICS IN MEDICINE UNLOCKED 2021; 24:100620. [PMID: 34075340 PMCID: PMC8158400 DOI: 10.1016/j.imu.2021.100620] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/21/2021] [Revised: 05/21/2021] [Accepted: 05/23/2021] [Indexed: 12/26/2022] Open
Abstract
The AI research community has recently been intensely focused on diagnosing COVID-19 by applying deep learning technology to the X-ray scans taken of COVID-19 patients. Differentiating COVID-19 from other pneumonia-inducing illnesses is a highly challenging task as it shares many of the same imaging characteristics as other pulmonary diseases. This is especially true given the small number of COVID-19 X-rays that are publicly available. Deep learning experts commonly use transfer learning to offset the small number of images typically available in medical imaging tasks. Our COV-SNET model is a deep neural network that was pretrained on over one hundred thousand X-ray images. In this paper, we designed two COV-SNET models with the purpose of diagnosing COVID-19. The experimental results demonstrate the robustness of our deep learning models, ultimately achieving sensitivities of 95% for our three-class and two-class models. We also discuss the strengths and weaknesses of such an approach, focusing mainly on the limitations of public X-ray datasets on current COVID-19 deep learning models. Finally, we conclude with possible future directions for this research.
Collapse
Affiliation(s)
- Robert Hertel
- Lakehead University, 955 Oliver Rd, Thunder Bay, ON P7B 5E1, Canada
| | - Rachid Benlamri
- Lakehead University, 955 Oliver Rd, Thunder Bay, ON P7B 5E1, Canada
| |
Collapse
|
210
|
Karbhari Y, Basu A, Geem ZW, Han GT, Sarkar R. Generation of Synthetic Chest X-ray Images and Detection of COVID-19: A Deep Learning Based Approach. Diagnostics (Basel) 2021; 11:895. [PMID: 34069841 PMCID: PMC8157360 DOI: 10.3390/diagnostics11050895] [Citation(s) in RCA: 24] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2021] [Revised: 05/14/2021] [Accepted: 05/16/2021] [Indexed: 12/13/2022] Open
Abstract
COVID-19 is a disease caused by the SARS-CoV-2 virus. The COVID-19 virus spreads when a person comes into contact with an affected individual. This is mainly through drops of saliva or nasal discharge. Most of the affected people have mild symptoms while some people develop acute respiratory distress syndrome (ARDS), which damages organs like the lungs and heart. Chest X-rays (CXRs) have been widely used to identify abnormalities that help in detecting the COVID-19 virus. They have also been used as an initial screening procedure for individuals highly suspected of being infected. However, the availability of radiographic CXRs is still scarce. This can limit the performance of deep learning (DL) based approaches for COVID-19 detection. To overcome these limitations, in this work, we developed an Auxiliary Classifier Generative Adversarial Network (ACGAN), to generate CXRs. Each generated X-ray belongs to one of the two classes COVID-19 positive or normal. To ensure the goodness of the synthetic images, we performed some experimentation on the obtained images using the latest Convolutional Neural Networks (CNNs) to detect COVID-19 in the CXRs. We fine-tuned the models and achieved more than 98% accuracy. After that, we also performed feature selection using the Harmony Search (HS) algorithm, which reduces the number of features while retaining classification accuracy. We further release a GAN-generated dataset consisting of 500 COVID-19 radiographic images.
Collapse
Affiliation(s)
- Yash Karbhari
- Department of Information Technology, Pune Vidyarthi Griha’s College of Engineering and Technology, Pune 411009, India;
| | - Arpan Basu
- Department of Computer Science and Engineering, Jadavpur University, Kolkata 700032, India; (A.B.); (R.S.)
| | - Zong Woo Geem
- College of IT Convergence, Gachon University, 1342 Seongnam Daero, Seongnam 13120, Korea;
| | - Gi-Tae Han
- College of IT Convergence, Gachon University, 1342 Seongnam Daero, Seongnam 13120, Korea;
| | - Ram Sarkar
- Department of Computer Science and Engineering, Jadavpur University, Kolkata 700032, India; (A.B.); (R.S.)
| |
Collapse
|
211
|
Alqahtani MS, Abbas M, Alqahtani A, Alshahrani M, Alkulib A, Alelyani M, Almarhaby A, Alsabaani A. A Novel Computational Model for Detecting the Severity of Inflammation in Confirmed COVID-19 Patients Using Chest X-ray Images. Diagnostics (Basel) 2021; 11:855. [PMID: 34068796 PMCID: PMC8151385 DOI: 10.3390/diagnostics11050855] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2021] [Revised: 05/01/2021] [Accepted: 05/02/2021] [Indexed: 12/28/2022] Open
Abstract
Since late 2019, Coronavirus Disease 2019 (COVID-19) has spread all over the world. The disease is highly contagious, and it may lead to acute respiratory distress (ARD). Medical imaging can play an important role in classifying, detecting, and measuring the severity of the virus. This study aims to provide a novel auto-detection tool that can detect abnormal changes in conventional X-ray images for confirmed COVID-19 cases. X-ray images from patients diagnosed with COVID-19 were converted into 19 different colored layers. Each layer represented objects with similar contrast that could be defined as a specific color. The objects with similar contrasts were formed in a single layer. All the objects from all the layers were extracted as a single-color image. Based on the differentiation of colors, the prototype model was able to recognize a wide spectrum of abnormal changes in the image texture. This was true even if there was minimal variation of the contrast values of the detected uncleared abnormalities. The results indicate that the proposed novel method can detect and determine the degree of lung infection from COVID-19 with an accuracy of 91%, compared to the opinions of three experienced radiologists. The method can also efficiently determine the sites of infection and the severity of the disease by classifying the X-rays into five levels of severity. Thus, the proposed COVID-19 autodetection method can identify locations and indicate the degree of severity of the disease by comparing affected tissue with healthy tissue, and it can predict where the disease may spread.
Collapse
Affiliation(s)
- Mohammed S. Alqahtani
- Department of Radiological Sciences, College of Applied Medical Sciences, King Khalid University, Abha 61421, Saudi Arabia;
- BioImaging Unit, Space Research Centre, Department of Physics and Astronomy, University of Leicester, Leicester LE1 7RH, UK;
| | - Mohamed Abbas
- Electrical Engineering Department, College of Engineering, King Khalid University, Abha 61421, Saudi Arabia;
- Computers and Communications Department, College of Engineering, Delta University for Science and Technology, Gamasa 35712, Egypt
| | - Ali Alqahtani
- Medical and Clinical Affairs Department, King Faisal Medical City, Abha 62523, Saudi Arabia; (A.A.); (A.A.)
| | - Mohammad Alshahrani
- Department of Clinical Laboratory Sciences, College of Applied Medical Sciences, King Khalid University, Abha 61421, Saudi Arabia;
| | - Abdulhadi Alkulib
- Medical and Clinical Affairs Department, King Faisal Medical City, Abha 62523, Saudi Arabia; (A.A.); (A.A.)
| | - Magbool Alelyani
- Department of Radiological Sciences, College of Applied Medical Sciences, King Khalid University, Abha 61421, Saudi Arabia;
| | - Awad Almarhaby
- BioImaging Unit, Space Research Centre, Department of Physics and Astronomy, University of Leicester, Leicester LE1 7RH, UK;
| | - Abdullah Alsabaani
- Department of Family and Community Medicine, College of Medicine, King Khalid University, Abha 61421, Saudi Arabia;
| |
Collapse
|
212
|
Short-Term Prediction of COVID-19 Cases Using Machine Learning Models. APPLIED SCIENCES-BASEL 2021. [DOI: 10.3390/app11094266] [Citation(s) in RCA: 27] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
Abstract
The first case in Bangladesh of the novel coronavirus disease (COVID-19) was reported on 8 March 2020, with the number of confirmed cases rapidly rising to over 175,000 by July 2020. In the absence of effective treatment, an essential tool of health policy is the modeling and forecasting of the progress of the pandemic. We, therefore, developed a cloud-based machine learning short-term forecasting model for Bangladesh, in which several regression-based machine learning models were applied to infected case data to estimate the number of COVID-19-infected people over the following seven days. This approach can accurately forecast the number of infected cases daily by training the prior 25 days sample data recorded on our web application. The outcomes of these efforts could aid the development and assessment of prevention strategies and identify factors that most affect the spread of COVID-19 infection in Bangladesh.
Collapse
|
213
|
Kugunavar S, Prabhakar CJ. Convolutional neural networks for the diagnosis and prognosis of the coronavirus disease pandemic. Vis Comput Ind Biomed Art 2021; 4:12. [PMID: 33950399 PMCID: PMC8097673 DOI: 10.1186/s42492-021-00078-w] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2021] [Accepted: 04/19/2021] [Indexed: 12/21/2022] Open
Abstract
A neural network is one of the current trends in deep learning, which is increasingly gaining attention owing to its contribution in transforming the different facets of human life. It also paves a way to approach the current crisis caused by the coronavirus disease (COVID-19) from all scientific directions. Convolutional neural network (CNN), a type of neural network, is extensively applied in the medical field, and is particularly useful in the current COVID-19 pandemic. In this article, we present the application of CNNs for the diagnosis and prognosis of COVID-19 using X-ray and computed tomography (CT) images of COVID-19 patients. The CNN models discussed in this review were mainly developed for the detection, classification, and segmentation of COVID-19 images. The base models used for detection and classification were AlexNet, Visual Geometry Group Network with 16 layers, residual network, DensNet, GoogLeNet, MobileNet, Inception, and extreme Inception. U-Net and voxel-based broad learning network were used for segmentation. Even with limited datasets, these methods proved to be beneficial for efficiently identifying the occurrence of COVID-19. To further validate these observations, we conducted an experimental study using a simple CNN framework for the binary classification of COVID-19 CT images. We achieved an accuracy of 93% with an F1-score of 0.93. Thus, with the availability of improved medical image datasets, it is evident that CNNs are very useful for the efficient diagnosis and prognosis of COVID-19.
Collapse
Affiliation(s)
- Sneha Kugunavar
- Department of Computer Science, Kuvempu University, Shimoga, Karnataka, 577451, India.
| | - C J Prabhakar
- Department of Computer Science, Kuvempu University, Shimoga, Karnataka, 577451, India
| |
Collapse
|
214
|
Serte S, Demirel H. Deep learning for diagnosis of COVID-19 using 3D CT scans. Comput Biol Med 2021; 132:104306. [PMID: 33780867 PMCID: PMC7943389 DOI: 10.1016/j.compbiomed.2021.104306] [Citation(s) in RCA: 52] [Impact Index Per Article: 13.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/19/2020] [Revised: 02/27/2021] [Accepted: 02/27/2021] [Indexed: 12/16/2022]
Abstract
A new pneumonia-type coronavirus, COVID-19, recently emerged in Wuhan, China. COVID-19 has subsequently infected many people and caused many deaths worldwide. Isolating infected people is one of the methods of preventing the spread of this virus. CT scans provide detailed imaging of the lungs and assist radiologists in diagnosing COVID-19 in hospitals. However, a person's CT scan contains hundreds of slides, and the diagnosis of COVID-19 using such scans can lead to delays in hospitals. Artificial intelligence techniques could assist radiologists with rapidly and accurately detecting COVID-19 infection from these scans. This paper proposes an artificial intelligence (AI) approach to classify COVID-19 and normal CT volumes. The proposed AI method uses the ResNet-50 deep learning model to predict COVID-19 on each CT image of a 3D CT scan. Then, this AI method fuses image-level predictions to diagnose COVID-19 on a 3D CT volume. We show that the proposed deep learning model provides 96% AUC value for detecting COVID-19 on CT scans.
Collapse
Affiliation(s)
- Sertan Serte
- Department of Electrical and Electronic Engineering Near East University Nicosia, North Cyprus Via Mersin 10, Turkey.
| | - Hasan Demirel
- Department of Electrical and Electronic Engineering Near East University Nicosia, North Cyprus Via Mersin 10, Turkey
| |
Collapse
|
215
|
Poly TN, Islam MM, Li YCJ, Alsinglawi B, Hsu MH, Jian WS, Yang HC. Application of Artificial Intelligence for Screening COVID-19 Patients Using Digital Images: Meta-analysis. JMIR Med Inform 2021; 9:e21394. [PMID: 33764884 PMCID: PMC8086786 DOI: 10.2196/21394] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/16/2020] [Revised: 09/04/2020] [Accepted: 03/21/2021] [Indexed: 12/24/2022] Open
Abstract
BACKGROUND The COVID-19 outbreak has spread rapidly and hospitals are overwhelmed with COVID-19 patients. While analysis of nasal and throat swabs from patients is the main way to detect COVID-19, analyzing chest images could offer an alternative method to hospitals, where health care personnel and testing kits are scarce. Deep learning (DL), in particular, has shown impressive levels of performance when analyzing medical images, including those related to COVID-19 pneumonia. OBJECTIVE The goal of this study was to perform a systematic review with a meta-analysis of relevant studies to quantify the performance of DL algorithms in the automatic stratification of COVID-19 patients using chest images. METHODS A search strategy for use in PubMed, Scopus, Google Scholar, and Web of Science was developed, where we searched for articles published between January 1 and April 25, 2020. We used the key terms "COVID-19," or "coronavirus," or "SARS-CoV-2," or "novel corona," or "2019-ncov," and "deep learning," or "artificial intelligence," or "automatic detection." Two authors independently extracted data on study characteristics, methods, risk of bias, and outcomes. Any disagreement between them was resolved by consensus. RESULTS A total of 16 studies were included in the meta-analysis, which included 5896 chest images from COVID-19 patients. The pooled sensitivity and specificity of the DL models in detecting COVID-19 were 0.95 (95% CI 0.94-0.95) and 0.96 (95% CI 0.96-0.97), respectively, with an area under the receiver operating characteristic curve of 0.98. The positive likelihood, negative likelihood, and diagnostic odds ratio were 19.02 (95% CI 12.83-28.19), 0.06 (95% CI 0.04-0.10), and 368.07 (95% CI 162.30-834.75), respectively. The pooled sensitivity and specificity for distinguishing other types of pneumonia from COVID-19 were 0.93 (95% CI 0.92-0.94) and 0.95 (95% CI 0.94-0.95), respectively. The performance of radiologists in detecting COVID-19 was lower than that of the DL models; however, the performance of junior radiologists was improved when they used DL-based prediction tools. CONCLUSIONS Our study findings show that DL models have immense potential in accurately stratifying COVID-19 patients and in correctly differentiating them from patients with other types of pneumonia and normal patients. Implementation of DL-based tools can assist radiologists in correctly and quickly detecting COVID-19 and, consequently, in combating the COVID-19 pandemic.
Collapse
Affiliation(s)
- Tahmina Nasrin Poly
- Graduate Institute of Biomedical Informatics, College of Medical Science and Technology, Taipei Medical University, Taipei, Taiwan
- International Center for Health Information Technology, Taipei Medical University, Taipei, Taiwan
- Research Center of Big Data and Meta-Analysis, Wan Fang Hospital, Taipei Medical University, Taipei, Taiwan
| | - Md Mohaimenul Islam
- Graduate Institute of Biomedical Informatics, College of Medical Science and Technology, Taipei Medical University, Taipei, Taiwan
- International Center for Health Information Technology, Taipei Medical University, Taipei, Taiwan
- Research Center of Big Data and Meta-Analysis, Wan Fang Hospital, Taipei Medical University, Taipei, Taiwan
| | - Yu-Chuan Jack Li
- Graduate Institute of Biomedical Informatics, College of Medical Science and Technology, Taipei Medical University, Taipei, Taiwan
- International Center for Health Information Technology, Taipei Medical University, Taipei, Taiwan
- Research Center of Big Data and Meta-Analysis, Wan Fang Hospital, Taipei Medical University, Taipei, Taiwan
- Department of Dermatology, Wan Fang Hospital, Taipei Medical University, Taipei, Taiwan
- TMU Research Center of Cancer Translational Medicine, Taipei Medical University, Taipei, Taiwan
| | - Belal Alsinglawi
- School of Computer, Data, and Mathematical Science, Western Sydney University, Sydney, Australia
| | - Min-Huei Hsu
- Graduate Institute of Data Science, Taipei Medical University, Taipei, Taiwan
| | - Wen Shan Jian
- School of Health Care Administration, Taipei Medical University, Taipei, Taiwan
| | - Hsuan-Chia Yang
- Graduate Institute of Biomedical Informatics, College of Medical Science and Technology, Taipei Medical University, Taipei, Taiwan
- International Center for Health Information Technology, Taipei Medical University, Taipei, Taiwan
- Research Center of Big Data and Meta-Analysis, Wan Fang Hospital, Taipei Medical University, Taipei, Taiwan
| |
Collapse
|
216
|
Dong J, Liu C, Man P, Zhao G, Wu Y, Lin Y. Fp roi-GAN with Fused Regional Features for the Synthesis of High-Quality Paired Medical Images. JOURNAL OF HEALTHCARE ENGINEERING 2021; 2021:6678031. [PMID: 34007428 PMCID: PMC8099524 DOI: 10.1155/2021/6678031] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/31/2020] [Revised: 02/20/2021] [Accepted: 04/16/2021] [Indexed: 11/19/2022]
Abstract
The use of medical image synthesis with generative adversarial networks (GAN) is effective for expanding medical samples. The structural consistency between the synthesized and actual image is a key indicator of the quality of the synthesized image, and the region of interest (ROI) of the synthesized image is related to its usability, and these parameters are the two key issues in image synthesis. In this paper, the fusion-ROI patch GAN (Fproi-GAN) model was constructed by incorporating a priori regional feature based on the two-stage cycle consistency mechanism of cycleGAN. This model has improved the tissue contrast of ROI and achieved the pairwise synthesis of high-quality medical images and their corresponding ROIs. The quantitative evaluation results in two publicly available datasets, INbreast and BRATS 2017, show that the synthesized ROI images have a DICE coefficient of 0.981 ± 0.11 and a Hausdorff distance of 4.21 ± 2.84 relative to the original images. The classification experimental results show that the synthesized images can effectively assist in the training of machine learning models, improve the generalization performance of prediction models, and improve the classification accuracy by 4% and sensitivity by 5.3% compared with the cycleGAN method. Hence, the paired medical images synthesized using Fproi-GAN have high quality and structural consistency with real medical images.
Collapse
Affiliation(s)
- Jiale Dong
- School of Information Engineering, Zhengzhou University, Zhengzhou 450001, China
- Collaborative Innovation Center for Internet Healthcare, Zhengzhou University, Zhengzhou 450052, China
| | - Caiwei Liu
- School of Information Engineering, Zhengzhou University, Zhengzhou 450001, China
- Collaborative Innovation Center for Internet Healthcare, Zhengzhou University, Zhengzhou 450052, China
| | - Panpan Man
- School of Information Engineering, Zhengzhou University, Zhengzhou 450001, China
- Collaborative Innovation Center for Internet Healthcare, Zhengzhou University, Zhengzhou 450052, China
| | - Guohua Zhao
- School of Information Engineering, Zhengzhou University, Zhengzhou 450001, China
- Collaborative Innovation Center for Internet Healthcare, Zhengzhou University, Zhengzhou 450052, China
| | - Yaping Wu
- Department of Medical Imaging, Henan Provincial People's Hospital, Zhengzhou 450003, China
| | - Yusong Lin
- Collaborative Innovation Center for Internet Healthcare, Zhengzhou University, Zhengzhou 450052, China
- School of Software, Zhengzhou University, Zhengzhou 450002, China
- Hanwei IoT Institute, Zhengzhou University, Zhengzhou 450002, China
| |
Collapse
|
217
|
Montazeri M, ZahediNasab R, Farahani A, Mohseni H, Ghasemian F. Machine Learning Models for Image-Based Diagnosis and Prognosis of COVID-19: Systematic Review. JMIR Med Inform 2021; 9:e25181. [PMID: 33735095 PMCID: PMC8074953 DOI: 10.2196/25181] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2020] [Revised: 12/31/2020] [Accepted: 01/16/2021] [Indexed: 01/08/2023] Open
Abstract
BACKGROUND Accurate and timely diagnosis and effective prognosis of the disease is important to provide the best possible care for patients with COVID-19 and reduce the burden on the health care system. Machine learning methods can play a vital role in the diagnosis of COVID-19 by processing chest x-ray images. OBJECTIVE The aim of this study is to summarize information on the use of intelligent models for the diagnosis and prognosis of COVID-19 to help with early and timely diagnosis, minimize prolonged diagnosis, and improve overall health care. METHODS A systematic search of databases, including PubMed, Web of Science, IEEE, ProQuest, Scopus, bioRxiv, and medRxiv, was performed for COVID-19-related studies published up to May 24, 2020. This study was performed in accordance with the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-analyses) guidelines. All original research articles describing the application of image processing for the prediction and diagnosis of COVID-19 were considered in the analysis. Two reviewers independently assessed the published papers to determine eligibility for inclusion in the analysis. Risk of bias was evaluated using the Prediction Model Risk of Bias Assessment Tool. RESULTS Of the 629 articles retrieved, 44 articles were included. We identified 4 prognosis models for calculating prediction of disease severity and estimation of confinement time for individual patients, and 40 diagnostic models for detecting COVID-19 from normal or other pneumonias. Most included studies used deep learning methods based on convolutional neural networks, which have been widely used as a classification algorithm. The most frequently reported predictors of prognosis in patients with COVID-19 included age, computed tomography data, gender, comorbidities, symptoms, and laboratory findings. Deep convolutional neural networks obtained better results compared with non-neural network-based methods. Moreover, all of the models were found to be at high risk of bias due to the lack of information about the study population, intended groups, and inappropriate reporting. CONCLUSIONS Machine learning models used for the diagnosis and prognosis of COVID-19 showed excellent discriminative performance. However, these models were at high risk of bias, because of various reasons such as inadequate information about study participants, randomization process, and the lack of external validation, which may have resulted in the optimistic reporting of these models. Hence, our findings do not recommend any of the current models to be used in practice for the diagnosis and prognosis of COVID-19.
Collapse
Affiliation(s)
- Mahdieh Montazeri
- Medical Informatics Research Center, Institute for Futures Studies in Health, Kerman University of Medical Sciences, Kerman, Iran
| | - Roxana ZahediNasab
- Computer Engineering Department, Faculty of Engineering, Shahid Bahonar University of Kerman, Kerman, Iran
| | - Ali Farahani
- Computer Engineering Department, Faculty of Engineering, Shahid Bahonar University of Kerman, Kerman, Iran
| | - Hadis Mohseni
- Computer Engineering Department, Faculty of Engineering, Shahid Bahonar University of Kerman, Kerman, Iran
| | - Fahimeh Ghasemian
- Computer Engineering Department, Faculty of Engineering, Shahid Bahonar University of Kerman, Kerman, Iran
| |
Collapse
|
218
|
Li X, Tan W, Liu P, Zhou Q, Yang J. Classification of COVID-19 Chest CT Images Based on Ensemble Deep Learning. JOURNAL OF HEALTHCARE ENGINEERING 2021; 2021:5528441. [PMID: 33936577 PMCID: PMC8061232 DOI: 10.1155/2021/5528441] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/22/2021] [Revised: 03/14/2021] [Accepted: 04/07/2021] [Indexed: 12/23/2022]
Abstract
Novel coronavirus pneumonia (NCP) has become a global pandemic disease, and computed tomography-based (CT) image analysis and recognition are one of the important tools for clinical diagnosis. In order to assist medical personnel to achieve an efficient and fast diagnosis of patients with new coronavirus pneumonia, this paper proposes an assisted diagnosis algorithm based on ensemble deep learning. The method combines the Stacked Generalization ensemble learning with the VGG16 deep learning to form a cascade classifier, and the information constituting the cascade classifier comes from multiple subsets of the training set, each of which is used to collect deviant information about the generalization behavior of the data set, such that this deviant information fills the cascade classifier. The algorithm was experimentally validated for classifying patients with novel coronavirus pneumonia, patients with common pneumonia (CP), and normal controls, and the algorithm achieved a prediction accuracy of 93.57%, sensitivity of 94.21%, specificity of 93.93%, precision of 89.40%, and F1-score of 91.74% for the three categories. The results show that the method proposed in this paper has good classification performance and can significantly improve the performance of deep neural networks for multicategory prediction tasks.
Collapse
Affiliation(s)
- Xiaoshuo Li
- Key Laboratory of Intelligent Computing in Medical Image, Ministry of Education, Northeastern University, Shenyang 110189, China
| | - Wenjun Tan
- Key Laboratory of Intelligent Computing in Medical Image, Ministry of Education, Northeastern University, Shenyang 110189, China
- College of Computer Science and Engineering, Northeastern University, Shenyang 110189, China
| | - Pan Liu
- Key Laboratory of Intelligent Computing in Medical Image, Ministry of Education, Northeastern University, Shenyang 110189, China
| | - Qinghua Zhou
- Key Laboratory of Intelligent Computing in Medical Image, Ministry of Education, Northeastern University, Shenyang 110189, China
| | - Jinzhu Yang
- College of Computer Science and Engineering, Northeastern University, Shenyang 110189, China
| |
Collapse
|
219
|
Detection of COVID-19 from CT scan images: A spiking neural network-based approach. Neural Comput Appl 2021; 33:12591-12604. [PMID: 33879976 PMCID: PMC8050640 DOI: 10.1007/s00521-021-05910-1] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/11/2020] [Accepted: 03/08/2021] [Indexed: 11/25/2022]
Abstract
The outbreak of a global pandemic called coronavirus has created unprecedented circumstances resulting into a large number of deaths and risk of community spreading throughout the world. Desperate times have called for desperate measures to detect the disease at an early stage via various medically proven methods like chest computed tomography (CT) scan, chest X-Ray, etc., in order to prevent the virus from spreading across the community. Developing deep learning models for analysing these kinds of radiological images is a well-known methodology in the domain of computer based medical image analysis. However, doing the same by mimicking the biological models and leveraging the newly developed neuromorphic computing chips might be more economical. These chips have been shown to be more powerful and are more efficient than conventional central and graphics processing units. Additionally, these chips facilitate the implementation of spiking neural networks (SNNs) in real-world scenarios. To this end, in this work, we have tried to simulate the SNNs using various deep learning libraries. We have applied them for the classification of chest CT scan images into COVID and non-COVID classes. Our approach has achieved very high F1 score of 0.99 for the potential-based model and outperforms many state-of-the-art models. The working code associated with our present work can be found here.
Collapse
|
220
|
Puttagunta M, Ravi S. Medical image analysis based on deep learning approach. MULTIMEDIA TOOLS AND APPLICATIONS 2021; 80:24365-24398. [PMID: 33841033 PMCID: PMC8023554 DOI: 10.1007/s11042-021-10707-4] [Citation(s) in RCA: 63] [Impact Index Per Article: 15.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/25/2020] [Revised: 11/28/2020] [Accepted: 02/10/2021] [Indexed: 05/05/2023]
Abstract
Medical imaging plays a significant role in different clinical applications such as medical procedures used for early detection, monitoring, diagnosis, and treatment evaluation of various medical conditions. Basicsof the principles and implementations of artificial neural networks and deep learning are essential for understanding medical image analysis in computer vision. Deep Learning Approach (DLA) in medical image analysis emerges as a fast-growing research field. DLA has been widely used in medical imaging to detect the presence or absence of the disease. This paper presents the development of artificial neural networks, comprehensive analysis of DLA, which delivers promising medical imaging applications. Most of the DLA implementations concentrate on the X-ray images, computerized tomography, mammography images, and digital histopathology images. It provides a systematic review of the articles for classification, detection, and segmentation of medical images based on DLA. This review guides the researchers to think of appropriate changes in medical image analysis based on DLA.
Collapse
Affiliation(s)
- Muralikrishna Puttagunta
- Department of Computer Science, School of Engineering and Technology, Pondicherry University, Pondicherry, India
| | - S. Ravi
- Department of Computer Science, School of Engineering and Technology, Pondicherry University, Pondicherry, India
| |
Collapse
|
221
|
Emokpae LE, Emokpae RN, Lalouani W, Younis M. Smart Multimodal Telehealth-IoT System for COVID-19 Patients. IEEE PERVASIVE COMPUTING 2021; 20:73-80. [PMID: 35937554 PMCID: PMC9280812 DOI: 10.1109/mprv.2021.3068183] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/11/2020] [Accepted: 03/15/2021] [Indexed: 06/12/2023]
Abstract
The COVID-19 pandemic has highlighted how the healthcare system could be overwhelmed. Telehealth stands out to be an effective solution, where patients can be monitored remotely without packing hospitals and exposing healthcare givers to the deadly virus. This article presents our Intel award winning solution for diagnosing COVID-19 related symptoms and similar contagious diseases. Our solution realizes an Internet of Things system with multimodal physiological sensing capabilities. The sensor nodes are integrated in a wearable shirt (vest) to enable continuous monitoring in a noninvasive manner; the data are collected and analyzed using advanced machine learning techniques at a gateway for remote access by a healthcare provider. Our system can be used by both patients and quarantined individuals. The article presents an overview of the system and briefly describes some novel techniques for increased resource efficiency and assessment fidelity. Preliminary results are provided and the roadmap for full clinical trials is discussed.
Collapse
Affiliation(s)
- Lloyd E Emokpae
- LASARRUS Clinic and Research Center LLC Baltimore MD 21220 USA
| | | | - Wassila Lalouani
- Department of Computer Science and Electrical EngineeringUniversity of Maryland Baltimore MD 21250 USA
| | - Mohamed Younis
- Department of Computer Science and Electrical EngineeringUniversity of Maryland Baltimore MD 21250 USA
| |
Collapse
|
222
|
Mohammad-Rahimi H, Nadimi M, Ghalyanchi-Langeroudi A, Taheri M, Ghafouri-Fard S. Application of Machine Learning in Diagnosis of COVID-19 Through X-Ray and CT Images: A Scoping Review. Front Cardiovasc Med 2021; 8:638011. [PMID: 33842563 PMCID: PMC8027078 DOI: 10.3389/fcvm.2021.638011] [Citation(s) in RCA: 35] [Impact Index Per Article: 8.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2021] [Accepted: 02/23/2021] [Indexed: 12/15/2022] Open
Abstract
Coronavirus disease, first detected in late 2019 (COVID-19), has spread fast throughout the world, leading to high mortality. This condition can be diagnosed using RT-PCR technique on nasopharyngeal and throat swabs with sensitivity values ranging from 30 to 70%. However, chest CT scans and X-ray images have been reported to have sensitivity values of 98 and 69%, respectively. The application of machine learning methods on CT and X-ray images has facilitated the accurate diagnosis of COVID-19. In this study, we reviewed studies which used machine and deep learning methods on chest X-ray images and CT scans for COVID-19 diagnosis and compared their performance. The accuracy of these methods ranged from 76% to more than 99%, indicating the applicability of machine and deep learning methods in the clinical diagnosis of COVID-19.
Collapse
Affiliation(s)
- Hossein Mohammad-Rahimi
- Dental Research Center, Research Institute of Dental Sciences, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Mohadeseh Nadimi
- Department of Medical Physics and Biomedical Engineering, Tehran University of Medical Sciences (TUMS), Tehran, Iran
- Research Center for Biomedical Technologies and Robotics (RCBTR), Tehran, Iran
| | - Azadeh Ghalyanchi-Langeroudi
- Department of Medical Physics and Biomedical Engineering, Tehran University of Medical Sciences (TUMS), Tehran, Iran
- Research Center for Biomedical Technologies and Robotics (RCBTR), Tehran, Iran
| | - Mohammad Taheri
- Urology and Nephrology Research Center, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Soudeh Ghafouri-Fard
- Department of Medical Genetics, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| |
Collapse
|
223
|
Kumar Das J, Tradigo G, Veltri P, H Guzzi P, Roy S. Data science in unveiling COVID-19 pathogenesis and diagnosis: evolutionary origin to drug repurposing. Brief Bioinform 2021; 22:855-872. [PMID: 33592108 PMCID: PMC7929414 DOI: 10.1093/bib/bbaa420] [Citation(s) in RCA: 21] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/18/2020] [Revised: 11/09/2020] [Accepted: 12/19/2020] [Indexed: 12/20/2022] Open
Abstract
MOTIVATION The outbreak of novel severe acute respiratory syndrome coronavirus (SARS-CoV-2, also known as COVID-19) in Wuhan has attracted worldwide attention. SARS-CoV-2 causes severe inflammation, which can be fatal. Consequently, there has been a massive and rapid growth in research aimed at throwing light on the mechanisms of infection and the progression of the disease. With regard to this data science is playing a pivotal role in in silico analysis to gain insights into SARS-CoV-2 and the outbreak of COVID-19 in order to forecast, diagnose and come up with a drug to tackle the virus. The availability of large multiomics, radiological, bio-molecular and medical datasets requires the development of novel exploratory and predictive models, or the customisation of existing ones in order to fit the current problem. The high number of approaches generates the need for surveys to guide data scientists and medical practitioners in selecting the right tools to manage their clinical data. RESULTS Focusing on data science methodologies, we conduct a detailed study on the state-of-the-art of works tackling the current pandemic scenario. We consider various current COVID-19 data analytic domains such as phylogenetic analysis, SARS-CoV-2 genome identification, protein structure prediction, host-viral protein interactomics, clinical imaging, epidemiological research and drug discovery. We highlight data types and instances, their generation pipelines and the data science models currently in use. The current study should give a detailed sketch of the road map towards handling COVID-19 like situations by leveraging data science experts in choosing the right tools. We also summarise our review focusing on prime challenges and possible future research directions. CONTACT hguzzi@unicz.it, sroy01@cus.ac.in.
Collapse
Affiliation(s)
- Jayanta Kumar Das
- Department of Pediatrics, School of Medicine, Johns Hopkins University, Maryland, USA
| | - Giuseppe Tradigo
- eCampus University, Via Isimbardi 10, 22060 Novedrate, CO, Italy
| | - Pierangelo Veltri
- Department of Surgical and Medical Sciences, Magna Graecia University, Catanzaro, 88100, Italy
| | - Pietro H Guzzi
- Department of Surgical and Medical Sciences, Magna Graecia University, Catanzaro, 88100, Italy
| | - Swarup Roy
- Network Reconstruction & Analysis (NetRA) Lab, Department of Computer Applications, Sikkim University, Gangtok, India
| |
Collapse
|
224
|
Automatic COVID-19 detection from X-ray images using ensemble learning with convolutional neural network. Pattern Anal Appl 2021. [DOI: 10.1007/s10044-021-00970-4] [Citation(s) in RCA: 19] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
|
225
|
Ghaderzadeh M, Asadi F. Deep Learning in the Detection and Diagnosis of COVID-19 Using Radiology Modalities: A Systematic Review. JOURNAL OF HEALTHCARE ENGINEERING 2021; 2021:6677314. [PMID: 33747419 PMCID: PMC7958142 DOI: 10.1155/2021/6677314] [Citation(s) in RCA: 37] [Impact Index Per Article: 9.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/08/2020] [Revised: 01/08/2021] [Accepted: 02/11/2021] [Indexed: 12/17/2022]
Abstract
Introduction The early detection and diagnosis of COVID-19 and the accurate separation of non-COVID-19 cases at the lowest cost and in the early stages of the disease are among the main challenges in the current COVID-19 pandemic. Concerning the novelty of the disease, diagnostic methods based on radiological images suffer from shortcomings despite their many applications in diagnostic centers. Accordingly, medical and computer researchers tend to use machine-learning models to analyze radiology images. Material and Methods. The present systematic review was conducted by searching the three databases of PubMed, Scopus, and Web of Science from November 1, 2019, to July 20, 2020, based on a search strategy. A total of 168 articles were extracted and, by applying the inclusion and exclusion criteria, 37 articles were selected as the research population. Result This review study provides an overview of the current state of all models for the detection and diagnosis of COVID-19 through radiology modalities and their processing based on deep learning. According to the findings, deep learning-based models have an extraordinary capacity to offer an accurate and efficient system for the detection and diagnosis of COVID-19, the use of which in the processing of modalities would lead to a significant increase in sensitivity and specificity values. Conclusion The application of deep learning in the field of COVID-19 radiologic image processing reduces false-positive and negative errors in the detection and diagnosis of this disease and offers a unique opportunity to provide fast, cheap, and safe diagnostic services to patients.
Collapse
Affiliation(s)
- Mustafa Ghaderzadeh
- Student Research Committee, Department and Faculty of Health Information Technology and Management, School of Allied Medical Sciences, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Farkhondeh Asadi
- Department of Health Information Technology and Management, School of Allied Medical Sciences, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| |
Collapse
|
226
|
Catalá ODT, Igual IS, Pérez-Benito FJ, Escrivá DM, Castelló VO, Llobet R, Peréz-Cortés JC. Bias Analysis on Public X-Ray Image Datasets of Pneumonia and COVID-19 Patients. IEEE ACCESS : PRACTICAL INNOVATIONS, OPEN SOLUTIONS 2021; 9:42370-42383. [PMID: 34812384 PMCID: PMC8545228 DOI: 10.1109/access.2021.3065456] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/10/2021] [Accepted: 03/07/2021] [Indexed: 05/03/2023]
Abstract
Chest X-ray images are useful for early COVID-19 diagnosis with the advantage that X-ray devices are already available in health centers and images are obtained immediately. Some datasets containing X-ray images with cases (pneumonia or COVID-19) and controls have been made available to develop machine-learning-based methods to aid in diagnosing the disease. However, these datasets are mainly composed of different sources coming from pre-COVID-19 datasets and COVID-19 datasets. Particularly, we have detected a significant bias in some of the released datasets used to train and test diagnostic systems, which might imply that the results published are optimistic and may overestimate the actual predictive capacity of the techniques proposed. In this article, we analyze the existing bias in some commonly used datasets and propose a series of preliminary steps to carry out before the classic machine learning pipeline in order to detect possible biases, to avoid them if possible and to report results that are more representative of the actual predictive power of the methods under analysis.
Collapse
Affiliation(s)
- Omar Del Tejo Catalá
- Instituto Tecnológico de Informática (ITI), Universitat Politècnica de València46022ValenciaSpain
| | - Ismael Salvador Igual
- Instituto Tecnológico de Informática (ITI), Universitat Politècnica de València46022ValenciaSpain
| | | | - David Millán Escrivá
- Instituto Tecnológico de Informática (ITI), Universitat Politècnica de València46022ValenciaSpain
| | - Vicent Ortiz Castelló
- Instituto Tecnológico de Informática (ITI), Universitat Politècnica de València46022ValenciaSpain
| | - Rafael Llobet
- Instituto Tecnológico de Informática (ITI), Universitat Politècnica de València46022ValenciaSpain
- Department of Computer Systems and Computation (DSIC)Universitat Politècnica de València46022ValenciaSpain
| | - Juan-Carlos Peréz-Cortés
- Instituto Tecnológico de Informática (ITI), Universitat Politècnica de València46022ValenciaSpain
- Department of Computing Engineering (DISCA)Universitat Politècnica de València46022ValenciaSpain
| |
Collapse
|
227
|
Singh AK, Kumar A, Mahmud M, Kaiser MS, Kishore A. COVID-19 Infection Detection from Chest X-Ray Images Using Hybrid Social Group Optimization and Support Vector Classifier. Cognit Comput 2021:1-13. [PMID: 33688379 PMCID: PMC7931982 DOI: 10.1007/s12559-021-09848-3] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2020] [Accepted: 02/04/2021] [Indexed: 12/24/2022]
Abstract
A novel strain of Coronavirus, identified as the Severe Acute Respiratory Syndrome-2 (SARS-CoV-2), outbroke in December 2019 causing the novel Corona Virus Disease (COVID-19). Since its emergence, the virus has spread rapidly and has been declared a global pandemic. As of the end of January 2021, there are almost 100 million cases worldwide with over 2 million confirmed deaths. Widespread testing is essential to reduce further spread of the disease, but due to a shortage of testing kits and limited supply, alternative testing methods are being evaluated. Recently researchers have found that chest X-Ray (CXR) images provide salient information about COVID-19. An intelligent system can help the radiologists to detect COVID-19 from these CXR images which can come in handy at remote locations in many developing nations. In this work, we propose a pipeline that uses CXR images to detect COVID-19 infection. The features from the CXR images were extracted and the relevant features were then selected using Hybrid Social Group Optimization algorithm. The selected features were then used to classify the CXR images using a number of classifiers. The proposed pipeline achieves a classification accuracy of 99.65% using support vector classifier, which outperforms other state-of-the-art deep learning algorithms for binary and multi-class classification.
Collapse
Affiliation(s)
- Asu Kumar Singh
- CSE Department, Maharaja Agrasen Institute of Technology, Delhi, India
| | - Anupam Kumar
- CSE Department, Maharaja Agrasen Institute of Technology, Delhi, India
| | - Mufti Mahmud
- Department of Computer Science and Medical Technology Innovation Facility, Nottingham Trent University, Clifton, NG11 8NS Nottingham, UK
| | - M Shamim Kaiser
- Institute of Information Technology, Jahangirnagar University, Savar, 1342 Dhaka, Bangladesh
| | - Akshat Kishore
- CSE Department, Maharaja Agrasen Institute of Technology, Delhi, India
| |
Collapse
|
228
|
Bilandi N, Verma HK, Dhir R. An Intelligent and Energy-Efficient Wireless Body Area Network to Control Coronavirus Outbreak. ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING 2021; 46:8203-8222. [PMID: 33680703 PMCID: PMC7909758 DOI: 10.1007/s13369-021-05411-2] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/10/2020] [Accepted: 01/28/2021] [Indexed: 01/05/2023]
Abstract
The coronaviruses are a deadly family of epidemic viruses that can spread from one individual to another very quickly, infecting masses. The literature on epidemics indicates that the early diagnosis of a coronavirus infection can lead to a reduction in mortality rates. To prevent coronavirus disease 2019 (COVID-19) from spreading, the regular identification and monitoring of infected patients are needed. In this regard, wireless body area networks (WBANs) can be used in conjunction with machine learning and the Internet of Things (IoT) to identify and monitor the human body for health-related information, which in turn can aid in the early diagnosis of diseases. This paper proposes a novel coronavirus-body area network (CoV-BAN) model based on IoT technology as a real-time health monitoring system for the detection of the early stages of coronavirus infection using a number of wearable biosensors to examine the health status of the patient. The proposed CoV-BAN model is tested with five machine learning-based classification methods, including random forest, logistic regression, Naive Bayes, support vector machine and multi-layer perceptron classifiers, to optimize the accuracy of the diagnosis of COVID-19. For the long-term sustainability of the sensor devices, the development of energy-efficient WBAN is critical. To address this issue, a long-range (LoRa)-based IoT program is used to receive biosensor signals from the patient and transmit them to the cloud directly for monitoring. The experimental results indicate that the proposed model using the random forest classifier outperforms models using the other classifiers, with an average accuracy of 88.6%. In addition, power consumption is reduced when LoRa technology is used as a relay node.
Collapse
Affiliation(s)
- Naveen Bilandi
- Department of Computer Science and Engineering, National Institute of Technology, Jalandhar, India.,Department of Computer Science and Engineering, DAV University, Jalandhar, India
| | - Harsh K Verma
- Department of Computer Science and Engineering, National Institute of Technology, Jalandhar, India
| | - Renu Dhir
- Department of Computer Science and Engineering, National Institute of Technology, Jalandhar, India
| |
Collapse
|
229
|
Elzeki OM, Shams M, Sarhan S, Abd Elfattah M, Hassanien AE. COVID-19: a new deep learning computer-aided model for classification. PeerJ Comput Sci 2021; 7:e358. [PMID: 33817008 PMCID: PMC7959596 DOI: 10.7717/peerj-cs.358] [Citation(s) in RCA: 21] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2020] [Accepted: 12/19/2020] [Indexed: 05/09/2023]
Abstract
Chest X-ray (CXR) imaging is one of the most feasible diagnosis modalities for early detection of the infection of COVID-19 viruses, which is classified as a pandemic according to the World Health Organization (WHO) report in December 2019. COVID-19 is a rapid natural mutual virus that belongs to the coronavirus family. CXR scans are one of the vital tools to early detect COVID-19 to monitor further and control its virus spread. Classification of COVID-19 aims to detect whether a subject is infected or not. In this article, a model is proposed for analyzing and evaluating grayscale CXR images called Chest X-Ray COVID Network (CXRVN) based on three different COVID-19 X-Ray datasets. The proposed CXRVN model is a lightweight architecture that depends on a single fully connected layer representing the essential features and thus reducing the total memory usage and processing time verse pre-trained models and others. The CXRVN adopts two optimizers: mini-batch gradient descent and Adam optimizer, and the model has almost the same performance. Besides, CXRVN accepts CXR images in grayscale that are a perfect image representation for CXR and consume less memory storage and processing time. Hence, CXRVN can analyze the CXR image with high accuracy in a few milliseconds. The consequences of the learning process focus on decision making using a scoring function called SoftMax that leads to high rate true-positive classification. The CXRVN model is trained using three different datasets and compared to the pre-trained models: GoogleNet, ResNet and AlexNet, using the fine-tuning and transfer learning technologies for the evaluation process. To verify the effectiveness of the CXRVN model, it was evaluated in terms of the well-known performance measures such as precision, sensitivity, F1-score and accuracy. The evaluation results based on sensitivity, precision, recall, accuracy, and F1 score demonstrated that, after GAN augmentation, the accuracy reached 96.7% in experiment 2 (Dataset-2) for two classes and 93.07% in experiment-3 (Dataset-3) for three classes, while the average accuracy of the proposed CXRVN model is 94.5%.
Collapse
Affiliation(s)
- Omar M. Elzeki
- Faculty of Computers and Information, Mansoura University, Mansoura, Egypt
| | - Mahmoud Shams
- Faculty of Artificial Intelligence, Kafrelsheikh University, Kafrelsheikh, Egypt
| | - Shahenda Sarhan
- Faculty of Computers and Information, Mansoura University, Mansoura, Egypt
| | | | - Aboul Ella Hassanien
- Faculty of Computers and Artificial Intelligence, Cairo University, Egypt, Cairo, Egypt
- Scientific Research Group in Egypt (SRGE), Cairo, Egypt
| |
Collapse
|
230
|
Islam MM, Karray F, Alhajj R, Zeng J. A Review on Deep Learning Techniques for the Diagnosis of Novel Coronavirus (COVID-19). IEEE ACCESS : PRACTICAL INNOVATIONS, OPEN SOLUTIONS 2021; 9:30551-30572. [PMID: 34976571 PMCID: PMC8675557 DOI: 10.1109/access.2021.3058537] [Citation(s) in RCA: 118] [Impact Index Per Article: 29.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/26/2021] [Accepted: 02/06/2021] [Indexed: 05/03/2023]
Abstract
Novel coronavirus (COVID-19) outbreak, has raised a calamitous situation all over the world and has become one of the most acute and severe ailments in the past hundred years. The prevalence rate of COVID-19 is rapidly rising every day throughout the globe. Although no vaccines for this pandemic have been discovered yet, deep learning techniques proved themselves to be a powerful tool in the arsenal used by clinicians for the automatic diagnosis of COVID-19. This paper aims to overview the recently developed systems based on deep learning techniques using different medical imaging modalities like Computer Tomography (CT) and X-ray. This review specifically discusses the systems developed for COVID-19 diagnosis using deep learning techniques and provides insights on well-known data sets used to train these networks. It also highlights the data partitioning techniques and various performance measures developed by researchers in this field. A taxonomy is drawn to categorize the recent works for proper insight. Finally, we conclude by addressing the challenges associated with the use of deep learning methods for COVID-19 detection and probable future trends in this research area. The aim of this paper is to facilitate experts (medical or otherwise) and technicians in understanding the ways deep learning techniques are used in this regard and how they can be potentially further utilized to combat the outbreak of COVID-19.
Collapse
Affiliation(s)
- Md. Milon Islam
- Centre for Pattern Analysis and Machine IntelligenceDepartment of Electrical and Computer EngineeringUniversity of WaterlooWaterlooONN2L 3G1Canada
| | - Fakhri Karray
- Centre for Pattern Analysis and Machine IntelligenceDepartment of Electrical and Computer EngineeringUniversity of WaterlooWaterlooONN2L 3G1Canada
| | - Reda Alhajj
- Department of Computer ScienceUniversity of CalgaryCalgaryABT2N 1N4Canada
| | - Jia Zeng
- Institute for Personalized Cancer TherapyMD Anderson Cancer CenterHoustonTX77030USA
| |
Collapse
|
231
|
Sampath V, Maurtua I, Aguilar Martín JJ, Gutierrez A. A survey on generative adversarial networks for imbalance problems in computer vision tasks. JOURNAL OF BIG DATA 2021; 8:27. [PMID: 33552840 PMCID: PMC7845583 DOI: 10.1186/s40537-021-00414-0] [Citation(s) in RCA: 37] [Impact Index Per Article: 9.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/30/2020] [Accepted: 01/16/2021] [Indexed: 05/21/2023]
Abstract
Any computer vision application development starts off by acquiring images and data, then preprocessing and pattern recognition steps to perform a task. When the acquired images are highly imbalanced and not adequate, the desired task may not be achievable. Unfortunately, the occurrence of imbalance problems in acquired image datasets in certain complex real-world problems such as anomaly detection, emotion recognition, medical image analysis, fraud detection, metallic surface defect detection, disaster prediction, etc., are inevitable. The performance of computer vision algorithms can significantly deteriorate when the training dataset is imbalanced. In recent years, Generative Adversarial Neural Networks (GANs) have gained immense attention by researchers across a variety of application domains due to their capability to model complex real-world image data. It is particularly important that GANs can not only be used to generate synthetic images, but also its fascinating adversarial learning idea showed good potential in restoring balance in imbalanced datasets. In this paper, we examine the most recent developments of GANs based techniques for addressing imbalance problems in image data. The real-world challenges and implementations of synthetic image generation based on GANs are extensively covered in this survey. Our survey first introduces various imbalance problems in computer vision tasks and its existing solutions, and then examines key concepts such as deep generative image models and GANs. After that, we propose a taxonomy to summarize GANs based techniques for addressing imbalance problems in computer vision tasks into three major categories: 1. Image level imbalances in classification, 2. object level imbalances in object detection and 3. pixel level imbalances in segmentation tasks. We elaborate the imbalance problems of each group, and provide GANs based solutions in each group. Readers will understand how GANs based techniques can handle the problem of imbalances and boost performance of the computer vision algorithms.
Collapse
Affiliation(s)
- Vignesh Sampath
- Autonomous and Intelligent Systems Unit, Tekniker, Member of Basque Research and Technology Alliance, Eibar, Spain
- Design and Manufacturing Engineering Department, Universidad de Zaragoza, 3 María de Luna Street, Torres Quevedo Bld, 50018 Zaragoza, Spain
| | - Iñaki Maurtua
- Autonomous and Intelligent Systems Unit, Tekniker, Member of Basque Research and Technology Alliance, Eibar, Spain
| | - Juan José Aguilar Martín
- Design and Manufacturing Engineering Department, Universidad de Zaragoza, 3 María de Luna Street, Torres Quevedo Bld, 50018 Zaragoza, Spain
| | - Aitor Gutierrez
- Autonomous and Intelligent Systems Unit, Tekniker, Member of Basque Research and Technology Alliance, Eibar, Spain
| |
Collapse
|
232
|
Mottaqi MS, Mohammadipanah F, Sajedi H. Contribution of machine learning approaches in response to SARS-CoV-2 infection. INFORMATICS IN MEDICINE UNLOCKED 2021; 23:100526. [PMID: 33869730 PMCID: PMC8044633 DOI: 10.1016/j.imu.2021.100526] [Citation(s) in RCA: 20] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/16/2020] [Revised: 01/19/2021] [Accepted: 01/20/2021] [Indexed: 12/19/2022] Open
Abstract
PROBLEM The lately emerged SARS-CoV-2 infection, which has put the whole world in an aberrant demanding situation, has generated an urgent need for developing effective responses through artificial intelligence (AI). AIM This paper aims to overview the recent applications of machine learning techniques contributing to prevention, diagnosis, monitoring, and treatment of coronavirus disease (SARS-CoV-2). METHODS A progressive investigation of the recent publications up to November 2020, related to AI approaches towards managing the challenges of COVID-19 infection was made. RESULTS For patient diagnosis and screening, Convolutional Neural Network (CNN) and Support Vector Machine (SVM) are broadly applied for classification purposes. Moreover, Deep Neural Network (DNN) and homology modeling are the most used SARS-CoV-2 drug repurposing models. CONCLUSION While the fields of diagnosis of the SARS-CoV-2 infection by medical image processing and its dissemination pattern through machine learning have been sufficiently studied, some areas such as treatment outcome in patients and drug development need to be further investigated using AI approaches.
Collapse
Affiliation(s)
- Mohammad Sadeq Mottaqi
- Department of Microbial Biotechnology, School of Biology and Center of Excellence in Phylogeny of Living Organisms, College of Science, University of Tehran, 14155-6455, Tehran, Iran
| | - Fatemeh Mohammadipanah
- Department of Microbial Biotechnology, School of Biology and Center of Excellence in Phylogeny of Living Organisms, College of Science, University of Tehran, 14155-6455, Tehran, Iran
| | - Hedieh Sajedi
- Department of Computer Science, School of Mathematics, Statistics and Computer Science, College of Science, University of Tehran, 14155-6455, Tehran, Iran
| |
Collapse
|
233
|
Syeda HB, Syed M, Sexton KW, Syed S, Begum S, Syed F, Prior F, Yu F. Role of Machine Learning Techniques to Tackle the COVID-19 Crisis: Systematic Review. JMIR Med Inform 2021; 9:e23811. [PMID: 33326405 PMCID: PMC7806275 DOI: 10.2196/23811] [Citation(s) in RCA: 74] [Impact Index Per Article: 18.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2020] [Revised: 10/27/2020] [Accepted: 11/15/2020] [Indexed: 12/15/2022] Open
Abstract
BACKGROUND SARS-CoV-2, the novel coronavirus responsible for COVID-19, has caused havoc worldwide, with patients presenting a spectrum of complications that have pushed health care experts to explore new technological solutions and treatment plans. Artificial Intelligence (AI)-based technologies have played a substantial role in solving complex problems, and several organizations have been swift to adopt and customize these technologies in response to the challenges posed by the COVID-19 pandemic. OBJECTIVE The objective of this study was to conduct a systematic review of the literature on the role of AI as a comprehensive and decisive technology to fight the COVID-19 crisis in the fields of epidemiology, diagnosis, and disease progression. METHODS A systematic search of PubMed, Web of Science, and CINAHL databases was performed according to PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analysis) guidelines to identify all potentially relevant studies published and made available online between December 1, 2019, and June 27, 2020. The search syntax was built using keywords specific to COVID-19 and AI. RESULTS The search strategy resulted in 419 articles published and made available online during the aforementioned period. Of these, 130 publications were selected for further analyses. These publications were classified into 3 themes based on AI applications employed to combat the COVID-19 crisis: Computational Epidemiology, Early Detection and Diagnosis, and Disease Progression. Of the 130 studies, 71 (54.6%) focused on predicting the COVID-19 outbreak, the impact of containment policies, and potential drug discoveries, which were classified under the Computational Epidemiology theme. Next, 40 of 130 (30.8%) studies that applied AI techniques to detect COVID-19 by using patients' radiological images or laboratory test results were classified under the Early Detection and Diagnosis theme. Finally, 19 of the 130 studies (14.6%) that focused on predicting disease progression, outcomes (ie, recovery and mortality), length of hospital stay, and number of days spent in the intensive care unit for patients with COVID-19 were classified under the Disease Progression theme. CONCLUSIONS In this systematic review, we assembled studies in the current COVID-19 literature that utilized AI-based methods to provide insights into different COVID-19 themes. Our findings highlight important variables, data types, and available COVID-19 resources that can assist in facilitating clinical and translational research.
Collapse
Affiliation(s)
- Hafsa Bareen Syeda
- Department of Neurology, University of Arkansas for Medical Sciences, Little Rock, AR, United States
| | - Mahanazuddin Syed
- Department of Biomedical Informatics, University of Arkansas for Medical Sciences, Little Rock, AR, United States
| | - Kevin Wayne Sexton
- Department of Biomedical Informatics, University of Arkansas for Medical Sciences, Little Rock, AR, United States
- Department of Surgery, University of Arkansas for Medical Sciences, Little Rock, AR, United States
- Department of Health Policy and Management, University of Arkansas for Medical Sciences, Little Rock, AR, United States
| | - Shorabuddin Syed
- Department of Biomedical Informatics, University of Arkansas for Medical Sciences, Little Rock, AR, United States
| | - Salma Begum
- Department of Information Technology, University of Arkansas for Medical Sciences, Little Rock, AR, United States
| | - Farhanuddin Syed
- College of Medicine, Shadan Institute of Medical Sciences, Hyderabad, India
| | - Fred Prior
- Department of Biomedical Informatics, University of Arkansas for Medical Sciences, Little Rock, AR, United States
- Department of Radiology, University of Arkansas for Medical Sciences, Little Rock, AR, United States
| | - Feliciano Yu
- Department of Biomedical Informatics, University of Arkansas for Medical Sciences, Little Rock, AR, United States
| |
Collapse
|
234
|
Rauf HT, Lali MIU, Khan MA, Kadry S, Alolaiyan H, Razaq A, Irfan R. Time series forecasting of COVID-19 transmission in Asia Pacific countries using deep neural networks. PERSONAL AND UBIQUITOUS COMPUTING 2021; 27:733-750. [PMID: 33456433 PMCID: PMC7797027 DOI: 10.1007/s00779-020-01494-0] [Citation(s) in RCA: 20] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/27/2020] [Accepted: 11/18/2020] [Indexed: 05/22/2023]
Abstract
The novel human coronavirus disease COVID-19 has become the fifth documented pandemic since the 1918 flu pandemic. COVID-19 was first reported in Wuhan, China, and subsequently spread worldwide. Almost all of the countries of the world are facing this natural challenge. We present forecasting models to estimate and predict COVID-19 outbreak in Asia Pacific countries, particularly Pakistan, Afghanistan, India, and Bangladesh. We have utilized the latest deep learning techniques such as Long Short Term Memory networks (LSTM), Recurrent Neural Network (RNN), and Gated Recurrent Units (GRU) to quantify the intensity of pandemic for the near future. We consider the time variable and data non-linearity when employing neural networks. Each model's salient features have been evaluated to foresee the number of COVID-19 cases in the next 10 days. The forecasting performance of employed deep learning models shown up to July 01, 2020, is more than 90% accurate, which shows the reliability of the proposed study. We hope that the present comparative analysis will provide an accurate picture of pandemic spread to the government officials so that they can take appropriate mitigation measures.
Collapse
Affiliation(s)
- Hafiz Tayyab Rauf
- Department of Computer Science, University of Gujrat, Gujrat, Pakistan
| | - M. Ikram Ullah Lali
- Department of Computer Science, University of Education, Lahore, 54770 Pakistan
| | | | - Seifedine Kadry
- Department of Mathematics and Computer Science, Faculty of Science, Beirut Arab University, Beirut, Lebanon
| | - Hanan Alolaiyan
- Department of Mathematics, King Saud University, Riyadh, 11451 Saudi Arabia
| | - Abdul Razaq
- Division of Science and Technology, Department of Mathematics, University of Education, Lahore, 54000 Pakistan
| | - Rizwana Irfan
- Department of Mathematics and Computer Science, Faculty of Science, University of Jeddah, Jeddah, Saudi Arabia
| |
Collapse
|
235
|
Nayak J, Naik B, Dinesh P, Vakula K, Rao BK, Ding W, Pelusi D. Intelligent system for COVID-19 prognosis: a state-of-the-art survey. APPL INTELL 2021; 51:2908-2938. [PMID: 34764577 PMCID: PMC7786871 DOI: 10.1007/s10489-020-02102-7] [Citation(s) in RCA: 19] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 11/27/2020] [Indexed: 01/31/2023]
Abstract
This 21st century is notable for experiencing so many disturbances at economic, social, cultural, and political levels in the entire world. The outbreak of novel corona virus 2019 (COVID-19) has been treated as a Public Health crisis of global Concern by the World Health Organization (WHO). Various outbreak models for COVID-19 are being utilized by researchers throughout the world to get well-versed decisions and impose significant control measures. Amid the standard methods for COVID-19 worldwide epidemic prediction, easy statistical, as well as epidemiological methods have got more consideration by researchers and authorities. One main difficulty in controlling the spreading of COVID-19 is the inadequacy and lack of medical tests for detecting as well as identifying a solution. To solve this problem, a few statistical-based advances are being enhanced and turn into a partial resolution up-to some level. To deal with the challenges of the medical field, a broad range of intelligent based methods, frameworks, and equipment have been recommended by Machine Learning (ML) and Deep Learning. As ML and DL have the ability of identifying and predicting patterns in complex large datasets, they are recognized as a suitable procedure for producing effective solutions for the diagnosis of COVID-19. In this paper, a perspective research has been conducted in the applicability of intelligent systems such as ML, DL and others in solving COVID-19 related outbreak issues. The main intention behind this study is (i) to understand the importance of intelligent approaches such as ML and DL for COVID-19 pandemic, (ii) discussing the efficiency and impact of these methods in the prognosis of COVID-19, (iii) the growth in the development of type of ML and advanced ML methods for COVID-19 prognosis,(iv) analyzing the impact of data types and the nature of data along with challenges in processing the data for COVID-19,(v) to focus on some future challenges in COVID-19 prognosis to inspire the researchers for innovating and enhancing their knowledge and research on other impacted sectors due to COVID-19.
Collapse
Affiliation(s)
- Janmenjoy Nayak
- Department of Computer Science and Engineering, Aditya Institute of Technology and Management (AITAM), K Kotturu, Tekkali, AP 532201 India
| | - Bighnaraj Naik
- Department of Computer Application, Veer Surendra Sai University of Technology, Burla, Odisha 768018 India
| | - Paidi Dinesh
- Department of Computer Science and Engineering, Sri Sivani College of Engineering, Srikakulam, AP 532402 India
| | - Kanithi Vakula
- Department of Computer Science and Engineering, Sri Sivani College of Engineering, Srikakulam, AP 532402 India
| | - B. Kameswara Rao
- Department of Computer Science and Engineering, Aditya Institute of Technology and Management (AITAM), K Kotturu, Tekkali, AP 532201 India
| | - Weiping Ding
- School of Information Science and Technology, Nantong University, Nantong, China
| | - Danilo Pelusi
- Faculty of Communication Sciences, University of Teramo, Coste Sant', Agostino Campus, Teramo, Italy
| |
Collapse
|
236
|
An Accuracy vs. Complexity Comparison of Deep Learning Architectures for the Detection of COVID-19 Disease. COMPUTATION 2021. [DOI: 10.3390/computation9010003] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/12/2023]
Abstract
In parallel with the vast medical research on clinical treatment of COVID-19, an important action to have the disease completely under control is to carefully monitor the patients. What the detection of COVID-19 relies on most is the viral tests, however, the study of X-rays is helpful due to the ease of availability. There are various studies that employ Deep Learning (DL) paradigms, aiming at reinforcing the radiography-based recognition of lung infection by COVID-19. In this regard, we make a comparison of the noteworthy approaches devoted to the binary classification of infected images by using DL techniques, then we also propose a variant of a convolutional neural network (CNN) with optimized parameters, which performs very well on a recent dataset of COVID-19. The proposed model’s effectiveness is demonstrated to be of considerable importance due to its uncomplicated design, in contrast to other presented models. In our approach, we randomly put several images of the utilized dataset aside as a hold out set; the model detects most of the COVID-19 X-rays correctly, with an excellent overall accuracy of 99.8%. In addition, the significance of the results obtained by testing different datasets of diverse characteristics (which, more specifically, are not used in the training process) demonstrates the effectiveness of the proposed approach in terms of an accuracy up to 93%.
Collapse
|
237
|
Ibrahim AU, Ozsoz M, Serte S, Al-Turjman F, Yakoi PS. Pneumonia Classification Using Deep Learning from Chest X-ray Images During COVID-19. Cognit Comput 2021:1-13. [PMID: 33425044 PMCID: PMC7781428 DOI: 10.1007/s12559-020-09787-5] [Citation(s) in RCA: 70] [Impact Index Per Article: 17.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/19/2020] [Accepted: 10/21/2020] [Indexed: 12/15/2022]
Abstract
The outbreak of the novel corona virus disease (COVID-19) in December 2019 has led to global crisis around the world. The disease was declared pandemic by World Health Organization (WHO) on 11th of March 2020. Currently, the outbreak has affected more than 200 countries with more than 37 million confirmed cases and more than 1 million death tolls as of 10 October 2020. Reverse-transcription polymerase chain reaction (RT-PCR) is the standard method for detection of COVID-19 disease, but it has many challenges such as false positives, low sensitivity, expensive, and requires experts to conduct the test. As the number of cases continue to grow, there is a high need for developing a rapid screening method that is accurate, fast, and cheap. Chest X-ray (CXR) scan images can be considered as an alternative or a confirmatory approach as they are fast to obtain and easily accessible. Though the literature reports a number of approaches to classify CXR images and detect the COVID-19 infections, the majority of these approaches can only recognize two classes (e.g., COVID-19 vs. normal). However, there is a need for well-developed models that can classify a wider range of CXR images belonging to the COVID-19 class itself such as the bacterial pneumonia, the non-COVID-19 viral pneumonia, and the normal CXR scans. The current work proposes the use of a deep learning approach based on pretrained AlexNet model for the classification of COVID-19, non-COVID-19 viral pneumonia, bacterial pneumonia, and normal CXR scans obtained from different public databases. The model was trained to perform two-way classification (i.e., COVID-19 vs. normal, bacterial pneumonia vs. normal, non-COVID-19 viral pneumonia vs. normal, and COVID-19 vs. bacterial pneumonia), three-way classification (i.e., COVID-19 vs. bacterial pneumonia vs. normal), and four-way classification (i.e., COVID-19 vs. bacterial pneumonia vs. non-COVID-19 viral pneumonia vs. normal). For non-COVID-19 viral pneumonia and normal (healthy) CXR images, the proposed model achieved 94.43% accuracy, 98.19% sensitivity, and 95.78% specificity. For bacterial pneumonia and normal CXR images, the model achieved 91.43% accuracy, 91.94% sensitivity, and 100% specificity. For COVID-19 pneumonia and normal CXR images, the model achieved 99.16% accuracy, 97.44% sensitivity, and 100% specificity. For classification CXR images of COVID-19 pneumonia and non-COVID-19 viral pneumonia, the model achieved 99.62% accuracy, 90.63% sensitivity, and 99.89% specificity. For the three-way classification, the model achieved 94.00% accuracy, 91.30% sensitivity, and 84.78%. Finally, for the four-way classification, the model achieved an accuracy of 93.42%, sensitivity of 89.18%, and specificity of 98.92%.
Collapse
Affiliation(s)
| | - Mehmet Ozsoz
- Department of Biomedical Engineering, Near East University, Nicosia, Mersin 10, Turkey
| | - Sertan Serte
- Department of Electrical Engineering, Near East University, Nicosia, Mersin 10, Turkey
| | - Fadi Al-Turjman
- Department of Artificial Intelligence, Research Center for AI and IoT, Near East University, Nicosia, Mersin 10, Turkey
| | | |
Collapse
|
238
|
Le DN, Parvathy VS, Gupta D, Khanna A, Rodrigues JJPC, Shankar K. IoT enabled depthwise separable convolution neural network with deep support vector machine for COVID-19 diagnosis and classification. INT J MACH LEARN CYB 2021; 12:3235-3248. [PMID: 33727984 PMCID: PMC7778504 DOI: 10.1007/s13042-020-01248-7] [Citation(s) in RCA: 33] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/06/2020] [Accepted: 11/20/2020] [Indexed: 01/08/2023]
Abstract
At present times, the drastic advancements in the 5G cellular and internet of things (IoT) technologies find useful in different applications of the healthcare sector. At the same time, COVID-19 is commonly spread from animals to persons, but today it is transmitting among persons by adapting the structure. It is a severe virus and inappropriately resulted in a global pandemic. Radiologists utilize X-ray or computed tomography (CT) images to diagnose COVID-19 disease. It is essential to identify and classify the disease through the use of image processing techniques. So, a new intelligent disease diagnosis model is in need to identify the COVID-19. In this view, this paper presents a novel IoT enabled Depthwise separable convolution neural network (DWS-CNN) with Deep support vector machine (DSVM) for COVID-19 diagnosis and classification. The proposed DWS-CNN model aims to detect both binary and multiple classes of COVID-19 by incorporating a set of processes namely data acquisition, Gaussian filtering (GF) based preprocessing, feature extraction, and classification. Initially, patient data will be collected in the data acquisition stage using IoT devices and sent to the cloud server. Besides, the GF technique is applied to remove the existence of noise that exists in the image. Then, the DWS-CNN model is employed for replacing default convolution for automatic feature extraction. Finally, the DSVM model is applied to determine the binary and multiple class labels of COVID-19. The diagnostic outcome of the DWS-CNN model is tested against Chest X-ray (CXR) image dataset and the results are investigated interms of distinct performance measures. The experimental results ensured the superior results of the DWS-CNN model by attaining maximum classification performance with the accuracy of 98.54% and 99.06% on binary and multiclass respectively.
Collapse
Affiliation(s)
- Dac-Nhuong Le
- Institute of Research and Development, Duy Tan University, Danang, 550000 Vietnam.,Faculty of Information Technology, Duy Tan University, Danang, 550000 Vietnam
| | - Velmurugan Subbiah Parvathy
- Department of Electronics and Communication Engineering, Kalasalingam Academy of Research and Education, Krishnankovil, India
| | - Deepak Gupta
- Department of Computer Science and Engineering, Maharaja Agrasen Institute of Technology, Rohini, Delhi India
| | - Ashish Khanna
- Department of Computer Science and Engineering, Maharaja Agrasen Institute of Technology, Rohini, Delhi India
| | - Joel J P C Rodrigues
- Federal University of Piauí, Teresina, 64049-550 Brazil.,Instituto de Telecomunicações, 1049-001 Lisbon, Portugal
| | - K Shankar
- Department of Computer Applications, Alagappa University, Karaikudi, India
| |
Collapse
|
239
|
Tayarani N MH. Applications of artificial intelligence in battling against covid-19: A literature review. CHAOS, SOLITONS, AND FRACTALS 2021; 142:110338. [PMID: 33041533 PMCID: PMC7532790 DOI: 10.1016/j.chaos.2020.110338] [Citation(s) in RCA: 63] [Impact Index Per Article: 15.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/21/2020] [Accepted: 10/01/2020] [Indexed: 05/14/2023]
Abstract
Colloquially known as coronavirus, the Severe Acute Respiratory Syndrome CoronaVirus 2 (SARS-CoV-2), that causes CoronaVirus Disease 2019 (COVID-19), has become a matter of grave concern for every country around the world. The rapid growth of the pandemic has wreaked havoc and prompted the need for immediate reactions to curb the effects. To manage the problems, many research in a variety of area of science have started studying the issue. Artificial Intelligence is among the area of science that has found great applications in tackling the problem in many aspects. Here, we perform an overview on the applications of AI in a variety of fields including diagnosis of the disease via different types of tests and symptoms, monitoring patients, identifying severity of a patient, processing covid-19 related imaging tests, epidemiology, pharmaceutical studies, etc. The aim of this paper is to perform a comprehensive survey on the applications of AI in battling against the difficulties the outbreak has caused. Thus we cover every way that AI approaches have been employed and to cover all the research until the writing of this paper. We try organize the works in a way that overall picture is comprehensible. Such a picture, although full of details, is very helpful in understand where AI sits in current pandemonium. We also tried to conclude the paper with ideas on how the problems can be tackled in a better way and provide some suggestions for future works.
Collapse
Affiliation(s)
- Mohammad-H Tayarani N
- Biocomputation Group, School of Computer Science, University of Hertfordshire, Hatfield, AL10 9AB, United Kingdom
| |
Collapse
|
240
|
Biswas S, Sen D, Bhatia D, Phukan P, Mukherjee M. Chest X-Ray image and pathological data based artificial intelligence enabled dual diagnostic method for multi-stage classification of COVID-19 patients. AIMS BIOPHYSICS 2021. [DOI: 10.3934/biophy.2021028] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/08/2023] Open
Abstract
<abstract>
<p>The use of Artificial Intelligence (AI) in combination with Internet of Things (IoT) drastically reduces the need to test the COVID samples manually, saving not only time but money and ultimately lives. In this paper, the authors have proposed a novel methodology to identify the COVID-19 patients with an annotated stage to enable the medical staff to manually activate a geo-fence around the subject thus ensuring early detection and isolation. The use of radiography images with pathology data used for COVID-19 identification forms the first-ever contribution by any research group globally. The novelty lies in the correct stage classification of COVID-19 subjects as well. The present analysis would bring this AI Model on the edge to make the facility an IoT-enabled unit. The developed system has been compared and extensively verified thoroughly with those of clinical observations. The significance of radiography imaging for detecting and identification of COVID-19 subjects with severity score tag for stage classification is mathematically established. In a Nutshell, this entire algorithmic workflow can be used not only for predictive analytics but also for prescriptive analytics to complete the entire pipeline from the diagnostic viewpoint of a doctor. As a matter of fact, the authors have used a supervised based learning approach aided by a multiple hypothesis based decision fusion based technique to increase the overall system's accuracy and prediction. The end to end value chain has been put under an IoT based ecosystem to leverage the combined power of AI and IoT to not only detect but also to isolate the coronavirus affected individuals. To emphasize further, the developed AI model predicts the respective categories of a coronavirus affected patients and the IoT system helps the point of care facilities to isolate and prescribe the need of hospitalization for the COVID patients.</p>
</abstract>
Collapse
|
241
|
Mondal MRH, Bharati S, Podder P. Diagnosis of COVID-19 Using Machine Learning and Deep Learning: A Review. Curr Med Imaging 2021; 17:1403-1418. [PMID: 34259149 DOI: 10.2174/1573405617666210713113439] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2020] [Revised: 03/29/2021] [Accepted: 04/08/2021] [Indexed: 02/08/2023]
Abstract
BACKGROUND This paper provides a systematic review of the application of Artificial Intelligence (AI) in the form of Machine Learning (ML) and Deep Learning (DL) techniques in fighting against the effects of novel coronavirus disease (COVID-19). OBJECTIVE & METHODS The objective is to perform a scoping review on AI for COVID-19 using preferred reporting items of systematic reviews and meta-analysis (PRISMA) guidelines. A literature search was performed for relevant studies published from 1 January 2020 till 27 March 2021. Out of 4050 research papers available in reputed publishers, a full-text review of 440 articles was done based on the keywords of AI, COVID-19, ML, forecasting, DL, X-ray, and Computed Tomography (CT). Finally, 52 articles were included in the result synthesis of this paper. As part of the review, different ML regression methods were reviewed first in predicting the number of confirmed and death cases. Secondly, a comprehensive survey was carried out on the use of ML in classifying COVID-19 patients. Thirdly, different datasets on medical imaging were compared in terms of the number of images, number of positive samples and number of classes in the datasets. The different stages of the diagnosis, including preprocessing, segmentation and feature extraction were also reviewed. Fourthly, the performance results of different research papers were compared to evaluate the effectiveness of DL methods on different datasets. RESULTS Results show that residual neural network (ResNet-18) and densely connected convolutional network (DenseNet 169) exhibit excellent classification accuracy for X-ray images, while DenseNet-201 has the maximum accuracy in classifying CT scan images. This indicates that ML and DL are useful tools in assisting researchers and medical professionals in predicting, screening and detecting COVID-19. CONCLUSION Finally, this review highlights the existing challenges, including regulations, noisy data, data privacy, and the lack of reliable large datasets, then provides future research directions in applying AI in managing COVID-19.
Collapse
Affiliation(s)
| | - Subrato Bharati
- Institute of ICT, Bangladesh University of Engineering and Technology, Dhaka-1205, Bangladesh
| | - Prajoy Podder
- Institute of ICT, Bangladesh University of Engineering and Technology, Dhaka-1205, Bangladesh
| |
Collapse
|
242
|
Ezzat D, Hassanien AE, Ella HA. An optimized deep learning architecture for the diagnosis of COVID-19 disease based on gravitational search optimization. Appl Soft Comput 2021; 98:106742. [PMID: 32982615 PMCID: PMC7505822 DOI: 10.1016/j.asoc.2020.106742] [Citation(s) in RCA: 69] [Impact Index Per Article: 17.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2020] [Revised: 09/05/2020] [Accepted: 09/17/2020] [Indexed: 12/17/2022]
Abstract
In this paper, a novel approach called GSA-DenseNet121-COVID-19 based on a hybrid convolutional neural network (CNN) architecture is proposed using an optimization algorithm. The CNN architecture that was used is called DenseNet121, and the optimization algorithm that was used is called the gravitational search algorithm (GSA). The GSA is used to determine the best values for the hyperparameters of the DenseNet121 architecture. To help this architecture to achieve a high level of accuracy in diagnosing COVID-19 through chest x-ray images. The obtained results showed that the proposed approach could classify 98.38% of the test set correctly. To test the efficacy of the GSA in setting the optimum values for the hyperparameters of DenseNet121. The GSA was compared to another approach called SSD-DenseNet121, which depends on the DenseNet121 and the optimization algorithm called social ski driver (SSD). The comparison results demonstrated the efficacy of the proposed GSA-DenseNet121-COVID-19. As it was able to diagnose COVID-19 better than SSD-DenseNet121 as the second was able to diagnose only 94% of the test set. The proposed approach was also compared to another method based on a CNN architecture called Inception-v3 and manual search to quantify hyperparameter values. The comparison results showed that the GSA-DenseNet121-COVID-19 was able to beat the comparison method, as the second was able to classify only 95% of the test set samples. The proposed GSA-DenseNet121-COVID-19 was also compared with some related work. The comparison results showed that GSA-DenseNet121-COVID-19 is very competitive.
Collapse
Affiliation(s)
- Dalia Ezzat
- Faculty of Computers and Artificial Intelligence, Cairo University, Egypt
| | | | - Hassan Aboul Ella
- Microbiology Department, Faculty of Veterinary Medicine, Cairo University, Egypt
| |
Collapse
|
243
|
A survey of machine learning techniques for detecting and diagnosing COVID-19 from imaging. QUANTITATIVE BIOLOGY 2021. [DOI: 10.15302/j-qb-021-0274] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|
244
|
Attique Khan M, Hussain N, Majid A, Alhaisoni M, Ahmad Chan Bukhari S, Kadry S, Nam Y, Zhang YD. Classification of Positive COVID-19 CT Scans using Deep Learning. COMPUTERS, MATERIALS & CONTINUA 2021; 66:2923-2938. [DOI: 10.32604/cmc.2021.013191] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/29/2020] [Accepted: 10/17/2020] [Indexed: 08/25/2024]
|
245
|
Panahi AH, Rafiei A, Rezaee A. FCOD: Fast COVID-19 Detector based on deep learning techniques. INFORMATICS IN MEDICINE UNLOCKED 2020; 22:100506. [PMID: 33392388 PMCID: PMC7759122 DOI: 10.1016/j.imu.2020.100506] [Citation(s) in RCA: 20] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2020] [Revised: 12/15/2020] [Accepted: 12/16/2020] [Indexed: 12/27/2022] Open
Abstract
The sudden COVID-19 pandemic has caused a serious global concern due to infections and mortality rates. It is a hazardous disease that has recently become the biggest crisis in the modern era. Due to the limitation of test kits and the need for screening and rapid diagnosis of patients, it is essential to perform a self-operating detection model as a fast recognition system to detect COVID-19 infection and prevent the spread among the people. In this paper, we propose a novel technique called Fast COVID-19 Detector (FCOD) to have a fast detection of COVID-19 using X-ray images. The FCOD is a deep learning model based on the Inception architecture that uses 17 depthwise separable convolution layers to detect COVID-19. Depthwise separable convolution layers decrease the computation costs, time, and they can have a reducing role in the number of parameters compared to the standard convolution layers. To evaluate FCOD, we used covid-chestxray-dataset, which contains 940 publicly available typical chest X-ray images. Our results show that FCOD can provide accuracy, F1-score, and AUC of 96%, 96%, and 0.95%, respectively in classifying COVID-19 during 0.014 s for each case. The proposed model can be employed as a supportive decision-making system to assist radiologists in clinics and hospitals to screen patients immediately.
Collapse
Affiliation(s)
- Amir Hossein Panahi
- Faculty of New Sciences and Technologies, University of Tehran, Tehran, Iran
| | - Alireza Rafiei
- Faculty of New Sciences and Technologies, University of Tehran, Tehran, Iran
| | - Alireza Rezaee
- Faculty of New Sciences and Technologies, University of Tehran, Tehran, Iran
| |
Collapse
|
246
|
Arias-Londoño JD, Gómez-García JA, Moro-Velázquez L, Godino-Llorente JI. Artificial Intelligence Applied to Chest X-Ray Images for the Automatic Detection of COVID-19. A Thoughtful Evaluation Approach. IEEE ACCESS : PRACTICAL INNOVATIONS, OPEN SOLUTIONS 2020; 8:226811-226827. [PMID: 34786299 PMCID: PMC8545248 DOI: 10.1109/access.2020.3044858] [Citation(s) in RCA: 33] [Impact Index Per Article: 6.6] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/25/2020] [Accepted: 12/08/2020] [Indexed: 05/17/2023]
Abstract
Current standard protocols used in the clinic for diagnosing COVID-19 include molecular or antigen tests, generally complemented by a plain chest X-Ray. The combined analysis aims to reduce the significant number of false negatives of these tests and provide complementary evidence about the presence and severity of the disease. However, the procedure is not free of errors, and the interpretation of the chest X-Ray is only restricted to radiologists due to its complexity. With the long term goal to provide new evidence for the diagnosis, this paper presents an evaluation of different methods based on a deep neural network. These are the first steps to develop an automatic COVID-19 diagnosis tool using chest X-Ray images to differentiate between controls, pneumonia, or COVID-19 groups. The paper describes the process followed to train a Convolutional Neural Network with a dataset of more than 79, 500 X-Ray images compiled from different sources, including more than 8, 500 COVID-19 examples. Three different experiments following three preprocessing schemes are carried out to evaluate and compare the developed models. The aim is to evaluate how preprocessing the data affects the results and improves its explainability. Likewise, a critical analysis of different variability issues that might compromise the system and its effects is performed. With the employed methodology, a 91.5% classification accuracy is obtained, with an 87.4% average recall for the worst but most explainable experiment, which requires a previous automatic segmentation of the lung region.
Collapse
Affiliation(s)
| | - Jorge A. Gómez-García
- Bioengineering and Optoelectronics Laboratory (ByO)Universidad Politécnica de Madrid28031MadridSpain
| | - Laureano Moro-Velázquez
- Department of Electrical and Computer EngineeringJohns Hopkins UniversityBaltimoreMD21218USA
| | - Juan I. Godino-Llorente
- Bioengineering and Optoelectronics Laboratory (ByO)Universidad Politécnica de Madrid28031MadridSpain
| |
Collapse
|
247
|
Autee P, Bagwe S, Shah V, Srivastava K. StackNet-DenVIS: a multi-layer perceptron stacked ensembling approach for COVID-19 detection using X-ray images. Phys Eng Sci Med 2020; 43:1399-1414. [PMID: 33275187 PMCID: PMC7715648 DOI: 10.1007/s13246-020-00952-6] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2020] [Accepted: 11/21/2020] [Indexed: 12/20/2022]
Abstract
The highly contagious nature of Coronavirus disease 2019 (Covid-19) resulted in a global pandemic. Due to the relatively slow and taxing nature of conventional testing for Covid-19, a faster method needs to be in place. The current researches have suggested that visible irregularities found in the chest X-ray of Covid-19 positive patients are indicative of the presence of the disease. Hence, Deep Learning and Image Classification techniques can be employed to learn from these irregularities, and classify accordingly with high accuracy. This research presents an approach to create a classifier model named StackNet-DenVIS which is designed to act as a screening process before conducting the existing swab tests. Using a novel approach, which incorporates Transfer Learning and Stacked Generalization, the model aims to lower the False Negative rate of classification compensating for the 30% False Negative rate of the swab tests. A dataset gathered from multiple reliable sources consisting of 9953 Chest X-rays (868 Covid and 9085 Non-Covid) was used. Also, this research demonstrates handling data imbalance using various techniques involving Generative Adversarial Networks and sampling techniques. The accuracy, sensitivity, and specificity obtained on our proposed model were 95.07%, 99.40% and 94.61% respectively. To the best of our knowledge, the combination of accuracy and false negative rate obtained by this paper outperforms the current implementations. We must also highlight that our proposed architecture also considers other types of viral pneumonia. Given the unprecedented sensitivity of our model we are optimistic it contributes to a better Covid-19 detection.
Collapse
Affiliation(s)
- Pratik Autee
- Department of Computer Engineering, Dwarkadas J. Sanghvi College of Engineering, Mumbai, India
| | - Sagar Bagwe
- Department of Computer Engineering, Dwarkadas J. Sanghvi College of Engineering, Mumbai, India
| | - Vimal Shah
- Department of Computer Engineering, Dwarkadas J. Sanghvi College of Engineering, Mumbai, India
- A/602, Venkatesh Pooja, Balaji Complex, 150 Feet Road, Bhayander (West), Thane, Maharashtra 401101 India
| | - Kriti Srivastava
- Department of Computer Engineering, Dwarkadas J. Sanghvi College of Engineering, Mumbai, India
| |
Collapse
|
248
|
Nour M, Cömert Z, Polat K. A Novel Medical Diagnosis model for COVID-19 infection detection based on Deep Features and Bayesian Optimization. Appl Soft Comput 2020; 97:106580. [PMID: 32837453 PMCID: PMC7385069 DOI: 10.1016/j.asoc.2020.106580] [Citation(s) in RCA: 152] [Impact Index Per Article: 30.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2020] [Revised: 07/21/2020] [Accepted: 07/22/2020] [Indexed: 12/24/2022]
Abstract
A pneumonia of unknown causes, which was detected in Wuhan, China, and spread rapidly throughout the world, was declared as Coronavirus disease 2019 (COVID-19). Thousands of people have lost their lives to this disease. Its negative effects on public health are ongoing. In this study, an intelligence computer-aided model that can automatically detect positive COVID-19 cases is proposed to support daily clinical applications. The proposed model is based on the convolution neural network (CNN) architecture and can automatically reveal discriminative features on chest X-ray images through its convolution with rich filter families, abstraction, and weight-sharing characteristics. Contrary to the generally used transfer learning approach, the proposed deep CNN model was trained from scratch. Instead of the pre-trained CNNs, a novel serial network consisting of five convolution layers was designed. This CNN model was utilized as a deep feature extractor. The extracted deep discriminative features were used to feed the machine learning algorithms, which were k-nearest neighbor, support vector machine (SVM), and decision tree. The hyperparameters of the machine learning models were optimized using the Bayesian optimization algorithm. The experiments were conducted on a public COVID-19 radiology database. The database was divided into two parts as training and test sets with 70% and 30% rates, respectively. As a result, the most efficient results were ensured by the SVM classifier with an accuracy of 98.97%, a sensitivity of 89.39%, a specificity of 99.75%, and an F-score of 96.72%. Consequently, a cheap, fast, and reliable intelligence tool has been provided for COVID-19 infection detection. The developed model can be used to assist field specialists, physicians, and radiologists in the decision-making process. Thanks to the proposed tool, the misdiagnosis rates can be reduced, and the proposed model can be used as a retrospective evaluation tool to validate positive COVID-19 infection cases.
Collapse
Affiliation(s)
- Majid Nour
- Department of Electrical and Computer Engineering, Faculty of Engineering, King Abdulaziz University, Jeddah 21589, Saudi Arabia
| | - Zafer Cömert
- Department of Software Engineering, Engineering Faculty, Samsun University, Samsun, Turkey
| | - Kemal Polat
- Department of Electrical and Electronics Engineering, Faculty of Engineering, Bolu Abant Izzet Baysal University, 14280, Bolu, Turkey
| |
Collapse
|
249
|
A Survey of Deep Learning for Lung Disease Detection on Medical Images: State-of-the-Art, Taxonomy, Issues and Future Directions. J Imaging 2020; 6:jimaging6120131. [PMID: 34460528 PMCID: PMC8321202 DOI: 10.3390/jimaging6120131] [Citation(s) in RCA: 24] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/24/2020] [Revised: 11/25/2020] [Accepted: 11/25/2020] [Indexed: 12/24/2022] Open
Abstract
The recent developments of deep learning support the identification and classification of lung diseases in medical images. Hence, numerous work on the detection of lung disease using deep learning can be found in the literature. This paper presents a survey of deep learning for lung disease detection in medical images. There has only been one survey paper published in the last five years regarding deep learning directed at lung diseases detection. However, their survey is lacking in the presentation of taxonomy and analysis of the trend of recent work. The objectives of this paper are to present a taxonomy of the state-of-the-art deep learning based lung disease detection systems, visualise the trends of recent work on the domain and identify the remaining issues and potential future directions in this domain. Ninety-eight articles published from 2016 to 2020 were considered in this survey. The taxonomy consists of seven attributes that are common in the surveyed articles: image types, features, data augmentation, types of deep learning algorithms, transfer learning, the ensemble of classifiers and types of lung diseases. The presented taxonomy could be used by other researchers to plan their research contributions and activities. The potential future direction suggested could further improve the efficiency and increase the number of deep learning aided lung disease detection applications.
Collapse
|
250
|
Hira S, Bai A, Hira S. An automatic approach based on CNN architecture to detect Covid-19 disease from chest X-ray images. APPL INTELL 2020; 51:2864-2889. [PMID: 34764572 PMCID: PMC7693857 DOI: 10.1007/s10489-020-02010-w] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/09/2020] [Indexed: 12/15/2022]
Abstract
Novel coronavirus (COVID-19) is started from Wuhan (City in China), and is rapidly spreading among people living in other countries. Today, around 215 countries are affected by COVID-19 disease. WHO announced approximately number of cases 11,274,600 worldwide. Due to rapidly rising cases daily in the hospitals, there are a limited number of resources available to control COVID-19 disease. Therefore, it is essential to develop an accurate diagnosis of COVID-19 disease. Early diagnosis of COVID-19 patients is important for preventing the disease from spreading to others. In this paper, we proposed a deep learning based approach that can differentiate COVID- 19 disease patients from viral pneumonia, bacterial pneumonia, and healthy (normal) cases. In this approach, deep transfer learning is adopted. We used binary and multi-class dataset which is categorized in four types for experimentation: (i) Collection of 728 X-ray images including 224 images with confirmed COVID-19 disease and 504 normal condition images (ii) Collection of 1428 X-ray images including 224 images with confirmed COVID-19 disease, 700 images with confirmed common bacterial pneumonia, and 504 normal condition images. (iii) Collections of 1442 X- ray images including 224 images with confirmed COVID-19 disease, 714 images with confirmed bacterial and viral pneumonia, and 504 images of normal conditions (iv) Collections of 5232 X- ray images including 2358 images with confirmed bacterial and 1345 with viral pneumonia, and 1346 images of normal conditions. In this paper, we have used nine convolutional neural network based architecture (AlexNet, GoogleNet, ResNet-50, Se-ResNet-50, DenseNet121, Inception V4, Inception ResNet V2, ResNeXt-50, and Se-ResNeXt-50). Experimental results indicate that the pre trained model Se-ResNeXt-50 achieves the highest classification accuracy of 99.32% for binary class and 97.55% for multi-class among all pre-trained models.
Collapse
Affiliation(s)
- Swati Hira
- Department of Computer Science and Engineering, Shri Ramdeobaba College of Engineering and Management, Nagpur, India
| | - Anita Bai
- Department of Computer Science and Engineering, Koneru Lakshmaiah Education Foundation, Deemed to be University, Hyderabad, Telangana 500075 India
| | - Sanchit Hira
- Student of Laboratory for Computational Sensing and Robotics, Johns Hopkins University, 3400 N. Charles Street, Baltimore, MD 21218 USA
| |
Collapse
|