351
|
Zokaeinikoo M, Kazemian P, Mitra P, Kumara S. AIDCOV: An Interpretable Artificial Intelligence Model for Detection of COVID-19 from Chest Radiography Images. ACM TRANSACTIONS ON MANAGEMENT INFORMATION SYSTEMS 2021. [DOI: 10.1145/3466690] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/10/2023]
Abstract
As the
Coronavirus Disease 2019 (COVID-19)
pandemic continues to grow globally, testing to detect COVID-19 and isolating individuals who test positive remains the primary strategy for preventing community spread of the disease. Therefore, automatic and accurate detection of COVID-19 using medical imaging modalities, which are more widely available and accessible, can be beneficial as an alternative diagnostic tool. In this study, an
Artificial Intelligence model for Detection of COVID-19 (AIDCOV)
is developed to classify chest radiography images as belonging to a person with either COVID-19, other infections, or no pneumonia (i.e., normal). The hierarchical structure in AIDCOV captures the dependencies among features and improves model performance while an attention mechanism makes the model interpretable and transparent. We used several publicly available datasets of both
computed tomography (CT)
and X-ray modalities. The main public dataset for chest X-ray images contains 475 COVID-19 samples, 3949 samples from other viral/bacterial infections, and 1583 normal samples. Our model achieves a mean cross-validation accuracy of 98.4%. AIDCOV has a sensitivity of 99.8%, a specificity of 100%, and an F1-score of 99.8% in detecting COVID-19 from X-ray images on that dataset. Using a large dataset of CT images, our model obtained mean cross-validation accuracy and sensitivity of 98.8% and 99.4%, respectively. Additionally, our interpretable model can distinguish subtle signs of infection within each radiography image. Assuming these results hold up in larger datasets obtained from a variety of patients over the world, AIDCOV can be used in conjunction with or instead of RT-PCR testing (where RT-PCR testing is unavailable) to detect and isolate individuals with COVID-19, prevent onward transmission to the general population and healthcare workers, and highlight the areas in the lungs that show signs of COVID-related damage.
Collapse
Affiliation(s)
- Maryam Zokaeinikoo
- Department of Supply Chain & Information Systems, Smeal College of Business, The Pennsylvania State University, State College, University Park, PA
| | - Pooyan Kazemian
- Department of Operations, Weatherhead School of Management, Case Western Reserve University, Cleveland, OH
| | - Prasenjit Mitra
- College of Information Sciences and Technology, The Pennsylvania State University, State College, University Park, PA
| | - Soundar Kumara
- Department of Industrial and Manufacturing Engineering, The Pennsylvania State University, State College, University Park, PA
| |
Collapse
|
352
|
Arco JE, Ortiz A, Ramírez J, Zhang YD, Górriz JM. Tiled Sparse Coding in Eigenspaces for Image Classification. Int J Neural Syst 2021; 32:2250007. [PMID: 34967705 DOI: 10.1142/s0129065722500071] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
The automation in the diagnosis of medical images is currently a challenging task. The use of Computer Aided Diagnosis (CAD) systems can be a powerful tool for clinicians, especially in situations when hospitals are overflowed. These tools are usually based on artificial intelligence (AI), a field that has been recently revolutionized by deep learning approaches. blackThese alternatives usually obtain a large performance based on complex solutions, leading to a high computational cost and the need of having large databases. In this work, we propose a classification framework based on sparse coding. Images are blackfirst partitioned into different tiles, and a dictionary is built after applying PCA to these tiles. The original signals are then transformed as a linear combination of the elements of the dictionary. blackThen, they are reconstructed by iteratively deactivating the elements associated with each component. Classification is finally performed employing as features the subsequent reconstruction errors. Performance is evaluated in a real context where distinguishing between four different pathologies: control versus bacterial pneumonia versus viral pneumonia versus COVID-19. blackOur system differentiates between pneumonia patients and controls with an accuracy of 97.74%, whereas in the 4-class context the accuracy is 86.73%. The excellent results and the pioneering use of sparse coding in this scenario evidence that our proposal can assist clinicians when their workload is high.
Collapse
Affiliation(s)
- Juan E Arco
- Department of Signal Theory, Networking and Communications, University of Granada 18010, Spain.,Andalusian Research Institute in Data, Science and Computational Intelligence, Spain
| | - Andrés Ortiz
- Department of Communications Engineering, University of Malaga 29010, Spain.,Andalusian Research Institute in Data, Science and Computational Intelligence, Spain
| | - Javier Ramírez
- Department of Signal Theory, Networking and Communications, University of Granada 18010, Spain.,Andalusian Research Institute in Data, Science and Computational Intelligence, Spain
| | - Yu-Dong Zhang
- School of Informatics, University of Leicester, Leicester LE1 7RH, UK
| | - Juan M Górriz
- Department of Signal Theory, Networking and Communications, University of Granada 18010, Spain.,Andalusian Research Institute in Data, Science and Computational Intelligence, Spain
| |
Collapse
|
353
|
Mondal AK, Bhattacharjee A, Singla P, Prathosh AP. xViTCOS: Explainable Vision Transformer Based COVID-19 Screening Using Radiography. IEEE JOURNAL OF TRANSLATIONAL ENGINEERING IN HEALTH AND MEDICINE 2021; 10:1100110. [PMID: 34956741 PMCID: PMC8691725 DOI: 10.1109/jtehm.2021.3134096] [Citation(s) in RCA: 39] [Impact Index Per Article: 9.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/26/2021] [Revised: 11/18/2021] [Accepted: 12/06/2021] [Indexed: 12/15/2022]
Abstract
Objective: Since its outbreak, the rapid spread of COrona VIrus Disease 2019 (COVID-19) across the globe has pushed the health care system in many countries to the verge of collapse. Therefore, it is imperative to correctly identify COVID-19 positive patients and isolate them as soon as possible to contain the spread of the disease and reduce the ongoing burden on the healthcare system. The primary COVID-19 screening test, RT-PCR although accurate and reliable, has a long turn-around time. In the recent past, several researchers have demonstrated the use of Deep Learning (DL) methods on chest radiography (such as X-ray and CT) for COVID-19 detection. However, existing CNN based DL methods fail to capture the global context due to their inherent image-specific inductive bias. Methods: Motivated by this, in this work, we propose the use of vision transformers (instead of convolutional networks) for COVID-19 screening using the X-ray and CT images. We employ a multi-stage transfer learning technique to address the issue of data scarcity. Furthermore, we show that the features learned by our transformer networks are explainable. Results: We demonstrate that our method not only quantitatively outperforms the recent benchmarks but also focuses on meaningful regions in the images for detection (as confirmed by Radiologists), aiding not only in accurate diagnosis of COVID-19 but also in localization of the infected area. The code for our implementation can be found here - https://github.com/arnabkmondal/xViTCOS. Conclusion: The proposed method will help in timely identification of COVID-19 and efficient utilization of limited resources.
Collapse
Affiliation(s)
- Arnab Kumar Mondal
- Amar Nath and Shashi Khosla School of Information TechnologyIndian Institute of Technology Delhi New Delhi 110016 India.,Department of Electrical Communication EngineeringIndian Institute of Science (IISc) Bangalore 560 India
| | - Arnab Bhattacharjee
- UQ-IITD Academy of ResearchIndian Institute of Technology Delhi New Delhi 110016 India
| | - Parag Singla
- Department of Computer Science and EngineeringIndian Institute of Technology Delhi New Delhi 110016 India
| | - A P Prathosh
- Department of Electrical Communication EngineeringIndian Institute of Science (IISc) Bangalore 560 India
| |
Collapse
|
354
|
Danilov VV, Proutski A, Karpovsky A, Kirpich A, Litmanovich D, Nefaridze D, Talalov O, Semyonov S, Koniukhovskii V, Shvartc V, Gankin Y. Indirect supervision applied to COVID-19 and pneumonia classification. INFORMATICS IN MEDICINE UNLOCKED 2021; 28:100835. [PMID: 34977331 PMCID: PMC8712713 DOI: 10.1016/j.imu.2021.100835] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2021] [Revised: 12/11/2021] [Accepted: 12/23/2021] [Indexed: 01/08/2023] Open
Abstract
The novel coronavirus 19 (COVID-19) continues to have a devastating effect around the globe, leading many scientists and clinicians to actively seek to develop new techniques to assist with the tackling of this disease. Modern machine learning methods have shown promise in their adoption to assist the healthcare industry through their data and analytics-driven decision making, inspiring researchers to develop new angles to fight the virus. In this paper, we aim to develop a CNN-based method for the detection of COVID-19 by utilizing patients' chest X-ray images. Developing upon the inclusion of convolutional units, the proposed method makes use of indirect supervision based on Grad-CAM. This technique is used in the training process where Grad-CAM's attention heatmaps support the network's predictions. Despite recent progress, scarcity of data has thus far limited the development of a robust solution. We extend upon existing work by combining publicly available data across 5 different sources and carefully annotate the comprising images across three categories: normal, pneumonia, and COVID-19. To achieve a high classification accuracy, we propose a training pipeline based on indirect supervision of traditional classification networks, where the guidance is directed by an external algorithm. With this method, we observed that the widely used, standard networks can achieve an accuracy comparable to tailor-made models, specifically for COVID-19, with one network in particular, VGG-16, outperforming the best of the tailor-made models.
Collapse
Affiliation(s)
- Viacheslav V Danilov
- Tomsk Polytechnic University, Tomsk, Russia
- Research Institute for Complex Issues of Cardiovascular Diseases, Kemerovo, Russia
| | | | | | | | | | | | | | | | | | | | | |
Collapse
|
355
|
Karlafti E, Anagnostis A, Kotzakioulafi E, Vittoraki MC, Eufraimidou A, Kasarjyan K, Eufraimidou K, Dimitriadou G, Kakanis C, Anthopoulos M, Kaiafa G, Savopoulos C, Didangelos T. Does COVID-19 Clinical Status Associate with Outcome Severity? An Unsupervised Machine Learning Approach for Knowledge Extraction. J Pers Med 2021; 11:1380. [PMID: 34945852 PMCID: PMC8705973 DOI: 10.3390/jpm11121380] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/19/2021] [Revised: 12/07/2021] [Accepted: 12/13/2021] [Indexed: 12/12/2022] Open
Abstract
Since the beginning of the COVID-19 pandemic, 195 million people have been infected and 4.2 million have died from the disease or its side effects. Physicians, healthcare scientists and medical staff continuously try to deal with overloaded hospital admissions, while in parallel, they try to identify meaningful correlations between the severity of infected patients with their symptoms, comorbidities and biomarkers. Artificial intelligence (AI) and machine learning (ML) have been used recently in many areas related to COVID-19 healthcare. The main goal is to manage effectively the wide variety of issues related to COVID-19 and its consequences. The existing applications of ML to COVID-19 healthcare are based on supervised classifications which require a labeled training dataset, serving as reference point for learning, as well as predefined classes. However, the existing knowledge about COVID-19 and its consequences is still not solid and the points of common agreement among different scientific communities are still unclear. Therefore, this study aimed to follow an unsupervised clustering approach, where prior knowledge is not required (tabula rasa). More specifically, 268 hospitalized patients at the First Propaedeutic Department of Internal Medicine of AHEPA University Hospital of Thessaloniki were assessed in terms of 40 clinical variables (numerical and categorical), leading to a high-dimensionality dataset. Dimensionality reduction was performed by applying a principal component analysis (PCA) on the numerical part of the dataset and a multiple correspondence analysis (MCA) on the categorical part of the dataset. Then, the Bayesian information criterion (BIC) was applied to Gaussian mixture models (GMM) in order to identify the optimal number of clusters under which the best grouping of patients occurs. The proposed methodology identified four clusters of patients with similar clinical characteristics. The analysis revealed a cluster of asymptomatic patients that resulted in death at a rate of 23.8%. This striking result forces us to reconsider the relationship between the severity of COVID-19 clinical symptoms and the patient's mortality.
Collapse
Affiliation(s)
- Eleni Karlafti
- First Propaedeutic Department of Internal Medicine, Aristotle University of Thessaloniki, AHEPA University Hospital of Thessaloniki, 54621 Thessaloniki, Greece; (E.K.); (M.C.V.); (A.E.); (K.K.); (K.E.); (G.D.); (C.K.); (M.A.); (G.K.); (C.S.); (T.D.)
- Emergency Department, AHEPA University Hospital, Aristotle University of Thessaloniki, 54621 Thessaloniki, Greece
| | - Athanasios Anagnostis
- Advanced Insights, Artificial Intelligence Solutions, Ipsilantou 10, Panorama, 55236 Thessaloniki, Greece;
| | - Evangelia Kotzakioulafi
- First Propaedeutic Department of Internal Medicine, Aristotle University of Thessaloniki, AHEPA University Hospital of Thessaloniki, 54621 Thessaloniki, Greece; (E.K.); (M.C.V.); (A.E.); (K.K.); (K.E.); (G.D.); (C.K.); (M.A.); (G.K.); (C.S.); (T.D.)
| | - Michaela Chrysanthi Vittoraki
- First Propaedeutic Department of Internal Medicine, Aristotle University of Thessaloniki, AHEPA University Hospital of Thessaloniki, 54621 Thessaloniki, Greece; (E.K.); (M.C.V.); (A.E.); (K.K.); (K.E.); (G.D.); (C.K.); (M.A.); (G.K.); (C.S.); (T.D.)
| | - Ariadni Eufraimidou
- First Propaedeutic Department of Internal Medicine, Aristotle University of Thessaloniki, AHEPA University Hospital of Thessaloniki, 54621 Thessaloniki, Greece; (E.K.); (M.C.V.); (A.E.); (K.K.); (K.E.); (G.D.); (C.K.); (M.A.); (G.K.); (C.S.); (T.D.)
| | - Kristine Kasarjyan
- First Propaedeutic Department of Internal Medicine, Aristotle University of Thessaloniki, AHEPA University Hospital of Thessaloniki, 54621 Thessaloniki, Greece; (E.K.); (M.C.V.); (A.E.); (K.K.); (K.E.); (G.D.); (C.K.); (M.A.); (G.K.); (C.S.); (T.D.)
| | - Katerina Eufraimidou
- First Propaedeutic Department of Internal Medicine, Aristotle University of Thessaloniki, AHEPA University Hospital of Thessaloniki, 54621 Thessaloniki, Greece; (E.K.); (M.C.V.); (A.E.); (K.K.); (K.E.); (G.D.); (C.K.); (M.A.); (G.K.); (C.S.); (T.D.)
| | - Georgia Dimitriadou
- First Propaedeutic Department of Internal Medicine, Aristotle University of Thessaloniki, AHEPA University Hospital of Thessaloniki, 54621 Thessaloniki, Greece; (E.K.); (M.C.V.); (A.E.); (K.K.); (K.E.); (G.D.); (C.K.); (M.A.); (G.K.); (C.S.); (T.D.)
| | - Chrisovalantis Kakanis
- First Propaedeutic Department of Internal Medicine, Aristotle University of Thessaloniki, AHEPA University Hospital of Thessaloniki, 54621 Thessaloniki, Greece; (E.K.); (M.C.V.); (A.E.); (K.K.); (K.E.); (G.D.); (C.K.); (M.A.); (G.K.); (C.S.); (T.D.)
| | - Michail Anthopoulos
- First Propaedeutic Department of Internal Medicine, Aristotle University of Thessaloniki, AHEPA University Hospital of Thessaloniki, 54621 Thessaloniki, Greece; (E.K.); (M.C.V.); (A.E.); (K.K.); (K.E.); (G.D.); (C.K.); (M.A.); (G.K.); (C.S.); (T.D.)
| | - Georgia Kaiafa
- First Propaedeutic Department of Internal Medicine, Aristotle University of Thessaloniki, AHEPA University Hospital of Thessaloniki, 54621 Thessaloniki, Greece; (E.K.); (M.C.V.); (A.E.); (K.K.); (K.E.); (G.D.); (C.K.); (M.A.); (G.K.); (C.S.); (T.D.)
| | - Christos Savopoulos
- First Propaedeutic Department of Internal Medicine, Aristotle University of Thessaloniki, AHEPA University Hospital of Thessaloniki, 54621 Thessaloniki, Greece; (E.K.); (M.C.V.); (A.E.); (K.K.); (K.E.); (G.D.); (C.K.); (M.A.); (G.K.); (C.S.); (T.D.)
| | - Triantafyllos Didangelos
- First Propaedeutic Department of Internal Medicine, Aristotle University of Thessaloniki, AHEPA University Hospital of Thessaloniki, 54621 Thessaloniki, Greece; (E.K.); (M.C.V.); (A.E.); (K.K.); (K.E.); (G.D.); (C.K.); (M.A.); (G.K.); (C.S.); (T.D.)
| |
Collapse
|
356
|
de Moura J, Novo J, Ortega M. Fully automatic deep convolutional approaches for the analysis of COVID-19 using chest X-ray images. Appl Soft Comput 2021; 115:108190. [PMID: 34899109 PMCID: PMC8645263 DOI: 10.1016/j.asoc.2021.108190] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2020] [Revised: 10/24/2021] [Accepted: 11/22/2021] [Indexed: 12/24/2022]
Abstract
Covid-19 is a new infectious disease caused by severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). Given the seriousness of the situation, the World Health Organization declared a global pandemic as the Covid-19 rapidly around the world. Among its applications, chest X-ray images are frequently used for an early diagnostic/screening of Covid-19 disease, given the frequent pulmonary impact in the patients, critical issue to prevent further complications caused by this highly infectious disease. In this work, we propose 4 fully automatic approaches for the classification of chest X-ray images under the analysis of 3 different categories: Covid-19, pneumonia and healthy cases. Given the similarity between the pathological impact in the lungs between Covid-19 and pneumonia, mainly during the initial stages of both lung diseases, we performed an exhaustive study of differentiation considering different pathological scenarios. To address these classification tasks, we evaluated 6 representative state-of-the-art deep network architectures on 3 different public datasets: (I) Chest X-ray dataset of the Radiological Society of North America (RSNA); (II) Covid-19 Image Data Collection; (III) SIRM dataset of the Italian Society of Medical Radiology. To validate the designed approaches, several representative experiments were performed using 6,070 chest X-ray radiographs. In general, satisfactory results were obtained from the designed approaches, reaching a global accuracy values of 0.9706 ± 0.0044, 0.9839 ± 0.0102, 0.9744 ± 0.0104 and 0.9744 ± 0.0104, respectively, thus helping the work of clinicians in the diagnosis and consequently in the early treatment of this relevant pandemic pathology.
Collapse
Affiliation(s)
- Joaquim de Moura
- Centro de Investigación CITIC, Universidade da Coruña, Campus de Elviña, s/n, 15071, A Coruña, Spain.,Grupo VARPA, Instituto de Investigación Biomédica de A Coruña (INIBIC), Universidade da Coruña, Xubias de Arriba, 84, 15006, A Coruña, Spain
| | - Jorge Novo
- Centro de Investigación CITIC, Universidade da Coruña, Campus de Elviña, s/n, 15071, A Coruña, Spain.,Grupo VARPA, Instituto de Investigación Biomédica de A Coruña (INIBIC), Universidade da Coruña, Xubias de Arriba, 84, 15006, A Coruña, Spain
| | - Marcos Ortega
- Centro de Investigación CITIC, Universidade da Coruña, Campus de Elviña, s/n, 15071, A Coruña, Spain.,Grupo VARPA, Instituto de Investigación Biomédica de A Coruña (INIBIC), Universidade da Coruña, Xubias de Arriba, 84, 15006, A Coruña, Spain
| |
Collapse
|
357
|
Haq AU, Li JP, Ahmad S, Khan S, Alshara MA, Alotaibi RM. Diagnostic Approach for Accurate Diagnosis of COVID-19 Employing Deep Learning and Transfer Learning Techniques through Chest X-ray Images Clinical Data in E-Healthcare. SENSORS (BASEL, SWITZERLAND) 2021; 21:8219. [PMID: 34960313 PMCID: PMC8707954 DOI: 10.3390/s21248219] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/30/2021] [Revised: 11/25/2021] [Accepted: 11/30/2021] [Indexed: 01/15/2023]
Abstract
COVID-19 is a transferable disease that is also a leading cause of death for a large number of people worldwide. This disease, caused by SARS-CoV-2, spreads very rapidly and quickly affects the respiratory system of the human being. Therefore, it is necessary to diagnosis this disease at the early stage for proper treatment, recovery, and controlling the spread. The automatic diagnosis system is significantly necessary for COVID-19 detection. To diagnose COVID-19 from chest X-ray images, employing artificial intelligence techniques based methods are more effective and could correctly diagnosis it. The existing diagnosis methods of COVID-19 have the problem of lack of accuracy to diagnosis. To handle this problem we have proposed an efficient and accurate diagnosis model for COVID-19. In the proposed method, a two-dimensional Convolutional Neural Network (2DCNN) is designed for COVID-19 recognition employing chest X-ray images. Transfer learning (TL) pre-trained ResNet-50 model weight is transferred to the 2DCNN model to enhanced the training process of the 2DCNN model and fine-tuning with chest X-ray images data for final multi-classification to diagnose COVID-19. In addition, the data augmentation technique transformation (rotation) is used to increase the data set size for effective training of the R2DCNNMC model. The experimental results demonstrated that the proposed (R2DCNNMC) model obtained high accuracy and obtained 98.12% classification accuracy on CRD data set, and 99.45% classification accuracy on CXI data set as compared to baseline methods. This approach has a high performance and could be used for COVID-19 diagnosis in E-Healthcare systems.
Collapse
Affiliation(s)
- Amin Ul Haq
- School of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China;
| | - Jian Ping Li
- School of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China;
| | - Sultan Ahmad
- Department of Computer Science, College of Computer Engineering and Sciences, Prince Sattam Bin Abdulaziz University, Alkharj 11942, Saudi Arabia;
| | - Shakir Khan
- College of Computer and Information Sciences, Imam Mohammad Ibn Saud Islamic University (IMSIU), Riyadh 11432, Saudi Arabia; (M.A.A.); (R.M.A.)
| | - Mohammed Ali Alshara
- College of Computer and Information Sciences, Imam Mohammad Ibn Saud Islamic University (IMSIU), Riyadh 11432, Saudi Arabia; (M.A.A.); (R.M.A.)
| | - Reemiah Muneer Alotaibi
- College of Computer and Information Sciences, Imam Mohammad Ibn Saud Islamic University (IMSIU), Riyadh 11432, Saudi Arabia; (M.A.A.); (R.M.A.)
| |
Collapse
|
358
|
Explainable COVID-19 Detection on Chest X-rays Using an End-to-End Deep Convolutional Neural Network Architecture. BIG DATA AND COGNITIVE COMPUTING 2021. [DOI: 10.3390/bdcc5040073] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/26/2022]
Abstract
The coronavirus pandemic is spreading around the world. Medical imaging modalities such as radiography play an important role in the fight against COVID-19. Deep learning (DL) techniques have been able to improve medical imaging tools and help radiologists to make clinical decisions for the diagnosis, monitoring and prognosis of different diseases. Computer-Aided Diagnostic (CAD) systems can improve work efficiency by precisely delineating infections in chest X-ray (CXR) images, thus facilitating subsequent quantification. CAD can also help automate the scanning process and reshape the workflow with minimal patient contact, providing the best protection for imaging technicians. The objective of this study is to develop a deep learning algorithm to detect COVID-19, pneumonia and normal cases on CXR images. We propose two classifications problems, (i) a binary classification to classify COVID-19 and normal cases and (ii) a multiclass classification for COVID-19, pneumonia and normal. Nine datasets and more than 3200 COVID-19 CXR images are used to assess the efficiency of the proposed technique. The model is trained on a subset of the National Institute of Health (NIH) dataset using swish activation, thus improving the training accuracy to detect COVID-19 and other pneumonia. The models are tested on eight merged datasets and on individual test sets in order to confirm the degree of generalization of the proposed algorithms. An explainability algorithm is also developed to visually show the location of the lung-infected areas detected by the model. Moreover, we provide a detailed analysis of the misclassified images. The obtained results achieve high performances with an Area Under Curve (AUC) of 0.97 for multi-class classification (COVID-19 vs. other pneumonia vs. normal) and 0.98 for the binary model (COVID-19 vs. normal). The average sensitivity and specificity are 0.97 and 0.98, respectively. The sensitivity of the COVID-19 class achieves 0.99. The results outperformed the comparable state-of-the-art models for the detection of COVID-19 on CXR images. The explainability model shows that our model is able to efficiently identify the signs of COVID-19.
Collapse
|
359
|
Haneya H, AlKaf D, Bajammal F, Brahimi T. A Meta-Analysis of Artificial Intelligence Applications for Tracking COVID-19: The Case of the U.A.E. PROCEDIA COMPUTER SCIENCE 2021; 194:180-189. [PMID: 34876933 PMCID: PMC8641301 DOI: 10.1016/j.procs.2021.10.072] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Coronavirus disease (COVID-19) is an infectious respiratory disease that was first found in Wuhan, China, on December 31, 2019. It is caused by severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). As of November 10, 2020, more than fifty million cases have been confirmed, and more than one million deaths have been reported globally. This situation has created a serious challenge for all countries to institute a variety of control measures to track and slow down the spread of the virus and prevent the increasing number of deaths. In recent years, there has been an ongoing interest in using Artificial Intelligence (A.I.) in healthcare to create new treatments and detecting diseases. The objective of this study is to analyze the application and the impact of A.I. on the breakout of COVID-19 and discuss the contribution of A.I. to the fight against the pandemic based on the most recent applications used in the United Arab Emirates, including Dubai Police Movement Restriction Monitoring System, Taxis Preventive Measures Compliance System, Mobile App "Wai-Eye," Smart Helmets, Virtual Doctor, and The Department of Health - Abu Dhabi (DoH) Remote Healthcare App. The method used in this study is based on a meta-analysis of recent COVID-19 studies from various databases such as ScienceDirect, Sage Journals, SpringerLink, ResearchGate, Emerald Open Research, and IEEE Xplore. The COVID-19 data was based on Johns Hopkins University Center for Systems Science and Engineering (JHU CCSE). Results showed that A.I. applications provided the necessary prevention of the spread of COVID-19, assisted in monitoring restrictions and preventive measures violations, and provided remote healthcare, which directly impacted the number of hospital visits amidst the lockdown. The study concluded that A.I. has proven to be effective in supporting governments in fighting the pandemic.
Collapse
Affiliation(s)
- Hala Haneya
- Computer Science Department, College of Engineering, Effat University Jeddah, Saudi Arabia
| | - Dhekra AlKaf
- Computer Science Department, College of Engineering, Effat University Jeddah, Saudi Arabia
| | - Faigah Bajammal
- Computer Science Department, College of Engineering, Effat University Jeddah, Saudi Arabia
| | - Tayeb Brahimi
- Energy and Technology Research Center Natural Science, Mathematics and Technology Unit, College of Engineering, Effat University Jeddah, Saudi Arabia
| |
Collapse
|
360
|
Bhardwaj P, Kaur A. A novel and efficient deep learning approach for COVID-19 detection using X-ray imaging modality. INTERNATIONAL JOURNAL OF IMAGING SYSTEMS AND TECHNOLOGY 2021; 31:1775-1791. [PMID: 34518739 PMCID: PMC8426690 DOI: 10.1002/ima.22627] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/07/2021] [Revised: 06/06/2021] [Accepted: 06/27/2021] [Indexed: 05/03/2023]
Abstract
With the exponential growth of COVID-19 cases, medical practitioners are searching for accurate and quick automated detection methods to prevent Covid from spreading while trying to reduce the computational requirement of devices. In this research article, a deep learning Convolutional Neural Network (CNN) based accurate and efficient ensemble model using deep learning is being proposed with 2161 COVID-19, 2022 pneumonia, and 5863 normal chest X-ray images that has been collected from previous publications and other online resources. To improve the detection accuracy contrast enhancement and image normalization have been done to produce better quality images at the pre-processing level. Further data augmentation methods are used by creating modified versions of images in the dataset to train the four efficient CNN models (Inceptionv3, DenseNet121, Xception, InceptionResNetv2) Experimental results provide 98.33% accuracy for binary class and 92.36% for multiclass. The performance evaluation metrics reveal that this tool can be very helpful for early disease diagnosis.
Collapse
Affiliation(s)
| | - Amanpreet Kaur
- Electronics and CommunicationThapar UniversityPatialaIndia
| |
Collapse
|
361
|
Abstract
Purpose Methods Results Conclusion
Collapse
|
362
|
Li MM, Kuo TT. Previewable Contract-Based On-Chain X-Ray Image Sharing Framework for Clinical Research. Int J Med Inform 2021; 156:104599. [PMID: 34628257 PMCID: PMC8479449 DOI: 10.1016/j.ijmedinf.2021.104599] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2021] [Revised: 09/17/2021] [Accepted: 09/25/2021] [Indexed: 12/24/2022]
Abstract
BACKGROUND An image sharing framework is important to support downstream data analysis especially for pandemics like Coronavirus Disease 2019 (COVID-19). Current centralized image sharing frameworks become dysfunctional if any part of the framework fails. Existing decentralized image sharing frameworks do not store the images on the blockchain, thus the data themselves are not highly available, immutable, and provable. Meanwhile, storing images on the blockchain provides availability/immutability/provenance to the images, yet produces challenges such as large-image handling, high viewing latency while viewing images, and software inconsistency while storing/loading images. OBJECTIVE This study aims to store chest x-ray images using a blockchain-based framework to handle large images, improve viewing latency, and enhance software consistency. BASIC PROCEDURES We developed a splitting and merging function to handle large images, a feature that allows previewing an image earlier to improve viewing latency, and a smart contract to enhance software consistency. We used 920 publicly available images to evaluate the storing and loading methods through time measurements. MAIN FINDINGS The blockchain network successfully shares large images up to 18 MB and supports smart contracts to provide code immutability, availability, and provenance. Applying the preview feature successfully shared images 93% faster than sharing images without the preview feature. PRINCIPAL CONCLUSIONS The findings of this study can guide future studies to generalize our framework to other forms of data to improve sharing and interoperability.
Collapse
Affiliation(s)
- Megan Mun Li
- University of California San Diego, La Jolla, CA, USA
| | | |
Collapse
|
363
|
Tahir AM, Chowdhury MEH, Khandakar A, Rahman T, Qiblawey Y, Khurshid U, Kiranyaz S, Ibtehaz N, Rahman MS, Al-Maadeed S, Mahmud S, Ezeddin M, Hameed K, Hamid T. COVID-19 infection localization and severity grading from chest X-ray images. Comput Biol Med 2021; 139:105002. [PMID: 34749094 PMCID: PMC8556687 DOI: 10.1016/j.compbiomed.2021.105002] [Citation(s) in RCA: 44] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2021] [Revised: 10/27/2021] [Accepted: 10/27/2021] [Indexed: 12/16/2022]
Abstract
The immense spread of coronavirus disease 2019 (COVID-19) has left healthcare systems incapable to diagnose and test patients at the required rate. Given the effects of COVID-19 on pulmonary tissues, chest radiographic imaging has become a necessity for screening and monitoring the disease. Numerous studies have proposed Deep Learning approaches for the automatic diagnosis of COVID-19. Although these methods achieved outstanding performance in detection, they have used limited chest X-ray (CXR) repositories for evaluation, usually with a few hundred COVID-19 CXR images only. Thus, such data scarcity prevents reliable evaluation of Deep Learning models with the potential of overfitting. In addition, most studies showed no or limited capability in infection localization and severity grading of COVID-19 pneumonia. In this study, we address this urgent need by proposing a systematic and unified approach for lung segmentation and COVID-19 localization with infection quantification from CXR images. To accomplish this, we have constructed the largest benchmark dataset with 33,920 CXR images, including 11,956 COVID-19 samples, where the annotation of ground-truth lung segmentation masks is performed on CXRs by an elegant human-machine collaborative approach. An extensive set of experiments was performed using the state-of-the-art segmentation networks, U-Net, U-Net++, and Feature Pyramid Networks (FPN). The developed network, after an iterative process, reached a superior performance for lung region segmentation with Intersection over Union (IoU) of 96.11% and Dice Similarity Coefficient (DSC) of 97.99%. Furthermore, COVID-19 infections of various shapes and types were reliably localized with 83.05% IoU and 88.21% DSC. Finally, the proposed approach has achieved an outstanding COVID-19 detection performance with both sensitivity and specificity values above 99%.
Collapse
Affiliation(s)
- Anas M Tahir
- Department of Electrical Engineering, Qatar University, Doha, 2713, Qatar.
| | | | - Amith Khandakar
- Department of Electrical Engineering, Qatar University, Doha, 2713, Qatar.
| | - Tawsifur Rahman
- Department of Electrical Engineering, Qatar University, Doha, 2713, Qatar.
| | - Yazan Qiblawey
- Department of Electrical Engineering, Qatar University, Doha, 2713, Qatar.
| | - Uzair Khurshid
- Department of Electrical Engineering, Qatar University, Doha, 2713, Qatar.
| | - Serkan Kiranyaz
- Department of Electrical Engineering, Qatar University, Doha, 2713, Qatar.
| | - Nabil Ibtehaz
- Department of Computer Science and Engineering, Bangladesh University of Engineering and Technology, Dhaka, 1205, Bangladesh.
| | - M Sohel Rahman
- Department of Computer Science and Engineering, Bangladesh University of Engineering and Technology, Dhaka, 1205, Bangladesh.
| | - Somaya Al-Maadeed
- Computer Science and Engineering Department, Qatar University, Doha, 2713, Qatar.
| | - Sakib Mahmud
- Department of Electrical Engineering, Qatar University, Doha, 2713, Qatar.
| | - Maymouna Ezeddin
- Department of Electrical Engineering, Qatar University, Doha, 2713, Qatar.
| | - Khaled Hameed
- Radiology Department, Reem Medical Center, Doha, Qatar.
| | - Tahir Hamid
- Hamad General Hospital and Weill Cornell Medicine - Qatar, Doha, Qatar
| |
Collapse
|
364
|
Gidde PS, Prasad SS, Singh AP, Bhatheja N, Prakash S, Singh P, Saboo A, Takhar R, Gupta S, Saurav S, M V R, Singh A, Sardana V, Mahajan H, Kalyanpur A, Mandal AS, Mahajan V, Agrawal A, Agrawal A, Venugopal VK, Singh S, Dash D. Validation of expert system enhanced deep learning algorithm for automated screening for COVID-Pneumonia on chest X-rays. Sci Rep 2021; 11:23210. [PMID: 34853342 PMCID: PMC8636645 DOI: 10.1038/s41598-021-02003-w] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/16/2021] [Accepted: 11/01/2021] [Indexed: 12/15/2022] Open
Abstract
SARS-CoV2 pandemic exposed the limitations of artificial intelligence based medical imaging systems. Earlier in the pandemic, the absence of sufficient training data prevented effective deep learning (DL) solutions for the diagnosis of COVID-19 based on X-Ray data. Here, addressing the lacunae in existing literature and algorithms with the paucity of initial training data; we describe CovBaseAI, an explainable tool using an ensemble of three DL models and an expert decision system (EDS) for COVID-Pneumonia diagnosis, trained entirely on pre-COVID-19 datasets. The performance and explainability of CovBaseAI was primarily validated on two independent datasets. Firstly, 1401 randomly selected CxR from an Indian quarantine center to assess effectiveness in excluding radiological COVID-Pneumonia requiring higher care. Second, curated dataset; 434 RT-PCR positive cases and 471 non-COVID/Normal historical scans, to assess performance in advanced medical settings. CovBaseAI had an accuracy of 87% with a negative predictive value of 98% in the quarantine-center data. However, sensitivity was 0.66-0.90 taking RT-PCR/radiologist opinion as ground truth. This work provides new insights on the usage of EDS with DL methods and the ability of algorithms to confidently predict COVID-Pneumonia while reinforcing the established learning; that benchmarking based on RT-PCR may not serve as reliable ground truth in radiological diagnosis. Such tools can pave the path for multi-modal high throughput detection of COVID-Pneumonia in screening and referral.
Collapse
Affiliation(s)
| | - Shyam Sunder Prasad
- CSIR-Central Electronics Engineering Research Institute, Pilani, Rajasthan, 333031, India
- Academy of Scientific and Innovative Research (AcSIR), Ghaziabad, 201002, India
| | - Ajay Pratap Singh
- CSIR-Institute of Genomics and Integrative Biology, Mathura Road, New Delhi, 110025, India
- Academy of Scientific and Innovative Research (AcSIR), Ghaziabad, 201002, India
| | - Nitin Bhatheja
- CSIR-Institute of Genomics and Integrative Biology, Mathura Road, New Delhi, 110025, India
| | - Satyartha Prakash
- CSIR-Institute of Genomics and Integrative Biology, Mathura Road, New Delhi, 110025, India
| | - Prateek Singh
- CSIR-Institute of Genomics and Integrative Biology, Mathura Road, New Delhi, 110025, India
- Academy of Scientific and Innovative Research (AcSIR), Ghaziabad, 201002, India
| | - Aakash Saboo
- Centre for Advanced Research in Imaging, Neurosciences Genomics (CARING), New Delhi, India
| | - Rohit Takhar
- Centre for Advanced Research in Imaging, Neurosciences Genomics (CARING), New Delhi, India
| | - Salil Gupta
- Centre for Advanced Research in Imaging, Neurosciences Genomics (CARING), New Delhi, India
| | - Sumeet Saurav
- CSIR-Central Electronics Engineering Research Institute, Pilani, Rajasthan, 333031, India
- Academy of Scientific and Innovative Research (AcSIR), Ghaziabad, 201002, India
| | - Raghunandanan M V
- CSIR-Institute of Genomics and Integrative Biology, Mathura Road, New Delhi, 110025, India
- Academy of Scientific and Innovative Research (AcSIR), Ghaziabad, 201002, India
| | | | - Viren Sardana
- CSIR-Institute of Genomics and Integrative Biology, Mathura Road, New Delhi, 110025, India
- Academy of Scientific and Innovative Research (AcSIR), Ghaziabad, 201002, India
| | - Harsh Mahajan
- Centre for Advanced Research in Imaging, Neurosciences Genomics (CARING), New Delhi, India
| | - Arjun Kalyanpur
- Teleradiology Solutions, 7G, Opposite Graphite India, Whitefield, Bangalore, Karnataka, 560048, India
| | - Atanendu Shekhar Mandal
- CSIR-Central Electronics Engineering Research Institute, Pilani, Rajasthan, 333031, India
- Academy of Scientific and Innovative Research (AcSIR), Ghaziabad, 201002, India
| | - Vidur Mahajan
- Centre for Advanced Research in Imaging, Neurosciences Genomics (CARING), New Delhi, India
| | - Anurag Agrawal
- CSIR-Institute of Genomics and Integrative Biology, Mathura Road, New Delhi, 110025, India
- Academy of Scientific and Innovative Research (AcSIR), Ghaziabad, 201002, India
| | - Anjali Agrawal
- Teleradiology Solutions, 12B Sriram Road, Civil Lines, Delhi, 110054, India.
| | | | - Sanjay Singh
- CSIR-Central Electronics Engineering Research Institute, Pilani, Rajasthan, 333031, India.
- Academy of Scientific and Innovative Research (AcSIR), Ghaziabad, 201002, India.
| | - Debasis Dash
- CSIR-Institute of Genomics and Integrative Biology, Mathura Road, New Delhi, 110025, India.
- Academy of Scientific and Innovative Research (AcSIR), Ghaziabad, 201002, India.
| |
Collapse
|
365
|
Tan W, Liu P, Li X, Liu Y, Zhou Q, Chen C, Gong Z, Yin X, Zhang Y. Classification of COVID-19 pneumonia from chest CT images based on reconstructed super-resolution images and VGG neural network. Health Inf Sci Syst 2021; 9:10. [PMID: 33643612 PMCID: PMC7896179 DOI: 10.1007/s13755-021-00140-0] [Citation(s) in RCA: 24] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2020] [Accepted: 01/16/2021] [Indexed: 12/13/2022] Open
Abstract
The COVID-19 coronavirus has spread rapidly around the world and has caused global panic. Chest CT images play a major role in confirming positive COVID-19 patients. The computer aided diagnosis of COVID-19 from CT images based on artificial intelligence have been developed and deployed in some hospitals. But environmental influences and the movement of lung will affect the image quality, causing the lung parenchyma and pneumonia area unclear in CT images. Therefore, the performance of COVID-19's artificial intelligence diagnostic algorithm is reduced. If chest CT images are reconstructed, the accuracy and performance of the aided diagnostic algorithm may be improved. In this paper, a new aided diagnostic algorithm for COVID-19 based on super-resolution reconstructed images and convolutional neural network is presented. Firstly, the SRGAN neural network is used to reconstruct super-resolution images from original chest CT images. Then COVID-19 images and Non-COVID-19 images are classified from super-resolution chest CT images by VGG16 neural network. Finally, the performance of this method is verified by the pubic COVID-CT dataset and compared with other aided diagnosis methods of COVID-19. The experimental results show that improving the data quality through SRGAN neural network can greatly improve the final classification accuracy when the data quality is low. This proves that this method can obtain high accuracy, sensitivity and specificity in the examined test image datasets and has similar performance to other state-of-the-art deep learning aided algorithms.
Collapse
Affiliation(s)
- Wenjun Tan
- Key Laboratory of Intelligent Computing in Medical Image of Ministry of Education, Northeastern University, Shenyang, 110189 China
| | - Pan Liu
- Key Laboratory of Intelligent Computing in Medical Image of Ministry of Education, Northeastern University, Shenyang, 110189 China
| | - Xiaoshuo Li
- Key Laboratory of Intelligent Computing in Medical Image of Ministry of Education, Northeastern University, Shenyang, 110189 China
| | - Yao Liu
- Key Laboratory of Intelligent Computing in Medical Image of Ministry of Education, Northeastern University, Shenyang, 110189 China
| | - Qinghua Zhou
- Key Laboratory of Intelligent Computing in Medical Image of Ministry of Education, Northeastern University, Shenyang, 110189 China
| | - Chao Chen
- Key Laboratory of Complex System Control Theory and Application, Tianjin University of Technology, Tianjin, 300384 China
| | - Zhaoxuan Gong
- Department of Computer science, Shenyang Aerospace University, Shenyang, 110136 Liaoning China
| | - Xiaoxia Yin
- Cyberspace Institute of Advanced Technology, Guangzhou University, Guangzhou, 510006 China
| | - Yanchun Zhang
- Centre for Applied Informatics, College of Engineering and Science, Victoria University, Melbourne, VIC 8001 Australia
| |
Collapse
|
366
|
Gudigar A, Raghavendra U, Nayak S, Ooi CP, Chan WY, Gangavarapu MR, Dharmik C, Samanth J, Kadri NA, Hasikin K, Barua PD, Chakraborty S, Ciaccio EJ, Acharya UR. Role of Artificial Intelligence in COVID-19 Detection. SENSORS (BASEL, SWITZERLAND) 2021; 21:8045. [PMID: 34884045 PMCID: PMC8659534 DOI: 10.3390/s21238045] [Citation(s) in RCA: 19] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/05/2021] [Revised: 11/26/2021] [Accepted: 11/26/2021] [Indexed: 12/15/2022]
Abstract
The global pandemic of coronavirus disease (COVID-19) has caused millions of deaths and affected the livelihood of many more people. Early and rapid detection of COVID-19 is a challenging task for the medical community, but it is also crucial in stopping the spread of the SARS-CoV-2 virus. Prior substantiation of artificial intelligence (AI) in various fields of science has encouraged researchers to further address this problem. Various medical imaging modalities including X-ray, computed tomography (CT) and ultrasound (US) using AI techniques have greatly helped to curb the COVID-19 outbreak by assisting with early diagnosis. We carried out a systematic review on state-of-the-art AI techniques applied with X-ray, CT, and US images to detect COVID-19. In this paper, we discuss approaches used by various authors and the significance of these research efforts, the potential challenges, and future trends related to the implementation of an AI system for disease detection during the COVID-19 pandemic.
Collapse
Affiliation(s)
- Anjan Gudigar
- Department of Instrumentation and Control Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal 576104, India; (A.G.); (S.N.); (M.R.G.); (C.D.)
| | - U Raghavendra
- Department of Instrumentation and Control Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal 576104, India; (A.G.); (S.N.); (M.R.G.); (C.D.)
| | - Sneha Nayak
- Department of Instrumentation and Control Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal 576104, India; (A.G.); (S.N.); (M.R.G.); (C.D.)
| | - Chui Ping Ooi
- School of Science and Technology, Singapore University of Social Sciences, Singapore 599494, Singapore;
| | - Wai Yee Chan
- Department of Biomedical Imaging, Faculty of Medicine, University of Malaya, Kuala Lumpur 50603, Malaysia;
| | - Mokshagna Rohit Gangavarapu
- Department of Instrumentation and Control Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal 576104, India; (A.G.); (S.N.); (M.R.G.); (C.D.)
| | - Chinmay Dharmik
- Department of Instrumentation and Control Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal 576104, India; (A.G.); (S.N.); (M.R.G.); (C.D.)
| | - Jyothi Samanth
- Department of Cardiovascular Technology, Manipal College of Health Professions, Manipal Academy of Higher Education, Manipal 576104, India;
| | - Nahrizul Adib Kadri
- Department of Biomedical Engineering, Faculty of Engineering, University of Malaya, Kuala Lumpur 50603, Malaysia; (N.A.K.); (K.H.)
| | - Khairunnisa Hasikin
- Department of Biomedical Engineering, Faculty of Engineering, University of Malaya, Kuala Lumpur 50603, Malaysia; (N.A.K.); (K.H.)
| | - Prabal Datta Barua
- Cogninet Brain Team, Cogninet Australia, Sydney, NSW 2010, Australia;
- School of Business (Information Systems), Faculty of Business, Education, Law & Arts, University of Southern Queensland, Toowoomba, QLD 4350, Australia
- Faculty of Engineering and Information Technology, University of Technology Sydney, Sydney, NSW 2007, Australia;
| | - Subrata Chakraborty
- Faculty of Engineering and Information Technology, University of Technology Sydney, Sydney, NSW 2007, Australia;
- Faculty of Science, Agriculture, Business and Law, University of New England, Armidale, NSW 2351, Australia
| | - Edward J. Ciaccio
- Department of Medicine, Columbia University Medical Center, New York, NY 10032, USA;
| | - U. Rajendra Acharya
- School of Engineering, Ngee Ann Polytechnic, Singapore 599489, Singapore;
- Department of Biomedical Informatics and Medical Engineering, Asia University, Taichung 41354, Taiwan
- International Research Organization for Advanced Science and Technology (IROAST), Kumamoto University, Kumamoto 860-8555, Japan
| |
Collapse
|
367
|
Saif AFM, Imtiaz T, Rifat S, Shahnaz C, Zhu WP, Ahmad MO. CapsCovNet: A Modified Capsule Network to Diagnose COVID-19 From Multimodal Medical Imaging. IEEE TRANSACTIONS ON ARTIFICIAL INTELLIGENCE 2021; 2:608-617. [PMID: 35582431 PMCID: PMC8851432 DOI: 10.1109/tai.2021.3104791] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/23/2021] [Accepted: 08/11/2021] [Indexed: 12/26/2022]
Abstract
Since the end of 2019, novel coronavirus disease (COVID-19) has brought about a plethora of unforeseen changes to the world as we know it. Despite our ceaseless fight against it, COVID-19 has claimed millions of lives, and the death toll exacerbated due to its extremely contagious and fast-spreading nature. To control the spread of this highly contagious disease, a rapid and accurate diagnosis can play a very crucial part. Motivated by this context, a parallelly concatenated convolutional block-based capsule network is proposed in this article as an efficient tool to diagnose the COVID-19 patients from multimodal medical images. Concatenation of deep convolutional blocks of different filter sizes allows us to integrate discriminative spatial features by simultaneously changing the receptive field and enhances the scalability of the model. Moreover, concatenation of capsule layers strengthens the model to learn more complex representation by presenting the information in a fine to coarser manner. The proposed model is evaluated on three benchmark datasets, in which two of them are chest radiograph datasets and the rest is an ultrasound imaging dataset. The architecture that we have proposed through extensive analysis and reasoning achieved outstanding performance in COVID-19 detection task, which signifies the potentiality of the proposed model.
Collapse
Affiliation(s)
- A F M Saif
- Department of Electrical and Electronic EngineeringBangladesh University of Engineering and Technology Dhaka 1000 Bangladesh
| | - Tamjid Imtiaz
- Department of Electrical and Electronic EngineeringBangladesh University of Engineering and Technology Dhaka 1000 Bangladesh
| | - Shahriar Rifat
- Department of Electrical and Electronic EngineeringBangladesh University of Engineering and Technology Dhaka 1000 Bangladesh
| | - Celia Shahnaz
- Department of Electrical and Electronic EngineeringBangladesh University of Engineering and Technology Dhaka 1000 Bangladesh
| | - Wei-Ping Zhu
- Department of Electrical and Computer EngineeringConcordia University Montreal QC H3G 2W1 Canada
| | - M Omair Ahmad
- Department of Electrical and Computer EngineeringConcordia University Montreal QC H3G 2W1 Canada
| |
Collapse
|
368
|
Prakash NB, Murugappan M, Hemalakshmi GR, Jayalakshmi M, Mahmud M. Deep transfer learning for COVID-19 detection and infection localization with superpixel based segmentation. SUSTAINABLE CITIES AND SOCIETY 2021; 75:103252. [PMID: 34422549 PMCID: PMC8364837 DOI: 10.1016/j.scs.2021.103252] [Citation(s) in RCA: 18] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/28/2021] [Revised: 08/01/2021] [Accepted: 08/09/2021] [Indexed: 05/07/2023]
Abstract
The evolution the novel corona virus disease (COVID-19) as a pandemic has inflicted several thousand deaths per day endangering the lives of millions of people across the globe. In addition to thermal scanning mechanisms, chest imaging examinations provide valuable insights to the detection of this virus, diagnosis and prognosis of the infections. Though Chest CT and Chest X-ray imaging are common in the clinical protocols of COVID-19 management, the latter is highly preferred, attributed to its simple image acquisition procedure and mobility of the imaging mechanism. However, Chest X-ray images are found to be less sensitive compared to Chest CT images in detecting infections in the early stages. In this paper, we propose a deep learning based framework to enhance the diagnostic values of these images for improved clinical outcomes. It is realized as a variant of the conventional SqueezeNet classifier with segmentation capabilities, which is trained with deep features extracted from the Chest X-ray images of a standard dataset for binary and multi class classification. The binary classifier achieves an accuracy of 99.53% in the discrimination of COVID-19 and Non COVID-19 images. Similarly, the multi class classifier performs classification of COVID-19, Viral Pneumonia and Normal cases with an accuracy of 99.79%. This model called the COVID-19 Super pixel SqueezNet (COVID-SSNet) performs super pixel segmentation of the activation maps to extract the regions of interest which carry perceptual image features and constructs an overlay of the Chest X-ray images with these regions. The proposed classifier model adds significant value to the Chest X-rays for an integral examination of the image features and the image regions influencing the classifier decisions to expedite the COVID-19 treatment regimen.
Collapse
Affiliation(s)
- N B Prakash
- Department of Electrical and Electronics Engineering, National Engineering College, Tamil Nadu, India
| | - M Murugappan
- Intelligent Signal Processing (ISP) Research Lab, Department of Electronics and Communication Engineering, Kuwait College of Science and Technology, Kuwait
| | - G R Hemalakshmi
- Department of Computer Science and Engineering, National Engineering College, Tamil Nadu, India
| | - M Jayalakshmi
- Department of Computer Science and Engineering, National Engineering College, Tamil Nadu, India
| | - Mufti Mahmud
- Department of Computer Science, Nottingham Trent University, Clifton, Nottingham NG11 8NS, UK
- Medical Technologies Innovation Facility, Nottingham Trent University, Clifton, Nottingham NG11 8NS, UK
- Computing and Informatics Research Centre, Nottingham Trent University, Clifton, Nottingham NG11 8NS, UK
| |
Collapse
|
369
|
Sarker S, Jamal L, Ahmed SF, Irtisam N. Robotics and artificial intelligence in healthcare during COVID-19 pandemic: A systematic review. ROBOTICS AND AUTONOMOUS SYSTEMS 2021; 146:103902. [PMID: 34629751 PMCID: PMC8493645 DOI: 10.1016/j.robot.2021.103902] [Citation(s) in RCA: 29] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/12/2021] [Revised: 09/03/2021] [Accepted: 09/13/2021] [Indexed: 05/05/2023]
Abstract
The outbreak of the COVID-19 pandemic is unarguably the biggest catastrophe of the 21st century, probably the most significant global crisis after the second world war. The rapid spreading capability of the virus has compelled the world population to maintain strict preventive measures. The outrage of the virus has rampaged through the healthcare sector tremendously. This pandemic created a huge demand for necessary healthcare equipment, medicines along with the requirement for advanced robotics and artificial intelligence-based applications. The intelligent robot systems have great potential to render service in diagnosis, risk assessment, monitoring, telehealthcare, disinfection, and several other operations during this pandemic which has helped reduce the workload of the frontline workers remarkably. The long-awaited vaccine discovery of this deadly virus has also been greatly accelerated with AI-empowered tools. In addition to that, many robotics and Robotics Process Automation platforms have substantially facilitated the distribution of the vaccine in many arrangements pertaining to it. These forefront technologies have also aided in giving comfort to the people dealing with less addressed mental health complicacies. This paper investigates the use of robotics and artificial intelligence-based technologies and their applications in healthcare to fight against the COVID-19 pandemic. A systematic search following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) method is conducted to accumulate such literature, and an extensive review on 147 selected records is performed.
Collapse
Affiliation(s)
- Sujan Sarker
- Department of Robotics and Mechatronics Engineering, University of Dhaka, Dhaka, Bangladesh
| | - Lafifa Jamal
- Department of Robotics and Mechatronics Engineering, University of Dhaka, Dhaka, Bangladesh
| | - Syeda Faiza Ahmed
- Department of Robotics and Mechatronics Engineering, University of Dhaka, Dhaka, Bangladesh
| | - Niloy Irtisam
- Department of Robotics and Mechatronics Engineering, University of Dhaka, Dhaka, Bangladesh
| |
Collapse
|
370
|
Halder A, Datta B. COVID-19 detection from lung CT-scan images using transfer learning approach. MACHINE LEARNING: SCIENCE AND TECHNOLOGY 2021. [DOI: 10.1088/2632-2153/abf22c] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/18/2022] Open
Abstract
Abstract
Since the onset of 2020, the spread of coronavirus disease (COVID-19) has rapidly accelerated worldwide into a state of severe pandemic. COVID-19 has infected more than 29 million people and caused more than 900 thousand deaths at the time of writing. Since it is highly contagious, it causes explosive community transmission. Thus, health care delivery has been disrupted and compromised by the lack of testing kits. COVID-19-infected patients show severe acute respiratory syndrome. Meanwhile, the scientific community has been involved in the implementation of deep learning (DL) techniques to diagnose COVID-19 using computed tomography (CT) lung scans, since CT is a pertinent screening tool due to its higher sensitivity in recognizing early pneumonic changes. However, large datasets of CT-scan images are not publicly available due to privacy concerns and obtaining very accurate models has become difficult. Thus, to overcome this drawback, transfer-learning pre-trained models are used in the proposed methodology to classify COVID-19 (positive) and COVID-19 (negative) patients. We describe the development of a DL framework that includes pre-trained models (DenseNet201, VGG16, ResNet50V2, and MobileNet) as its backbone, known as KarNet. To extensively test and analyze the framework, each model was trained on original (i.e. unaugmented) and manipulated (i.e. augmented) datasets. Among the four pre-trained models of KarNet, the one that used DenseNet201 demonstrated excellent diagnostic ability, with AUC scores of 1.00 and 0.99 for models trained on unaugmented and augmented data sets, respectively. Even after considerable distortion of the images (i.e. the augmented dataset) DenseNet201 achieved an accuracy of 97% for the test dataset, followed by ResNet50V2, MobileNet, and VGG16 (which achieved accuracies of 96%, 95%, and 94%, respectively).
Collapse
|
371
|
Sahoo P, Roy I, Ahlawat R, Irtiza S, Khan L. Potential diagnosis of COVID-19 from chest X-ray and CT findings using semi-supervised learning. Phys Eng Sci Med 2021; 45:31-42. [PMID: 34780042 PMCID: PMC8591440 DOI: 10.1007/s13246-021-01075-2] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2021] [Accepted: 10/30/2021] [Indexed: 12/11/2022]
Abstract
COVID-19 is an infectious disease, which has adversely affected public health and the economy across the world. On account of the highly infectious nature of the disease, rapid automated diagnosis of COVID-19 is urgently needed. A few recent findings suggest that chest X-rays and CT scans can be used by machine learning for the diagnosis of COVID-19. Herein, we employed semi-supervised learning (SSL) approaches to detect COVID-19 cases accurately by analyzing digital chest X-rays and CT scans. On a relatively small COVID-19 radiography dataset, which contains only 219 COVID-19 positive images, 1341 normal and 1345 viral pneumonia images, our algorithm, COVIDCon, which takes advantage of data augmentation, consistency regularization, and multicontrastive learning, attains 97.07% average class prediction accuracy, with 1000 labeled images, which is 7.65% better than the next best SSL method, virtual adversarial training. COVIDCon performs even better on a larger COVID-19 CT Scan dataset that contains 82,767 images. It achieved an excellent accuracy of 99.13%, at 20,000 labels, which is 6.45% better than the next best pseudo-labeling approach. COVIDCon outperforms other state-of-the-art algorithms at every label that we have investigated. These results demonstrate COVIDCon as the benchmark SSL algorithm for potential diagnosis of COVID-19 from chest X-rays and CT-Scans. Furthermore, COVIDCon performs exceptionally well in identifying COVID-19 positive cases from a completely unseen repository with a confirmed COVID-19 case history. COVIDCon, may provide a fast, accurate, and reliable method for screening COVID-19 patients.
Collapse
Affiliation(s)
- Pracheta Sahoo
- Department of Computer Science, The University of Texas at Dallas, Richardson, TX, 75080, USA.
| | - Indranil Roy
- Department of Chemistry, Northwestern University, 2145 Sheridan Road, Evanston, IL, 60208-3113, USA
| | - Randeep Ahlawat
- Department of Computer Science, The University of Texas at Dallas, Richardson, TX, 75080, USA
| | - Saquib Irtiza
- Department of Computer Science, The University of Texas at Dallas, Richardson, TX, 75080, USA
| | - Latifur Khan
- Department of Computer Science, The University of Texas at Dallas, Richardson, TX, 75080, USA
| |
Collapse
|
372
|
Ensemble Deep Learning for the Detection of COVID-19 in Unbalanced Chest X-ray Dataset. APPLIED SCIENCES-BASEL 2021. [DOI: 10.3390/app112210528] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/26/2022]
Abstract
The ongoing COVID-19 pandemic has caused devastating effects on humanity worldwide. With practical advantages and wide accessibility, chest X-rays (CXRs) play vital roles in the diagnosis of COVID-19 and the evaluation of the extent of lung damages incurred by the virus. This study aimed to leverage deep-learning-based methods toward the automated classification of COVID-19 from normal and viral pneumonia on CXRs, and the identification of indicative regions of COVID-19 biomarkers. Initially, we preprocessed and segmented the lung regions usingDeepLabV3+ method, and subsequently cropped the lung regions. The cropped lung regions were used as inputs to several deep convolutional neural networks (CNNs) for the prediction of COVID-19. The dataset was highly unbalanced; the vast majority were normal images, with a small number of COVID-19 and pneumonia images. To remedy the unbalanced distribution and to avoid biased classification results, we applied five different approaches: (i) balancing the class using weighted loss; (ii) image augmentation to add more images to minority cases; (iii) the undersampling of majority classes; (iv) the oversampling of minority classes; and (v) a hybrid resampling approach of oversampling and undersampling. The best-performing methods from each approach were combined as the ensemble classifier using two voting strategies. Finally, we used the saliency map of CNNs to identify the indicative regions of COVID-19 biomarkers which are deemed useful for interpretability. The algorithms were evaluated using the largest publicly available COVID-19 dataset. An ensemble of the top five CNNs with image augmentation achieved the highest accuracy of 99.23% and area under curve (AUC) of 99.97%, surpassing the results of previous studies.
Collapse
|
373
|
Boulila W, Shah SA, Ahmad J, Driss M, Ghandorh H, Alsaeedi A, Al-Sarem M, Saeed F. Noninvasive Detection of Respiratory Disorder Due to COVID-19 at the Early Stages in Saudi Arabia. ELECTRONICS 2021; 10:2701. [DOI: 10.3390/electronics10212701] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
The Kingdom of Saudi Arabia has suffered from COVID-19 disease as part of the global pandemic due to severe acute respiratory syndrome coronavirus 2. The economy of Saudi Arabia also suffered a heavy impact. Several measures were taken to help mitigate its impact and stimulate the economy. In this context, we present a safe and secure WiFi-sensing-based COVID-19 monitoring system exploiting commercially available low-cost wireless devices that can be deployed in different indoor settings within Saudi Arabia. We extracted different activities of daily living and respiratory rates from ubiquitous WiFi signals in terms of channel state information (CSI) and secured them from unauthorized access through permutation and diffusion with multiple substitution boxes using chaos theory. The experiments were performed on healthy participants. We used the variances of the amplitude information of the CSI data and evaluated their security using several security parameters such as the correlation coefficient, mean-squared error (MSE), peak-signal-to-noise ratio (PSNR), entropy, number of pixel change rate (NPCR), and unified average change intensity (UACI). These security metrics, for example, lower correlation and higher entropy, indicate stronger security of the proposed encryption method. Moreover, the NPCR and UACI values were higher than 99% and 30, respectively, which also confirmed the security strength of the encrypted information.
Collapse
Affiliation(s)
- Wadii Boulila
- College of Computer Science and Engineering, Taibah University, Medina 42353, Saudi Arabia
- RIADI Laboratory, National School of Computer Science, University of Manouba, Manouba 2010, Tunisia
| | - Syed Aziz Shah
- Centre for Intelligent Healthcare, Coventry University, Coventry CV1 5FB, UK
| | - Jawad Ahmad
- School of Computing, Edinburgh Napier University, Edinburgh EH10 5DT, UK
| | - Maha Driss
- College of Computer Science and Engineering, Taibah University, Medina 42353, Saudi Arabia
| | - Hamza Ghandorh
- College of Computer Science and Engineering, Taibah University, Medina 42353, Saudi Arabia
| | - Abdullah Alsaeedi
- College of Computer Science and Engineering, Taibah University, Medina 42353, Saudi Arabia
| | - Mohammed Al-Sarem
- College of Computer Science and Engineering, Taibah University, Medina 42353, Saudi Arabia
- Department of Computer Science, Saba’a Region University, Mareb, Yemen
| | - Faisal Saeed
- College of Computer Science and Engineering, Taibah University, Medina 42353, Saudi Arabia
- School of Computing and Digital Technology, Birmingham City University, Birmingham B4 7XG, UK
| |
Collapse
|
374
|
Murugamoorthy G, Khan N. Interpreting Uncertainty in Model Predictions for Covid-19 Diagnosis. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2021; 2021:2034-2037. [PMID: 34891687 DOI: 10.1109/embc46164.2021.9630945] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
COVID-19, due to its accelerated spread has brought in the need to use assistive tools for faster diagnosis in addition to typical lab swab testing. Chest X-Rays for COVID cases tend to show changes in the lungs such as ground glass opacities and peripheral consolidations which can be detected by deep neural networks. However, traditional convolutional networks use point estimate for predictions, lacking in capture of uncertainty, which makes them less reliable for adoption. There have been several works so far in predicting COVID positive cases with chest X-Rays. However, not much has been explored on quantifying the uncertainty of these predictions, interpreting uncertainty, and decomposing this to model or data uncertainty. To address these needs, we develop a visualization framework to address interpretability of uncertainty and its components, with uncertainty in predictions computed with a Bayesian Convolutional Neural Network. This framework aims to understand the contribution of individual features in the Chest-X-Ray images to predictive uncertainty. Providing this as an assistive tool can help the radiologist understand why the model came up with a prediction and whether the regions of interest captured by the model for the specific prediction are of significance in diagnosis. We demonstrate the usefulness of the tool in chest x-ray interpretation through several test cases from a benchmark dataset.
Collapse
|
375
|
Vieira P, Sousa O, Magalhães D, Rabêlo R, Silva R. Detecting pulmonary diseases using deep features in X-ray images. PATTERN RECOGNITION 2021; 119:108081. [PMID: 34149099 PMCID: PMC8193974 DOI: 10.1016/j.patcog.2021.108081] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/19/2021] [Revised: 04/29/2021] [Accepted: 05/27/2021] [Indexed: 05/09/2023]
Abstract
COVID-19 leads to radiological evidence of lower respiratory tract lesions, which support analysis to screen this disease using chest X-ray. In this scenario, deep learning techniques are applied to detect COVID-19 pneumonia in X-ray images, aiding a fast and precise diagnosis. Here, we investigate seven deep learning architectures associated with data augmentation and transfer learning techniques to detect different pneumonia types. We also propose an image resizing method with the maximum window function that preserves anatomical structures of the chest. The results are promising, reaching an accuracy of 99.8% considering COVID-19, normal, and viral and bacterial pneumonia classes. The differentiation between viral pneumonia and COVID-19 achieved an accuracy of 99.8%, and 99.9% of accuracy between COVID-19 and bacterial pneumonia. We also evaluated the impact of the proposed image resizing method on classification performance comparing with the bilinear interpolation; this pre-processing increased the classification rate regardless of the deep learning architectures used. We c ompared our results with ten related works in the state-of-the-art using eight sets of experiments, which showed that the proposed method outperformed them in most cases. Therefore, we demonstrate that deep learning models trained with pre-processed X-ray images could precisely assist the specialist in COVID-19 detection.
Collapse
Affiliation(s)
- Pablo Vieira
- Electrical Engineering Department, Federal University of Piau, Picos, Brazil
- Development and Research, Maida.Health, Piau, Teresina, Brazil
| | - Orrana Sousa
- Electrical Engineering Department, Federal University of Piau, Picos, Brazil
| | - Deborah Magalhães
- Information Systems Department, Federal University of Piau, Picos, Brazil
| | - Ricardo Rabêlo
- Computer Science Department, Federal University of Piau, Teresina, Brazil
| | - Romuere Silva
- Electrical Engineering Department, Federal University of Piau, Picos, Brazil
- Information Systems Department, Federal University of Piau, Picos, Brazil
- Computer Science Department, Federal University of Piau, Teresina, Brazil
| |
Collapse
|
376
|
Haque F, Ibne Reaz MB, Chowdhury MEH, Md Ali SH, Ashrif A Bakar A, Rahman T, Kobashi S, Dhawale CA, Sobhan Bhuiyan MA. A nomogram-based diabetic sensorimotor polyneuropathy severity prediction using Michigan neuropathy screening instrumentations. Comput Biol Med 2021; 139:104954. [PMID: 34715551 DOI: 10.1016/j.compbiomed.2021.104954] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2021] [Revised: 10/14/2021] [Accepted: 10/15/2021] [Indexed: 12/15/2022]
Abstract
BACKGROUND Diabetic Sensorimotor polyneuropathy (DSPN) is one of the major indelible complications in diabetic patients. Michigan neuropathy screening instrumentation (MNSI) is one of the most common screening techniques used for DSPN, however, it does not provide any direct severity grading system. METHOD For designing and modeling the DSPN severity grading systems for MNSI, 19 years of data from Epidemiology of Diabetes Interventions and Complications (EDIC) clinical trials were used. Different Machine learning-based feature ranking techniques were investigated to identify the important MNSI features associated with DSPN diagnosis. A multivariable logistic regression-based nomogram was generated and validated for DSPN severity grading using the best performing top-ranked MNSI features. RESULTS Top-10 ranked features from MNSI features: Appearance of Feet (R), Ankle Reflexes (R), Vibration perception (L), Vibration perception (R), Appearance of Feet (L), 10-gm filament (L), Ankle Reflexes (L), 10-gm filament (R), Bed Cover Touch, and Ulceration (R) were identified as important features for identifying DSPN by Multi-Tree Extreme Gradient Boost model. The nomogram-based prediction model exhibited an accuracy of 97.95% and 98.84% for the EDIC test set and an independent test set, respectively. A DSPN severity score technique was generated for MNSI from the DSPN severity prediction model. DSPN patients were stratified into four severity levels: absent, mild, moderate, and severe using the cut-off values of 17.6, 19.1, 20.5 for the DSPN probability less than 50%, 75%-90%, and above 90%, respectively. CONCLUSIONS The findings of this work provide a machine learning-based MNSI severity grading system which has the potential to be used as a secondary decision support system by health professionals in clinical applications and large clinical trials to identify high-risk DSPN patients.
Collapse
Affiliation(s)
- Fahmida Haque
- Department of Electrical, Electronic and System Engineering, Universiti Kebangsaan Malaysia, Bangi, 43600, Selangor, Malaysia
| | - Mamun Bin Ibne Reaz
- Department of Electrical, Electronic and System Engineering, Universiti Kebangsaan Malaysia, Bangi, 43600, Selangor, Malaysia.
| | | | - Sawal Hamid Md Ali
- Department of Electrical, Electronic and System Engineering, Universiti Kebangsaan Malaysia, Bangi, 43600, Selangor, Malaysia
| | - Ahmad Ashrif A Bakar
- Department of Electrical, Electronic and System Engineering, Universiti Kebangsaan Malaysia, Bangi, 43600, Selangor, Malaysia
| | - Tawsifur Rahman
- Department of Electrical Engineering, Qatar University, Doha, 2713, Qatar
| | - Syoji Kobashi
- Graduate School of Engineering, University of Hyogo, Hyogo, Japan
| | - Chitra A Dhawale
- P. R. Pote College of Engineering and Management, Kathora Road, Amravati, 444602, India
| | - Mohammad Arif Sobhan Bhuiyan
- Department Electrical and Electronic Engineering, Xiamen University Malaysia, Bandar Sunsuria, Sepang, 43900, Selangor, Malaysia.
| |
Collapse
|
377
|
Chakraborty S, Paul S, Hasan KMA. A Transfer Learning-Based Approach with Deep CNN for COVID-19- and Pneumonia-Affected Chest X-ray Image Classification. SN COMPUTER SCIENCE 2021; 3:17. [PMID: 34723208 PMCID: PMC8547126 DOI: 10.1007/s42979-021-00881-5] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/18/2021] [Accepted: 09/14/2021] [Indexed: 01/22/2023]
Abstract
The COVID-19 pandemic creates a significant impact on everyone's life. One of the fundamental movements to cope with this challenge is identifying the COVID-19-affected patients as early as possible. In this paper, we classified COVID-19, Pneumonia, and Healthy cases from the chest X-ray images by applying the transfer learning approach on the pre-trained VGG-19 architecture. We use MongoDB as a database to store the original image and corresponding category. The analysis is performed on a public dataset of 3797 X-ray images, among them COVID-19 affected (1184 images), Pneumonia affected (1294 images), and Healthy (1319 images) (https://www.kaggle.com/tawsifurrahman/covid19-radiography-database/version/3). This research gained an accuracy of 97.11%, average precision of 97%, and average Recall of 97% on the test dataset.
Collapse
Affiliation(s)
- Soarov Chakraborty
- Department of Computer Science and Engineering, Khulna University of Engineering & Technology, Khulna, 9203 Bangladesh
| | - Shourav Paul
- Department of Computer Science and Engineering, Khulna University of Engineering & Technology, Khulna, 9203 Bangladesh
| | - K. M. Azharul Hasan
- Department of Computer Science and Engineering, Khulna University of Engineering & Technology, Khulna, 9203 Bangladesh
| |
Collapse
|
378
|
Elharrouss O, Subramanian N, Al-Maadeed S. An Encoder-Decoder-Based Method for Segmentation of COVID-19 Lung Infection in CT Images. SN COMPUTER SCIENCE 2021; 3:13. [PMID: 34723206 PMCID: PMC8543772 DOI: 10.1007/s42979-021-00874-4] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/12/2020] [Accepted: 09/02/2021] [Indexed: 10/26/2022]
Abstract
The novelty of the COVID-19 Disease and the speed of spread, created colossal chaotic, impulse all the worldwide researchers to exploit all resources and capabilities to understand and analyze characteristics of the coronavirus in terms of spread ways and virus incubation time. For that, the existing medical features such as CT-scan and X-ray images are used. For example, CT-scan images can be used for the detection of lung infection. However, the quality of these images and infection characteristics limit the effectiveness of these features. Using artificial intelligence (AI) tools and computer vision algorithms, the accuracy of detection can be more accurate and can help to overcome these issues. In this paper, we propose a multi-task deep-learning-based method for lung infection segmentation on CT-scan images. Our proposed method starts by segmenting the lung regions that may be infected. Then, segmenting the infections in these regions. In addition, to perform a multi-class segmentation the proposed model is trained using the two-stream inputs. The multi-task learning used in this paper allows us to overcome the shortage of labeled data. In addition, the multi-input stream allows the model to learn from many features that can improve the results. To evaluate the proposed method, many metrics have been used including Sorensen-Dice similarity, Sensitivity, Specificity, Precision, and MAE metrics. As a result of experiments, the proposed method can segment lung infections with high performance even with the shortage of data and labeled images. In addition, comparing with the state-of-the-art method our method achieves good performance results. For example, the proposed method reached 78..6% for Dice, 71.1% for Sensitivity metric, 99.3% for Specificity 85.6% for Precision, and 0.062 for Mean Average Error metric, which demonstrates the effectiveness of the proposed method for lung infection segmentation.
Collapse
Affiliation(s)
- Omar Elharrouss
- Department of Computer Science and Engineering, Qatar University, Doha, Qatar
| | | | - Somaya Al-Maadeed
- Department of Computer Science and Engineering, Qatar University, Doha, Qatar
| |
Collapse
|
379
|
Bashar A, Latif G, Ben Brahim G, Mohammad N, Alghazo J. COVID-19 Pneumonia Detection Using Optimized Deep Learning Techniques. Diagnostics (Basel) 2021; 11:1972. [PMID: 34829319 PMCID: PMC8625739 DOI: 10.3390/diagnostics11111972] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2021] [Revised: 10/13/2021] [Accepted: 10/18/2021] [Indexed: 12/24/2022] Open
Abstract
It became apparent that mankind has to learn to live with and adapt to COVID-19, especially because the developed vaccines thus far do not prevent the infection but rather just reduce the severity of the symptoms. The manual classification and diagnosis of COVID-19 pneumonia requires specialized personnel and is time consuming and very costly. On the other hand, automatic diagnosis would allow for real-time diagnosis without human intervention resulting in reduced costs. Therefore, the objective of this research is to propose a novel optimized Deep Learning (DL) approach for the automatic classification and diagnosis of COVID-19 pneumonia using X-ray images. For this purpose, a publicly available dataset of chest X-rays on Kaggle was used in this study. The dataset was developed over three stages in a quest to have a unified COVID-19 entities dataset available for researchers. The dataset consists of 21,165 anterior-to-posterior and posterior-to-anterior chest X-ray images classified as: Normal (48%), COVID-19 (17%), Lung Opacity (28%) and Viral Pneumonia (6%). Data Augmentation was also applied to increase the dataset size to enhance the reliability of results by preventing overfitting. An optimized DL approach is implemented in which chest X-ray images go through a three-stage process. Image Enhancement is performed in the first stage, followed by Data Augmentation stage and in the final stage the results are fed to the Transfer Learning algorithms (AlexNet, GoogleNet, VGG16, VGG19, and DenseNet) where the images are classified and diagnosed. Extensive experiments were performed under various scenarios, which led to achieving the highest classification accuracy of 95.63% through the application of VGG16 transfer learning algorithm on the augmented enhanced dataset with freeze weights. This accuracy was found to be better as compared to the results reported by other methods in the recent literature. Thus, the proposed approach proved superior in performance as compared with that of other similar approaches in the extant literature, and it made a valuable contribution to the body of knowledge. Although the results achieved so far are promising, further work is planned to correlate the results of the proposed approach with clinical observations to further enhance the efficiency and accuracy of COVID-19 diagnosis.
Collapse
Affiliation(s)
- Abul Bashar
- Department of Computer Engineering, Prince Mohammad Bin Fahd University, Khobar 31952, Saudi Arabia
| | - Ghazanfar Latif
- Université du Québec à Chicoutimi, 555 Boulevard de l’Université, Chicoutimi, QC G7H2B1, Canada;
- Department of Computer Science, Prince Mohammad Bin Fahd University, Khobar 31952, Saudi Arabia;
| | - Ghassen Ben Brahim
- Department of Computer Science, Prince Mohammad Bin Fahd University, Khobar 31952, Saudi Arabia;
| | - Nazeeruddin Mohammad
- Cybersecurity Center, Prince Mohammad Bin Fahd University, Khobar 31952, Saudi Arabia;
| | - Jaafar Alghazo
- Department of Electrical and Computer Engineering, Virginia Military Institute, Lexington, VA 24450, USA;
| |
Collapse
|
380
|
Tamal M, Alshammari M, Alabdullah M, Hourani R, Alola HA, Hegazi TM. An integrated framework with machine learning and radiomics for accurate and rapid early diagnosis of COVID-19 from Chest X-ray. EXPERT SYSTEMS WITH APPLICATIONS 2021; 180:115152. [PMID: 33967406 PMCID: PMC8095015 DOI: 10.1016/j.eswa.2021.115152] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/23/2020] [Revised: 05/01/2021] [Accepted: 05/01/2021] [Indexed: 05/24/2023]
Abstract
The objective of the research article is to propose and validate a combination of machine learning and radiomics features to detect COVID-19 early and rapidly from chest X-ray (CXR) in presence of other viral/bacterial pneumonia and at different severity levels of diseases. It is vital to assess the performance of any diagnosis method on an independent data set and at very early stage of the disease when the disease severity of is very low. In such cases, most of the diagnosis methods fail. A total of 378 CXR images containing both normal lung and pneumonia (both COVID-19 and others lung conditions) were collected from publically available data set. 71 radiomics features for each lung segment were chosen from 100 extracted features based on Z-score heatmap and one way ANOVA test that can detect COVID-19. Three best performing classical machine learning algorithms during the training phase - 1) fine Gaussian support vector machine (SVM), 2) fine k-nearest neighbor (KNN) and 3) ensemble bagged model (EBM) trees were chosen for further evaluation on an independent test data set. The independent test data set consists of 115 COVID-19 CXR images collected from a local hospital and 100 CXR images collected from publically available data set containing normal lung and viral/bacterial pneumonia. Severity was scored between 0 to 4 by two experienced radiologists for each lung with pneumonia (both COVID-19 and non COVID-19) for the test data set. Ensemble Bagging Model Trees (EBM) with the selected radiomics features is the most suitable to distinguish between COVID-19 and other lung infections with an overall sensitivity of 87.8% and specificity of 97% (95.2% accuracy and 0.9228 area under curve) and is robust across severity levels. The method also can detect COVID-19 from CXR when two experienced radiologists were unable to detect any abnormality in the lung CXR (represented by severity score of 0). Once the CXR is acquired and lung is segmented, it takes less than two minutes for extracting radiomics features and providing diagnosis result. Since the proposed method does not require any manual intervention (e.g., sample collection etc.), it can be straightway integrated with standard X-ray reporting system to be used as an efficient, cost-effective and rapid early diagnosis device.
Collapse
Affiliation(s)
- Mahbubunnabi Tamal
- Department of Biomedical Engineering, College of Engineering, Imam Abdulrahman Bin Faisal University, PO Box 1982, Dammam 31441, Saudi Arabia
| | - Maha Alshammari
- Department of Biomedical Engineering, College of Engineering, Imam Abdulrahman Bin Faisal University, PO Box 1982, Dammam 31441, Saudi Arabia
| | - Meernah Alabdullah
- Department of Biomedical Engineering, College of Engineering, Imam Abdulrahman Bin Faisal University, PO Box 1982, Dammam 31441, Saudi Arabia
| | - Rana Hourani
- Department of Biomedical Engineering, College of Engineering, Imam Abdulrahman Bin Faisal University, PO Box 1982, Dammam 31441, Saudi Arabia
| | - Hossain Abu Alola
- Department of Radiology, College of Medicine, Imam Abdulrahman Bin Faisal University, PO Box 1982, Dammam 31441, Saudi Arabia
| | - Tarek M Hegazi
- Department of Radiology, College of Medicine, Imam Abdulrahman Bin Faisal University, PO Box 1982, Dammam 31441, Saudi Arabia
| |
Collapse
|
381
|
Baltazar LR, Manzanillo MG, Gaudillo J, Viray ED, Domingo M, Tiangco B, Albia J. Artificial intelligence on COVID-19 pneumonia detection using chest xray images. PLoS One 2021; 16:e0257884. [PMID: 34648509 PMCID: PMC8516252 DOI: 10.1371/journal.pone.0257884] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/16/2021] [Accepted: 09/13/2021] [Indexed: 12/24/2022] Open
Abstract
Recent studies show the potential of artificial intelligence (AI) as a screening tool to detect COVID-19 pneumonia based on chest x-ray (CXR) images. However, issues on the datasets and study designs from medical and technical perspectives, as well as questions on the vulnerability and robustness of AI algorithms have emerged. In this study, we address these issues with a more realistic development of AI-driven COVID-19 pneumonia detection models by generating our own data through a retrospective clinical study to augment the dataset aggregated from external sources. We optimized five deep learning architectures, implemented development strategies by manipulating data distribution to quantitatively compare study designs, and introduced several detection scenarios to evaluate the robustness and diagnostic performance of the models. At the current level of data availability, the performance of the detection model depends on the hyperparameter tuning and has less dependency on the quantity of data. InceptionV3 attained the highest performance in distinguishing pneumonia from normal CXR in two-class detection scenario with sensitivity (Sn), specificity (Sp), and positive predictive value (PPV) of 96%. The models attained higher general performance of 91-96% Sn, 94-98% Sp, and 90-96% PPV in three-class compared to four-class detection scenario. InceptionV3 has the highest general performance with accuracy, F1-score, and g-mean of 96% in the three-class detection scenario. For COVID-19 pneumonia detection, InceptionV3 attained the highest performance with 86% Sn, 99% Sp, and 91% PPV with an AUC of 0.99 in distinguishing pneumonia from normal CXR. Its capability of differentiating COVID-19 pneumonia from normal and non-COVID-19 pneumonia attained 0.98 AUC and a micro-average of 0.99 for other classes.
Collapse
Affiliation(s)
- Lei Rigi Baltazar
- Data-Driven Research Laboratory (DARE Lab), Institute of Mathematical Sciences and Physics, University of the Philippines Los Baños, Los Baños, Philippines
- Domingo Artificial Intelligence Research Center (DARC Labs), Pasig City, Philippines
- Computational Interdisciplinary Research Laboratories (CINTERLabs), University of the Philippines Los Baños, Los Baños, Philippines
| | - Mojhune Gabriel Manzanillo
- Data-Driven Research Laboratory (DARE Lab), Institute of Mathematical Sciences and Physics, University of the Philippines Los Baños, Los Baños, Philippines
- Domingo Artificial Intelligence Research Center (DARC Labs), Pasig City, Philippines
- Computational Interdisciplinary Research Laboratories (CINTERLabs), University of the Philippines Los Baños, Los Baños, Philippines
| | - Joverlyn Gaudillo
- Data-Driven Research Laboratory (DARE Lab), Institute of Mathematical Sciences and Physics, University of the Philippines Los Baños, Los Baños, Philippines
- Domingo Artificial Intelligence Research Center (DARC Labs), Pasig City, Philippines
- Computational Interdisciplinary Research Laboratories (CINTERLabs), University of the Philippines Los Baños, Los Baños, Philippines
| | | | - Mario Domingo
- Domingo Artificial Intelligence Research Center (DARC Labs), Pasig City, Philippines
| | - Beatrice Tiangco
- National Institute of Health, College of Medicine, University of the Philippines, Manila, Philippines
- Division of Medicine, The Medical City, Pasig City, Philippines
| | - Jason Albia
- Data-Driven Research Laboratory (DARE Lab), Institute of Mathematical Sciences and Physics, University of the Philippines Los Baños, Los Baños, Philippines
- Domingo Artificial Intelligence Research Center (DARC Labs), Pasig City, Philippines
- Computational Interdisciplinary Research Laboratories (CINTERLabs), University of the Philippines Los Baños, Los Baños, Philippines
| |
Collapse
|
382
|
Backdoor Attacks to Deep Neural Network-Based System for COVID-19 Detection from Chest X-ray Images. APPLIED SCIENCES-BASEL 2021. [DOI: 10.3390/app11209556] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/15/2022]
Abstract
Open-source deep neural networks (DNNs) for medical imaging are significant in emergent situations, such as during the pandemic of the 2019 novel coronavirus disease (COVID-19), since they accelerate the development of high-performance DNN-based systems. However, adversarial attacks are not negligible during open-source development. Since DNNs are used as computer-aided systems for COVID-19 screening from radiography images, we investigated the vulnerability of the COVID-Net model, a representative open-source DNN for COVID-19 detection from chest X-ray images to backdoor attacks that modify DNN models and cause their misclassification when a specific trigger input is added. The results showed that backdoors for both non-targeted attacks, for which DNNs classify inputs into incorrect labels, and targeted attacks, for which DNNs classify inputs into a specific target class, could be established in the COVID-Net model using a small trigger and small fraction of training data. Moreover, the backdoors were effective for models fine-tuned from the backdoored COVID-Net models, although the performance of non-targeted attacks was limited. This indicated that backdoored models could be spread via fine-tuning (thereby becoming a significant security threat). The findings showed that emphasis is required on open-source development and practical applications of DNNs for COVID-19 detection.
Collapse
|
383
|
Public Covid-19 X-ray datasets and their impact on model bias - A systematic review of a significant problem. Med Image Anal 2021; 74:102225. [PMID: 34597937 PMCID: PMC8479314 DOI: 10.1016/j.media.2021.102225] [Citation(s) in RCA: 30] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2021] [Revised: 08/29/2021] [Accepted: 09/02/2021] [Indexed: 12/23/2022]
Abstract
Computer-aided-diagnosis and stratification of COVID-19 based on chest X-ray suffers from weak bias assessment and limited quality-control. Undetected bias induced by inappropriate use of datasets, and improper consideration of confounders prevents the translation of prediction models into clinical practice. By adopting established tools for model evaluation to the task of evaluating datasets, this study provides a systematic appraisal of publicly available COVID-19 chest X-ray datasets, determining their potential use and evaluating potential sources of bias. Only 9 out of more than a hundred identified datasets met at least the criteria for proper assessment of risk of bias and could be analysed in detail. Remarkably most of the datasets utilised in 201 papers published in peer-reviewed journals, are not among these 9 datasets, thus leading to models with high risk of bias. This raises concerns about the suitability of such models for clinical use. This systematic review highlights the limited description of datasets employed for modelling and aids researchers to select the most suitable datasets for their task.
Collapse
|
384
|
Abdelwhab Ouahab. Multimodal Convolutional Neural Networks for Detection of Covid-19 Using Chest X-Ray and CT Images. OPTICAL MEMORY AND NEURAL NETWORKS 2021. [PMCID: PMC8715284 DOI: 10.3103/s1060992x21040044] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
Abstract
The Covid-19 was first appeared in 2019 in Wuhan, China. It widely and rapidly expanded all over the world. Since then, it has had a strong effect on people’s daily lives, the world economy and the public health. The fast prediction of Covid-19 can assist the medicine to choose the right treatment. In this paper, we propose a classification of Covid-19 using Models based on a Convolutional Neural Network (CNN). We propose two models to detect Covid-19. The first one uses CNN with CT or X-ray images separately. The second uses CNN with both CT and X-ray images at the same time. The used datasets contain X-ray and CT images divided into three classes which are Covid-19, Normal and Pneumonia. Each type image class has 1045 images for training and 300 for testing. All these data sets are available in Kaggle repository. In order to evaluate the proposed models, we calculate the confusion matrix, the accuracy, precision, recall and F1 score. The model that uses CNN with both X-ray and CT images of 0.99 achieves the best accuracy. We deduced that using CT images is more efficient than using X-ray images to predict Covid-19. The combination of the CT and X-ray images to detect Covid-19 is more efficient than using only CT or X-ray images. The proposed models could effectively assist the radiologists in predicting Covid-19.
Collapse
|
385
|
Wu T, Tang C, Xu M, Hong N, Lei Z. ULNet for the detection of coronavirus (COVID-19) from chest X-ray images. Comput Biol Med 2021; 137:104834. [PMID: 34507159 PMCID: PMC8418052 DOI: 10.1016/j.compbiomed.2021.104834] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2021] [Revised: 08/27/2021] [Accepted: 08/31/2021] [Indexed: 12/21/2022]
Abstract
Novel coronavirus disease 2019 (COVID-19) is an infectious disease that spreads very rapidly and threatens the health of billions of people worldwide. With the number of cases increasing rapidly, most countries are facing the problem of a shortage of testing kits and resources, and it is necessary to use other diagnostic methods as an alternative to these test kits. In this paper, we propose a convolutional neural network (CNN) model (ULNet) to detect COVID-19 using chest X-ray images. The proposed architecture is constructed by adding a new downsampling side, skip connections and fully connected layers on the basis of U-net. Because the shape of the network is similar to UL, it is named ULNet. This model is trained and tested on a publicly available Kaggle dataset (consisting of a combination of 219 COVID-19, 1314 normal and 1345 viral pneumonia chest X-ray images), including binary classification (COVID-19 vs. Normal) and multiclass classification (COVID-19 vs. Normal vs. Viral Pneumonia). The accuracy of the proposed model in the detection of COVID-19 in the binary-class and multiclass tasks is 99.53% and 95.35%, respectively. Based on these promising results, this method is expected to help doctors diagnose and detect COVID-19. Overall, our ULNet provides a quick method for identifying patients with COVID-19, which is conducive to the control of the COVID-19 pandemic.
Collapse
Affiliation(s)
- Tianbo Wu
- School of Electrical and Information Engineering, Tianjin University, Tianjin, 300072, China
| | - Chen Tang
- School of Electrical and Information Engineering, Tianjin University, Tianjin, 300072, China.
| | - Min Xu
- School of Electrical and Information Engineering, Tianjin University, Tianjin, 300072, China
| | - Nian Hong
- School of Electrical and Information Engineering, Tianjin University, Tianjin, 300072, China
| | - Zhenkun Lei
- State Key Laboratory Analysis for Industrial Equipment, Dalian University of Technology, Dalian, 116024, China
| |
Collapse
|
386
|
Khan SH, Sohail A, Khan A, Hassan M, Lee YS, Alam J, Basit A, Zubair S. COVID-19 detection in chest X-ray images using deep boosted hybrid learning. Comput Biol Med 2021; 137:104816. [PMID: 34482199 PMCID: PMC8403339 DOI: 10.1016/j.compbiomed.2021.104816] [Citation(s) in RCA: 27] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2021] [Revised: 08/16/2021] [Accepted: 08/26/2021] [Indexed: 12/24/2022]
Abstract
The new emerging COVID-19, declared a pandemic disease, has affected millions of human lives and caused a massive burden on healthcare centers. Therefore, a quick, accurate, and low-cost computer-based tool is required to timely detect and treat COVID-19 patients. In this work, two new deep learning frameworks: Deep Hybrid Learning (DHL) and Deep Boosted Hybrid Learning (DBHL), is proposed for effective COVID-19 detection in X-ray dataset. In the proposed DHL framework, the representation learning ability of the two developed COVID-RENet-1 & 2 models is exploited individually through a machine learning (ML) classifier. In COVID-RENet models, Region and Edge-based operations are carefully applied to learn region homogeneity and extract boundaries features. While in the case of the proposed DBHL framework, COVID-RENet-1 & 2 are fine-tuned using transfer learning on the chest X-rays. Furthermore, deep feature spaces are generated from the penultimate layers of the two models and then concatenated to get a single enriched boosted feature space. A conventional ML classifier exploits the enriched feature space to achieve better COVID-19 detection performance. The proposed COVID-19 detection frameworks are evaluated on radiologist's authenticated chest X-ray data, and their performance is compared with the well-established CNNs. It is observed through experiments that the proposed DBHL framework, which merges the two-deep CNN feature spaces, yields good performance (accuracy: 98.53%, sensitivity: 0.99, F-score: 0.98, and precision: 0.98). Furthermore, a web-based interface is developed, which takes only 5-10s to detect COVID-19 in each unseen chest X-ray image. This web-predictor is expected to help early diagnosis, save precious lives, and thus positively impact society.
Collapse
Affiliation(s)
- Saddam Hussain Khan
- Pattern Recognition Lab, Department of Computer & Information Sciences, Pakistan Institute of Engineering & Applied Sciences, Nilore, Islamabad, 45650, Pakistan; PIEAS Artificial Intelligence Center (PAIC), Pakistan Institute of Engineering & Applied Sciences, Nilore, Islamabad, 45650, Pakistan.
| | - Anabia Sohail
- Pattern Recognition Lab, Department of Computer & Information Sciences, Pakistan Institute of Engineering & Applied Sciences, Nilore, Islamabad, 45650, Pakistan; PIEAS Artificial Intelligence Center (PAIC), Pakistan Institute of Engineering & Applied Sciences, Nilore, Islamabad, 45650, Pakistan.
| | - Asifullah Khan
- Pattern Recognition Lab, Department of Computer & Information Sciences, Pakistan Institute of Engineering & Applied Sciences, Nilore, Islamabad, 45650, Pakistan; PIEAS Artificial Intelligence Center (PAIC), Pakistan Institute of Engineering & Applied Sciences, Nilore, Islamabad, 45650, Pakistan; Center for Mathematical Sciences, Pakistan Institute of Engineering & Applied Sciences, Nilore, Islamabad, 45650, Pakistan.
| | - Mehdi Hassan
- Department of Computer Science, Air University, Islamabad, Pakistan.
| | - Yeon Soo Lee
- Department of Biomedical Engineering, College of Medical Science, Catholic University of Daegu, South Korea.
| | | | - Abdul Basit
- TPD, Pakistan Institute of Nuclear Science and Technology, Nilore, Islamabad, 45650, Pakistan.
| | - Saima Zubair
- Islamabad Institute of Reproduce Medicine, Pakistan.
| |
Collapse
|
387
|
A Hybrid Deep Learning Approach for COVID-19 Diagnosis via CT and X-ray Medical Images. IOCA 2021 2021. [DOI: 10.3390/ioca2021-10909] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/22/2023]
|
388
|
COV-VGX: An automated COVID-19 detection system using X-ray images and transfer learning. INFORMATICS IN MEDICINE UNLOCKED 2021; 26:100741. [PMID: 34549079 PMCID: PMC8445760 DOI: 10.1016/j.imu.2021.100741] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/27/2021] [Revised: 09/14/2021] [Accepted: 09/15/2021] [Indexed: 12/05/2022] Open
Abstract
Coronavirus (COVID-19) has been one of the most dangerous and acute deadly diseases across the world recently. Researchers are trying to develop automated and feasible COVID-19 detection systems with the help of deep neural networks, machine learning techniques, etc. In this paper, a deep learning-based COVID-19 detection system called COV-VGX is proposed that contributes to detecting coronavirus disease automatically using chest X-ray images. The system introduces two types of classifiers, namely, a multiclass classifier that automatically predicts coronavirus, pneumonia, and normal classes and a binary classifier that predicts coronavirus and pneumonia classes. Using transfer learning, a deep CNN model is proposed to extract distinct and high-level features from X-ray images in collaboration with the pretrained model VGG-16. Despite the limitation of the COVID-19 dataset, the model is evaluated with sufficient COVID-19 images. Extensive experiments for multiclass classifier have achieved 98.91% accuracy, 97.31% precision, 99.50% recall, 98.39% F1-score, while 99.37% accuracy, 98.76% precision, 100% recall, 99.38% F1-score for binary classifier. The proposed system can contribute a lot in diagnosing COVID-19 effectively in the medical field.
Collapse
|
389
|
A Histogram-Based Low-Complexity Approach for the Effective Detection of COVID-19 Disease from CT and X-ray Images. APPLIED SCIENCES-BASEL 2021. [DOI: 10.3390/app11198867] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
Abstract
The global COVID-19 pandemic certainly has posed one of the more difficult challenges for researchers in the current century. The development of an automatic diagnostic tool, able to detect the disease in its early stage, could undoubtedly offer a great advantage to the battle against the pandemic. In this regard, most of the research efforts have been focused on the application of Deep Learning (DL) techniques to chest images, including traditional chest X-rays (CXRs) and Computed Tomography (CT) scans. Although these approaches have demonstrated their effectiveness in detecting the COVID-19 disease, they are of huge computational complexity and require large datasets for training. In addition, there may not exist a large amount of COVID-19 CXRs and CT scans available to researchers. To this end, in this paper, we propose an approach based on the evaluation of the histogram from a common class of images that is considered as the target. A suitable inter-histogram distance measures how this target histogram is far from the histogram evaluated on a test image: if this distance is greater than a threshold, the test image is labeled as anomaly, i.e., the scan belongs to a patient affected by COVID-19 disease. Extensive experimental results and comparisons with some benchmark state-of-the-art methods support the effectiveness of the developed approach, as well as demonstrate that, at least when the images of the considered datasets are homogeneous enough (i.e., a few outliers are present), it is not really needed to resort to complex-to-implement DL techniques, in order to attain an effective detection of the COVID-19 disease. Despite the simplicity of the proposed approach, all the considered metrics (i.e., accuracy, precision, recall, and F-measure) attain a value of 1.0 under the selected datasets, a result comparable to the corresponding state-of-the-art DNN approaches, but with a remarkable computational simplicity.
Collapse
|
390
|
Taresh MM, Zhu N, Ali TAA, Alghaili M, Hameed AS, Mutar ML. KL-MOB: automated COVID-19 recognition using a novel approach based on image enhancement and a modified MobileNet CNN. PeerJ Comput Sci 2021; 7:e694. [PMID: 34616885 PMCID: PMC8459788 DOI: 10.7717/peerj-cs.694] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/13/2021] [Accepted: 08/05/2021] [Indexed: 06/13/2023]
Abstract
The emergence of the novel coronavirus pneumonia (COVID-19) pandemic at the end of 2019 led to worldwide chaos. However, the world breathed a sigh of relief when a few countries announced the development of a vaccine and gradually began to distribute it. Nevertheless, the emergence of another wave of this pandemic returned us to the starting point. At present, early detection of infected people is the paramount concern of both specialists and health researchers. This paper proposes a method to detect infected patients through chest x-ray images by using the large dataset available online for COVID-19 (COVIDx), which consists of 2128 X-ray images of COVID-19 cases, 8,066 normal cases, and 5,575 cases of pneumonia. A hybrid algorithm is applied to improve image quality before undertaking neural network training. This algorithm combines two different noise-reduction filters in the image, followed by a contrast enhancement algorithm. To detect COVID-19, we propose a novel convolution neural network (CNN) architecture called KL-MOB (COVID-19 detection network based on the MobileNet structure). The performance of KL-MOB is boosted by adding the Kullback-Leibler (KL) divergence loss function when trained from scratch. The KL divergence loss function is adopted for content-based image retrieval and fine-grained classification to improve the quality of image representation. The results are impressive: the overall benchmark accuracy, sensitivity, specificity, and precision are 98.7%, 98.32%, 98.82% and 98.37%, respectively. These promising results should help other researchers develop innovative methods to aid specialists. The tremendous potential of the method proposed herein can also be used to detect COVID-19 quickly and safely in patients throughout the world.
Collapse
Affiliation(s)
| | - Ningbo Zhu
- College of Information Science and Engineering, Hunan University, Changsha, Hunan, China
| | - Talal Ahmed Ali Ali
- College of Information Science and Engineering, Hunan University, Changsha, Hunan, China
| | - Mohammed Alghaili
- College of Information Science and Engineering, Hunan University, Changsha, Hunan, China
| | - Asaad Shakir Hameed
- Department of Mathematics, General Directorate of Thi-Qar Education, Ministry of Education, Thi-Qar, Iraq
| | - Modhi Lafta Mutar
- Department of Mathematics, General Directorate of Thi-Qar Education, Ministry of Education, Thi-Qar, Iraq
| |
Collapse
|
391
|
Khandakar A, Chowdhury MEH, Ibne Reaz MB, Md Ali SH, Hasan MA, Kiranyaz S, Rahman T, Alfkey R, Bakar AAA, Malik RA. A machine learning model for early detection of diabetic foot using thermogram images. Comput Biol Med 2021; 137:104838. [PMID: 34534794 DOI: 10.1016/j.compbiomed.2021.104838] [Citation(s) in RCA: 41] [Impact Index Per Article: 10.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2021] [Revised: 08/31/2021] [Accepted: 09/01/2021] [Indexed: 10/20/2022]
Abstract
Diabetes foot ulceration (DFU) and amputation are a cause of significant morbidity. The prevention of DFU may be achieved by the identification of patients at risk of DFU and the institution of preventative measures through education and offloading. Several studies have reported that thermogram images may help to detect an increase in plantar temperature prior to DFU. However, the distribution of plantar temperature may be heterogeneous, making it difficult to quantify and utilize to predict outcomes. We have compared a machine learning-based scoring technique with feature selection and optimization techniques and learning classifiers to several state-of-the-art Convolutional Neural Networks (CNNs) on foot thermogram images and propose a robust solution to identify the diabetic foot. A comparatively shallow CNN model, MobilenetV2 achieved an F1 score of ∼95% for a two-feet thermogram image-based classification and the AdaBoost Classifier used 10 features and achieved an F1 score of 97%. A comparison of the inference time for the best-performing networks confirmed that the proposed algorithm can be deployed as a smartphone application to allow the user to monitor the progression of the DFU in a home setting.
Collapse
Affiliation(s)
- Amith Khandakar
- Department of Electrical Engineering, Qatar University, Doha, 2713, Qatar; Dept. of Electrical, Electronics and Systems Engineering, Universiti Kebangsaan Malaysia, Bangi, Selangor, 43600, Malaysia
| | | | - Mamun Bin Ibne Reaz
- Dept. of Electrical, Electronics and Systems Engineering, Universiti Kebangsaan Malaysia, Bangi, Selangor, 43600, Malaysia.
| | - Sawal Hamid Md Ali
- Dept. of Electrical, Electronics and Systems Engineering, Universiti Kebangsaan Malaysia, Bangi, Selangor, 43600, Malaysia
| | - Md Anwarul Hasan
- Department of Industrial and Mechanical Engineering, Qatar University, Doha, 2713, Qatar
| | - Serkan Kiranyaz
- Department of Electrical Engineering, Qatar University, Doha, 2713, Qatar
| | - Tawsifur Rahman
- Department of Electrical Engineering, Qatar University, Doha, 2713, Qatar
| | - Rashad Alfkey
- Acute Care Surgery and General Surgery, Hamad Medical Corporation, Qatar
| | - Ahmad Ashrif A Bakar
- Dept. of Electrical, Electronics and Systems Engineering, Universiti Kebangsaan Malaysia, Bangi, Selangor, 43600, Malaysia
| | | |
Collapse
|
392
|
Li Q, Ning J, Yuan J, Xiao L. A depthwise separable dense convolutional network with convolution block attention module for COVID-19 diagnosis on CT scans. Comput Biol Med 2021; 137:104837. [PMID: 34530335 PMCID: PMC8425669 DOI: 10.1016/j.compbiomed.2021.104837] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2021] [Revised: 08/16/2021] [Accepted: 08/31/2021] [Indexed: 12/31/2022]
Abstract
Coronavirus disease 2019 (COVID-19) has caused more than 3 million deaths and infected more than 170 million individuals all over the world. Rapid identification of patients with COVID-19 is the key to control transmission and prevent depletion of hospitals. Several networks have been proposed to assist radiologists in diagnosing COVID-19 based on CT scans. However, CTs used in these studies are unavailable for other researchers to do deeper extensions due to privacy concerns. Furthermore, these networks are too heavy-weighted to satisfy the general trend applying on a computationally limited platform. In this paper, we aim to solve these two problems. Firstly, we establish an available dataset COVID-CTx, which contains 828 CT scans positive for COVID-19 across 324 patient cases from three open access data repositories. To our knowledge, it has the largest number of publicly available COVID-19 positive cases compared to other public datasets. Secondly, we propose a light-weighted hybrid neural network: Depthwise Separable Dense Convolutional Network with Convolution Block Attention Module (AM-SdenseNet). AM-SdenseNet synergistically integrates Convolutional Block Attention Module with depthwise separable convolutions to learn powerful feature representations while reducing the parameters to overcome the overfitting problem. Through experiments, we demonstrate the superior performance of our proposed AM-SdenseNet compared with several state-of-the-art baselines. The excellent performance of AM-SdenseNet can improve the speed and accuracy of COVID-19 diagnosis, which is extremely useful to control the spreading of infection.
Collapse
Affiliation(s)
- Qian Li
- Research Center for Ultrasonics and Technologies, Institute of Acoustics, Chinese Academy of Sciences, Beijing, 100190, China; University of Chinese Academy of Sciences, Beijing, 100049, China.
| | - Jiangbo Ning
- Research Center for Ultrasonics and Technologies, Institute of Acoustics, Chinese Academy of Sciences, Beijing, 100190, China.
| | - Jianping Yuan
- Research Center for Ultrasonics and Technologies, Institute of Acoustics, Chinese Academy of Sciences, Beijing, 100190, China.
| | - Ling Xiao
- Research Center for Ultrasonics and Technologies, Institute of Acoustics, Chinese Academy of Sciences, Beijing, 100190, China.
| |
Collapse
|
393
|
Bhowal P, Sen S, Yoon JH, Geem ZW, Sarkar R. Choquet Integral and Coalition Game-based Ensemble of Deep Learning Models for COVID-19 Screening from Chest X-ray Images. IEEE J Biomed Health Inform 2021; 25:4328-4339. [PMID: 34499608 DOI: 10.1109/jbhi.2021.3111415] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Under the present circumstances, when we are still under the threat of different strains of coronavirus, and since the most widely used method for COVID-19 detection, RT-PCR is a tedious and time-consuming manual procedure with poor precision, the application of Artificial Intelligence (AI) and Computer-Aided Diagnosis (CAD) is inevitable. In this work, we have analyzed Chest X-ray (CXR) images for the detection of the coronavirus. The primary agenda of this proposed research study is to leverage the classification performance of the deep learning models using ensemble learning. Many papers have proposed different ensemble learning techniques in this field, some methods using aggregation functions like Weighted Arithmetic Mean (WAM) among others. However, none of these methods take into consideration the decisions that subsets of the classifiers take. In this paper, we have applied Choquet integral for ensemble and propose a novel method for the evaluation of fuzzy measures using Coalition Game Theory, Information Theory, and Lambda fuzzy approximation. Three different sets of Fuzzy Measures are calculated using three different weighting schemes along with information theory and coalition game theory. Using these three sets of fuzzy measures three Choquet Integrals are calculated and their decisions are finally combined.We have created a database by combining several image repositories developed recently. Impressive results on the newly developed dataset and the challenging COVIDx dataset support the efficacy and robustness of the proposed method. To the best of our knowledge, our experimental results outperform many recently proposed methods. Source code available at https://github.com/subhankar01/Covid-Chestxray-lambda-fuzzy.
Collapse
|
394
|
Khasawneh N, Fraiwan M, Fraiwan L, Khassawneh B, Ibnian A. Detection of COVID-19 from Chest X-ray Images Using Deep Convolutional Neural Networks. SENSORS (BASEL, SWITZERLAND) 2021; 21:5940. [PMID: 34502829 PMCID: PMC8434649 DOI: 10.3390/s21175940] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/29/2021] [Revised: 08/19/2021] [Accepted: 09/01/2021] [Indexed: 12/24/2022]
Abstract
The COVID-19 global pandemic has wreaked havoc on every aspect of our lives. More specifically, healthcare systems were greatly stretched to their limits and beyond. Advances in artificial intelligence have enabled the implementation of sophisticated applications that can meet clinical accuracy requirements. In this study, customized and pre-trained deep learning models based on convolutional neural networks were used to detect pneumonia caused by COVID-19 respiratory complications. Chest X-ray images from 368 confirmed COVID-19 patients were collected locally. In addition, data from three publicly available datasets were used. The performance was evaluated in four ways. First, the public dataset was used for training and testing. Second, data from the local and public sources were combined and used to train and test the models. Third, the public dataset was used to train the model and the local data were used for testing only. This approach adds greater credibility to the detection models and tests their ability to generalize to new data without overfitting the model to specific samples. Fourth, the combined data were used for training and the local dataset was used for testing. The results show a high detection accuracy of 98.7% with the combined dataset, and most models handled new data with an insignificant drop in accuracy.
Collapse
Affiliation(s)
- Natheer Khasawneh
- Department of Software Engineering, Jordan University of Science and Technology, P.O. Box 3030, Irbid 22110, Jordan
| | - Mohammad Fraiwan
- Department of Computer Engineering, Jordan University of Science and Technology, P.O. Box 3030, Irbid 22110, Jordan;
| | - Luay Fraiwan
- Department of Biomedical Engineering, Jordan University of Science and Technology, P.O. Box 3030, Irbid 22110, Jordan;
| | - Basheer Khassawneh
- Department of Internal Medicine, Jordan University of Science and Technology, P.O. Box 3030, Irbid 22110, Jordan; (B.K.); (A.I.)
| | - Ali Ibnian
- Department of Internal Medicine, Jordan University of Science and Technology, P.O. Box 3030, Irbid 22110, Jordan; (B.K.); (A.I.)
| |
Collapse
|
395
|
ARDANEH M, TAVAKOLİ-FAR F, PAYANDEH A, AMİRİ-ARDEKANİ E. How Screening plays role in Covid-19 management? Results of a Cross-Sectional Study on Covid-19 patients signs and symptoms. TURKISH JOURNAL OF INTERNAL MEDICINE 2021. [DOI: 10.46310/tjim.984243] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/08/2023] Open
|
396
|
Zhang X, Wang G, Zhao S. COVSeg-NET: A deep convolution neural network for COVID-19 lung CT image segmentation. INTERNATIONAL JOURNAL OF IMAGING SYSTEMS AND TECHNOLOGY 2021; 31:1071-1086. [PMID: 34226795 PMCID: PMC8242523 DOI: 10.1002/ima.22611] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/05/2020] [Revised: 03/23/2021] [Accepted: 05/19/2021] [Indexed: 06/13/2023]
Abstract
COVID-19 is a new type of respiratory infectious disease that poses a serious threat to the survival of human beings all over the world. Using artificial intelligence technology to analyze lung images of COVID-19 patients can achieve rapid and effective detection. This study proposes a COVSeg-NET model that can accurately segment ground glass opaque lesions in COVID-19 lung CT images. The COVSeg-NET model is based on the fully convolutional neural network model structure, which mainly includes convolutional layer, nonlinear unit activation function, maximum pooling layer, batch normalization layer, merge layer, flattening layer, sigmoid layer, and so forth. Through experiments and evaluation results, it can be seen that the dice coefficient, sensitivity, and specificity of the COVSeg-NET model are 0.561, 0.447, and 0.996 respectively, which are more advanced than other deep learning methods. The COVSeg-NET model can use a smaller training set and shorter test time to obtain better segmentation results.
Collapse
Affiliation(s)
- XiaoQing Zhang
- Taizhou Institute of Science and Technology, Nanjing University of Science and TechnologyNo.8, Meilan East RoadTaizhouChina
| | - GuangYu Wang
- College of Information Science and Technology, Donghua UniversityShanghaiChina
| | - Shu‐Guang Zhao
- College of Information Science and Technology, Donghua UniversityShanghaiChina
| |
Collapse
|
397
|
Wang X, Jiang L, Li L, Xu M, Deng X, Dai L, Xu X, Li T, Guo Y, Wang Z, Dragotti PL. Joint Learning of 3D Lesion Segmentation and Classification for Explainable COVID-19 Diagnosis. IEEE TRANSACTIONS ON MEDICAL IMAGING 2021; 40:2463-2476. [PMID: 33983881 PMCID: PMC8544955 DOI: 10.1109/tmi.2021.3079709] [Citation(s) in RCA: 22] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/10/2021] [Revised: 03/30/2021] [Accepted: 05/09/2021] [Indexed: 05/13/2023]
Abstract
Given the outbreak of COVID-19 pandemic and the shortage of medical resource, extensive deep learning models have been proposed for automatic COVID-19 diagnosis, based on 3D computed tomography (CT) scans. However, the existing models independently process the 3D lesion segmentation and disease classification, ignoring the inherent correlation between these two tasks. In this paper, we propose a joint deep learning model of 3D lesion segmentation and classification for diagnosing COVID-19, called DeepSC-COVID, as the first attempt in this direction. Specifically, we establish a large-scale CT database containing 1,805 3D CT scans with fine-grained lesion annotations, and reveal 4 findings about lesion difference between COVID-19 and community acquired pneumonia (CAP). Inspired by our findings, DeepSC-COVID is designed with 3 subnets: a cross-task feature subnet for feature extraction, a 3D lesion subnet for lesion segmentation, and a classification subnet for disease diagnosis. Besides, the task-aware loss is proposed for learning the task interaction across the 3D lesion and classification subnets. Different from all existing models for COVID-19 diagnosis, our model is interpretable with fine-grained 3D lesion distribution. Finally, extensive experimental results show that the joint learning framework in our model significantly improves the performance of 3D lesion segmentation and disease classification in both efficiency and efficacy.
Collapse
Affiliation(s)
- Xiaofei Wang
- School of Electronic and Information EngineeringBeihang UniversityBeijing100191China
| | - Lai Jiang
- School of Electronic and Information EngineeringBeihang UniversityBeijing100191China
| | - Liu Li
- Department of ComputingImperial College LondonLondonSW7 2AZU.K.
| | - Mai Xu
- School of Electronic and Information EngineeringBeihang UniversityBeijing100191China
| | - Xin Deng
- School of Cyber Science and TechnologyBeihang UniversityBeijing100191China
| | - Lisong Dai
- Liyuan HospitalHuazhong University of Science and TechnologyWuhan430077China
| | - Xiangyang Xu
- Liyuan HospitalHuazhong University of Science and TechnologyWuhan430077China
| | - Tianyi Li
- School of Electronic and Information EngineeringBeihang UniversityBeijing100191China
| | - Yichen Guo
- School of Electronic and Information EngineeringBeihang UniversityBeijing100191China
| | - Zulin Wang
- School of Electronic and Information EngineeringBeihang UniversityBeijing100191China
| | - Pier Luigi Dragotti
- Department of Electrical and Electronic EngineeringImperial College LondonLondonSW7 2AZU.K.
| |
Collapse
|
398
|
Dixit A, Mani A, Bansal R. CoV2-Detect-Net: Design of COVID-19 prediction model based on hybrid DE-PSO with SVM using chest X-ray images. Inf Sci (N Y) 2021; 571:676-692. [PMID: 33840820 PMCID: PMC8021529 DOI: 10.1016/j.ins.2021.03.062] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2020] [Revised: 03/21/2021] [Accepted: 03/29/2021] [Indexed: 12/16/2022]
Abstract
For Covid-19 suspected cases, it is critical to diagnose them accurately and rapidly so that they can be isolated and provided with required medical care. A self-learning automation model will be helpful to diagnose the COVID-19 suspected individual using chest X-rays. AI based designs, which utilizes chest X-rays, have been recently proposed for the detection of COVID-19. However, these approaches are either using non-public database or having a complex design. In this study we have proposed a novel framework for real time detection of coronavirus patients without manual intervention. In our framework, we have introduced a 3-step process in which initially K-means clustering, and feature extraction is performed as a data pre-processing step. In the second step, the selected features are optimized by a novel feature optimization approach based on hybrid differential evolution algorithm and particle swarm optimization. The optimized features are then feed forwarded to SVM classifier. Empirical results show that our proposed model is able to achieve 99.34% accuracy. This shows that our model is robust and sustainable in diagnosis of COVID-19 infected individual.
Collapse
Affiliation(s)
- Abhishek Dixit
- Department of Computer Science, Amity School of Engineering and Technology, Amity University, Noida, Uttar Pradesh, India
| | - Ashish Mani
- Department of EEE, Amity School of Engineering and Technology, Amity University, Noida, Uttar Pradesh, India
| | - Rohit Bansal
- Department of Management Studies, Rajiv Gandhi Institute of Petroleum Technology, Rae Bareli, Uttar Pradesh, India
| |
Collapse
|
399
|
Rehouma R, Buchert M, Chen YP. Machine learning for medical imaging-based COVID-19 detection and diagnosis. INT J INTELL SYST 2021; 36:5085-5115. [PMID: 38607786 PMCID: PMC8242401 DOI: 10.1002/int.22504] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/18/2021] [Revised: 04/15/2021] [Accepted: 05/11/2021] [Indexed: 12/15/2022]
Abstract
The novel coronavirus disease 2019 (COVID-19) is considered to be a significant health challenge worldwide because of its rapid human-to-human transmission, leading to a rise in the number of infected people and deaths. The detection of COVID-19 at the earliest stage is therefore of paramount importance for controlling the pandemic spread and reducing the mortality rate. The real-time reverse transcription-polymerase chain reaction, the primary method of diagnosis for coronavirus infection, has a relatively high false negative rate while detecting early stage disease. Meanwhile, the manifestations of COVID-19, as seen through medical imaging methods such as computed tomography (CT), radiograph (X-ray), and ultrasound imaging, show individual characteristics that differ from those of healthy cases or other types of pneumonia. Machine learning (ML) applications for COVID-19 diagnosis, detection, and the assessment of disease severity based on medical imaging have gained considerable attention. Herein, we review the recent progress of ML in COVID-19 detection with a particular focus on ML models using CT and X-ray images published in high-ranking journals, including a discussion of the predominant features of medical imaging in patients with COVID-19. Deep Learning algorithms, particularly convolutional neural networks, have been utilized widely for image segmentation and classification to identify patients with COVID-19 and many ML modules have achieved remarkable predictive results using datasets with limited sample sizes.
Collapse
Affiliation(s)
- Rokaya Rehouma
- School of Cancer MedicineLa Trobe UniversityMelbourneVictoriaAustralia
| | - Michael Buchert
- School of Cancer MedicineLa Trobe UniversityMelbourneVictoriaAustralia
- Tumour Microenvironment and Cancer Signaling GroupOlivia Newton‐John Cancer Research InstituteMelbourneVictoriaAustralia
| | - Yi‐Ping Phoebe Chen
- Department of Computer Science and Information TechnologyLa Trobe UniversityMelbourneVictoriaAustralia
| |
Collapse
|
400
|
Tang S, Wang C, Nie J, Kumar N, Zhang Y, Xiong Z, Barnawi A. EDL-COVID: Ensemble Deep Learning for COVID-19 Case Detection From Chest X-Ray Images. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS 2021; 17:6539-6549. [PMID: 37981915 PMCID: PMC8545018 DOI: 10.1109/tii.2021.3057683] [Citation(s) in RCA: 52] [Impact Index Per Article: 13.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/07/2020] [Revised: 12/23/2020] [Accepted: 01/20/2021] [Indexed: 11/16/2023]
Abstract
Effective screening of COVID-19 cases has been becoming extremely important to mitigate and stop the quick spread of the disease during the current period of COVID-19 pandemic worldwide. In this article, we consider radiology examination of using chest X-ray images, which is among the effective screening approaches for COVID-19 case detection. Given deep learning is an effective tool and framework for image analysis, there have been lots of studies for COVID-19 case detection by training deep learning models with X-ray images. Although some of them report good prediction results, their proposed deep learning models might suffer from overfitting, high variance, and generalization errors caused by noise and a limited number of datasets. Considering ensemble learning can overcome the shortcomings of deep learning by making predictions with multiple models instead of a single model, we propose EDL-COVID, an ensemble deep learning model employing deep learning and ensemble learning. The EDL-COVID model is generated by combining multiple snapshot models of COVID-Net, which has pioneered in an open-sourced COVID-19 case detection method with deep neural network processed chest X-ray images, by employing a proposed weighted averaging ensembling method that is aware of different sensitivities of deep learning models on different classes types. Experimental results show that EDL-COVID offers promising results for COVID-19 case detection with an accuracy of 95%, better than COVID-Net of 93.3%.
Collapse
Affiliation(s)
- Shanjiang Tang
- College of Intelligence, and ComputingTianjin UniversityTianjin300072China
| | - Chunjiang Wang
- College of Intelligence, and ComputingTianjin UniversityTianjin300072China
| | - Jiangtian Nie
- School of Computer Science and EngineeringNanyang Technological UniversitySingapore639798Singapore
| | - Neeraj Kumar
- Department of Computer Science and EngineeringThapar Institute of Engineering and TechnologyPatialaPunjab147004India
- School of Computer ScienceUniversity of Petroleum and Energy StudiesDehradunUttarakhandIndia
- Department of Computer Science and Information EngineeringAsia UniversityTaichung41354Taiwan
| | - Yang Zhang
- School of Computer Science and TechnologyTechnology University of WuhanWuhan430063China
| | - Zehui Xiong
- Pillar of Information Systems Technology and DesignSingapore University of Technology and DesignSingapore639798Singapore
| | - Ahmed Barnawi
- Computing and ITKing Abdulaziz UniversityJeddah21589Saudi Arabia
| |
Collapse
|