1
|
Nalaie K, Herasevich V, Heier LM, Pickering BW, Diedrich D, Lindroth H. Clinician and Visitor Activity Patterns in an Intensive Care Unit Room: A Study to Examine How Ambient Monitoring Can Inform the Measurement of Delirium Severity and Escalation of Care. J Imaging 2024; 10:253. [PMID: 39452416 PMCID: PMC11508238 DOI: 10.3390/jimaging10100253] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2024] [Revised: 09/30/2024] [Accepted: 10/02/2024] [Indexed: 10/26/2024] Open
Abstract
The early detection of the acute deterioration of escalating illness severity is crucial for effective patient management and can significantly impact patient outcomes. Ambient sensing technology, such as computer vision, may provide real-time information that could impact early recognition and response. This study aimed to develop a computer vision model to quantify the number and type (clinician vs. visitor) of people in an intensive care unit (ICU) room, study the trajectory of their movement, and preliminarily explore its relationship with delirium as a marker of illness severity. To quantify the number of people present, we implemented a counting-by-detection supervised strategy using images from ICU rooms. This was accomplished through developing three methods: single-frame, multi-frame, and tracking-to-count. We then explored how the type of person and distribution in the room corresponded to the presence of delirium. Our designed pipeline was tested with a different set of detection models. We report model performance statistics and preliminary insights into the relationship between the number and type of persons in the ICU room and delirium. We evaluated our method and compared it with other approaches, including density estimation, counting by detection, regression methods, and their adaptability to ICU environments.
Collapse
Affiliation(s)
- Keivan Nalaie
- Division of Nursing Research, Department of Nursing, Mayo Clinic, Rochester, MN 55905, USA; (K.N.); (L.M.H.)
- Department of Anesthesiology and Perioperative Medicine, Mayo Clinic, Rochester, MN 55905, USA; (V.H.); (B.W.P.); (D.D.)
| | - Vitaly Herasevich
- Department of Anesthesiology and Perioperative Medicine, Mayo Clinic, Rochester, MN 55905, USA; (V.H.); (B.W.P.); (D.D.)
| | - Laura M. Heier
- Division of Nursing Research, Department of Nursing, Mayo Clinic, Rochester, MN 55905, USA; (K.N.); (L.M.H.)
- School of Nursing, Viterbo University, La Crosse, WI 54601, USA
| | - Brian W. Pickering
- Department of Anesthesiology and Perioperative Medicine, Mayo Clinic, Rochester, MN 55905, USA; (V.H.); (B.W.P.); (D.D.)
| | - Daniel Diedrich
- Department of Anesthesiology and Perioperative Medicine, Mayo Clinic, Rochester, MN 55905, USA; (V.H.); (B.W.P.); (D.D.)
| | - Heidi Lindroth
- Division of Nursing Research, Department of Nursing, Mayo Clinic, Rochester, MN 55905, USA; (K.N.); (L.M.H.)
- Center for Aging Research, Regenstrief Institute, School of Medicine, Indiana University, Indianapolis, IN 46202, USA
- Center for Health Innovation and Implementation Science, School of Medicine, Indiana University, Indianapolis, IN 46202, USA
| |
Collapse
|
2
|
Alazeb A, Chughtai BR, Al Mudawi N, AlQahtani Y, Alonazi M, Aljuaid H, Jalal A, Liu H. Remote intelligent perception system for multi-object detection. Front Neurorobot 2024; 18:1398703. [PMID: 38831877 PMCID: PMC11144911 DOI: 10.3389/fnbot.2024.1398703] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2024] [Accepted: 04/17/2024] [Indexed: 06/05/2024] Open
Abstract
Introduction During the last few years, a heightened interest has been shown in classifying scene images depicting diverse robotic environments. The surge in interest can be attributed to significant improvements in visual sensor technology, which has enhanced image analysis capabilities. Methods Advances in vision technology have a major impact on the areas of multiple object detection and scene understanding. These tasks are an integral part of a variety of technologies, including integrating scenes in augmented reality, facilitating robot navigation, enabling autonomous driving systems, and improving applications in tourist information. Despite significant strides in visual interpretation, numerous challenges persist, encompassing semantic understanding, occlusion, orientation, insufficient availability of labeled data, uneven illumination including shadows and lighting, variation in direction, and object size and changing background. To overcome these challenges, we proposed an innovative scene recognition framework, which proved to be highly effective and yielded remarkable results. First, we perform preprocessing using kernel convolution on scene data. Second, we perform semantic segmentation using UNet segmentation. Then, we extract features from these segmented data using discrete wavelet transform (DWT), Sobel and Laplacian, and textual (local binary pattern analysis). To recognize the object, we have used deep belief network and then find the object-to-object relation. Finally, AlexNet is used to assign the relevant labels to the scene based on recognized objects in the image. Results The performance of the proposed system was validated using three standard datasets: PASCALVOC-12, Cityscapes, and Caltech 101. The accuracy attained on the PASCALVOC-12 dataset exceeds 96% while achieving a rate of 95.90% on the Cityscapes dataset. Discussion Furthermore, the model demonstrates a commendable accuracy of 92.2% on the Caltech 101 dataset. This model showcases noteworthy advancements beyond the capabilities of current models.
Collapse
Affiliation(s)
- Abdulwahab Alazeb
- Department of Computer Science, College of Computer Science and Information System, Najran University, Najran, Saudi Arabia
| | | | - Naif Al Mudawi
- Department of Computer Science, College of Computer Science and Information System, Najran University, Najran, Saudi Arabia
| | - Yahya AlQahtani
- Department of Computer Science, Applied College, King Khalid University, Abha, Saudi Arabia
| | - Mohammed Alonazi
- Department of Information Systems, College of Computer Engineering and Sciences, Prince Sattam bin Abdulaziz University, Al-Kharj, Saudi Arabia
| | - Hanan Aljuaid
- Computer Sciences Department, College of Computer and Information Sciences, Princess Nourah Bint Abdulrahman University (PNU), Riyadh, Saudi Arabia
| | - Ahmad Jalal
- Department of Computer Science, Air University, Islamabad, Pakistan
| | - Hui Liu
- Cognitive Systems Lab, University of Bremen, Bremen, Germany
| |
Collapse
|
3
|
De Ruvo S, Pio G, Vessio G, Volpe V. Forecasting and what-if analysis of new positive COVID-19 cases during the first three waves in Italy. Med Biol Eng Comput 2023:10.1007/s11517-023-02831-0. [PMID: 37316767 DOI: 10.1007/s11517-023-02831-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2022] [Accepted: 03/29/2023] [Indexed: 06/16/2023]
Abstract
The joint exploitation of data related to epidemiological, mobility, and restriction aspects of COVID-19 with machine learning algorithms can support the development of predictive models that can be used to forecast new positive cases and study the impact of more or less severe restrictions. In this work, we integrate heterogeneous data from several sources and solve a multivariate time series forecasting task, specifically targeting the Italian case at both national and regional levels, during the first three waves of the pandemic. The goal is to build a robust predictive model to predict the number of new cases over a given time horizon so that any restrictive actions can be better planned. In addition, we perform a what-if analysis based on the best-identified predictive models to evaluate the impact of specific restrictions on the trend of positive cases. Our focus on the first three waves is motivated by the fact that it represents a typical emergency scenario (when no stable cure or vaccine is available) that may occur when a new pandemic spreads. Our experimental results prove that exploiting the considered heterogeneous data leads to accurate predictive models, reaching a WAPE of 5.75% at the national level. Furthermore, in the subsequent what-if analysis, we observed that strong all-in-one initiatives, such as total lockdowns, may not be adequate, while more specific and targeted solutions should be adopted. The developed models can help policy and decision-makers better plan intervention strategies and retrospectively analyze the effects of the decisions made at different scales. Joint exploitation of data on epidemiological, mobility, and restriction aspects of COVID-19 with machine learning algorithms to learn predictive models to forecast new positive cases.
Collapse
Affiliation(s)
- Serena De Ruvo
- Dept. of Computer Science, University of Bari Aldo Moro, Bari, Italy
| | - Gianvito Pio
- Dept. of Computer Science, University of Bari Aldo Moro, Bari, Italy.
- Big Data Lab, National Interuniversity Consortium for Informatics (CINI), Rome, Italy.
| | - Gennaro Vessio
- Dept. of Computer Science, University of Bari Aldo Moro, Bari, Italy
| | - Vincenzo Volpe
- Dept. of Computer Science, University of Bari Aldo Moro, Bari, Italy
| |
Collapse
|
4
|
Lyu H, Imtiaz A, Zhao Y, Luo J. Human behavior in the time of COVID-19: Learning from big data. Front Big Data 2023; 6:1099182. [PMID: 37091459 PMCID: PMC10118015 DOI: 10.3389/fdata.2023.1099182] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2022] [Accepted: 03/21/2023] [Indexed: 04/09/2023] Open
Abstract
Since the World Health Organization (WHO) characterized COVID-19 as a pandemic in March 2020, there have been over 600 million confirmed cases of COVID-19 and more than six million deaths as of October 2022. The relationship between the COVID-19 pandemic and human behavior is complicated. On one hand, human behavior is found to shape the spread of the disease. On the other hand, the pandemic has impacted and even changed human behavior in almost every aspect. To provide a holistic understanding of the complex interplay between human behavior and the COVID-19 pandemic, researchers have been employing big data techniques such as natural language processing, computer vision, audio signal processing, frequent pattern mining, and machine learning. In this study, we present an overview of the existing studies on using big data techniques to study human behavior in the time of the COVID-19 pandemic. In particular, we categorize these studies into three groups-using big data to measure, model, and leverage human behavior, respectively. The related tasks, data, and methods are summarized accordingly. To provide more insights into how to fight the COVID-19 pandemic and future global catastrophes, we further discuss challenges and potential opportunities.
Collapse
Affiliation(s)
| | | | | | - Jiebo Luo
- Department of Computer Science, University of Rochester, Rochester, NY, United States
| |
Collapse
|
5
|
Eyiokur FI, Kantarcı A, Erakın ME, Damer N, Ofli F, Imran M, Križaj J, Salah AA, Waibel A, Štruc V, Ekenel HK. A survey on computer vision based human analysis in the COVID-19 era. IMAGE AND VISION COMPUTING 2023; 130:104610. [PMID: 36540857 PMCID: PMC9755265 DOI: 10.1016/j.imavis.2022.104610] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/07/2022] [Accepted: 12/11/2022] [Indexed: 06/17/2023]
Abstract
The emergence of COVID-19 has had a global and profound impact, not only on society as a whole, but also on the lives of individuals. Various prevention measures were introduced around the world to limit the transmission of the disease, including face masks, mandates for social distancing and regular disinfection in public spaces, and the use of screening applications. These developments also triggered the need for novel and improved computer vision techniques capable of ( i ) providing support to the prevention measures through an automated analysis of visual data, on the one hand, and ( ii ) facilitating normal operation of existing vision-based services, such as biometric authentication schemes, on the other. Especially important here, are computer vision techniques that focus on the analysis of people and faces in visual data and have been affected the most by the partial occlusions introduced by the mandates for facial masks. Such computer vision based human analysis techniques include face and face-mask detection approaches, face recognition techniques, crowd counting solutions, age and expression estimation procedures, models for detecting face-hand interactions and many others, and have seen considerable attention over recent years. The goal of this survey is to provide an introduction to the problems induced by COVID-19 into such research and to present a comprehensive review of the work done in the computer vision based human analysis field. Particular attention is paid to the impact of facial masks on the performance of various methods and recent solutions to mitigate this problem. Additionally, a detailed review of existing datasets useful for the development and evaluation of methods for COVID-19 related applications is also provided. Finally, to help advance the field further, a discussion on the main open challenges and future research direction is given at the end of the survey. This work is intended to have a broad appeal and be useful not only for computer vision researchers but also the general public.
Collapse
Affiliation(s)
- Fevziye Irem Eyiokur
- Institute for Anthropomatics and Robotics, Karlsruhe Institute of Technology, Karlsruhe, Germany
| | - Alperen Kantarcı
- Department of Computer Engineering, Istanbul Technical University, Istanbul, Turkey
| | - Mustafa Ekrem Erakın
- Department of Computer Engineering, Istanbul Technical University, Istanbul, Turkey
| | - Naser Damer
- Fraunhofer Institute for Computer Graphics Research IGD, Darmstadt, Germany
- Department of Computer Science, TU Darmstadt, Darmstadt, Germany
| | - Ferda Ofli
- Qatar Computing Research Institute, HBKU, Doha, Qatar
| | | | - Janez Križaj
- Faculty of Electrical Engineering, University of Ljubljana, Tržaška cesta 25, 1000 Ljubljana, Slovenia
| | - Albert Ali Salah
- Department of Information and Computing Sciences, Utrecht University, Utrecht, The Netherlands
- Department of Computer Engineering, Bogˇaziçi University, Istanbul, Turkey
| | - Alexander Waibel
- Institute for Anthropomatics and Robotics, Karlsruhe Institute of Technology, Karlsruhe, Germany
- Carnegie Mellon University, Pittsburgh, United States
| | - Vitomir Štruc
- Faculty of Electrical Engineering, University of Ljubljana, Tržaška cesta 25, 1000 Ljubljana, Slovenia
| | - Hazım Kemal Ekenel
- Department of Computer Engineering, Istanbul Technical University, Istanbul, Turkey
| |
Collapse
|
6
|
Aldhahi W, Sull S. Uncertain-CAM: Uncertainty-Based Ensemble Machine Voting for Improved COVID-19 CXR Classification and Explainability. Diagnostics (Basel) 2023; 13:441. [PMID: 36766546 PMCID: PMC9914375 DOI: 10.3390/diagnostics13030441] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/23/2022] [Revised: 01/08/2023] [Accepted: 01/20/2023] [Indexed: 01/27/2023] Open
Abstract
The ongoing coronavirus disease 2019 (COVID-19) pandemic has had a significant impact on patients and healthcare systems across the world. Distinguishing non-COVID-19 patients from COVID-19 patients at the lowest possible cost and in the earliest stages of the disease is a major issue. Additionally, the implementation of explainable deep learning decisions is another issue, especially in critical fields such as medicine. The study presents a method to train deep learning models and apply an uncertainty-based ensemble voting policy to achieve 99% accuracy in classifying COVID-19 chest X-rays from normal and pneumonia-related infections. We further present a training scheme that integrates the cyclic cosine annealing approach with cross-validation and uncertainty quantification that is measured using prediction interval coverage probability (PICP) as final ensemble voting weights. We also propose the Uncertain-CAM technique, which improves deep learning explainability and provides a more reliable COVID-19 classification system. We introduce a new image processing technique to measure the explainability based on ground-truth, and we compared it with the widely adopted Grad-CAM method.
Collapse
Affiliation(s)
| | - Sanghoon Sull
- School of Electrical Engineering, Korea University, 145 Anam-ro, Seongbuk-gu, Seoul 02841, Republic of Korea
| |
Collapse
|
7
|
Deepanshi, Budhiraja I, Garg D, Kumar N, Sharma R. A comprehensive review on variants of SARS-CoVs-2: Challenges, solutions and open issues. COMPUTER COMMUNICATIONS 2023; 197:34-51. [PMID: 36313592 PMCID: PMC9598046 DOI: 10.1016/j.comcom.2022.10.013] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/19/2022] [Revised: 09/14/2022] [Accepted: 10/19/2022] [Indexed: 10/29/2023]
Abstract
SARS-CoV-2 is an infected disease caused by one of the variants of Coronavirus which emerged in December 2019. It is declared a pandemic by WHO in March 2020. COVID-19 outbreak has put the world on a halt and is a major threat to the public health system. It has shattered the world with its effects on different areas as the pandemic hit the world in a number of waves with different variants and mutations. Each variant and mutation have different transmission and infection rates in the human population. More than 609 million people have tested positive and more than 6.5 million people have died due to this disease as per 14th September 2022. Despite of numerous efforts, precautions and vaccination the infection has grown rapidly in the world. In this paper, we aim to give a holistic overview of COVID-19 its variants, game theory perspective, effects on the different social and economic areas, diagnostic advancements, treatment methods. A taxonomy is made for the proper insight of the work demonstrated in the paper. Finally, we discuss the open issues associated with COVID-19 in different fields and futuristic research trends in the area. The main aim of the paper is to provide comprehensive literature that covers all the areas and provide an expert understanding of the COVID-19 techniques and potentially be further utilized to combat the outbreak of COVID-19.
Collapse
Affiliation(s)
- Deepanshi
- School of Computer Science Engineering and Technology, Bennett University, Uttar Pradesh, India
| | - Ishan Budhiraja
- School of Computer Science Engineering and Technology, Bennett University, Uttar Pradesh, India
| | - Deepak Garg
- School of Computer Science Engineering and Technology, Bennett University, Uttar Pradesh, India
| | - Neeraj Kumar
- Department of Computer Science and Engineering, Thapar Institute of Engineering and Technology, Patiala, Punjab, India
- Department of Electrical and Computer Engineering, Lebanese American University, Beirut, Lebanon
- School of Computer Science, University of Petroleum and Energy Studies, Dehradun, Uttarakhand
- Faculty of Computing and IT, King Abdul Aziz University, Jeddah, Saudi Arabia
| | - Rohit Sharma
- Department of Electronics & Communication Engineering, SRM Institute of Science and Technology, NCR Campus, Modinagar, Ghaziabad, UP, India
| |
Collapse
|
8
|
Alsaeedi MAK, Kurnaz S. RETRACTED ARTICLE: Feature selection for diagnose coronavirus (COVID-19) disease by neural network and Caledonian crow learning algorithm. APPLIED NANOSCIENCE 2023; 13:3129. [PMID: 35155058 PMCID: PMC8818372 DOI: 10.1007/s13204-021-02159-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/15/2021] [Accepted: 10/09/2021] [Indexed: 11/07/2022]
Affiliation(s)
| | - Sefer Kurnaz
- Department of Electrical Computer Engineering, Altinbas University, Istanbul, Turkey
| |
Collapse
|
9
|
Rajamani KT, Rani P, Siebert H, ElagiriRamalingam R, Heinrich MP. Attention-augmented U-Net (AA-U-Net) for semantic segmentation. SIGNAL, IMAGE AND VIDEO PROCESSING 2023; 17:981-989. [PMID: 35910403 PMCID: PMC9311338 DOI: 10.1007/s11760-022-02302-3] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/27/2021] [Revised: 06/24/2022] [Accepted: 06/27/2022] [Indexed: 05/22/2023]
Abstract
UNLABELLED Deep learning-based image segmentation models rely strongly on capturing sufficient spatial context without requiring complex models that are hard to train with limited labeled data. For COVID-19 infection segmentation on CT images, training data are currently scarce. Attention models, in particular the most recent self-attention methods, have shown to help gather contextual information within deep networks and benefit semantic segmentation tasks. The recent attention-augmented convolution model aims to capture long range interactions by concatenating self-attention and convolution feature maps. This work proposes a novel attention-augmented convolution U-Net (AA-U-Net) that enables a more accurate spatial aggregation of contextual information by integrating attention-augmented convolution in the bottleneck of an encoder-decoder segmentation architecture. A deep segmentation network (U-Net) with this attention mechanism significantly improves the performance of semantic segmentation tasks on challenging COVID-19 lesion segmentation. The validation experiments show that the performance gain of the attention-augmented U-Net comes from their ability to capture dynamic and precise (wider) attention context. The AA-U-Net achieves Dice scores of 72.3% and 61.4% for ground-glass opacity and consolidation lesions for COVID-19 segmentation and improves the accuracy by 4.2% points against a baseline U-Net and 3.09% points compared to a baseline U-Net with matched parameters. SUPPLEMENTARY INFORMATION The online version contains supplementary material available at 10.1007/s11760-022-02302-3.
Collapse
Affiliation(s)
| | - Priya Rani
- Applied Artificial Intelligence Institute, Deakin University, Burwood, VIC 3125 Australia
| | - Hanna Siebert
- Institute of Medical Informatics, University of Lübeck, Luebeck, Germany
| | | | | |
Collapse
|
10
|
Chai PR, Rupp P, Huang HW, Chen J, Vaz C, Sinha A, Ehmke C, Thomas A, Dadabhoy F, Liang JY, Landman AB, Player G, Slattery K, Traverso G. Acceptance of a computer vision facilitated protocol to measure adherence to face mask use: a single-site, observational cohort study among hospital staff. BMJ Open 2022; 12:e062707. [PMID: 36600328 PMCID: PMC9742841 DOI: 10.1136/bmjopen-2022-062707] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/27/2022] [Accepted: 11/09/2022] [Indexed: 12/13/2022] Open
Abstract
OBJECTIVES Mask adherence continues to be a critical public health measure to prevent transmission of aerosol pathogens, such as SARS-CoV-2. We aimed to develop and deploy a computer vision algorithm to provide real-time feedback of mask wearing among staff in a hospital. DESIGN Single-site, observational cohort study. SETTING An urban, academic hospital in Boston, Massachusetts, USA. PARTICIPANTS We enrolled adult hospital staff entering the hospital at a key ingress point. INTERVENTIONS Consenting participants entering the hospital were invited to experience the computer vision mask detection system. Key aspects of the detection algorithm and feedback were described to participants, who then completed a quantitative assessment to understand their perceptions and acceptance of interacting with the system to detect their mask adherence. OUTCOME MEASURES Primary outcomes were willingness to interact with the mask system, and the degree of comfort participants felt in interacting with a public facing computer vision mask algorithm. RESULTS One hundred and eleven participants with mean age 40 (SD15.5) were enrolled in the study. Males (47.7%) and females (52.3%) were equally represented, and the majority identified as white (N=54, 49%). Most participants (N=97, 87.3%) reported acceptance of the system and most participants (N=84, 75.7%) were accepting of deployment of the system to reinforce mask adherence in public places. One third of participants (N=36) felt that a public facing computer vision system would be an intrusion into personal privacy.Public-facing computer vision software to detect and provide feedback around mask adherence may be acceptable in the hospital setting. Similar systems may be considered for deployment in locations where mask adherence is important.
Collapse
Affiliation(s)
- Peter R Chai
- Emergency Medicine, Brigham and Women's Hospital, Boston, Massachusetts, USA
- Massachusetts Institute of Technology Koch Institute for Integrative Cancer Research, Cambridge, Massachusetts, USA
- The Fenway Institute, Boston, MA, USA
| | - Phillip Rupp
- Massachusetts Institute of Technology Koch Institute for Integrative Cancer Research, Cambridge, Massachusetts, USA
| | - Hen-Wei Huang
- Massachusetts Institute of Technology Koch Institute for Integrative Cancer Research, Cambridge, Massachusetts, USA
- Medicine/Division of Gastroenterology, Brigham and Women's Hospital, Boston, Massachusetts, USA
- Mechanical Engineering, Massachusetts Institute of Technology, Cambridge, Massachusetts, USA
| | - Jack Chen
- Massachusetts Institute of Technology Koch Institute for Integrative Cancer Research, Cambridge, Massachusetts, USA
- Medicine/Division of Gastroenterology, Brigham and Women's Hospital, Boston, Massachusetts, USA
- Mechanical Engineering, Massachusetts Institute of Technology, Cambridge, Massachusetts, USA
| | - Clint Vaz
- Emergency Medicine, Brigham and Women's Hospital, Boston, Massachusetts, USA
| | - Anjali Sinha
- Massachusetts Institute of Technology Koch Institute for Integrative Cancer Research, Cambridge, Massachusetts, USA
| | - Claas Ehmke
- Massachusetts Institute of Technology Koch Institute for Integrative Cancer Research, Cambridge, Massachusetts, USA
| | - Akhil Thomas
- Massachusetts Institute of Technology Koch Institute for Integrative Cancer Research, Cambridge, Massachusetts, USA
| | - Farah Dadabhoy
- Emergency Medicine, Brigham and Women's Hospital, Boston, Massachusetts, USA
| | - Jia Y Liang
- Massachusetts Institute of Technology Koch Institute for Integrative Cancer Research, Cambridge, Massachusetts, USA
- Medicine/Division of Gastroenterology, Brigham and Women's Hospital, Boston, Massachusetts, USA
- Mechanical Engineering, Massachusetts Institute of Technology, Cambridge, Massachusetts, USA
| | - Adam B Landman
- Emergency Medicine, Brigham and Women's Hospital, Boston, Massachusetts, USA
- Digital Innovation Hub, Brigham and Women's Hospital, Boston, MA, USA
| | - George Player
- Facilities, Brigham and Women's Hospital, Boston, Massachusetts, USA
| | - Kevin Slattery
- Security, Safety and Parking, Brigham and Women's Hospital, Boston, Massachusetts, USA
| | - Giovanni Traverso
- Medicine/Division of Gastroenterology, Brigham and Women's Hospital, Boston, Massachusetts, USA
- Mechanical Engineering, Massachusetts Institute of Technology, Cambridge, Massachusetts, USA
| |
Collapse
|
11
|
Diwakar M, Singh P, Swarup C, Bajal E, Jindal M, Ravi V, Singh KU, Singh T. Noise Suppression and Edge Preservation for Low-Dose COVID-19 CT Images Using NLM and Method Noise Thresholding in Shearlet Domain. Diagnostics (Basel) 2022; 12:diagnostics12112766. [PMID: 36428826 PMCID: PMC9689094 DOI: 10.3390/diagnostics12112766] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2022] [Revised: 11/09/2022] [Accepted: 11/09/2022] [Indexed: 11/16/2022] Open
Abstract
In the COVID-19 era, it may be possible to detect COVID-19 by detecting lesions in scans, i.e., ground-glass opacity, consolidation, nodules, reticulation, or thickened interlobular septa, and lesion distribution, but it becomes difficult at the early stages due to embryonic lesion growth and the restricted use of high dose X-ray detection. Therefore, it may be possible for a patient who may or may not be infected with coronavirus to consider using high-dose X-rays, but it may cause more risks. Conclusively, using low-dose X-rays to produce CT scans and then adding a rigorous denoising algorithm to the scans is the best way to protect patients from side effects or a high dose X-ray when diagnosing coronavirus involvement early. Hence, this paper proposed a denoising scheme using an NLM filter and method noise thresholding concept in the shearlet domain for noisy COVID CT images. Low-dose COVID CT images can be further utilized. The results and comparative analysis showed that, in most cases, the proposed method gives better outcomes than existing ones.
Collapse
Affiliation(s)
- Manoj Diwakar
- Computer Science and Engineering Department, Graphic Era Deemed to be University, Dehradun 248007, India
| | - Prabhishek Singh
- School of Computer Science Engineering and Technology, Bennett University, Greater Noida 201310, India
| | - Chetan Swarup
- Department of Basic Science, College of Science and Theoretical Studies, Saudi Electronic University, Riyadh-Male Campus, Riyadh 13316, Saudi Arabia
- Correspondence:
| | - Eshan Bajal
- Department of Computer Science and Engineering, Amity School of Engineering and Technology, Amity University, Noida 201303, India
| | - Muskan Jindal
- Department of Computer Science and Engineering, Amity School of Engineering and Technology, Amity University, Noida 201303, India
| | - Vinayakumar Ravi
- Center for Artificial Intelligence, Prince Mohammad Bin Fahd University, Khobar 34754, Saudi Arabia
| | - Kamred Udham Singh
- Department of Computer Science and Information Engineering, National Cheng Kung University, Tainan 701, Taiwan
| | - Teekam Singh
- School of Computer Science, University of Petroleum and Energy Studies, Dehradun 248007, India
| |
Collapse
|
12
|
Chakraborty S, Mali K. SUFEMO: A superpixel based fuzzy image segmentation method for COVID-19 radiological image elucidation. Appl Soft Comput 2022; 129:109625. [PMID: 36124000 PMCID: PMC9474408 DOI: 10.1016/j.asoc.2022.109625] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2021] [Revised: 08/15/2022] [Accepted: 09/05/2022] [Indexed: 11/27/2022]
Abstract
COVID-19 causes an ongoing worldwide pandemic situation. The non-discovery of specialized drugs and/or any other kind of medicines makes the situation worse. Early diagnosis of this disease will be certainly helpful to start the treatment early and also to bring down the dire spread of this highly infectious virus. This article describes the proposed novel unsupervised segmentation method to segment the radiological image samples of the chest area that are accumulated from the COVID-19 infected patients. The proposed approach is helpful for physicians, medical technologists, and other related experts in the quick and early diagnosis of COVID-19 infection. The proposed approach will be the SUFEMO (SUperpixel based Fuzzy Electromagnetism-like Optimization). This approach is developed depending on some well-known theories like the Electromagnetism-like optimization algorithm, the type-2 fuzzy logic, and the superpixels. The proposed approach brings down the processing burden that is required to deal with a considerably large amount of spatial information by assimilating the notion of the superpixel. In this work, the EMO approach is modified by utilizing the type 2 fuzzy framework. The EMO approach updates the cluster centers without using the cluster center updation equation. This approach is independent of the choice of the initial cluster centers. To decrease the related computational overhead of handling a lot of spatial data, a novel superpixel-based approach is proposed in which the noise-sensitiveness of the watershed-based superpixel formation approach is dealt with by computing the nearby minima from the gradient image. Also, to take advantage of the superpixels, the fuzzy objective function is modified. The proposed approach was evaluated using both qualitatively and quantitatively using 310 chest CT scan images that are gathered from various sources. Four standard cluster validity indices are taken into consideration to quantify the results. It is observed that the proposed approach gives better performance compared to some of the state-of-the-art approaches in terms of both qualitative and quantitative outcomes. On average, the proposed approach attains Davies-Bouldin index value of 1.812008792, Xie-Beni index value of 1.683281, Dunn index value 2.588595748, and β index value 3.142069236 for 5 clusters. Apart from this, the proposed approach is also found to be superior with regard to the rate of convergence. Rigorous experiments prove the effectiveness of the proposed approach and establish the real-life applicability of the proposed method for the initial filtering of the COVID-19 patients.
Collapse
Affiliation(s)
- Shouvik Chakraborty
- Department of Computer Science and Engineering, University of Kalyani, India
| | - Kalyani Mali
- Department of Computer Science and Engineering, University of Kalyani, India
| |
Collapse
|
13
|
Karthik R, Menaka R, Hariharan M, Kathiresan GS. AI for COVID-19 Detection from Radiographs: Incisive Analysis of State of the Art Techniques, Key Challenges and Future Directions. Ing Rech Biomed 2022; 43:486-510. [PMID: 34336141 PMCID: PMC8312058 DOI: 10.1016/j.irbm.2021.07.002] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2021] [Revised: 06/14/2021] [Accepted: 07/19/2021] [Indexed: 12/24/2022]
Abstract
Background and objective In recent years, Artificial Intelligence has had an evident impact on the way research addresses challenges in different domains. It has proven to be a huge asset, especially in the medical field, allowing for time-efficient and reliable solutions. This research aims to spotlight the impact of deep learning and machine learning models in the detection of COVID-19 from medical images. This is achieved by conducting a review of the state-of-the-art approaches proposed by the recent works in this field. Methods The main focus of this study is the recent developments of classification and segmentation approaches to image-based COVID-19 detection. The study reviews 140 research papers published in different academic research databases. These papers have been screened and filtered based on specified criteria, to acquire insights prudent to image-based COVID-19 detection. Results The methods discussed in this review include different types of imaging modality, predominantly X-rays and CT scans. These modalities are used for classification and segmentation tasks as well. This review seeks to categorize and discuss the different deep learning and machine learning architectures employed for these tasks, based on the imaging modality utilized. It also hints at other possible deep learning and machine learning architectures that can be proposed for better results towards COVID-19 detection. Along with that, a detailed overview of the emerging trends and breakthroughs in Artificial Intelligence-based COVID-19 detection has been discussed as well. Conclusion This work concludes by stipulating the technical and non-technical challenges faced by researchers and illustrates the advantages of image-based COVID-19 detection with Artificial Intelligence techniques.
Collapse
Affiliation(s)
- R Karthik
- Centre for Cyber Physical Systems, Vellore Institute of Technology, Chennai, India
| | - R Menaka
- Centre for Cyber Physical Systems, Vellore Institute of Technology, Chennai, India
| | - M Hariharan
- School of Computing Sciences and Engineering, Vellore Institute of Technology, Chennai, India
| | - G S Kathiresan
- School of Electronics Engineering, Vellore Institute of Technology, Chennai, India
| |
Collapse
|
14
|
Adadi A, Lahmer M, Nasiri S. Artificial Intelligence and COVID-19: A Systematic umbrella review and roads ahead. JOURNAL OF KING SAUD UNIVERSITY. COMPUTER AND INFORMATION SCIENCES 2022; 34:5898-5920. [PMID: 37520766 PMCID: PMC8831917 DOI: 10.1016/j.jksuci.2021.07.010] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/08/2021] [Revised: 06/21/2021] [Accepted: 07/11/2021] [Indexed: 12/15/2022]
Abstract
Artificial Intelligence (AI) has played a substantial role in the response to the challenges posed by the current pandemic. The growing interest in using AI to handle Covid-19 issues has accelerated the pace of AI research and resulted in an exponential increase in articles and review studies within a very short period of time. Hence, it is becoming challenging to explore the large corpus of academic publications dedicated to the global health crisis. Even with the presence of systematic review studies, given their number and diversity, identifying trends and research avenues beyond the pandemic should be an arduous task. We conclude therefore that after the one-year mark of the declaration of Covid-19 as a pandemic, the accumulated scientific contribution lacks two fundamental aspects: Knowledge synthesis and Future projections. In contribution to fill this void, this paper is a (i) synthesis study and (ii) foresight exercise. The synthesis study aims to provide the scholars a consolidation of findings and a knowledge synthesis through a systematic review of the reviews (umbrella review) studying AI applications against Covid-19. Following the PRISMA guidelines, we systematically searched PubMed, Scopus, and other preprint sources from 1st December 2019 to 1st June 2021 for eligible reviews. The literature search and screening process resulted in 45 included reviews. Our findings reveal patterns, relationships, and trends in the AI research community response to the pandemic. We found that in the space of few months, the research objectives of the literature have developed rapidly from identifying potential AI applications to evaluating current uses of intelligent systems. Only few reviews have adopted the meta-analysis as a study design. Moreover, a clear dominance of the medical theme and the DNN methods has been observed in the reported AI applications. Based on its constructive systematic umbrella review, this work conducts a foresight exercise that tries to envision the post-Covid-19 research landscape of the AI field. We see seven key themes of research that may be an outcome of the present crisis and which advocate a more sustainable and responsible form of intelligent systems. We set accordingly a post-pandemic research agenda articulated around these seven drivers. The results of this study can be useful for the AI research community to obtain a holistic view of the current literature and to help prioritize research needs as we are heading toward the new normal.
Collapse
Affiliation(s)
- Amina Adadi
- ISIC Research Team of High School of Technology, LMMI Laboratory, Moulay Ismail University, Meknes, Morocco
| | - Mohammed Lahmer
- ISIC Research Team of High School of Technology, LMMI Laboratory, Moulay Ismail University, Meknes, Morocco
| | - Samia Nasiri
- ISIC Research Team of High School of Technology, LMMI Laboratory, Moulay Ismail University, Meknes, Morocco
| |
Collapse
|
15
|
Ding W, Chakraborty S, Mali K, Chatterjee S, Nayak J, Das AK, Banerjee S. An Unsupervised Fuzzy Clustering Approach for Early Screening of COVID-19 From Radiological Images. IEEE TRANSACTIONS ON FUZZY SYSTEMS : A PUBLICATION OF THE IEEE NEURAL NETWORKS COUNCIL 2022; 30:2902-2914. [PMID: 36345371 PMCID: PMC9454279 DOI: 10.1109/tfuzz.2021.3097806] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/18/2021] [Revised: 06/29/2021] [Accepted: 07/12/2021] [Indexed: 05/04/2023]
Abstract
A global pandemic scenario is witnessed worldwide owing to the menace of the rapid outbreak of the deadly COVID-19 virus. To save mankind from this apocalyptic onslaught, it is essential to curb the fast spreading of this dreadful virus. Moreover, the absence of specialized drugs has made the scenario even more badly and thus an early-stage adoption of necessary precautionary measures would provide requisite supportive treatment for its prevention. The prime objective of this article is to use radiological images as a tool to help in early diagnosis. The interval type 2 fuzzy clustering is blended with the concept of superpixels, and metaheuristics to efficiently segment the radiological images. Despite noise sensitivity of watershed-based approach, it is adopted for superpixel computation owing to its simplicity where the noise problem is handled by the important edge information of the gradient image is preserved with the help of morphological opening and closing based reconstruction operations. The traditional objective function of the fuzzy c-means clustering algorithm is modified to incorporate the spatial information from the neighboring superpixel-based local window. The computational overhead associated with the processing of a huge amount of spatial information is reduced by incorporating the concept of superpixels and the optimal clusters are determined by a modified version of the flower pollination algorithm. Although the proposed approach performs well but should not be considered as an alternative to gold standard detection tests of COVID-19. Experimental results are found to be promising enough to deploy this approach for real-life applications.
Collapse
Affiliation(s)
- Weiping Ding
- School of Information Science and TechnologyNantong UniversityNantong226019China
| | - Shouvik Chakraborty
- Department of Computer Science and EngineeringUniversity of KalyaniKalyani741235India
| | - Kalyani Mali
- Department of Computer Science and EngineeringUniversity of KalyaniKalyani741235India
| | - Sankhadeep Chatterjee
- Department of Computer Science and EngineeringUniversity of Engineering and ManagementKolkata700160India
| | - Janmenjoy Nayak
- Department of Computer Science and EngineeringAditya Institute of Technology and ManagementSrikakulam532201India
| | - Asit Kumar Das
- Department of Computer Science and TechnologyIndian Institute of Engineering Science and TechnologyHowrah711103India
| | - Soumen Banerjee
- Department of Electronics and Communication EngineeringUniversity of Engineering and ManagementKolkata700160India
| |
Collapse
|
16
|
Generalizability assessment of COVID-19 3D CT data for deep learning-based disease detection. Comput Biol Med 2022; 145:105464. [PMID: 35390746 PMCID: PMC8971071 DOI: 10.1016/j.compbiomed.2022.105464] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2021] [Revised: 03/25/2022] [Accepted: 03/25/2022] [Indexed: 12/16/2022]
Abstract
BACKGROUND Artificial intelligence technologies in classification/detection of COVID-19 positive cases suffer from generalizability. Moreover, accessing and preparing another large dataset is not always feasible and time-consuming. Several studies have combined smaller COVID-19 CT datasets into "supersets" to maximize the number of training samples. This study aims to assess generalizability by splitting datasets into different portions based on 3D CT images using deep learning. METHOD Two large datasets, including 1110 3D CT images, were split into five segments of 20% each. Each dataset's first 20% segment was separated as a holdout test set. 3D-CNN training was performed with the remaining 80% from each dataset. Two small external datasets were also used to independently evaluate the trained models. RESULTS The total combination of 80% of each dataset has an accuracy of 91% on Iranmehr and 83% on Moscow holdout test datasets. Results indicated that 80% of the primary datasets are adequate for fully training a model. The additional fine-tuning using 40% of a secondary dataset helps the model generalize to a third, unseen dataset. The highest accuracy achieved through transfer learning was 85% on LDCT dataset and 83% on Iranmehr holdout test sets when retrained on 80% of Iranmehr dataset. CONCLUSION While the total combination of both datasets produced the best results, different combinations and transfer learning still produced generalizable results. Adopting the proposed methodology may help to obtain satisfactory results in the case of limited external datasets.
Collapse
|
17
|
Wang H, Jia S, Li Z, Duan Y, Tao G, Zhao Z. A Comprehensive Review of Artificial Intelligence in Prevention and Treatment of COVID-19 Pandemic. Front Genet 2022; 13:845305. [PMID: 35559010 PMCID: PMC9086537 DOI: 10.3389/fgene.2022.845305] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/29/2021] [Accepted: 03/30/2022] [Indexed: 11/13/2022] Open
Abstract
The unprecedented outbreak of the Corona Virus Disease 2019 (COVID-19) pandemic has seriously affected numerous countries in the world from various aspects such as education, economy, social security, public health, etc. Most governments have made great efforts to control the spread of COVID-19, e.g., locking down hard-hit cities and advocating masks for the population. However, some countries and regions have relatively poor medical conditions in terms of insufficient medical equipment, hospital capacity overload, personnel shortage, and other problems, resulting in the large-scale spread of the epidemic. With the unique advantages of Artificial Intelligence (AI), it plays an extremely important role in medical imaging, clinical data, drug development, epidemic prediction, and telemedicine. Therefore, AI is a powerful tool that can help humans solve complex problems, especially in the fight against COVID-19. This study aims to analyze past research results and interpret the role of Artificial Intelligence in the prevention and treatment of COVID-19 from five aspects. In this paper, we also discuss the future development directions in different fields and prove the validity of the models through experiments, which will help researchers develop more efficient models to control the spread of COVID-19.
Collapse
Affiliation(s)
- Haishuai Wang
- College of Computer Science, Zhejiang University, Hangzhou, China
| | - Shangru Jia
- Department of Computer and Information Engineering, Tianjin Normal University, Tianjin, China
| | - Zhao Li
- Alibaba-ZJU Joint Research Institute of Frontier Technologies, Zhejiang University, Hangzhou, China
| | - Yucong Duan
- College of Computer Science and Technology, Hainan University, Haikou, China
| | - Guangyu Tao
- Department of Radiology, Shanghai Chest Hospital, Shanghai Jiaotong University, Shanghai, China
| | - Ziping Zhao
- Department of Computer and Information Engineering, Tianjin Normal University, Tianjin, China
| |
Collapse
|
18
|
Cognitive Networks Extract Insights on COVID-19 Vaccines from English and Italian Popular Tweets: Anticipation, Logistics, Conspiracy and Loss of Trust. BIG DATA AND COGNITIVE COMPUTING 2022. [DOI: 10.3390/bdcc6020052] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/27/2023]
Abstract
Monitoring social discourse about COVID-19 vaccines is key to understanding how large populations perceive vaccination campaigns. This work reconstructs how popular and trending posts framed semantically and emotionally COVID-19 vaccines on Twitter. We achieve this by merging natural language processing, cognitive network science and AI-based image analysis. We focus on 4765 unique popular tweets in English or Italian about COVID-19 vaccines between December 2020 and March 2021. One popular English tweet contained in our data set was liked around 495,000 times, highlighting how popular tweets could cognitively affect large parts of the population. We investigate both text and multimedia content in tweets and build a cognitive network of syntactic/semantic associations in messages, including emotional cues and pictures. This network representation indicates how online users linked ideas in social discourse and framed vaccines along specific semantic/emotional content. The English semantic frame of “vaccine” was highly polarised between trust/anticipation (towards the vaccine as a scientific asset saving lives) and anger/sadness (mentioning critical issues with dose administering). Semantic associations with “vaccine,” “hoax” and conspiratorial jargon indicated the persistence of conspiracy theories and vaccines in extremely popular English posts. Interestingly, these were absent in Italian messages. Popular tweets with images of people wearing face masks used language that lacked the trust and joy found in tweets showing people with no masks. This difference indicates a negative effect attributed to face-covering in social discourse. Behavioural analysis revealed a tendency for users to share content eliciting joy, sadness and disgust and to like sad messages less. Both patterns indicate an interplay between emotions and content diffusion beyond sentiment. After its suspension in mid-March 2021, “AstraZeneca” was associated with trustful language driven by experts. After the deaths of a small number of vaccinated people in mid-March, popular Italian tweets framed “vaccine” by crucially replacing earlier levels of trust with deep sadness. Our results stress how cognitive networks and innovative multimedia processing open new ways for reconstructing online perceptions about vaccines and trust.
Collapse
|
19
|
Albalawi U, Mustafa M. Current Artificial Intelligence (AI) Techniques, Challenges, and Approaches in Controlling and Fighting COVID-19: A Review. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2022; 19:5901. [PMID: 35627437 PMCID: PMC9140632 DOI: 10.3390/ijerph19105901] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/04/2022] [Revised: 05/07/2022] [Accepted: 05/09/2022] [Indexed: 11/17/2022]
Abstract
SARS-CoV-2 (COVID-19) has been one of the worst global health crises in the 21st century. The currently available rollout vaccines are not 100% effective for COVID-19 due to the evolving nature of the virus. There is a real need for a concerted effort to fight the virus, and research from diverse fields must contribute. Artificial intelligence-based approaches have proven to be significantly effective in every branch of our daily lives, including healthcare and medical domains. During the early days of this pandemic, artificial intelligence (AI) was utilized in the fight against this virus outbreak and it has played a major role in containing the spread of the virus. It provided innovative opportunities to speed up the development of disease interventions. Several methods, models, AI-based devices, robotics, and technologies have been proposed and utilized for diverse tasks such as surveillance, spread prediction, peak time prediction, classification, hospitalization, healthcare management, heath system capacity, etc. This paper attempts to provide a quick, concise, and precise survey of the state-of-the-art AI-based techniques, technologies, and datasets used in fighting COVID-19. Several domains, including forecasting, surveillance, dynamic times series forecasting, spread prediction, genomics, compute vision, peak time prediction, the classification of medical imaging-including CT and X-ray and how they can be processed-and biological data (genome and protein sequences) have been investigated. An overview of the open-access computational resources and platforms is given and their useful tools are pointed out. The paper presents the potential research areas in AI and will thus encourage researchers to contribute to fighting against the virus and aid global health by slowing down the spread of the virus. This will be a significant contribution to help minimize the high death rate across the globe.
Collapse
Affiliation(s)
- Umar Albalawi
- Faculty of Computing and Information Technology, University of Tabuk, KSA, Tabuk 71491, Saudi Arabia;
- Industrial Innovation and Robotics Center, University of Tabuk, KSA, Tabuk 71491, Saudi Arabia
| | - Mohammed Mustafa
- Faculty of Computing and Information Technology, University of Tabuk, KSA, Tabuk 71491, Saudi Arabia;
- Industrial Innovation and Robotics Center, University of Tabuk, KSA, Tabuk 71491, Saudi Arabia
| |
Collapse
|
20
|
Carobene A, Milella F, Famiglini L, Cabitza F. How is test laboratory data used and characterised by machine learning models? A systematic review of diagnostic and prognostic models developed for COVID-19 patients using only laboratory data. Clin Chem Lab Med 2022; 60:1887-1901. [PMID: 35508417 DOI: 10.1515/cclm-2022-0182] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2022] [Accepted: 04/22/2022] [Indexed: 12/13/2022]
Abstract
The current gold standard for COVID-19 diagnosis, the rRT-PCR test, is hampered by long turnaround times, probable reagent shortages, high false-negative rates and high prices. As a result, machine learning (ML) methods have recently piqued interest, particularly when applied to digital imagery (X-rays and CT scans). In this review, the literature on ML-based diagnostic and prognostic studies grounded on hematochemical parameters has been considered. By doing so, a gap in the current literature was addressed concerning the application of machine learning to laboratory medicine. Sixty-eight articles have been included that were extracted from the Scopus and PubMed indexes. These studies were marked by a great deal of heterogeneity in terms of the examined laboratory test and clinical parameters, sample size, reference populations, ML algorithms, and validation approaches. The majority of research was found to be hampered by reporting and replicability issues: only four of the surveyed studies provided complete information on analytic procedures (units of measure, analyzing equipment), while 29 provided no information at all. Only 16 studies included independent external validation. In light of these findings, we discuss the importance of closer collaboration between data scientists and medical laboratory professionals in order to correctly characterise the relevant population, select the most appropriate statistical and analytical methods, ensure reproducibility, enable the proper interpretation of the results, and gain actual utility by using machine learning methods in clinical practice.
Collapse
Affiliation(s)
- Anna Carobene
- IRCCS San Raffaele Scientific Institute, Milan, Italy
| | | | | | - Federico Cabitza
- IRCCS Istituto Ortopedico Galeazzi, Milan, Italy.,DISCo, Università Degli Studi di Milano-Bicocca, Milan, Italy
| |
Collapse
|
21
|
Jemioło P, Storman D, Orzechowski P. Artificial Intelligence for COVID-19 Detection in Medical Imaging-Diagnostic Measures and Wasting-A Systematic Umbrella Review. J Clin Med 2022; 11:2054. [PMID: 35407664 PMCID: PMC9000039 DOI: 10.3390/jcm11072054] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/23/2022] [Revised: 03/24/2022] [Accepted: 03/26/2022] [Indexed: 01/08/2023] Open
Abstract
The COVID-19 pandemic has sparked a barrage of primary research and reviews. We investigated the publishing process, time and resource wasting, and assessed the methodological quality of the reviews on artificial intelligence techniques to diagnose COVID-19 in medical images. We searched nine databases from inception until 1 September 2020. Two independent reviewers did all steps of identification, extraction, and methodological credibility assessment of records. Out of 725 records, 22 reviews analysing 165 primary studies met the inclusion criteria. This review covers 174,277 participants in total, including 19,170 diagnosed with COVID-19. The methodological credibility of all eligible studies was rated as critically low: 95% of papers had significant flaws in reporting quality. On average, 7.24 (range: 0-45) new papers were included in each subsequent review, and 14% of studies did not include any new paper into consideration. Almost three-quarters of the studies included less than 10% of available studies. More than half of the reviews did not comment on the previously published reviews at all. Much wasting time and resources could be avoided if referring to previous reviews and following methodological guidelines. Such information chaos is alarming. It is high time to draw conclusions from what we experienced and prepare for future pandemics.
Collapse
Affiliation(s)
- Paweł Jemioło
- AGH University of Science and Technology, Faculty of Electrical Engineering, Automatics, Computer Science and Biomedical Engineering, al. A. Mickiewicza 30, 30-059 Krakow, Poland;
| | - Dawid Storman
- Chair of Epidemiology and Preventive Medicine, Department of Hygiene and Dietetics, Jagiellonian University Medical College, ul. M. Kopernika 7, 31-034 Krakow, Poland;
| | - Patryk Orzechowski
- AGH University of Science and Technology, Faculty of Electrical Engineering, Automatics, Computer Science and Biomedical Engineering, al. A. Mickiewicza 30, 30-059 Krakow, Poland;
- Institute for Biomedical Informatics, University of Pennsylvania, 3700 Hamilton Walk, Philadelphia, PA 19104, USA
| |
Collapse
|
22
|
Wu Z, Xue R, Shao M. Knowledge graph analysis and visualization of AI technology applied in COVID-19. ENVIRONMENTAL SCIENCE AND POLLUTION RESEARCH INTERNATIONAL 2022; 29:26396-26408. [PMID: 34859342 PMCID: PMC8638799 DOI: 10.1007/s11356-021-17800-z] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/27/2021] [Accepted: 11/23/2021] [Indexed: 05/14/2023]
Abstract
With the global outbreak of coronavirus disease (COVID-19) all over the world, artificial intelligence (AI) technology is widely used in COVID-19 and has become a hot topic. In recent 2 years, the application of AI technology in COVID-19 has developed rapidly, and more than 100 relevant papers are published every month. In this paper, we combined with the bibliometric and visual knowledge map analysis, used the WOS database as the sample data source, and applied VOSviewer and CiteSpace analysis tools to carry out multi-dimensional statistical analysis and visual analysis about 1903 pieces of literature of recent 2 years (by the end of July this year). The data is analyzed by several terms with the main annual article and citation count, major publication sources, institutions and countries, their contribution and collaboration, etc. Since last year, the research on the COVID-19 has sharply increased; especially the corresponding research fields combined with the AI technology are expanding, such as medicine, management, economics, and informatics. The China and USA are the most prolific countries in AI applied in COVID-19, which have made a significant contribution to AI applied in COVID-19, as the high-level international collaboration of countries and institutions is increasing and more impactful. Moreover, we widely studied the issues: detection, surveillance, risk prediction, therapeutic research, virus modeling, and analysis of COVID-19. Finally, we put forward perspective challenges and limits to the application of AI in the COVID-19 for researchers and practitioners to facilitate future research on AI applied in COVID-19.
Collapse
Affiliation(s)
- Zongsheng Wu
- School of Computer Science, Xianyang Normal University, Xianyang, 712000, Shaanxi, China.
| | - Ru Xue
- School of Information Engineering, Xizang Minzu University, Xianyang, 712082, Shaanxi, China
| | - Meiyun Shao
- School of Information Engineering, Xizang Minzu University, Xianyang, 712082, Shaanxi, China
| |
Collapse
|
23
|
Monday HN, Li J, Nneji GU, Hossin MA, Nahar S, Jackson J, Chikwendu IA. WMR-DepthwiseNet: A Wavelet Multi-Resolution Depthwise Separable Convolutional Neural Network for COVID-19 Diagnosis. Diagnostics (Basel) 2022; 12:765. [PMID: 35328318 PMCID: PMC8947526 DOI: 10.3390/diagnostics12030765] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2022] [Revised: 03/07/2022] [Accepted: 03/18/2022] [Indexed: 11/17/2022] Open
Abstract
Timely discovery of COVID-19 could aid in formulating a suitable treatment plan for disease mitigation and containment decisions. The widely used COVID-19 test necessitates a regular method and has a low sensitivity value. Computed tomography and chest X-ray are also other methods utilized by numerous studies for detecting COVID-19. In this article, we propose a CNN called depthwise separable convolution network with wavelet multiresolution analysis module (WMR-DepthwiseNet) that is robust to automatically learn details from both spatialwise and channelwise for COVID-19 identification with a limited radiograph dataset, which is critical due to the rapid growth of COVID-19. This model utilizes an effective strategy to prevent loss of spatial details, which is a prevalent issue in traditional convolutional neural network, and second, the depthwise separable connectivity framework ensures reusability of feature maps by directly connecting previous layer to all subsequent layers for extracting feature representations from few datasets. We evaluate the proposed model by utilizing a public domain dataset of COVID-19 confirmed case and other pneumonia illness. The proposed method achieves 98.63% accuracy, 98.46% sensitivity, 97.99% specificity, and 98.69% precision on chest X-ray dataset, whereas using the computed tomography dataset, the model achieves 96.83% accuracy, 97.78% sensitivity, 96.22% specificity, and 97.02% precision. According to the results of our experiments, our model achieves up-to-date accuracy with only a few training cases available, which is useful for COVID-19 screening. This latest paradigm is expected to contribute significantly in the battle against COVID-19 and other life-threatening diseases.
Collapse
Affiliation(s)
- Happy Nkanta Monday
- School of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China;
| | - Jianping Li
- School of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China;
| | - Grace Ugochi Nneji
- School of Information and Software Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China; (G.U.N.); (J.J.)
| | - Md Altab Hossin
- School of Management and Economics, University of Electronic Science and Technology of China, Chengdu 611731, China;
| | - Saifun Nahar
- Department of Information System and Technology, University of Missouri-St. Louis, St. Louis, MO 63121, USA;
| | - Jehoiada Jackson
- School of Information and Software Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China; (G.U.N.); (J.J.)
| | - Ijeoma Amuche Chikwendu
- School of Information and Communication Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China;
| |
Collapse
|
24
|
Monday HN, Li J, Nneji GU, Nahar S, Hossin MA, Jackson J, Ejiyi CJ. COVID-19 Diagnosis from Chest X-ray Images Using a Robust Multi-Resolution Analysis Siamese Neural Network with Super-Resolution Convolutional Neural Network. Diagnostics (Basel) 2022; 12:diagnostics12030741. [PMID: 35328294 PMCID: PMC8946937 DOI: 10.3390/diagnostics12030741] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2022] [Revised: 03/07/2022] [Accepted: 03/15/2022] [Indexed: 02/04/2023] Open
Abstract
Chest X-ray (CXR) is becoming a useful method in the evaluation of coronavirus disease 19 (COVID-19). Despite the global spread of COVID-19, utilizing a computer-aided diagnosis approach for COVID-19 classification based on CXR images could significantly reduce the clinician burden. There is no doubt that low resolution, noise and irrelevant annotations in chest X-ray images are a major constraint to the performance of AI-based COVID-19 diagnosis. While a few studies have made huge progress, they underestimate these bottlenecks. In this study, we propose a super-resolution-based Siamese wavelet multi-resolution convolutional neural network called COVID-SRWCNN for COVID-19 classification using chest X-ray images. Concretely, we first reconstruct high-resolution (HR) counterparts from low-resolution (LR) CXR images in order to enhance the quality of the dataset for improved performance of our model by proposing a novel enhanced fast super-resolution convolutional neural network (EFSRCNN) to capture texture details in each given chest X-ray image. Exploiting a mutual learning approach, the HR images are passed to the proposed Siamese wavelet multi-resolution convolutional neural network to learn the high-level features for COVID-19 classification. We validate the proposed COVID-SRWCNN model on public-source datasets, achieving accuracy of 98.98%. Our screening technique achieves 98.96% AUC, 99.78% sensitivity, 98.53% precision, and 98.86% specificity. Owing to the fact that COVID-19 chest X-ray datasets are low in quality, experimental results show that our proposed algorithm obtains up-to-date performance that is useful for COVID-19 screening.
Collapse
Affiliation(s)
- Happy Nkanta Monday
- School of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China;
| | - Jianping Li
- School of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China;
- Correspondence:
| | - Grace Ugochi Nneji
- School of Information and Software Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China; (G.U.N.); (J.J.); (C.J.E.)
| | - Saifun Nahar
- Department of Information System and Technology, University of Missouri-St. Louis, St. Louis, MO 63121, USA;
| | - Md Altab Hossin
- School of Management and Economics, University of Electronic Science and Technology of China, Chengdu 611731, China;
| | - Jehoiada Jackson
- School of Information and Software Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China; (G.U.N.); (J.J.); (C.J.E.)
| | - Chukwuebuka Joseph Ejiyi
- School of Information and Software Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China; (G.U.N.); (J.J.); (C.J.E.)
| |
Collapse
|
25
|
Oulefki A, Agaian S, Trongtirakul T, Benbelkacem S, Aouam D, Zenati-Henda N, Abdelli ML. Virtual Reality visualization for computerized COVID-19 lesion segmentation and interpretation. Biomed Signal Process Control 2022; 73:103371. [PMID: 34840591 PMCID: PMC8610934 DOI: 10.1016/j.bspc.2021.103371] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2021] [Revised: 09/23/2021] [Accepted: 11/07/2021] [Indexed: 02/01/2023]
Abstract
Coronavirus disease (COVID-19) is a severe infectious disease that causes respiratory illness and has had devastating medical and economic consequences globally. Therefore, early, and precise diagnosis is critical to control disease progression and management. Compared to the very popular RT-PCR (reverse-transcription polymerase chain reaction) method, chest CT imaging is a more consistent, sensible, and fast approach for identifying and managing infected COVID-19 patients, specifically in the epidemic area. CT images use computational methods to combine 2D X-ray images and transform them into 3D images. One major drawback of CT scans in diagnosing COVID-19 is creating false-negative effects, especially early infection. This article aims to combine novel CT imaging tools and Virtual Reality (VR) technology and generate an automatize system for accurately screening COVID-19 disease and navigating 3D visualizations of medical scenes. The key benefits of this system are a) it offers stereoscopic depth perception, b) give better insights and comprehension into the overall imaging data, c) it allows doctors to visualize the 3D models, manipulate them, study the inside 3D data, and do several kinds of measurements, and finally d) it has the capacity of real-time interactivity and accurately visualizes dynamic 3D volumetric data. The tool provides novel visualizations for medical practitioners to identify and analyze the change in the shape of COVID-19 infectious. The second objective of this work is to generate, the first time, the CT African patient COVID-19 scan datasets containing 224 patients positive for an infection and 70 regular patients CT-scan images. Computer simulations demonstrate that the proposed method's effectiveness comparing with state-of-the-art baselines methods. The results have also been evaluated with medical professionals. The developed system could be used for medical education professional training and a telehealth VR platform.
Collapse
Affiliation(s)
- Adel Oulefki
- Centre de Développement des Technologies Avancées (CDTA), PO. Box 17 Baba Hassen, Algiers 16081, Algeria
| | - Sos Agaian
- Dept. of Computer Science, College of Staten Island, New York, 2800 Victory Blvd Staten Island, New York 10314, USA
| | - Thaweesak Trongtirakul
- Faculty of Industrial Education, Rajamangala University of Technology Phra Nakhon, 399 Samsen Rd. Vachira Phayaban, Dusit, Bangkok 10300, Thailand
| | - Samir Benbelkacem
- Centre de Développement des Technologies Avancées (CDTA), PO. Box 17 Baba Hassen, Algiers 16081, Algeria
| | - Djamel Aouam
- Centre de Développement des Technologies Avancées (CDTA), PO. Box 17 Baba Hassen, Algiers 16081, Algeria
| | - Nadia Zenati-Henda
- Centre de Développement des Technologies Avancées (CDTA), PO. Box 17 Baba Hassen, Algiers 16081, Algeria
| | | |
Collapse
|
26
|
Asadzadeh A, Mohammadzadeh Z, Fathifar Z, Jahangiri-Mirshekarlou S, Rezaei-Hachesu P. A framework for information technology-based management against COVID-19 in Iran. BMC Public Health 2022; 22:402. [PMID: 35219292 PMCID: PMC8881940 DOI: 10.1186/s12889-022-12781-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2021] [Accepted: 02/16/2022] [Indexed: 11/20/2022] Open
Abstract
BACKGROUND The COVID-19 pandemic has become a global concern. Iran is one of the countries affected most by the SARS-CoV-2 outbreak. As a result, the use of information technology (IT) has a variety of applications for pandemic management. The purpose of this study was to develop a conceptual framework for responding to the COVID-19 pandemic via IT management, based on extensive literature review and expert knowledge. METHODS The conceptual framework is developed in three stages: (1) a literature review to gather practical experience with IT applications for managing the COVID-19 pandemic, (2) a study of Iranian documents and papers that present Iran's practical experience with COVID-19, and (3) developing a conceptual framework based on the previous steps and validating it through a Delphi approach in two rounds, and by 13 experts. RESULTS The proposed conceptual framework demonstrates that during pandemics, 22 different types of technologies were used for various purposes, including virtual education, early warning, rapid screening and diagnosis of infected individuals, and data management. These objectives were classified into six categories, with the following applications highlighted: (1) Prevention (M-health, Internet search queries, telehealth, robotics, Internet of things (IoT), Artificial Intelligence (AI), big data, Virtual Reality (VR), social media); (2) Diagnosis (M-health, drones, telehealth, IoT, Robotics, AI, Decision Support System (DSS), Electronic Health Record (EHR)); (3) Treatment (Telehealth, M-health, AI, Robotic, VR, IoT); (4) Follow-up (Telehealth, M-health, VR), (5) Management & planning (Geographic information system, M-health, IoT, blockchain), and (6) Protection (IoT, AI, Robotic and automatic vehicles, Augmented Reality (AR)). In Iran, the use of IT for prevention has been emphasized through M-health, internet search queries, social media, video conferencing, management and planning objectives using databases, health information systems, dashboards, surveillance systems, and vaccine coverage. CONCLUSIONS IT capabilities were critical during the COVID-19 outbreak. Practical experience demonstrates that various aspects of information technologies were overlooked. To combat this pandemic, the government and decision-makers of this country should consider strategic planning that incorporates successful experiences against COVID-19 and the most advanced IT capabilities.
Collapse
Affiliation(s)
- Afsoon Asadzadeh
- Student Research Committee, Tabriz University of Medical Sciences, Tabriz, Iran
- Health Information Technology Department, School of Management and Medical Informatics, Tabriz University of Medical Sciences, Daneshgah St, 5165665811, Tabriz, Iran
| | - Zeinab Mohammadzadeh
- Health Information Technology Department, School of Management and Medical Informatics, Tabriz University of Medical Sciences, Daneshgah St, 5165665811, Tabriz, Iran
| | - Zahra Fathifar
- Student Research Committee, Tabriz University of Medical Sciences, Tabriz, Iran
- Health Information Technology Department, School of Management and Medical Informatics, Tabriz University of Medical Sciences, Daneshgah St, 5165665811, Tabriz, Iran
| | - Soheila Jahangiri-Mirshekarlou
- Student Research Committee, Tabriz University of Medical Sciences, Tabriz, Iran
- Health Information Technology Department, School of Management and Medical Informatics, Tabriz University of Medical Sciences, Daneshgah St, 5165665811, Tabriz, Iran
| | - Peyman Rezaei-Hachesu
- Health Information Technology Department, School of Management and Medical Informatics, Tabriz University of Medical Sciences, Daneshgah St, 5165665811, Tabriz, Iran.
| |
Collapse
|
27
|
An Overview of Medical Electronic Hardware Security and Emerging Solutions. ELECTRONICS 2022. [DOI: 10.3390/electronics11040610] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/27/2023]
Abstract
Electronic healthcare technology is widespread around the world and creates massive potential to improve clinical outcomes and transform care delivery. However, there are increasing concerns with respect to the cyber vulnerabilities of medical tools, malicious medical errors, and security attacks on healthcare data and devices. Increased connectivity to existing computer networks has exposed the medical devices/systems and their communicating data to new cybersecurity vulnerabilities. Adversaries leverage the state-of-the-art technologies, in particular artificial intelligence and computer vision-based techniques, in order to launch stronger and more detrimental attacks on the medical targets. The medical domain is an attractive area for cybercrimes for two fundamental reasons: (a) it is rich resource of valuable and sensitive data; and (b) its protection and defensive mechanisms are weak and ineffective. The attacks aim to steal health information from the patients, manipulate the medical information and queries, maliciously change the medical diagnosis, decisions, and prescriptions, etc. A successful attack in the medical domain causes serious damage to the patient’s health and even death. Therefore, cybersecurity is critical to patient safety and every aspect of the medical domain, while it has not been studied sufficiently. To tackle this problem, new human- and computer-based countermeasures are researched and proposed for medical attacks using the most effective software and hardware technologies, such as artificial intelligence and computer vision. This review provides insights to the novel and existing solutions in the literature that mitigate cyber risks, errors, damage, and threats in the medical domain. We have performed a scoping review analyzing the four major elements in this area (in order from a medical perspective): (1) medical errors; (2) security weaknesses of medical devices at software- and hardware-level; (3) artificial intelligence and/or computer vision in medical applications; and (4) cyber attacks and defenses in the medical domain. Meanwhile, artificial intelligence and computer vision are key topics in this review and their usage in all these four elements are discussed. The review outcome delivers the solutions through building and evaluating the connections among these elements in order to serve as a beneficial guideline for medical electronic hardware security.
Collapse
|
28
|
Ponomarchuk A, Burenko I, Malkin E, Nazarov I, Kokh V, Avetisian M, Zhukov L. Project Achoo: A Practical Model and Application for COVID-19 Detection From Recordings of Breath, Voice, and Cough. IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING 2022; 16:175-187. [PMID: 35582703 PMCID: PMC9088778 DOI: 10.1109/jstsp.2022.3142514] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/03/2021] [Revised: 11/23/2021] [Accepted: 01/06/2022] [Indexed: 05/27/2023]
Abstract
The COVID-19 pandemic created significant interest and demand for infection detection and monitoring solutions. In this paper, we propose a machine learning method to quickly detect COVID-19 using audio recordings made on consumer devices. The approach combines signal processing and noise removal methods with an ensemble of fine-tuned deep learning networks and enables COVID detection on coughs. We have also developed and deployed a mobile application that uses a symptoms checker together with voice, breath, and cough signals to detect COVID-19 infection. The application showed robust performance on both openly sourced datasets and the noisy data collected during beta testing by the end users.
Collapse
|
29
|
Rodríguez R, Mondeja BA, Valdes O, Resik S, Vizcaino A, Acosta EF, González Y, Kourí V, Díaz A, Guzmán MG. SARS-CoV-2: theoretical analysis of the proposed algorithms to the enhancement and segmentation of high-resolution microscopy images-Part II. SIGNAL, IMAGE AND VIDEO PROCESSING 2022; 16:595-604. [PMID: 35039754 PMCID: PMC8754368 DOI: 10.1007/s11760-021-02045-7] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/25/2020] [Revised: 01/15/2021] [Accepted: 04/09/2021] [Indexed: 06/14/2023]
Abstract
Today is a reality that the novel coronavirus SARS-Cov-2 has become a global pandemic. For this reason, the study of real microscopic images of this coronavirus is of great importance, as it allows us to carry out a more precise research on it. However, as we pointed out in a former paper as reported by Roberto Rodríguez (SARS-CoV-2: Enhancement and Segmentation of High-Resolution Microscopy Images. Part I", Sent to Signal, Image and Video Processing Video Processing, Springer, New York, 2020), many times these microscopic images present some blurring problems, which are always susceptible to be improved. The aim of this work is to carry out a theoretical analysis of the proposed algorithms to enhancement and segmentation of these microscopic images, which is important for the design and development of future algorithms before new epidemics.
Collapse
Affiliation(s)
- Roberto Rodríguez
- Institute of Cybernetics, Mathematics, and Physics of Cuba (ICIMAF), Havana, Cuba
| | | | - Odalys Valdes
- Institute of Tropical Medicine ¨Pedro Kourí ¨ (IPK), Havana, Cuba
| | - Sonia Resik
- Institute of Tropical Medicine ¨Pedro Kourí ¨ (IPK), Havana, Cuba
| | | | | | | | - Vivian Kourí
- Institute of Tropical Medicine ¨Pedro Kourí ¨ (IPK), Havana, Cuba
| | - Angelina Díaz
- Center for Advanced Studies of Cuba (CEA), Havana, Cuba
| | - María G. Guzmán
- Institute of Tropical Medicine ¨Pedro Kourí ¨ (IPK), Havana, Cuba
| |
Collapse
|
30
|
Recognition of Human Face Regions under Adverse Conditions—Face Masks and Glasses—In Thermographic Sanitary Barriers through Learning Transfer from an Object Detector. MACHINES 2022. [DOI: 10.3390/machines10010043] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/25/2023]
Abstract
The COVID-19 pandemic has detrimentally affected people’s lives and the economies of many countries, causing disruption in the health, education, transport, and other sectors. Several countries have implemented sanitary barriers at airports, bus and train stations, company gates, and other shared spaces to detect patients with viral symptoms in an effort to contain the spread of the disease. As fever is one of the most recurrent disease symptoms, the demand for devices that measure skin (body surface) temperature has increased. The thermal imaging camera, also known as a thermal imager, is one such device used to measure temperature. It employs a technology known as infrared thermography and is a noninvasive, fast, and objective tool. This study employed machine learning transfer using You Only Look Once (YOLO) to detect the hottest temperatures in the regions of interest (ROIs) of the human face in thermographic images, allowing the identification of a febrile state in humans. The algorithms detect areas of interest in the thermographic images, such as the eyes, forehead, and ears, before analyzing the temperatures in these regions. The developed software achieved excellent performance in detecting the established areas of interest, adequately indicating the maximum temperature within each region of interest, and correctly choosing the maximum temperature among them.
Collapse
|
31
|
Zhao L, Lediju Bell MA. A Review of Deep Learning Applications in Lung Ultrasound Imaging of COVID-19 Patients. BME FRONTIERS 2022; 2022:9780173. [PMID: 36714302 PMCID: PMC9880989 DOI: 10.34133/2022/9780173] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/02/2023] Open
Abstract
The massive and continuous spread of COVID-19 has motivated researchers around the world to intensely explore, understand, and develop new techniques for diagnosis and treatment. Although lung ultrasound imaging is a less established approach when compared to other medical imaging modalities such as X-ray and CT, multiple studies have demonstrated its promise to diagnose COVID-19 patients. At the same time, many deep learning models have been built to improve the diagnostic efficiency of medical imaging. The integration of these initially parallel efforts has led multiple researchers to report deep learning applications in medical imaging of COVID-19 patients, most of which demonstrate the outstanding potential of deep learning to aid in the diagnosis of COVID-19. This invited review is focused on deep learning applications in lung ultrasound imaging of COVID-19 and provides a comprehensive overview of ultrasound systems utilized for data acquisition, associated datasets, deep learning models, and comparative performance.
Collapse
Affiliation(s)
- Lingyi Zhao
- Department of Electrical and Computer Engineering, Johns Hopkins University, Baltimore, USA
| | - Muyinatu A. Lediju Bell
- Department of Electrical and Computer Engineering, Johns Hopkins University, Baltimore, USA,Department of Computer Science, Johns Hopkins University, Baltimore, USA,Department of Biomedical Engineering, Johns Hopkins University, Baltimore, USA
| |
Collapse
|
32
|
|
33
|
Sadik F, Dastider AG, Fattah SA. SpecMEn-DL: spectral mask enhancement with deep learning models to predict COVID-19 from lung ultrasound videos. Health Inf Sci Syst 2021; 9:28. [PMID: 34257953 PMCID: PMC8269407 DOI: 10.1007/s13755-021-00154-8] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2021] [Accepted: 05/24/2021] [Indexed: 12/12/2022] Open
Abstract
Lung Ultrasound (LUS) images are considered to be effective for detecting Coronavirus Disease (COVID-19) as an alternative to the existing reverse transcription-polymerase chain reaction (RT-PCR)-based detection scheme. However, the recent literature exhibits a shortage of works dealing with LUS image-based COVID-19 detection. In this paper, a spectral mask enhancement (SpecMEn) scheme is introduced along with a histogram equalization pre-processing stage to reduce the noise effect in LUS images prior to utilizing them for feature extraction. In order to detect the COVID-19 cases, we propose to utilize the SpecMEn pre-processed LUS images in the deep learning (DL) models (namely the SpecMEn-DL method), which offers a better representation of some characteristics features in LUS images and results in very satisfactory classification performance. The performance of the proposed SpecMEn-DL technique is appraised by implementing some state-of-the-art DL models and comparing the results with related studies. It is found that the use of the SpecMEn scheme in DL techniques offers an average increase in accuracy and F 1 score of 11 % and 11.75 % , respectively, at the video-level. Comprehensive analysis and visualization of the intermediate steps manifest a very satisfactory detection performance creating a flexible and safe alternative option for the clinicians to get assistance while obtaining the immediate evaluation of the patients.
Collapse
Affiliation(s)
- Farhan Sadik
- Department of Electrical and Electronic Engineering, Bangladesh University of Engineering and Technology, Dhaka, 1205 Bangladesh
| | - Ankan Ghosh Dastider
- Department of Electrical and Electronic Engineering, Bangladesh University of Engineering and Technology, Dhaka, 1205 Bangladesh
| | - Shaikh Anowarul Fattah
- Department of Electrical and Electronic Engineering, Bangladesh University of Engineering and Technology, Dhaka, 1205 Bangladesh
| |
Collapse
|
34
|
Horry MJ, Chakraborty S, Pradhan B, Fallahpoor M, Chegeni H, Paul M. Factors determining generalization in deep learning models for scoring COVID-CT images. MATHEMATICAL BIOSCIENCES AND ENGINEERING : MBE 2021; 18:9264-9293. [PMID: 34814345 DOI: 10.3934/mbe.2021456] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
The COVID-19 pandemic has inspired unprecedented data collection and computer vision modelling efforts worldwide, focused on the diagnosis of COVID-19 from medical images. However, these models have found limited, if any, clinical application due in part to unproven generalization to data sets beyond their source training corpus. This study investigates the generalizability of deep learning models using publicly available COVID-19 Computed Tomography data through cross dataset validation. The predictive ability of these models for COVID-19 severity is assessed using an independent dataset that is stratified for COVID-19 lung involvement. Each inter-dataset study is performed using histogram equalization, and contrast limited adaptive histogram equalization with and without a learning Gabor filter. We show that under certain conditions, deep learning models can generalize well to an external dataset with F1 scores up to 86%. The best performing model shows predictive accuracy of between 75% and 96% for lung involvement scoring against an external expertly stratified dataset. From these results we identify key factors promoting deep learning generalization, being primarily the uniform acquisition of training images, and secondly diversity in CT slice position.
Collapse
Affiliation(s)
- Michael James Horry
- Center for Advanced Modelling and Geospatial Information Systems (CAMGIS), Faculty of Engineering and Information Technology, University of Technology Sydney, Australia
| | - Subrata Chakraborty
- Center for Advanced Modelling and Geospatial Information Systems (CAMGIS), Faculty of Engineering and Information Technology, University of Technology Sydney, Australia
| | - Biswajeet Pradhan
- Center for Advanced Modelling and Geospatial Information Systems (CAMGIS), Faculty of Engineering and Information Technology, University of Technology Sydney, Australia
- Center of Excellence for Climate Change Research, King Abdulaziz University, Jeddah 21589, Saudi Arabia
- Earth Observation Center, Institute of Climate Change, Universiti Kebangsaan Malaysia, Selangor 43600, Malaysia
| | - Maryam Fallahpoor
- Center for Advanced Modelling and Geospatial Information Systems (CAMGIS), Faculty of Engineering and Information Technology, University of Technology Sydney, Australia
| | - Hossein Chegeni
- Fellowship of Interventional Radiology Imaging Center, IranMehr General Hospital, Iran
| | - Manoranjan Paul
- Machine Vision and Digital Health (MaViDH), School of Computing, Mathematics, and Engineering, Charles Sturt University, Australia
| |
Collapse
|
35
|
López-Cabrera JD, Orozco-Morales R, Portal-Díaz JA, Lovelle-Enríquez O, Pérez-Díaz M. Current limitations to identify covid-19 using artificial intelligence with chest x-ray imaging (part ii). The shortcut learning problem. HEALTH AND TECHNOLOGY 2021; 11:1331-1345. [PMID: 34660166 PMCID: PMC8502237 DOI: 10.1007/s12553-021-00609-8] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2021] [Accepted: 10/05/2021] [Indexed: 12/12/2022]
Abstract
Since the outbreak of the COVID-19 pandemic, computer vision researchers have been working on automatic identification of this disease using radiological images. The results achieved by automatic classification methods far exceed those of human specialists, with sensitivity as high as 100% being reported. However, prestigious radiology societies have stated that the use of this type of imaging alone is not recommended as a diagnostic method. According to some experts the patterns presented in these images are unspecific and subtle, overlapping with other viral pneumonias. This report seeks to evaluate the analysis the robustness and generalizability of different approaches using artificial intelligence, deep learning and computer vision to identify COVID-19 using chest X-rays images. We also seek to alert researchers and reviewers to the issue of "shortcut learning". Recommendations are presented to identify whether COVID-19 automatic classification models are being affected by shortcut learning. Firstly, papers using explainable artificial intelligence methods are reviewed. The results of applying external validation sets are evaluated to determine the generalizability of these methods. Finally, studies that apply traditional computer vision methods to perform the same task are considered. It is evident that using the whole chest X-Ray image or the bounding box of the lungs, the image regions that contribute most to the classification appear outside of the lung region, something that is not likely possible. In addition, although the investigations that evaluated their models on data sets external to the training set, the effectiveness of these models decreased significantly, it may provide a more realistic representation as how the model will perform in the clinic. The results indicate that, so far, the existing models often involve shortcut learning, which makes their use less appropriate in the clinical setting.
Collapse
Affiliation(s)
- José Daniel López-Cabrera
- Centro de Investigaciones de La Informática, Facultad de Matemática, Física y Computación, Universidad Central “Marta Abreu” de Las Villas, Villa Clara, Santa Clara, Cuba
| | - Rubén Orozco-Morales
- Departamento de Control Automático, Facultad de Ingeniería Eléctrica, Universidad Central “Marta Abreu” de Las Villas, Villa Clara, Santa Clara, Cuba
| | - Jorge Armando Portal-Díaz
- Departamento de Control Automático, Facultad de Ingeniería Eléctrica, Universidad Central “Marta Abreu” de Las Villas, Villa Clara, Santa Clara, Cuba
| | - Orlando Lovelle-Enríquez
- Departamento de Imagenología, Hospital Comandante Manuel Fajardo Rivero, Villa Clara, Santa Clara, Cuba
| | - Marlén Pérez-Díaz
- Departamento de Control Automático, Facultad de Ingeniería Eléctrica, Universidad Central “Marta Abreu” de Las Villas, Villa Clara, Santa Clara, Cuba
| |
Collapse
|
36
|
Mohanty F, Dora C. An optimized KELM approach for the diagnosis of COVID-19 from 2D-SSA reconstructed CXR Images. OPTIK 2021; 244:167572. [PMID: 34248209 PMCID: PMC8260491 DOI: 10.1016/j.ijleo.2021.167572] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/04/2021] [Accepted: 06/30/2021] [Indexed: 05/17/2023]
Abstract
The COVID-19 is proved to be the most infectious disease of the current century with a high mortality rate world-wide. The current RT-PCR test standard for the diagnosis of COVID-19 is an invasive and time-consuming procedure, whereas the chest X-ray (CXR) images provide a non-invasive and time/cost-effective method for COVID-19 diagnosis. The current existing deep learning methods for the detection and diagnosis of CXR images provide biased results for the small size dataset available. Hence, in the present work, a conventional yet efficient method is proposed classifying the CXR images into COVID-19, Pneumonia, and Normal. The proposed approach pre-processes the CXR images using 2D singular spectrum analysis (SSA) for image reconstruction which enhances the feature inputs to the classifier. The features are extracted from the reconstructed images using a block-based GLCM approach. Then, a grasshopper-based Kernel extreme learning machine (KELM) is proposed which finds the optimal features and kernel parameters of KELM at the same instance. From the experimental analysis, it is seen that the present work outperforms that of other competent schemes in terms of classification accuracy with a minimal set of features extracted from the first 2 eigen components of the 2D-SSA reconstructed image with 5 × 5 decomposition.
Collapse
Affiliation(s)
- Figlu Mohanty
- School of Engineering & Technology, Centurion University of Technology & Management, Odisha, India
| | - Chinmayee Dora
- School of Engineering & Technology, Centurion University of Technology & Management, Odisha, India
| |
Collapse
|
37
|
Khorami E, Mahdi Babaei F, Azadeh A. Optimal Diagnosis of COVID-19 Based on Convolutional Neural Network and Red Fox Optimization Algorithm. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2021; 2021:4454507. [PMID: 34422033 PMCID: PMC8378967 DOI: 10.1155/2021/4454507] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/24/2021] [Revised: 05/12/2021] [Accepted: 08/05/2021] [Indexed: 11/18/2022]
Abstract
SARS-CoV-2 is a specific type of Coronavirus that was firstly reported in China in December 2019 and is the causative agent of coronavirus disease 2019 (COVID-19). In March 2020, this disease spread to different parts of the world causing a global pandemic. Although this disease is still increasing exponentially day by day, early diagnosis of this disease is very important to reduce the death rate and to reduce the prevalence of this pandemic. Since there are sometimes human errors by physicians in the diagnosis of this disease, using computer-aided diagnostic systems can be helpful to get more accurate results. In this paper, chest X-ray images have been examined using a new pipeline machine vision-based system to provide more accurate results. In the proposed method, after preprocessing the input X-ray images, the region of interest has been segmented. Then, a combined gray-level cooccurrence matrix (GLCM) and Discrete Wavelet Transform (DWT) features have been extracted from the processed images. Finally, an improved version of Convolutional Neural Network (CNN) based on the Red Fox Optimization algorithm is employed for the classification of the images based on the features. The proposed method is validated by performing to three datasets and its results are compared with some state-of-the-art methods. The final results show that the suggested method has proper efficiency toward the others for the diagnosis of COVID-19.
Collapse
Affiliation(s)
- Ehsan Khorami
- Department of Computer Engineering, Ravansar (Kermanshah) Branch, Islamic Azad University, Ravansar (Kermanshah), Iran
| | - Fatemeh Mahdi Babaei
- Department of Electrical and Computer Engineering, Mahallat Branch, Islamic Azad University, Mahallat, Iran
| | - Aidin Azadeh
- Shafaghkar Dena Technical Engineering Company, Ahvaz, Iran
| |
Collapse
|
38
|
Alzubaidi M, Zubaydi HD, Bin-Salem AA, Abd-Alrazaq AA, Ahmed A, Househ M. Role of deep learning in early detection of COVID-19: Scoping review. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE UPDATE 2021; 1:100025. [PMID: 34345877 PMCID: PMC8321699 DOI: 10.1016/j.cmpbup.2021.100025] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/03/2021] [Revised: 07/21/2021] [Accepted: 07/21/2021] [Indexed: 06/13/2023]
Abstract
BACKGROUND Since the onset of the COVID-19 pandemic, the world witnessed disruption on an unprecedented scale affecting our daily lives including but not limited to healthcare, business, education, and transportation. Deep Learning (DL) is a branch of Artificial intelligence (AI) applications, the recent growth of DL includes features that could be helpful in fighting the COVID-19 pandemic. Utilizing such features could support public health efforts. OBJECTIVE Investigate the literature available in the use of DL technology to support dealing with the COVID-19 crisis. We summarize the literature that uses DL features to analyze datasets for the purpose of a quick COVID-19 detection. METHODS This review follows PRISMA Extension for Scoping Reviews (PRISMA-ScR). We have scanned the most two commonly used databases (IEEE, ACM). Search terms were identified based on the target intervention (DL) and the target population (COVID-19). Two authors independently handled study selection and one author assigned for data extraction. A narrative approach is used to synthesize the extracted data. RESULTS We retrieved 53 studies and after passing through PRISMA excluding criteria, only 17 studies are considered in this review. All studies used deep learning for detection of COVID-19 cases in early stage based on different diagnostic modalities. Convolutional Neural Network (CNN) and Transfer Learning (TL) were the most commonly used techniques. CONCLUSION The included studies showed that DL techniques has significant impact on early detection of COVID-19 with high accuracy rate. However, most of the proposed methods are still in development and not tested in a clinical setting. Further investigation and collaboration are required from the research community and healthcare professionals in order to develop and standardize guidelines for use of DL in the healthcare domain.
Collapse
Key Words
- AI, Artificial intelligence
- CNN, Convolutional Neural Network
- COVID-19
- COVID-19, Corona Virus 2019
- CT, Computed Tomography
- CXR, Chest X-Ray Radiography
- Coronavirus
- DL, Deep Learning
- Deep learning
- Machine learning
- RNN, Recurrent Neural Network
- SARS-CoV-2, Severe Acute Respiratory Syndrome Coronavirus 2
- ULS, Ultrasonography
- WHO, World Health Organization
Collapse
Affiliation(s)
- Mahmood Alzubaidi
- College of Science and Engineering, Hamad Bin Khalifa University, Doha, Qatar
| | - Haider Dhia Zubaydi
- National Advanced IPv6 Centre, Universiti Sains Malaysia, Gelugor 11800, Penang, Malaysia
| | | | - Alaa A Abd-Alrazaq
- College of Science and Engineering, Hamad Bin Khalifa University, Doha, Qatar
| | - Arfan Ahmed
- College of Science and Engineering, Hamad Bin Khalifa University, Doha, Qatar
| | - Mowafa Househ
- College of Science and Engineering, Hamad Bin Khalifa University, Doha, Qatar
| |
Collapse
|
39
|
Oulefki A, Agaian S, Trongtirakul T, Kassah Laouar A. Automatic COVID-19 lung infected region segmentation and measurement using CT-scans images. PATTERN RECOGNITION 2021; 114:107747. [PMID: 33162612 PMCID: PMC7605758 DOI: 10.1016/j.patcog.2020.107747] [Citation(s) in RCA: 88] [Impact Index Per Article: 22.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/23/2020] [Revised: 09/26/2020] [Accepted: 11/01/2020] [Indexed: 05/03/2023]
Abstract
History shows that the infectious disease (COVID-19) can stun the world quickly, causing massive losses to health, resulting in a profound impact on the lives of billions of people, from both a safety and an economic perspective, for controlling the COVID-19 pandemic. The best strategy is to provide early intervention to stop the spread of the disease. In general, Computer Tomography (CT) is used to detect tumors in pneumonia, lungs, tuberculosis, emphysema, or other pleura (the membrane covering the lungs) diseases. Disadvantages of CT imaging system are: inferior soft tissue contrast compared to MRI as it is X-ray-based Radiation exposure. Lung CT image segmentation is a necessary initial step for lung image analysis. The main challenges of segmentation algorithms exaggerated due to intensity in-homogeneity, presence of artifacts, and closeness in the gray level of different soft tissue. The goal of this paper is to design and evaluate an automatic tool for automatic COVID-19 Lung Infection segmentation and measurement using chest CT images. The extensive computer simulations show better efficiency and flexibility of this end-to-end learning approach on CT image segmentation with image enhancement comparing to the state of the art segmentation approaches, namely GraphCut, Medical Image Segmentation (MIS), and Watershed. Experiments performed on COVID-CT-Dataset containing (275) CT scans that are positive for COVID-19 and new data acquired from the EL-BAYANE center for Radiology and Medical Imaging. The means of statistical measures obtained using the accuracy, sensitivity, F-measure, precision, MCC, Dice, Jacquard, and specificity are 0.98, 0.73, 0.71, 0.73, 0.71, 0.71, 0.57, 0.99 respectively; which is better than methods mentioned above. The achieved results prove that the proposed approach is more robust, accurate, and straightforward.
Collapse
Affiliation(s)
- Adel Oulefki
- Centre de Développement des Technologies Avancées - CDTA, PO. Box 17 Baba Hassen, Algiers 16081, Algeria
| | - Sos Agaian
- Department of Computer Science, College of Staten Island, New York, 2800 Victory Blvd Staten Island, New York 10314, USA
| | - Thaweesak Trongtirakul
- Faculty of Industrial Education Rajamangala University of Technology Phra Nakhon, Vachira Phayaban Dusit Bangkok 10300, Thailand
| | - Azzeddine Kassah Laouar
- EL-BAYANE Center for Radiology and Medical Imaging (Cabinet d'Imagerie Médicale), Bordj Bou Arréridj 34000, Algeria
| |
Collapse
|
40
|
Singh PD, Kaur R, Singh KD, Dhiman G. A Novel Ensemble-based Classifier for Detecting the COVID-19 Disease for Infected Patients. INFORMATION SYSTEMS FRONTIERS : A JOURNAL OF RESEARCH AND INNOVATION 2021; 23:1385-1401. [PMID: 33935584 PMCID: PMC8068562 DOI: 10.1007/s10796-021-10132-w] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 03/30/2021] [Indexed: 05/02/2023]
Abstract
The recently discovered coronavirus, SARS-CoV-2, which was detected in Wuhan, China, has spread worldwide and is still being studied at the end of 2019. Detection of COVID-19 at an early stage is essential to provide adequate healthcare to affected patients and protect the uninfected community. This paper aims to design and develop a novel ensemble-based classifier to predict COVID-19 cases at a very early stage so that appropriate action can be taken by patients, doctors, health organizations, and the government. In this paper, a synthetic dataset of COVID-19 is generated by a dataset generation algorithm. A novel ensemble-based classifier of machine learning is employed on the COVID-19 dataset to predict the disease. A convex hull-based approach is also applied to the data to improve the proposed novel, ensemble-based classifier's accuracy and speed. The model is designed and developed through the python programming language and compares with the most popular classifier, i.e., Decision Tree, ID3, and support vector machine. The results indicate that the proposed novel classifier provides a more significant precision, kappa static, root means a square error, recall, F-measure, and accuracy.
Collapse
Affiliation(s)
- Prabh Deep Singh
- Department of Computer Science & Engineering, Punjabi University, Patiala, Punjab India
| | - Rajbir Kaur
- Department of Electronics & Communication Engineering, Punjabi University, Patiala, Punjab India
| | - Kiran Deep Singh
- Department of Computer Science & Engineering, IKG Punjab Technical University, Punjab, India
| | - Gaurav Dhiman
- Department of Computer Science, Government Bikram College of Commerce, Punjabi University, Patiala, Punjab India
| |
Collapse
|
41
|
Peddinti B, Shaikh A, K R B, K C NK. Framework for Real-Time Detection and Identification of possible patients of COVID-19 at public places. Biomed Signal Process Control 2021; 68:102605. [PMID: 33824682 PMCID: PMC8015425 DOI: 10.1016/j.bspc.2021.102605] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/13/2020] [Revised: 03/22/2021] [Accepted: 03/26/2021] [Indexed: 12/23/2022]
Abstract
The novel Corona Virus (COVID-19) has become the reason for the world to declare it as a global pandemic, which has already taken many lives from all around the world. This pandemic has become a disaster since the spreading rate from person to person is incredibly high and many techniques have come forth to aid in stopping the infection. Although various types of methods have been put into implementation, the search and suggestions of new approaches to reduce the increasing rate of infection will never come to an end until a vaccine terminates this pandemic. This study focuses on proposing a new framework that is based on Deep Learning algorithms for recognizing the COVID-19 cases, mostly in public places. The algorithms include Background Subtraction for extracting the foreground of thermal images from thermal videos generated by Thermal Cameras through the Thermal Imaging process and the Convolutional Neural Network for detecting people infected with the virus. This automated prototype works in a real-time scenario that helps identify people with the disease and will try to trace it while separating them from having any other contact. This proposal intends to achieve a satisfying growth in determining the real cases of COVID-19 and minimize the spreading rate of this virus to the max, ultimately avoiding more deaths.
Collapse
Affiliation(s)
- Bharati Peddinti
- Department of Computer Science, Graphic Era Deemed to be University, Dehradun, India
| | - Amir Shaikh
- Department of Mechanical Engineering, Graphic Era Deemed to be University, Dehradun, India
| | - Bhavya K R
- Department of Computer Science, Presidency University, Bengaluru, India
| | - Nithin Kumar K C
- Department of Mechanical Engineering, Graphic Era Deemed to be University, Dehradun, India
| |
Collapse
|
42
|
Islam MM, Karray F, Alhajj R, Zeng J. A Review on Deep Learning Techniques for the Diagnosis of Novel Coronavirus (COVID-19). IEEE ACCESS : PRACTICAL INNOVATIONS, OPEN SOLUTIONS 2021; 9:30551-30572. [PMID: 34976571 PMCID: PMC8675557 DOI: 10.1109/access.2021.3058537] [Citation(s) in RCA: 118] [Impact Index Per Article: 29.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/26/2021] [Accepted: 02/06/2021] [Indexed: 05/03/2023]
Abstract
Novel coronavirus (COVID-19) outbreak, has raised a calamitous situation all over the world and has become one of the most acute and severe ailments in the past hundred years. The prevalence rate of COVID-19 is rapidly rising every day throughout the globe. Although no vaccines for this pandemic have been discovered yet, deep learning techniques proved themselves to be a powerful tool in the arsenal used by clinicians for the automatic diagnosis of COVID-19. This paper aims to overview the recently developed systems based on deep learning techniques using different medical imaging modalities like Computer Tomography (CT) and X-ray. This review specifically discusses the systems developed for COVID-19 diagnosis using deep learning techniques and provides insights on well-known data sets used to train these networks. It also highlights the data partitioning techniques and various performance measures developed by researchers in this field. A taxonomy is drawn to categorize the recent works for proper insight. Finally, we conclude by addressing the challenges associated with the use of deep learning methods for COVID-19 detection and probable future trends in this research area. The aim of this paper is to facilitate experts (medical or otherwise) and technicians in understanding the ways deep learning techniques are used in this regard and how they can be potentially further utilized to combat the outbreak of COVID-19.
Collapse
Affiliation(s)
- Md. Milon Islam
- Centre for Pattern Analysis and Machine IntelligenceDepartment of Electrical and Computer EngineeringUniversity of WaterlooWaterlooONN2L 3G1Canada
| | - Fakhri Karray
- Centre for Pattern Analysis and Machine IntelligenceDepartment of Electrical and Computer EngineeringUniversity of WaterlooWaterlooONN2L 3G1Canada
| | - Reda Alhajj
- Department of Computer ScienceUniversity of CalgaryCalgaryABT2N 1N4Canada
| | - Jia Zeng
- Institute for Personalized Cancer TherapyMD Anderson Cancer CenterHoustonTX77030USA
| |
Collapse
|
43
|
Accelerating Detection of Lung Pathologies with Explainable Ultrasound Image Analysis. APPLIED SCIENCES-BASEL 2021. [DOI: 10.3390/app11020672] [Citation(s) in RCA: 47] [Impact Index Per Article: 11.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
Abstract
Care during the COVID-19 pandemic hinges upon the existence of fast, safe, and highly sensitive diagnostic tools. Considering significant practical advantages of lung ultrasound (LUS) over other imaging techniques, but difficulties for doctors in pattern recognition, we aim to leverage machine learning toward guiding diagnosis from LUS. We release the largest publicly available LUS dataset for COVID-19 consisting of 202 videos from four classes (COVID-19, bacterial pneumonia, non-COVID-19 viral pneumonia and healthy controls). On this dataset, we perform an in-depth study of the value of deep learning methods for the differential diagnosis of lung pathologies. We propose a frame-based model that correctly distinguishes COVID-19 LUS videos from healthy and bacterial pneumonia data with a sensitivity of 0.90±0.08 and a specificity of 0.96±0.04. To investigate the utility of the proposed method, we employ interpretability methods for the spatio-temporal localization of pulmonary biomarkers, which are deemed useful for human-in-the-loop scenarios in a blinded study with medical experts. Aiming for robustness, we perform uncertainty estimation and demonstrate the model to recognize low-confidence situations which also improves performance. Lastly, we validated our model on an independent test dataset and report promising performance (sensitivity 0.806, specificity 0.962). The provided dataset facilitates the validation of related methodology in the community and the proposed framework might aid the development of a fast, accessible screening method for pulmonary diseases. Dataset and all code are publicly available at: https://github.com/BorgwardtLab/covid19_ultrasound.
Collapse
|
44
|
Rodríguez R, Mondeja BA, Valdés O, Resik S, Vizcaino A, Acosta EF, González Y, Kourí V, Díaz A, Guzmán MG. SARS-CoV-2: enhancement and segmentation of high-resolution microscopy images-Part I. SIGNAL, IMAGE AND VIDEO PROCESSING 2021; 15:1713-1721. [PMID: 33907588 PMCID: PMC8063193 DOI: 10.1007/s11760-021-01912-7] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/05/2020] [Revised: 03/02/2021] [Accepted: 04/10/2021] [Indexed: 05/09/2023]
Abstract
Possibly, and due to poor eating habits and unhealthy lifestyle, many viruses are transmitted to human people. Such is the case, of the novel coronavirus SARS-Cov-2, which has expanded of exponential way, practically, to whole world population. For this reason, the enhancement of real microscopic images of this coronavirus is of great importance. Of this way, one can highlight the S-spikes and visualizing those areas that show a high density, which are related to active zones of viral germination and major spread of the virus. The SARS-Cov-2 images were captured from nasopharyngeal samples of Cuban symptomatic individuals (RT-PCR positives for SARS-CoV-2) and processed via scanning electron microscopy. However, many times these microscopic images present some blurring problems, and the S-spikes do not look well defined. Therefore, the aim of this work is to propose new computational methods to carry out enhancement and segmentation of SARS-Cov-2 high-resolution microscopic images. The proposed strategy obtained very satisfactory results, and we validated its performance, together with specialist physicians, on a set of 1005 images. Due to the importance of the obtained results, this first work will be addressed to the application of the proposed algorithm. A second paper will deeply analyze the theory related to these algorithms.
Collapse
Affiliation(s)
- Roberto Rodríguez
- Institute of Cybernetics, Mathematics and Physics (ICIMAF), La Habana, Cuba
| | | | - Odalys Valdés
- Institute of Tropical Medicine ¨Pedro Kourí ¨ (IPK), Ciudad de La Habana, Cuba
| | - Sonia Resik
- Institute of Tropical Medicine ¨Pedro Kourí ¨ (IPK), Ciudad de La Habana, Cuba
| | | | | | | | - Vivian Kourí
- Institute of Tropical Medicine ¨Pedro Kourí ¨ (IPK), Ciudad de La Habana, Cuba
| | - Angelina Díaz
- Center for Advanced Studies of Cuba (CEA), Valle Grande, Cuba
| | - María G. Guzmán
- Institute of Tropical Medicine ¨Pedro Kourí ¨ (IPK), Ciudad de La Habana, Cuba
| |
Collapse
|
45
|
Attique Khan M, Majid A, Akram T, Hussain N, Nam Y, Kadry S, Wang SH, Alhaisoni M. Classification of COVID-19 CT Scans via Extreme Learning Machine. COMPUTERS, MATERIALS & CONTINUA 2021; 68:1003-1019. [DOI: 10.32604/cmc.2021.015541] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/26/2020] [Accepted: 01/23/2021] [Indexed: 08/25/2024]
|
46
|
Shen Y, Guo D, Long F, Mateos LA, Ding H, Xiu Z, Hellman RB, King A, Chen S, Zhang C, Tan H. Robots Under COVID-19 Pandemic: A Comprehensive Survey. IEEE ACCESS : PRACTICAL INNOVATIONS, OPEN SOLUTIONS 2020; 9:1590-1615. [PMID: 34976569 PMCID: PMC8675561 DOI: 10.1109/access.2020.3045792] [Citation(s) in RCA: 54] [Impact Index Per Article: 10.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/16/2020] [Accepted: 12/08/2020] [Indexed: 05/04/2023]
Abstract
As a result of the difficulties brought by COVID-19 and its associated lockdowns, many individuals and companies have turned to robots in order to overcome the challenges of the pandemic. Compared with traditional human labor, robotic and autonomous systems have advantages such as an intrinsic immunity to the virus and an inability for human-robot-human spread of any disease-causing pathogens, though there are still many technical hurdles for the robotics industry to overcome. This survey comprehensively reviews over 200 reports covering robotic systems which have emerged or have been repurposed during the past several months, to provide insights to both academia and industry. In each chapter, we cover both the advantages and the challenges for each robot, finding that robotics systems are overall apt solutions for dealing with many of the problems brought on by COVID-19, including: diagnosis, screening, disinfection, surgery, telehealth, care, logistics, manufacturing and broader interpersonal problems unique to the lockdowns of the pandemic. By discussing the potential new robot capabilities and fields they applied to, we expect the robotics industry to take a leap forward due to this unexpected pandemic.
Collapse
Affiliation(s)
- Yang Shen
- UBTECH North America Research and Development CenterPasadenaCA91101USA
| | - Dejun Guo
- UBTECH North America Research and Development CenterPasadenaCA91101USA
| | - Fei Long
- UBTECH North America Research and Development CenterPasadenaCA91101USA
| | - Luis A. Mateos
- UBTECH North America Research and Development CenterPasadenaCA91101USA
| | - Houzhu Ding
- UBTECH North America Research and Development CenterPasadenaCA91101USA
| | - Zhen Xiu
- UBTECH North America Research and Development CenterPasadenaCA91101USA
| | | | - Adam King
- UBTECH North America Research and Development CenterPasadenaCA91101USA
| | - Shixun Chen
- UBTECH North America Research and Development CenterPasadenaCA91101USA
| | - Chengkun Zhang
- UBTECH North America Research and Development CenterPasadenaCA91101USA
| | - Huan Tan
- UBTECH North America Research and Development CenterPasadenaCA91101USA
| |
Collapse
|
47
|
DeepSOCIAL: Social Distancing Monitoring and Infection Risk Assessment in COVID-19 Pandemic. APPLIED SCIENCES-BASEL 2020. [DOI: 10.3390/app10217514] [Citation(s) in RCA: 48] [Impact Index Per Article: 9.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/21/2022]
Abstract
Social distancing is a recommended solution by the World Health Organisation (WHO) to minimise the spread of COVID-19 in public places. The majority of governments and national health authorities have set the 2-m physical distancing as a mandatory safety measure in shopping centres, schools and other covered areas. In this research, we develop a hybrid Computer Vision and YOLOv4-based Deep Neural Network (DNN) model for automated people detection in the crowd in indoor and outdoor environments using common CCTV security cameras. The proposed DNN model in combination with an adapted inverse perspective mapping (IPM) technique and SORT tracking algorithm leads to a robust people detection and social distancing monitoring. The model has been trained against two most comprehensive datasets by the time of the research—the Microsoft Common Objects in Context (MS COCO) and Google Open Image datasets. The system has been evaluated against the Oxford Town Centre dataset (including 150,000 instances of people detection) with superior performance compared to three state-of-the-art methods. The evaluation has been conducted in challenging conditions, including occlusion, partial visibility, and under lighting variations with the mean average precision of 99.8% and the real-time speed of 24.1 fps. We also provide an online infection risk assessment scheme by statistical analysis of the spatio-temporal data from people’s moving trajectories and the rate of social distancing violations. We identify high-risk zones with the highest possibility of virus spread and infection. This may help authorities to redesign the layout of a public place or to take precaution actions to mitigate high-risk zones. The developed model is a generic and accurate people detection and tracking solution that can be applied in many other fields such as autonomous vehicles, human action recognition, anomaly detection, sports, crowd analysis, or any other research areas where the human detection is in the centre of attention.
Collapse
|
48
|
Ulhaq A, Born J, Khan A, Gomes DPS, Chakraborty S, Paul M. COVID-19 Control by Computer Vision Approaches: A Survey. IEEE ACCESS : PRACTICAL INNOVATIONS, OPEN SOLUTIONS 2020; 8:179437-179456. [PMID: 34812357 PMCID: PMC8545281 DOI: 10.1109/access.2020.3027685] [Citation(s) in RCA: 30] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/22/2020] [Accepted: 09/26/2020] [Indexed: 05/03/2023]
Abstract
The COVID-19 pandemic has triggered an urgent call to contribute to the fight against an immense threat to the human population. Computer Vision, as a subfield of artificial intelligence, has enjoyed recent success in solving various complex problems in health care and has the potential to contribute to the fight of controlling COVID-19. In response to this call, computer vision researchers are putting their knowledge base at test to devise effective ways to counter COVID-19 challenge and serve the global community. New contributions are being shared with every passing day. It motivated us to review the recent work, collect information about available research resources, and an indication of future research directions. We want to make it possible for computer vision researchers to find existing and future research directions. This survey article presents a preliminary review of the literature on research community efforts against COVID-19 pandemic.
Collapse
Affiliation(s)
- Anwaar Ulhaq
- School of Computing and MathematicsCharles Sturt UniversityPort MacquarieNSW2795Australia
| | - Jannis Born
- Department for Biosystems Science and EngineeringETH Zurich4058BaselSwitzerland
| | - Asim Khan
- College of Engineering and ScienceVictoria UniversityMelbourneVIC3011Australia
| | | | - Subrata Chakraborty
- Faculty of Engineering and Information TechnologyUniversity of Technology SydneySydneyNSW2007Australia
| | - Manoranjan Paul
- School of Computing and MathematicsCharles Sturt UniversityPort MacquarieNSW2795Australia
| |
Collapse
|