1
|
Wang M, He Y, Peng L, Song X, Dong S, Gong Y. Cross-Domain Invariant Feature Absorption and Domain-Specific Feature Retention for Domain Incremental Chest X-Ray Classification. IEEE TRANSACTIONS ON MEDICAL IMAGING 2025; 44:2041-2055. [PMID: 40030951 DOI: 10.1109/tmi.2025.3525902] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/05/2025]
Abstract
Chest X-ray (CXR) images have been widely adopted in clinical care and pathological diagnosis in recent years. Some advanced methods on CXR classification task achieve impressive performance by training the model statically. However, in the real clinical environment, the model needs to learn continually and this can be viewed as a domain incremental learning (DIL) problem. Due to large domain gaps, DIL is faced with catastrophic forgetting. Therefore, in this paper, we propose a Cross-domain invariant feature absorption and Domain-specific feature retention (CaD) framework. To be specific, we adopt a Cross-domain Invariant Feature Absorption (CIFA) module to learn the domain invariant knowledge and a Domain-Specific Feature Retention (DSFR) module to learn the domain-specific knowledge. The CIFA module contains the C(lass)-adapter and an absorbing strategy is used to fuse the common features among different domains. The DSFR module contains the D(omain)-adapter for each domain and it connects to the network in parallel independently to prevent forgetting. A multi-label contrastive loss (MLCL) is used in the training process and improves the class distinctiveness within each domain. We leverage publicly available large-scale datasets to simulate domain incremental learning scenarios, extensive experimental results substantiate the effectiveness of our proposed methods and it has reached state-of-the-art performance.
Collapse
|
2
|
Luo Y, Khan MO, Wen C, Afzal MM, Wuermeling TF, Shi M, Tian Y, Fang Y, Wang M. FairDiffusion: Enhancing equity in latent diffusion models via fair Bayesian perturbation. SCIENCE ADVANCES 2025; 11:eads4593. [PMID: 40184460 DOI: 10.1126/sciadv.ads4593] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/14/2024] [Accepted: 03/04/2025] [Indexed: 04/06/2025]
Abstract
Recent advancements in generative AI, particularly diffusion models, have proven valuable for text-to-image synthesis. In health care, these models offer immense potential in generating synthetic datasets and aiding medical training. Despite these strong performances, it remains uncertain whether the image generation quality is consistent across different demographic subgroups. To address this, we conduct a comprehensive analysis of fairness in medical text-to-image diffusion models. Evaluations of the Stable Diffusion model reveal substantial disparities across gender, race, and ethnicity. To reduce these biases, we propose FairDiffusion, an equity-aware latent diffusion model that improves both image quality and the semantic alignment of clinical features. In addition, we design and curate FairGenMed, a dataset tailored for fairness studies in medical generative models. FairDiffusion is further assessed on HAM10000 (dermatoscopic images) and CheXpert (chest x-rays), demonstrating its effectiveness in diverse medical imaging modalities. Together, FairDiffusion and FairGenMed advance research in fair generative learning, promoting equitable benefits of generative AI in health care.
Collapse
Affiliation(s)
- Yan Luo
- Harvard AI and Robotics Lab, Schepens Eye Research Institute of Massachusetts Eye and Ear, Harvard Medical School, Boston, MA 02114 USA
- Harvard Ophthalmology AI Lab, Schepens Eye Research Institute of Massachusetts Eye and Ear, Harvard Medical School, Boston, MA 02114, USA
- Broad Institute of MIT and Harvard, Cambridge, MA 02142, USA
| | - Muhammad Osama Khan
- Center for Artificial Intelligence and Robotics, New York University Abu Dhabi, Saadiyat Island, Abu Dhabi, 129188, United Arab Emirates
| | - Congcong Wen
- Center for Artificial Intelligence and Robotics, New York University Abu Dhabi, Saadiyat Island, Abu Dhabi, 129188, United Arab Emirates
- Embodied AI and Robotics (AIR) Lab, New York University, 6 MetroTech Center, Brooklyn, 11201, NY, USA
| | - Muhammad Muneeb Afzal
- Center for Artificial Intelligence and Robotics, New York University Abu Dhabi, Saadiyat Island, Abu Dhabi, 129188, United Arab Emirates
| | - Titus Fidelis Wuermeling
- Harvard AI and Robotics Lab, Schepens Eye Research Institute of Massachusetts Eye and Ear, Harvard Medical School, Boston, MA 02114 USA
- Harvard Ophthalmology AI Lab, Schepens Eye Research Institute of Massachusetts Eye and Ear, Harvard Medical School, Boston, MA 02114, USA
| | - Min Shi
- Harvard AI and Robotics Lab, Schepens Eye Research Institute of Massachusetts Eye and Ear, Harvard Medical School, Boston, MA 02114 USA
- Harvard Ophthalmology AI Lab, Schepens Eye Research Institute of Massachusetts Eye and Ear, Harvard Medical School, Boston, MA 02114, USA
| | - Yu Tian
- Harvard AI and Robotics Lab, Schepens Eye Research Institute of Massachusetts Eye and Ear, Harvard Medical School, Boston, MA 02114 USA
- Harvard Ophthalmology AI Lab, Schepens Eye Research Institute of Massachusetts Eye and Ear, Harvard Medical School, Boston, MA 02114, USA
| | - Yi Fang
- Center for Artificial Intelligence and Robotics, New York University Abu Dhabi, Saadiyat Island, Abu Dhabi, 129188, United Arab Emirates
- Embodied AI and Robotics (AIR) Lab, New York University, 6 MetroTech Center, Brooklyn, 11201, NY, USA
| | - Mengyu Wang
- Harvard AI and Robotics Lab, Schepens Eye Research Institute of Massachusetts Eye and Ear, Harvard Medical School, Boston, MA 02114 USA
- Harvard Ophthalmology AI Lab, Schepens Eye Research Institute of Massachusetts Eye and Ear, Harvard Medical School, Boston, MA 02114, USA
- Broad Institute of MIT and Harvard, Cambridge, MA 02142, USA
- Kempner Institute for the Study of Natural and Artificial Intelligence, Harvard University, Boston, MA 02134, USA
| |
Collapse
|
3
|
Touloumes N, Gagianas G, Bradley J, Muelly M, Kalra A, Reicher J. ScreenDx, an artificial intelligence-based algorithm for the incidental detection of pulmonary fibrosis. Am J Med Sci 2025:S0002-9629(25)00926-7. [PMID: 40020875 DOI: 10.1016/j.amjms.2025.02.011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/23/2024] [Revised: 02/06/2025] [Accepted: 02/26/2025] [Indexed: 03/03/2025]
Abstract
BACKGROUND Nonspecific symptoms and variability in radiographic reporting patterns contribute to a diagnostic delay of the diagnosis of pulmonary fibrosis. An attractive solution is the use of machine-learning algorithms to screen for radiographic features suggestive of pulmonary fibrosis. Thus, we developed and validated a machine learning classifier algorithm (ScreenDx) to screen computed tomography imaging and identify incidental cases of pulmonary fibrosis. METHODS ScreenDx is a deep learning convolutional neural network that was developed from a multi-source dataset (cohort A) of 3,658 cases of normal and abnormal CT's, including CT's from patients with COPD, emphysema, and community-acquired pneumonia. Cohort B, a US-based cohort (n = 381) was used for tuning the algorithm, and external validation was performed on cohort C (n = 683), a separate international dataset. RESULTS At the optimal threshold, the sensitivity and specificity for detection of pulmonary fibrosis in cohort B was 0.91 (95 % CI 88-94 %) and 0.95 (95 % CI 93-97 %), respectively, with AUC 0.98. In the external validation dataset (cohort C), the sensitivity and specificity were 1.0 (95 % 99.9-100.0) and 0.98 (95 % CI 97.9-99.6), respectively, with AUC 0.997. There were no significant differences in the ability of ScreenDx to identify pulmonary fibrosis based on CT manufacturer (Phillips, Toshiba, GE Healthcare, or Siemens) or slice thickness (2 mm vs 2-4 mm vs 4 mm). CONCLUSION Regardless of CT manufacturer or slice thickness, ScreenDx demonstrated high performance across two, multi-site datasets for identifying incidental cases of pulmonary fibrosis. This suggest that the algorithm may be generalizable across patient populations and different healthcare systems.
Collapse
Affiliation(s)
- Nikolas Touloumes
- Division of General Internal Medicine, Dept. of Medicine, University of Louisville. 550 South Jackson Street, 3rd Floor, Ste A3K00, Louisville, KY 40202, United States
| | - Georgia Gagianas
- Philadelphia College of Osteopathic Medicine. Philadelphia, PA, 4170 City Avenue, Philadelphia, PA 19131, United States
| | - James Bradley
- Division of Pulmonary, Critical Care Medicine, and Sleep Disorders, Dept. of Medicine, University of Louisville. 550 South Jackson Street, 3rd Floor, Ste A3R40, Louisville, KY 40202, United States.
| | - Michael Muelly
- Division of Body MRI, Department of Radiology, Stanford Medicine Diagnostic Radiology, 300 Pasteur Dr Rm S092, MC 5105, Stanford, CA 94305, United States; Imvaria Inc. Berkeley, CA 94709, United States
| | - Angad Kalra
- Imvaria Inc. Berkeley, CA 94709, United States
| | | |
Collapse
|
4
|
Pham NT, Ko J, Shah M, Rakkiyappan R, Woo HG, Manavalan B. Leveraging deep transfer learning and explainable AI for accurate COVID-19 diagnosis: Insights from a multi-national chest CT scan study. Comput Biol Med 2025; 185:109461. [PMID: 39631112 DOI: 10.1016/j.compbiomed.2024.109461] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2024] [Revised: 11/03/2024] [Accepted: 11/19/2024] [Indexed: 12/07/2024]
Abstract
The COVID-19 pandemic has emerged as a global health crisis, impacting millions worldwide. Although chest computed tomography (CT) scan images are pivotal in diagnosing COVID-19, their manual interpretation by radiologists is time-consuming and potentially subjective. Automated computer-aided diagnostic (CAD) frameworks offer efficient and objective solutions. However, machine or deep learning methods often face challenges in their reproducibility due to underlying biases and methodological flaws. To address these issues, we propose XCT-COVID, an explainable, transferable, and reproducible CAD framework based on deep transfer learning to predict COVID-19 infection from CT scan images accurately. This is the first study to develop three distinct models within a unified framework by leveraging a previously unexplored large dataset and two widely used smaller datasets. We employed five known convolutional neural network architectures, both with and without pretrained weights, on the larger dataset. We optimized hyperparameters through extensive grid search and 5-fold cross-validation (CV), significantly enhancing the model performance. Experimental results from the larger dataset showed that the VGG16 architecture (XCT-COVID-L) with pretrained weights consistently outperformed other architectures, achieving the best performance, on both 5-fold CV and independent test. When evaluated with the external datasets, XCT-COVID-L performed well with data with similar distributions, demonstrating its transferability. However, its performance significantly decreased on smaller datasets with lower-quality images. To address this, we developed other models, XCT-COVID-S1 and XCT-COVID-S2, specifically for the smaller datasets, outperforming existing methods. Moreover, eXplainable Artificial Intelligence (XAI) analyses were employed to interpret the models' functionalities. For prediction and reproducibility purposes, the implementation of XCT-COVID is publicly accessible at https://github.com/cbbl-skku-org/XCT-COVID/.
Collapse
Affiliation(s)
- Nhat Truong Pham
- Department of Integrative Biotechnology, College of Biotechnology and Bioengineering, Sungkyunkwan University, Suwon, 16419, Gyeonggi-do, Republic of Korea
| | - Jinsol Ko
- Department of Physiology, Ajou University School of Medicine, Suwon, 16499, Republic of Korea; Department of Biomedical Science, Graduate School, Ajou University, Suwon, Republic of Korea
| | - Masaud Shah
- Department of Physiology, Ajou University School of Medicine, Suwon, 16499, Republic of Korea
| | - Rajan Rakkiyappan
- Department of Mathematics, Bharathiar University, Coimbatore, 641046, Tamil Nadu, India
| | - Hyun Goo Woo
- Department of Physiology, Ajou University School of Medicine, Suwon, 16499, Republic of Korea; Department of Biomedical Science, Graduate School, Ajou University, Suwon, Republic of Korea; Ajou Translational Omics Center (ATOC), Ajou University Medical Center, Republic of Korea.
| | - Balachandran Manavalan
- Department of Integrative Biotechnology, College of Biotechnology and Bioengineering, Sungkyunkwan University, Suwon, 16419, Gyeonggi-do, Republic of Korea.
| |
Collapse
|
5
|
Huang Y, Liu W, Yao C, Miao X, Guan X, Lu X, Liang X, Ma L, Tang S, Zhang Z, Zhan J. A multimodal dental dataset facilitating machine learning research and clinic services. Sci Data 2024; 11:1291. [PMID: 39604495 PMCID: PMC11603170 DOI: 10.1038/s41597-024-04130-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2023] [Accepted: 11/13/2024] [Indexed: 11/29/2024] Open
Abstract
Oral diseases affect nearly 3.5 billion people, and medical resources are limited, which makes access to oral health services nontrivial. Imaging-based machine learning technology is one of the most promising technologies to improve oral medical services and reduce patient costs. The development of machine learning technology requires publicly accessible datasets. However, previous public dental datasets have several limitations: a small volume of computed tomography (CT) images, a lack of multimodal data, and a lack of complexity and diversity of data. These issues are detrimental to the development of the field of dentistry. Thus, to solve these problems, this paper introduces a new dental dataset that contains 169 patients, three commonly used dental image modalities, and images of various health conditions of the oral cavity. The proposed dataset has good potential to facilitate research on oral medical services, such as reconstructing the 3D structure of assisting clinicians in diagnosis and treatment, image translation, and image segmentation.
Collapse
Affiliation(s)
- Yunyou Huang
- Key Lab of Education Blockchain and Intelligent Technology, Ministry of Education, Guangxi Normal University, Guilin, 541004, China
- Guangxi Key Lab of Multi-Source Information Mining and Security, Guangxi Normal University, Guilin, 541004, China
- The International Open Benchmark Council, 19801, Delaware, USA
| | - Wenjing Liu
- Key Lab of Education Blockchain and Intelligent Technology, Ministry of Education, Guangxi Normal University, Guilin, 541004, China
- Guangxi Key Lab of Multi-Source Information Mining and Security, Guangxi Normal University, Guilin, 541004, China
- Guilin Medical University, Guilin, 541199, China
| | - Caiqin Yao
- The Second Nanning People's Hospital, Nanning, 530031, China
| | - Xiuxia Miao
- Key Lab of Education Blockchain and Intelligent Technology, Ministry of Education, Guangxi Normal University, Guilin, 541004, China
- Guangxi Key Lab of Multi-Source Information Mining and Security, Guangxi Normal University, Guilin, 541004, China
| | - Xianglong Guan
- Key Lab of Education Blockchain and Intelligent Technology, Ministry of Education, Guangxi Normal University, Guilin, 541004, China
- Guangxi Key Lab of Multi-Source Information Mining and Security, Guangxi Normal University, Guilin, 541004, China
| | - Xiangjiang Lu
- Key Lab of Education Blockchain and Intelligent Technology, Ministry of Education, Guangxi Normal University, Guilin, 541004, China
- Guangxi Key Lab of Multi-Source Information Mining and Security, Guangxi Normal University, Guilin, 541004, China
| | - Xiaoshuang Liang
- Key Lab of Education Blockchain and Intelligent Technology, Ministry of Education, Guangxi Normal University, Guilin, 541004, China
- Guangxi Key Lab of Multi-Source Information Mining and Security, Guangxi Normal University, Guilin, 541004, China
| | - Li Ma
- Guilin Medical University, Guilin, 541199, China.
| | - Suqin Tang
- Key Lab of Education Blockchain and Intelligent Technology, Ministry of Education, Guangxi Normal University, Guilin, 541004, China.
| | - Zhifei Zhang
- Department of Physiology and Pathophysiology, Capital Medical University, Beijing, 100069, China.
| | - Jianfeng Zhan
- The International Open Benchmark Council, 19801, Delaware, USA.
- Institute of Computing Technology, Chinese Academy of Sciences, Beijing, 100086, China.
- University of Chinese Academy of Sciences, Beijing, 100086, China.
| |
Collapse
|
6
|
Huang Q, Li G. Knowledge graph based reasoning in medical image analysis: A scoping review. Comput Biol Med 2024; 182:109100. [PMID: 39244959 DOI: 10.1016/j.compbiomed.2024.109100] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2024] [Revised: 08/04/2024] [Accepted: 08/31/2024] [Indexed: 09/10/2024]
Abstract
Automated computer-aided diagnosis (CAD) is becoming more significant in the field of medicine due to advancements in computer hardware performance and the progress of artificial intelligence. The knowledge graph is a structure for visually representing knowledge facts. In the last decade, a large body of work based on knowledge graphs has effectively improved the organization and interpretability of large-scale complex knowledge. Introducing knowledge graph inference into CAD is a research direction with significant potential. In this review, we briefly review the basic principles and application methods of knowledge graphs firstly. Then, we systematically organize and analyze the research and application of knowledge graphs in medical imaging-assisted diagnosis. We also summarize the shortcomings of the current research, such as medical data barriers and deficiencies, low utilization of multimodal information, and weak interpretability. Finally, we propose future research directions with possibilities and potentials to address the shortcomings of current approaches.
Collapse
Affiliation(s)
- Qinghua Huang
- School of Artificial Intelligence, OPtics and ElectroNics (iOPEN), Northwestern Polytechnical University, 127 West Youyi Road, Beilin District, Xi'an, 710072, Shaanxi, China.
| | - Guanghui Li
- School of Artificial Intelligence, OPtics and ElectroNics (iOPEN), Northwestern Polytechnical University, 127 West Youyi Road, Beilin District, Xi'an, 710072, Shaanxi, China; School of Computer Science, Northwestern Polytechnical University, 1 Dongxiang Road, Chang'an District, Xi'an, 710129, Shaanxi, China.
| |
Collapse
|
7
|
Xu Z, Li J, Yao Q, Li H, Zhao M, Zhou SK. Addressing fairness issues in deep learning-based medical image analysis: a systematic review. NPJ Digit Med 2024; 7:286. [PMID: 39420149 PMCID: PMC11487181 DOI: 10.1038/s41746-024-01276-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/29/2024] [Accepted: 10/03/2024] [Indexed: 10/19/2024] Open
Abstract
Deep learning algorithms have demonstrated remarkable efficacy in various medical image analysis (MedIA) applications. However, recent research highlights a performance disparity in these algorithms when applied to specific subgroups, such as exhibiting poorer predictive performance in elderly females. Addressing this fairness issue has become a collaborative effort involving AI scientists and clinicians seeking to understand its origins and develop solutions for mitigation within MedIA. In this survey, we thoroughly examine the current advancements in addressing fairness issues in MedIA, focusing on methodological approaches. We introduce the basics of group fairness and subsequently categorize studies on fair MedIA into fairness evaluation and unfairness mitigation. Detailed methods employed in these studies are presented too. Our survey concludes with a discussion of existing challenges and opportunities in establishing a fair MedIA and healthcare system. By offering this comprehensive review, we aim to foster a shared understanding of fairness among AI researchers and clinicians, enhance the development of unfairness mitigation methods, and contribute to the creation of an equitable MedIA society.
Collapse
Affiliation(s)
- Zikang Xu
- School of Biomedical Engineering, Division of Life Sciences and Medicine, University of Science and Technology of China, Hefei, Anhui, PR China
- Center for Medical Imaging, Robotics, Analytic Computing & Learning (MIRACLE), Suzhou Institute for Advanced Research, University of Science and Technology of China, Suzhou, Jiangsu, PR China
| | - Jun Li
- Key Lab of Intelligent Information Processing of Chinese Academy of Sciences (CAS), Institute of Computing Technology, CAS, Beijing, PR China
| | - Qingsong Yao
- Key Lab of Intelligent Information Processing of Chinese Academy of Sciences (CAS), Institute of Computing Technology, CAS, Beijing, PR China
| | - Han Li
- School of Biomedical Engineering, Division of Life Sciences and Medicine, University of Science and Technology of China, Hefei, Anhui, PR China
- Center for Medical Imaging, Robotics, Analytic Computing & Learning (MIRACLE), Suzhou Institute for Advanced Research, University of Science and Technology of China, Suzhou, Jiangsu, PR China
| | - Mingyue Zhao
- School of Biomedical Engineering, Division of Life Sciences and Medicine, University of Science and Technology of China, Hefei, Anhui, PR China
- Center for Medical Imaging, Robotics, Analytic Computing & Learning (MIRACLE), Suzhou Institute for Advanced Research, University of Science and Technology of China, Suzhou, Jiangsu, PR China
| | - S Kevin Zhou
- School of Biomedical Engineering, Division of Life Sciences and Medicine, University of Science and Technology of China, Hefei, Anhui, PR China.
- Center for Medical Imaging, Robotics, Analytic Computing & Learning (MIRACLE), Suzhou Institute for Advanced Research, University of Science and Technology of China, Suzhou, Jiangsu, PR China.
- Key Lab of Intelligent Information Processing of Chinese Academy of Sciences (CAS), Institute of Computing Technology, CAS, Beijing, PR China.
- Key Laboratory of Precision and Intelligent Chemistry, University of Science and Technology of China, Hefei, Anhui, PR China.
| |
Collapse
|
8
|
Sadeghi A, Sadeghi M, Fakhar M, Zakariaei Z, Sadeghi M, Bastani R. A deep learning-based model for detecting Leishmania amastigotes in microscopic slides: a new approach to telemedicine. BMC Infect Dis 2024; 24:551. [PMID: 38824500 PMCID: PMC11144338 DOI: 10.1186/s12879-024-09428-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/08/2023] [Accepted: 05/23/2024] [Indexed: 06/03/2024] Open
Abstract
BACKGROUND Leishmaniasis, an illness caused by protozoa, accounts for a substantial number of human fatalities globally, thereby emerging as one of the most fatal parasitic diseases. The conventional methods employed for detecting the Leishmania parasite through microscopy are not only time-consuming but also susceptible to errors. Therefore, the main objective of this study is to develop a model based on deep learning, a subfield of artificial intelligence, that could facilitate automated diagnosis of leishmaniasis. METHODS In this research, we introduce LeishFuNet, a deep learning framework designed for detecting Leishmania parasites in microscopic images. To enhance the performance of our model through same-domain transfer learning, we initially train four distinct models: VGG19, ResNet50, MobileNetV2, and DenseNet 169 on a dataset related to another infectious disease, COVID-19. These trained models are then utilized as new pre-trained models and fine-tuned on a set of 292 self-collected high-resolution microscopic images, consisting of 138 positive cases and 154 negative cases. The final prediction is generated through the fusion of information analyzed by these pre-trained models. Grad-CAM, an explainable artificial intelligence technique, is implemented to demonstrate the model's interpretability. RESULTS The final results of utilizing our model for detecting amastigotes in microscopic images are as follows: accuracy of 98.95 1.4%, specificity of 98 2.67%, sensitivity of 100%, precision of 97.91 2.77%, F1-score of 98.92 1.43%, and Area Under Receiver Operating Characteristic Curve of 99 1.33. CONCLUSION The newly devised system is precise, swift, user-friendly, and economical, thus indicating the potential of deep learning as a substitute for the prevailing leishmanial diagnostic techniques.
Collapse
Affiliation(s)
- Alireza Sadeghi
- Department of Mechatronics Engineering, Faculty of New Sciences and Technologies, University of Tehran, Tehran, Iran
| | - Mahdieh Sadeghi
- Student Research Committee, Mazandaran University of Medical Sciences, Sari, Iran
| | - Mahdi Fakhar
- Iranian National Registry Center for Lophomoniasis and Toxoplasmosis, Imam Khomeini Hospital, Mazandaran University of Medical Sciences, P. O box, Sari, 48166-33131, Iran.
| | - Zakaria Zakariaei
- Toxicology and Forensic Medicine Division, Mazandaran Registry Center for Opioids Poisoning, Anti-microbial Resistance Research Center, Imam Khomeini Hospital, Mazandaran University of Medical Sciences, Sari, Iran
| | | | - Reza Bastani
- Iranian National Registry Center for Lophomoniasis and Toxoplasmosis, Imam Khomeini Hospital, Mazandaran University of Medical Sciences, P. O box, Sari, 48166-33131, Iran
| |
Collapse
|
9
|
Yang Y, Lin M, Zhao H, Peng Y, Huang F, Lu Z. A survey of recent methods for addressing AI fairness and bias in biomedicine. J Biomed Inform 2024; 154:104646. [PMID: 38677633 PMCID: PMC11129918 DOI: 10.1016/j.jbi.2024.104646] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/13/2024] [Accepted: 04/17/2024] [Indexed: 04/29/2024]
Abstract
OBJECTIVES Artificial intelligence (AI) systems have the potential to revolutionize clinical practices, including improving diagnostic accuracy and surgical decision-making, while also reducing costs and manpower. However, it is important to recognize that these systems may perpetuate social inequities or demonstrate biases, such as those based on race or gender. Such biases can occur before, during, or after the development of AI models, making it critical to understand and address potential biases to enable the accurate and reliable application of AI models in clinical settings. To mitigate bias concerns during model development, we surveyed recent publications on different debiasing methods in the fields of biomedical natural language processing (NLP) or computer vision (CV). Then we discussed the methods, such as data perturbation and adversarial learning, that have been applied in the biomedical domain to address bias. METHODS We performed our literature search on PubMed, ACM digital library, and IEEE Xplore of relevant articles published between January 2018 and December 2023 using multiple combinations of keywords. We then filtered the result of 10,041 articles automatically with loose constraints, and manually inspected the abstracts of the remaining 890 articles to identify the 55 articles included in this review. Additional articles in the references are also included in this review. We discuss each method and compare its strengths and weaknesses. Finally, we review other potential methods from the general domain that could be applied to biomedicine to address bias and improve fairness. RESULTS The bias of AIs in biomedicine can originate from multiple sources such as insufficient data, sampling bias and the use of health-irrelevant features or race-adjusted algorithms. Existing debiasing methods that focus on algorithms can be categorized into distributional or algorithmic. Distributional methods include data augmentation, data perturbation, data reweighting methods, and federated learning. Algorithmic approaches include unsupervised representation learning, adversarial learning, disentangled representation learning, loss-based methods and causality-based methods.
Collapse
Affiliation(s)
- Yifan Yang
- National Center for Biotechnology Information (NCBI), National Library of Medicine (NLM), National Institutes of Health (NIH), Bethesda, MD, USA; Department of Computer Science, University of Maryland, College Park, USA
| | - Mingquan Lin
- Department of Population Health Sciences, Weill Cornell Medicine, NY, USA
| | - Han Zhao
- Department of Computer Science, University of Illinois at Urbana-Champaign, Champaign, IL, USA
| | - Yifan Peng
- Department of Population Health Sciences, Weill Cornell Medicine, NY, USA
| | - Furong Huang
- Department of Computer Science, University of Maryland, College Park, USA
| | - Zhiyong Lu
- National Center for Biotechnology Information (NCBI), National Library of Medicine (NLM), National Institutes of Health (NIH), Bethesda, MD, USA.
| |
Collapse
|
10
|
Cai Q, Zhang P, Xie F, Zhang Z, Tu B. Clinical application of high-resolution spiral CT scanning in the diagnosis of auriculotemporal and ossicle. BMC Med Imaging 2024; 24:102. [PMID: 38724896 PMCID: PMC11080198 DOI: 10.1186/s12880-024-01277-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/20/2023] [Accepted: 04/19/2024] [Indexed: 05/13/2024] Open
Abstract
Precision and intelligence in evaluating the complexities of middle ear structures are required to diagnose auriculotemporal and ossicle-related diseases within otolaryngology. Due to the complexity of the anatomical details and the varied etiologies of illnesses such as trauma, chronic otitis media, and congenital anomalies, traditional diagnostic procedures may not yield accurate diagnoses. This research intends to enhance the diagnosis of diseases of the auriculotemporal region and ossicles by combining High-Resolution Spiral Computed Tomography (HRSCT) scanning with Deep Learning Techniques (DLT). This study employs a deep learning method, Convolutional Neural Network-UNet (CNN-UNet), to extract sub-pixel information from medical photos. This method equips doctors and researchers with cutting-edge resources, leading to groundbreaking discoveries and better patient healthcare. The research effort is the interaction between the CNN-UNet model and high-resolution Computed Tomography (CT) scans, automating activities including ossicle segmentation, fracture detection, and disruption cause classification, accelerating the diagnostic process and increasing clinical decision-making. The suggested HRSCT-DLT model represents the integration of high-resolution spiral CT scans with the CNN-UNet model, which has been fine-tuned to address the nuances of auriculotemporal and ossicular diseases. This novel combination improves diagnostic efficiency and our overall understanding of these intricate diseases. The results of this study highlight the promise of combining high-resolution CT scanning with the CNN-UNet model in otolaryngology, paving the way for more accurate diagnosis and more individualized treatment plans for patients experiencing auriculotemporal and ossicle-related disruptions.
Collapse
Affiliation(s)
- Qinfang Cai
- Department of Otolaryngology, The First Clinical Medical College of Jinan University, Guangzhou, 510630, Guangdong, China
- Department of Otolaryngology, The Fifth Affiliated Hospital of Southern Medical University, Guangzhou, 510900, Guangdong, China
| | - Peishan Zhang
- Department of Otolaryngology, The Fifth Affiliated Hospital of Southern Medical University, Guangzhou, 510900, Guangdong, China
| | - Fengmei Xie
- Department of Otolaryngology, The Fifth Affiliated Hospital of Southern Medical University, Guangzhou, 510900, Guangdong, China
| | - Zedong Zhang
- Department of Otolaryngology, The Fifth Affiliated Hospital of Southern Medical University, Guangzhou, 510900, Guangdong, China
| | - Bo Tu
- Department of Otolaryngology, The First Affiliated Hospital of Jinan University, Guangzhou, 510630, Guangdong, China.
| |
Collapse
|
11
|
Zhao H, Deng X, Shao H, Jiang Y. COVID-19 diagnostic prediction on chest CT scan images using hybrid quantum-classical convolutional neural network. J Biomol Struct Dyn 2024; 42:3737-3746. [PMID: 38600864 DOI: 10.1080/07391102.2023.2226215] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/27/2023] [Accepted: 05/11/2023] [Indexed: 04/12/2024]
Abstract
Notwithstanding the extensive research efforts directed towards devising a dependable approach for the diagnosis of coronavirus disease 2019 (COVID-19), the inherent complexity and capriciousness of the virus continue to pose a formidable challenge to the precise identification of affected individuals. In light of this predicament, it is essential to devise a model for COVID-19 prediction utilizing chest computed tomography (CT) scans. To this end, we present a hybrid quantum-classical convolutional neural network (HQCNN) model, which is founded on stochastic quantum circuits that can discern COVID-19 patients from chest CT images. Two publicly available chest CT image datasets were employed to evaluate the performance of our model. The experimental outcomes evinced diagnostic accuracies of 99.39% and 97.91%, along with precisions of 99.19% and 98.52%, respectively. These findings are indicative of the fact that the proposed model surpasses recently published works in terms of performance, thus providing a superior ability to precisely predict COVID-19 positive instances.Communicated by Ramaswamy H. Sarma.
Collapse
Affiliation(s)
- Haorong Zhao
- School of Computer, Jiangsu University of Science and Technology, Zhenjiang, Jiangsu, China
| | - Xing Deng
- School of Computer, Jiangsu University of Science and Technology, Zhenjiang, Jiangsu, China
| | - Haijian Shao
- School of Computer, Jiangsu University of Science and Technology, Zhenjiang, Jiangsu, China
- Department of Electrical and Computer Engineering, University of Nevada, Las Vegas, NV, USA
| | - Yingtao Jiang
- Department of Electrical and Computer Engineering, University of Nevada, Las Vegas, NV, USA
| |
Collapse
|
12
|
Rajinikanth V, Biju R, Mittal N, Mittal V, Askar S, Abouhawwash M. COVID-19 detection in lung CT slices using Brownian-butterfly-algorithm optimized lightweight deep features. Heliyon 2024; 10:e27509. [PMID: 38468955 PMCID: PMC10926136 DOI: 10.1016/j.heliyon.2024.e27509] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2023] [Revised: 02/29/2024] [Accepted: 02/29/2024] [Indexed: 03/13/2024] Open
Abstract
Several deep-learning assisted disease assessment schemes (DAS) have been proposed to enhance accurate detection of COVID-19, a critical medical emergency, through the analysis of clinical data. Lung imaging, particularly from CT scans, plays a pivotal role in identifying and assessing the severity of COVID-19 infections. Existing automated methods leveraging deep learning contribute significantly to reducing the diagnostic burden associated with this process. This research aims in developing a simple DAS for COVID-19 detection using the pre-trained lightweight deep learning methods (LDMs) applied to lung CT slices. The use of LDMs contributes to a less complex yet highly accurate detection system. The key stages of the developed DAS include image collection and initial processing using Shannon's thresholding, deep-feature mining supported by LDMs, feature optimization utilizing the Brownian Butterfly Algorithm (BBA), and binary classification through three-fold cross-validation. The performance evaluation of the proposed scheme involves assessing individual, fused, and ensemble features. The investigation reveals that the developed DAS achieves a detection accuracy of 93.80% with individual features, 96% accuracy with fused features, and an impressive 99.10% accuracy with ensemble features. These outcomes affirm the effectiveness of the proposed scheme in significantly enhancing COVID-19 detection accuracy in the chosen lung CT database.
Collapse
Affiliation(s)
- Venkatesan Rajinikanth
- Department of Computer Science and Engineering, Division of Research and Innovation, Saveetha School of Engineering, Saveetha Institute of Medical and Technical Sciences, Chennai, 602105, Tamil Nadu, India
| | - Roshima Biju
- Department of Computer Science Engineering, Parul University, Vadodara, 391760, Gujarat, India
| | - Nitin Mittal
- Skill Faculty of Engineering and Technology, Shri Vishwakarma Skill University, Palwal, 121102, Haryana, India
| | - Vikas Mittal
- Department of Electronics and Communication Engineering, Chandigarh University, Mohali, 140413, India
| | - S.S. Askar
- Department of Statistics and Operations Research, College of Science, King Saud University, P.O. Box 2455, Riyadh, 11451, Saudi Arabia
| | - Mohamed Abouhawwash
- Department of Mathematics, Faculty of Science, Mansoura University, Mansoura, 35516, Egypt
| |
Collapse
|
13
|
Ju H, Cui Y, Su Q, Juan L, Manavalan B. CODENET: A deep learning model for COVID-19 detection. Comput Biol Med 2024; 171:108229. [PMID: 38447500 DOI: 10.1016/j.compbiomed.2024.108229] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2023] [Revised: 02/20/2024] [Accepted: 02/25/2024] [Indexed: 03/08/2024]
Abstract
Conventional COVID-19 testing methods have some flaws: they are expensive and time-consuming. Chest X-ray (CXR) diagnostic approaches can alleviate these flaws to some extent. However, there is no accurate and practical automatic diagnostic framework with good interpretability. The application of artificial intelligence (AI) technology to medical radiography can help to accurately detect the disease, reduce the burden on healthcare organizations, and provide good interpretability. Therefore, this study proposes a new deep neural network (CNN) based on CXR for COVID-19 diagnosis - CodeNet. This method uses contrastive learning to make full use of latent image data to enhance the model's ability to extract features and generalize across different data domains. On the evaluation dataset, the proposed method achieves an accuracy as high as 94.20%, outperforming several other existing methods used for comparison. Ablation studies validate the efficacy of the proposed method, while interpretability analysis shows that the method can effectively guide clinical professionals. This work demonstrates the superior detection performance of a CNN using contrastive learning techniques on CXR images, paving the way for computer vision and artificial intelligence technologies to leverage massive medical data for disease diagnosis.
Collapse
Affiliation(s)
- Hong Ju
- Heilongjiang Agricultural Engineering Vocational College, China
| | - Yanyan Cui
- Beidahuang Industry Group General Hospital, Harbin, China
| | - Qiaosen Su
- Department of Integrative Biotechnology, College of Biotechnology and Bioengineering, Sungkyunkwan University, Suwon, 16419, Gyeonggi-do, Republic of Korea
| | - Liran Juan
- School of Life Science and Technology, Harbin Institute of Technology, Harbin, 150001, China.
| | - Balachandran Manavalan
- Department of Integrative Biotechnology, College of Biotechnology and Bioengineering, Sungkyunkwan University, Suwon, 16419, Gyeonggi-do, Republic of Korea.
| |
Collapse
|
14
|
Yang Y, Lin M, Zhao H, Peng Y, Huang F, Lu Z. A survey of recent methods for addressing AI fairness and bias in biomedicine. ARXIV 2024:arXiv:2402.08250v1. [PMID: 38529077 PMCID: PMC10962742] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Subscribe] [Scholar Register] [Indexed: 03/27/2024]
Abstract
Objectives Artificial intelligence (AI) systems have the potential to revolutionize clinical practices, including improving diagnostic accuracy and surgical decision-making, while also reducing costs and manpower. However, it is important to recognize that these systems may perpetuate social inequities or demonstrate biases, such as those based on race or gender. Such biases can occur before, during, or after the development of AI models, making it critical to understand and address potential biases to enable the accurate and reliable application of AI models in clinical settings. To mitigate bias concerns during model development, we surveyed recent publications on different debiasing methods in the fields of biomedical natural language processing (NLP) or computer vision (CV). Then we discussed the methods, such as data perturbation and adversarial learning, that have been applied in the biomedical domain to address bias. Methods We performed our literature search on PubMed, ACM digital library, and IEEE Xplore of relevant articles published between January 2018 and December 2023 using multiple combinations of keywords. We then filtered the result of 10,041 articles automatically with loose constraints, and manually inspected the abstracts of the remaining 890 articles to identify the 55 articles included in this review. Additional articles in the references are also included in this review. We discuss each method and compare its strengths and weaknesses. Finally, we review other potential methods from the general domain that could be applied to biomedicine to address bias and improve fairness. Results The bias of AIs in biomedicine can originate from multiple sources such as insufficient data, sampling bias and the use of health-irrelevant features or race-adjusted algorithms. Existing debiasing methods that focus on algorithms can be categorized into distributional or algorithmic. Distributional methods include data augmentation, data perturbation, data reweighting methods, and federated learning. Algorithmic approaches include unsupervised representation learning, adversarial learning, disentangled representation learning, loss-based methods and causality-based methods.
Collapse
Affiliation(s)
- Yifan Yang
- National Center for Biotechnology Information (NCBI), National Library of Medicine (NLM), National Institutes of Health (NIH), Bethesda, MD, USA
- Department of Computer Science, University of Maryland, College Park USA
| | - Mingquan Lin
- Department of Population Health Sciences, Weill Cornell Medicine, New York, USA
| | - Han Zhao
- Department of Computer Science, University of Illinois at Urbana-Champaign, Champaign, IL
| | - Yifan Peng
- Department of Population Health Sciences, Weill Cornell Medicine, New York, USA
| | - Furong Huang
- Department of Computer Science, University of Maryland, College Park USA
| | - Zhiyong Lu
- National Center for Biotechnology Information (NCBI), National Library of Medicine (NLM), National Institutes of Health (NIH), Bethesda, MD, USA
| |
Collapse
|
15
|
Garg A, Alag S, Duncan D. CoSev: Data-Driven Optimizations for COVID-19 Severity Assessment in Low-Sample Regimes. Diagnostics (Basel) 2024; 14:337. [PMID: 38337853 PMCID: PMC10855975 DOI: 10.3390/diagnostics14030337] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2023] [Revised: 01/06/2024] [Accepted: 01/19/2024] [Indexed: 02/12/2024] Open
Abstract
Given the pronounced impact COVID-19 continues to have on society-infecting 700 million reported individuals and causing 6.96 million deaths-many deep learning works have recently focused on the virus's diagnosis. However, assessing severity has remained an open and challenging problem due to a lack of large datasets, the large dimensionality of images for which to find weights, and the compute limitations of modern graphics processing units (GPUs). In this paper, a new, iterative application of transfer learning is demonstrated on the understudied field of 3D CT scans for COVID-19 severity analysis. This methodology allows for enhanced performance on the MosMed Dataset, which is a small and challenging dataset containing 1130 images of patients for five levels of COVID-19 severity (Zero, Mild, Moderate, Severe, and Critical). Specifically, given the large dimensionality of the input images, we create several custom shallow convolutional neural network (CNN) architectures and iteratively refine and optimize them, paying attention to learning rates, layer types, normalization types, filter sizes, dropout values, and more. After a preliminary architecture design, the models are systematically trained on a simplified version of the dataset-building models for two-class, then three-class, then four-class, and finally five-class classification. The simplified problem structure allows the model to start learning preliminary features, which can then be further modified for more difficult classification tasks. Our final model CoSev boosts classification accuracies from below 60% at first to 81.57% with the optimizations, reaching similar performance to the state-of-the-art on the dataset, with much simpler setup procedures. In addition to COVID-19 severity diagnosis, the explored methodology can be applied to general image-based disease detection. Overall, this work highlights innovative methodologies that advance current computer vision practices for high-dimension, low-sample data as well as the practicality of data-driven machine learning and the importance of feature design for training, which can then be implemented for improvements in clinical practices.
Collapse
Affiliation(s)
- Aksh Garg
- Computer Science Department, Stanford University, Stanford, CA 94305, USA; (A.G.); (S.A.)
| | - Shray Alag
- Computer Science Department, Stanford University, Stanford, CA 94305, USA; (A.G.); (S.A.)
| | - Dominique Duncan
- Laboratory of Neuro Imaging, USC Stevens Neuroimaging and Informatics Institute, University of Southern California, Los Angeles, CA 90033, USA
| |
Collapse
|
16
|
Abedi I, Vali M, Otroshi B, Zamanian M, Bolhasani H. HRCTCov19-a high-resolution chest CT scan image dataset for COVID-19 diagnosis and differentiation. BMC Res Notes 2024; 17:32. [PMID: 38254225 PMCID: PMC10804784 DOI: 10.1186/s13104-024-06693-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2023] [Accepted: 01/10/2024] [Indexed: 01/24/2024] Open
Abstract
INTRODUCTION Computed tomography (CT) was a widely used diagnostic technique for COVID-19 during the pandemic. High-Resolution Computed Tomography (HRCT), is a type of computed tomography that enhances image resolution through the utilization of advanced methods. Due to privacy concerns, publicly available COVID-19 CT image datasets are incredibly tough to come by, leading to it being challenging to research and create AI-powered COVID-19 diagnostic algorithms based on CT images. DATA DESCRIPTION To address this issue, we created HRCTCov19, a new COVID-19 high-resolution chest CT scan image collection that includes not only COVID-19 cases of Ground Glass Opacity (GGO), Crazy Paving, and Air Space Consolidation but also CT images of cases with negative COVID-19. The HRCTCov19 dataset, which includes slice-level and patient-level labeling, has the potential to assist in COVID-19 research, in particular for diagnosis and a distinction using AI algorithms, machine learning, and deep learning methods. This dataset, which can be accessed through the web at http://databiox.com , includes 181,106 chest HRCT images from 395 patients labeled as GGO, Crazy Paving, Air Space Consolidation, and Negative.
Collapse
Affiliation(s)
- Iraj Abedi
- Department of Medical Physics, School of Medicine, Isfahan University of Medical Sciences, Isfahan, Iran
| | - Mahsa Vali
- Department of Electrical and Computer Engineering, Isfahan University of Technology, Isfahan, Iran
| | - Bentolhoda Otroshi
- Department of Radiology, School of Medicine, Arak University of Medical Sciences, Arak, Iran
| | - Maryam Zamanian
- Department of Medical Physics, School of Medicine, Isfahan University of Medical Sciences, Isfahan, Iran
| | - Hamidreza Bolhasani
- Department of Computer Engineering, Science and Research Branch, Islamic Azad University, Tehran, Iran.
| |
Collapse
|
17
|
Rahman A, Debnath T, Kundu D, Khan MSI, Aishi AA, Sazzad S, Sayduzzaman M, Band SS. Machine learning and deep learning-based approach in smart healthcare: Recent advances, applications, challenges and opportunities. AIMS Public Health 2024; 11:58-109. [PMID: 38617415 PMCID: PMC11007421 DOI: 10.3934/publichealth.2024004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/19/2023] [Accepted: 12/18/2023] [Indexed: 04/16/2024] Open
Abstract
In recent years, machine learning (ML) and deep learning (DL) have been the leading approaches to solving various challenges, such as disease predictions, drug discovery, medical image analysis, etc., in intelligent healthcare applications. Further, given the current progress in the fields of ML and DL, there exists the promising potential for both to provide support in the realm of healthcare. This study offered an exhaustive survey on ML and DL for the healthcare system, concentrating on vital state of the art features, integration benefits, applications, prospects and future guidelines. To conduct the research, we found the most prominent journal and conference databases using distinct keywords to discover scholarly consequences. First, we furnished the most current along with cutting-edge progress in ML-DL-based analysis in smart healthcare in a compendious manner. Next, we integrated the advancement of various services for ML and DL, including ML-healthcare, DL-healthcare, and ML-DL-healthcare. We then offered ML and DL-based applications in the healthcare industry. Eventually, we emphasized the research disputes and recommendations for further studies based on our observations.
Collapse
Affiliation(s)
- Anichur Rahman
- Department of CSE, National Institute of Textile Engineering and Research (NITER), Constituent Institute of the University of Dhaka, Savar, Dhaka-1350
- Department of CSE, Mawlana Bhashani Science and Technology University, Tangail, Bangladesh
| | - Tanoy Debnath
- Department of CSE, Mawlana Bhashani Science and Technology University, Tangail, Bangladesh
- Department of CSE, Green University of Bangladesh, 220/D, Begum Rokeya Sarani, Dhaka -1207, Bangladesh
| | - Dipanjali Kundu
- Department of CSE, National Institute of Textile Engineering and Research (NITER), Constituent Institute of the University of Dhaka, Savar, Dhaka-1350
| | - Md. Saikat Islam Khan
- Department of CSE, Mawlana Bhashani Science and Technology University, Tangail, Bangladesh
| | - Airin Afroj Aishi
- Department of Computing and Information System, Daffodil International University, Savar, Dhaka, Bangladesh
| | - Sadia Sazzad
- Department of CSE, National Institute of Textile Engineering and Research (NITER), Constituent Institute of the University of Dhaka, Savar, Dhaka-1350
| | - Mohammad Sayduzzaman
- Department of CSE, National Institute of Textile Engineering and Research (NITER), Constituent Institute of the University of Dhaka, Savar, Dhaka-1350
| | - Shahab S. Band
- Department of Information Management, International Graduate School of Artificial Intelligence, National Yunlin University of Science and Technology, Taiwan
| |
Collapse
|
18
|
Sadeghi A, Sadeghi M, Sharifpour A, Fakhar M, Zakariaei Z, Sadeghi M, Rokni M, Zakariaei A, Banimostafavi ES, Hajati F. Potential diagnostic application of a novel deep learning- based approach for COVID-19. Sci Rep 2024; 14:280. [PMID: 38167985 PMCID: PMC10762017 DOI: 10.1038/s41598-023-50742-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2023] [Accepted: 12/24/2023] [Indexed: 01/05/2024] Open
Abstract
COVID-19 is a highly communicable respiratory illness caused by the novel coronavirus SARS-CoV-2, which has had a significant impact on global public health and the economy. Detecting COVID-19 patients during a pandemic with limited medical facilities can be challenging, resulting in errors and further complications. Therefore, this study aims to develop deep learning models to facilitate automated diagnosis of COVID-19 from CT scan records of patients. The study also introduced COVID-MAH-CT, a new dataset that contains 4442 CT scan images from 133 COVID-19 patients, as well as 133 CT scan 3D volumes. We proposed and evaluated six different transfer learning models for slide-level analysis that are responsible for detecting COVID-19 in multi-slice spiral CT. Additionally, multi-head attention squeeze and excitation residual (MASERes) neural network, a novel 3D deep model was developed for patient-level analysis, which analyzes all the CT slides of a given patient as a whole and can accurately diagnose COVID-19. The codes and dataset developed in this study are available at https://github.com/alrzsdgh/COVID . The proposed transfer learning models for slide-level analysis were able to detect COVID-19 CT slides with an accuracy of more than 99%, while MASERes was able to detect COVID-19 patients from 3D CT volumes with an accuracy of 100%. These achievements demonstrate that the proposed models in this study can be useful for automatically detecting COVID-19 in both slide-level and patient-level from patients' CT scan records, and can be applied for real-world utilization, particularly in diagnosing COVID-19 cases in areas with limited medical facilities.
Collapse
Affiliation(s)
- Alireza Sadeghi
- Intelligent Mobile Robot Lab (IMRL), Department of Mechatronics Engineering, Faculty of New Sciences and Technologies, University of Tehran, Tehran, Iran
| | - Mahdieh Sadeghi
- Student Research Committee, Mazandaran University of Medical Sciences, Sari, Iran
| | - Ali Sharifpour
- Pulmonary and Critical Care Division, Imam Khomeini Hospital, Mazandaran University of Medical Sciences, Sari, Iran
| | - Mahdi Fakhar
- Iranian National Registry Center for Lophomoniasis and Toxoplasmosis, Imam Khomeini Hospital, Mazandaran University of Medical Sciences, P.O Box: 48166-33131, Sari, Iran.
| | - Zakaria Zakariaei
- Toxicology and Forensic Medicine Division, Mazandaran Registry Center for Opioids Poisoning, Anti-microbial Resistance Research Center, Imam Khomeini Hospital, Mazandaran University of Medical Sciences, P.O box: 48166-33131, Sari, Iran.
| | - Mohammadreza Sadeghi
- Student Research Committee, Mazandaran University of Medical Sciences, Sari, Iran
| | - Mojtaba Rokni
- Department of Radiology, Qaemshahr Razi Hospital, Mazandaran University of Medical Sciences, Sari, Iran
| | - Atousa Zakariaei
- MSC in Civil Engineering, European University of Lefke, Nicosia, Cyprus
| | - Elham Sadat Banimostafavi
- Department of Radiology, Imam Khomeini Hospital, Mazandaran University of Medical Sciences, Sari, Iran
| | - Farshid Hajati
- Intelligent Technology Innovation Lab (ITIL) Group, Institute for Sustainable Industries and Liveable Cities, Victoria University, Footscray, Australia
| |
Collapse
|
19
|
Li W, Liu GH, Fan H, Li Z, Zhang D. Self-Supervised Multi-Scale Cropping and Simple Masked Attentive Predicting for Lung CT-Scan Anomaly Detection. IEEE TRANSACTIONS ON MEDICAL IMAGING 2024; 43:594-607. [PMID: 37695968 DOI: 10.1109/tmi.2023.3313778] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/13/2023]
Abstract
Anomaly detection has been widely explored by training an out-of-distribution detector with only normal data for medical images. However, detecting local and subtle irregularities without prior knowledge of anomaly types brings challenges for lung CT-scan image anomaly detection. In this paper, we propose a self-supervised framework for learning representations of lung CT-scan images via both multi-scale cropping and simple masked attentive predicting, which is capable of constructing a powerful out-of-distribution detector. Firstly, we propose CropMixPaste, a self-supervised augmentation task for generating density shadow-like anomalies that encourage the model to detect local irregularities of lung CT-scan images. Then, we propose a self-supervised reconstruction block, named simple masked attentive predicting block (SMAPB), to better refine local features by predicting masked context information. Finally, the learned representations by self-supervised tasks are used to build an out-of-distribution detector. The results on real lung CT-scan datasets demonstrate the effectiveness and superiority of our proposed method compared with state-of-the-art methods.
Collapse
|
20
|
Vaikunta Pai T, Maithili K, Arun Kumar R, Nagaraju D, Anuradha D, Kumar S, Ravuri A, Sunilkumar Reddy T, Sivaram M, Vidhya RG. DKCNN: Improving deep kernel convolutional neural network-based COVID-19 identification from CT images of the chest. JOURNAL OF X-RAY SCIENCE AND TECHNOLOGY 2024; 32:913-930. [PMID: 38820059 DOI: 10.3233/xst-230424] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/02/2024]
Abstract
BACKGROUND An efficient deep convolutional neural network (DeepCNN) is proposed in this article for the classification of Covid-19 disease. OBJECTIVE A novel structure known as the Pointwise-Temporal-pointwise convolution unit is developed incorporated with the varying kernel-based depth wise temporal convolution before and after the pointwise convolution operations. METHODS The outcome is optimized by the Slap Swarm algorithm (SSA). The proposed Deep CNN is composed of depth wise temporal convolution and end-to-end automatic detection of disease. First, the datasets SARS-COV-2 Ct-Scan Dataset and CT scan COVID Prediction dataset are preprocessed using the min-max approach and the features are extracted for further processing. RESULTS The experimental analysis is conducted between the proposed and some state-of-art works and stated that the proposed work effectively classifies the disease than the other approaches. CONCLUSION The proposed structural unit is used to design the deep CNN with the increasing kernel sizes. The classification process is improved by the inclusion of depth wise temporal convolutions along with the kernel variation. The computational complexity is reduced by the introduction of stride convolutions are used in the residual linkage among the adjacent structural units.
Collapse
Affiliation(s)
- T Vaikunta Pai
- Department of Information Science and Engineering, NMAM Institute of Technology-Affiliated to NITTE (Deemed to be University), Bangalore, Karnataka, India
| | - K Maithili
- Department of Computer Science and Engineering (Ai & ML), KG Reddy College of Engineering and Technology, Hyderabad, Telangana, India
| | - Ravula Arun Kumar
- Department of Computer Science and Engineering, Vardhaman College of Engineering, Hyderabad, Telangana, India
| | - D Nagaraju
- Department of Computer Science and Engineering, Sri Venkatesa Perumal College of Engineering and Technology, Puttur, Andhra Pradesh, India
| | - D Anuradha
- Department of Computer Science and Business Systems, Panimalar Engineering College, Chennai, India
| | - Shailendra Kumar
- Department of Electronics and Communication Engineering, Integral University Lucknow, Uttar Pradesh, India
| | | | - T Sunilkumar Reddy
- Department of Computer Science and Engineering, Sri Venkatesa Perumal College of Engineering and Technology, Puttur, Andhra Pradesh, India
| | - M Sivaram
- Saveetha School of Engineering, Saveetha Institute of Medical and Technical Sciences, Saveetha Nagar, Thandalam, Tamil Nadu, India
| | - R G Vidhya
- Department of ECE, HKBKCE, Bangalore, India
| |
Collapse
|
21
|
Nur-A-Alam M, Nasir MK, Ahsan M, Based MA, Haider J, Kowalski M. Ensemble classification of integrated CT scan datasets in detecting COVID-19 using feature fusion from contourlet transform and CNN. Sci Rep 2023; 13:20063. [PMID: 37973820 PMCID: PMC10654719 DOI: 10.1038/s41598-023-47183-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2023] [Accepted: 11/09/2023] [Indexed: 11/19/2023] Open
Abstract
The COVID-19 disease caused by coronavirus is constantly changing due to the emergence of different variants and thousands of people are dying every day worldwide. Early detection of this new form of pulmonary disease can reduce the mortality rate. In this paper, an automated method based on machine learning (ML) and deep learning (DL) has been developed to detect COVID-19 using computed tomography (CT) scan images extracted from three publicly available datasets (A total of 11,407 images; 7397 COVID-19 images and 4010 normal images). An unsupervised clustering approach that is a modified region-based clustering technique for segmenting COVID-19 CT scan image has been proposed. Furthermore, contourlet transform and convolution neural network (CNN) have been employed to extract features individually from the segmented CT scan images and to fuse them in one feature vector. Binary differential evolution (BDE) approach has been employed as a feature optimization technique to obtain comprehensible features from the fused feature vector. Finally, a ML/DL-based ensemble classifier considering bagging technique has been employed to detect COVID-19 from the CT images. A fivefold and generalization cross-validation techniques have been used for the validation purpose. Classification experiments have also been conducted with several pre-trained models (AlexNet, ResNet50, GoogleNet, VGG16, VGG19) and found that the ensemble classifier technique with fused feature has provided state-of-the-art performance with an accuracy of 99.98%.
Collapse
Affiliation(s)
- Md Nur-A-Alam
- Department of Computer Science & Engineering, Mawlana Bhashani Science and Technology University, Tangail, 1902, Bangladesh
| | - Mostofa Kamal Nasir
- Department of Computer Science & Engineering, Mawlana Bhashani Science and Technology University, Tangail, 1902, Bangladesh
| | - Mominul Ahsan
- Department of Computer Science, University of York, Deramore Lane, York, YO10 5GH, UK
| | - Md Abdul Based
- Department of Computer Science & Engineering, Dhaka International University, Dhaka, 1205, Bangladesh
| | - Julfikar Haider
- Department of Engineering, Manchester Metropolitan University, Chester St, Manchester, M1 5GD, UK
| | - Marcin Kowalski
- Institute of Optoelectronics, Military University of Technology, Gen. S. Kaliskiego 2, Warsaw, Poland.
| |
Collapse
|
22
|
Ahmadinejad N, Ayyoubzadeh SM, Zeinalkhani F, Delazar S, Javanmard Z, Ahmadinejad Z, Mohajeri A, Esmaeili M. Discovering associations between radiological features and COVID-19 patients' deterioration. Health Sci Rep 2023; 6:e1257. [PMID: 37711676 PMCID: PMC10497911 DOI: 10.1002/hsr2.1257] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/13/2023] [Revised: 04/17/2023] [Accepted: 04/23/2023] [Indexed: 09/16/2023] Open
Abstract
Background and Aims Data mining methods are effective and well-known tools for developing predictive models and extracting useful information from various data of patients. The present study aimed to predict the severity of patients with COVID-19 by applying the rule mining method using characteristics of medical images. Methods This retrospective study has analyzed the radiological data from 104 COVID-19 hospitalized patients diagnosed with COVID-19 in a hospital in Iran. A data set containing 75 binary features was generated. Apriori method is utilized for association rule mining on this data set. Only rules with confidence equal to one were generated. The performance of rules is calculated by support, coverage, and lift indexes. Results Ten rules were extracted with only X-ray-related features on cases referred to ICU. The Support and Coverage index of all of these rules was 0.087, and the Lift index of them was 1.58. Thirteen rules were extracted from only CT scan-related features on cases referred to ICU. The CXR_Pleural effusion feature has appeared in all the rules. The CXR_Left upper zone feature appears in 9 rules out of 10. The Support and Coverage index of all rules was 0.15, and the Lift index of all rules was 1.63. the CT_Adjacent pleura thickening feature has appeared in all rules, and the CT_Right middle lobe appeared in 9 rules out of 13. Conclusion This study could reveal the application and efficacy of CXR and CT scan imaging modalities in predicting ICU admission to a major COVID-19 infection via data mining methods. The findings of this study could help data scientists, radiologists, and clinicians in the future development and implementation of these methods in similar conditions and timely and appropriately save patients from adverse disease outcomes.
Collapse
Affiliation(s)
- Nasrin Ahmadinejad
- Advanced Diagnostic and Interventional Radiology Research Center (ADIR)Tehran University of Medical SciencesTehranIran
- Radiology Department, Cancer Institute, Imam Khomeini Hospital ComplexTehran University of Medical ScienceTehranIran
| | - Seyed Mohammad Ayyoubzadeh
- Department of Health Information Management, School of Allied Medical SciencesTehran University of Medical SciencesTehranIran
| | - Fahimeh Zeinalkhani
- Advanced Diagnostic and Interventional Radiology Research Center (ADIR)Tehran University of Medical SciencesTehranIran
- Radiology Department, Cancer Institute, Imam Khomeini Hospital ComplexTehran University of Medical ScienceTehranIran
| | - Sina Delazar
- Advanced Diagnostic and Interventional Radiology Research Center (ADIR)Tehran University of Medical SciencesTehranIran
| | - Zohreh Javanmard
- Department of Health Information Management, School of Allied Medical SciencesTehran University of Medical SciencesTehranIran
| | - Zahra Ahmadinejad
- Department of Infectious Diseases, Imam Khomeini Hospital ComplexTehran University of Medical SciencesTehranIran
| | | | - Marzieh Esmaeili
- Department of Health Information Management, School of Allied Medical SciencesTehran University of Medical SciencesTehranIran
| |
Collapse
|
23
|
Liu Z, Lv Q, Yang Z, Li Y, Lee CH, Shen L. Recent progress in transformer-based medical image analysis. Comput Biol Med 2023; 164:107268. [PMID: 37494821 DOI: 10.1016/j.compbiomed.2023.107268] [Citation(s) in RCA: 23] [Impact Index Per Article: 11.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2023] [Revised: 05/30/2023] [Accepted: 07/16/2023] [Indexed: 07/28/2023]
Abstract
The transformer is primarily used in the field of natural language processing. Recently, it has been adopted and shows promise in the computer vision (CV) field. Medical image analysis (MIA), as a critical branch of CV, also greatly benefits from this state-of-the-art technique. In this review, we first recap the core component of the transformer, the attention mechanism, and the detailed structures of the transformer. After that, we depict the recent progress of the transformer in the field of MIA. We organize the applications in a sequence of different tasks, including classification, segmentation, captioning, registration, detection, enhancement, localization, and synthesis. The mainstream classification and segmentation tasks are further divided into eleven medical image modalities. A large number of experiments studied in this review illustrate that the transformer-based method outperforms existing methods through comparisons with multiple evaluation metrics. Finally, we discuss the open challenges and future opportunities in this field. This task-modality review with the latest contents, detailed information, and comprehensive comparison may greatly benefit the broad MIA community.
Collapse
Affiliation(s)
- Zhaoshan Liu
- Department of Mechanical Engineering, National University of Singapore, 9 Engineering Drive 1, Singapore, 117575, Singapore.
| | - Qiujie Lv
- Department of Mechanical Engineering, National University of Singapore, 9 Engineering Drive 1, Singapore, 117575, Singapore; School of Intelligent Systems Engineering, Sun Yat-sen University, No. 66, Gongchang Road, Guangming District, 518107, China.
| | - Ziduo Yang
- Department of Mechanical Engineering, National University of Singapore, 9 Engineering Drive 1, Singapore, 117575, Singapore; School of Intelligent Systems Engineering, Sun Yat-sen University, No. 66, Gongchang Road, Guangming District, 518107, China.
| | - Yifan Li
- Department of Mechanical Engineering, National University of Singapore, 9 Engineering Drive 1, Singapore, 117575, Singapore.
| | - Chau Hung Lee
- Department of Radiology, Tan Tock Seng Hospital, 11 Jalan Tan Tock Seng, Singapore, 308433, Singapore.
| | - Lei Shen
- Department of Mechanical Engineering, National University of Singapore, 9 Engineering Drive 1, Singapore, 117575, Singapore.
| |
Collapse
|
24
|
Santosh KC, GhoshRoy D, Nakarmi S. A Systematic Review on Deep Structured Learning for COVID-19 Screening Using Chest CT from 2020 to 2022. Healthcare (Basel) 2023; 11:2388. [PMID: 37685422 PMCID: PMC10486542 DOI: 10.3390/healthcare11172388] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/12/2023] [Revised: 08/16/2023] [Accepted: 08/22/2023] [Indexed: 09/10/2023] Open
Abstract
The emergence of the COVID-19 pandemic in Wuhan in 2019 led to the discovery of a novel coronavirus. The World Health Organization (WHO) designated it as a global pandemic on 11 March 2020 due to its rapid and widespread transmission. Its impact has had profound implications, particularly in the realm of public health. Extensive scientific endeavors have been directed towards devising effective treatment strategies and vaccines. Within the healthcare and medical imaging domain, the application of artificial intelligence (AI) has brought significant advantages. This study delves into peer-reviewed research articles spanning the years 2020 to 2022, focusing on AI-driven methodologies for the analysis and screening of COVID-19 through chest CT scan data. We assess the efficacy of deep learning algorithms in facilitating decision making processes. Our exploration encompasses various facets, including data collection, systematic contributions, emerging techniques, and encountered challenges. However, the comparison of outcomes between 2020 and 2022 proves intricate due to shifts in dataset magnitudes over time. The initiatives aimed at developing AI-powered tools for the detection, localization, and segmentation of COVID-19 cases are primarily centered on educational and training contexts. We deliberate on their merits and constraints, particularly in the context of necessitating cross-population train/test models. Our analysis encompassed a review of 231 research publications, bolstered by a meta-analysis employing search keywords (COVID-19 OR Coronavirus) AND chest CT AND (deep learning OR artificial intelligence OR medical imaging) on both the PubMed Central Repository and Web of Science platforms.
Collapse
Affiliation(s)
- KC Santosh
- 2AI: Applied Artificial Intelligence Research Lab, Vermillion, SD 57069, USA
| | - Debasmita GhoshRoy
- School of Automation, Banasthali Vidyapith, Tonk 304022, Rajasthan, India;
| | - Suprim Nakarmi
- Department of Computer Science, University of South Dakota, Vermillion, SD 57069, USA;
| |
Collapse
|
25
|
Application of a novel deep learning technique using CT images for COVID-19 diagnosis on embedded systems. ALEXANDRIA ENGINEERING JOURNAL 2023; 74:345-358. [PMCID: PMC10183629 DOI: 10.1016/j.aej.2023.05.036] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/05/2023] [Revised: 04/24/2023] [Accepted: 05/08/2023] [Indexed: 11/04/2023]
Abstract
Problem A novel coronavirus (COVID-19) has created a worldwide pneumonia epidemic, and it's important to make a computer-aided way for doctors to use computed tomography (CT) images to find people with COVID-19 as soon as possible. Aim: A fully automated, novel deep-learning method for diagnosis and prognostic analysis of COVID-19 on the embedded system is presented. Methods In this study, CT scans are utilized to identify individuals with COVID-19, pneumonia, or normal class. To achieve classification two pre-trained CNN models, namely ResNet50 and MobileNetv2, which are commonly used for image classification tasks. Additionally, a novel CNN architecture called CovidxNet-CT is introduced specifically designed for COVID-19 diagnosis using three classes of CT scans. To evaluate the effectiveness of the proposed method, k-fold cross-validation is employed, which is a common approach to estimate the performance of deep learning. The study is also evaluated the proposed method on two embedded system platforms, Jetson Nano and Tx2, to demonstrate its feasibility for deployment in resource-constrained environments. Results With an average accuracy of %98.83 and an AUC of 0.988, the system is trained and verified using a 4 fold cross-validation approach. Conclusion The optimistic outcomes from the investigation propose that CovidxNet-CT has the capacity to support radiologists and contribute towards the efforts to combat COVID-19. This study proposes a fully automated, deep-learning-based method for COVID-19 diagnosis and prognostic analysis that is specifically designed for use on embedded systems.
Collapse
|
26
|
Das S, Ayus I, Gupta D. A comprehensive review of COVID-19 detection with machine learning and deep learning techniques. HEALTH AND TECHNOLOGY 2023; 13:1-14. [PMID: 37363343 PMCID: PMC10244837 DOI: 10.1007/s12553-023-00757-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2022] [Accepted: 05/14/2023] [Indexed: 06/28/2023]
Abstract
Purpose The first transmission of coronavirus to humans started in Wuhan city of China, took the shape of a pandemic called Corona Virus Disease 2019 (COVID-19), and posed a principal threat to the entire world. The researchers are trying to inculcate artificial intelligence (Machine learning or deep learning models) for the efficient detection of COVID-19. This research explores all the existing machine learning (ML) or deep learning (DL) models, used for COVID-19 detection which may help the researcher to explore in different directions. The main purpose of this review article is to present a compact overview of the application of artificial intelligence to the research experts, helping them to explore the future scopes of improvement. Methods The researchers have used various machine learning, deep learning, and a combination of machine and deep learning models for extracting significant features and classifying various health conditions in COVID-19 patients. For this purpose, the researchers have utilized different image modalities such as CT-Scan, X-Ray, etc. This study has collected over 200 research papers from various repositories like Google Scholar, PubMed, Web of Science, etc. These research papers were passed through various levels of scrutiny and finally, 50 research articles were selected. Results In those listed articles, the ML / DL models showed an accuracy of 99% and above while performing the classification of COVID-19. This study has also presented various clinical applications of various research. This study specifies the importance of various machine and deep learning models in the field of medical diagnosis and research. Conclusion In conclusion, it is evident that ML/DL models have made significant progress in recent years, but there are still limitations that need to be addressed. Overfitting is one such limitation that can lead to incorrect predictions and overburdening of the models. The research community must continue to work towards finding ways to overcome these limitations and make machine and deep learning models even more effective and efficient. Through this ongoing research and development, we can expect even greater advances in the future.
Collapse
Affiliation(s)
- Sreeparna Das
- Department of Computer Science and Engineering, National Institute of Technology Arunachal Pradesh, Jote, Arunachal Pradesh 791113 India
| | - Ishan Ayus
- Department of Computer Science and Engineering, ITER, Siksha ‘O’ Anusandhan Deemed to be University, Bhubaneswar, Odisha 751030 India
| | - Deepak Gupta
- Department of Computer Science and Engineering, Motilal Nehru National Institute of Technology Allahabad, Prayagraj, UP 211004 India
| |
Collapse
|
27
|
Mozaffari J, Amirkhani A, Shokouhi SB. A survey on deep learning models for detection of COVID-19. Neural Comput Appl 2023; 35:1-29. [PMID: 37362568 PMCID: PMC10224665 DOI: 10.1007/s00521-023-08683-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2021] [Accepted: 05/10/2023] [Indexed: 06/28/2023]
Abstract
The spread of the COVID-19 started back in 2019; and so far, more than 4 million people around the world have lost their lives to this deadly virus and its variants. In view of the high transmissibility of the Corona virus, which has turned this disease into a global pandemic, artificial intelligence can be employed as an effective tool for an earlier detection and treatment of this illness. In this review paper, we evaluate the performance of the deep learning models in processing the X-Ray and CT-Scan images of the Corona patients' lungs and describe the changes made to these models in order to enhance their Corona detection accuracy. To this end, we introduce the famous deep learning models such as VGGNet, GoogleNet and ResNet and after reviewing the research works in which these models have been used for the detection of COVID-19, we compare the performances of the newer models such as DenseNet, CapsNet, MobileNet and EfficientNet. We then present the deep learning techniques of GAN, transfer learning, and data augmentation and examine the statistics of using these techniques. Here, we also describe the datasets introduced since the onset of the COVID-19. These datasets contain the lung images of Corona patients, healthy individuals, and the patients with non-Corona pulmonary diseases. Lastly, we elaborate on the existing challenges in the use of artificial intelligence for COVID-19 detection and the prospective trends of using this method in similar situations and conditions. Supplementary Information The online version contains supplementary material available at 10.1007/s00521-023-08683-x.
Collapse
Affiliation(s)
- Javad Mozaffari
- School of Electrical Engineering, Iran University of Science and Technology, Tehran, 16846-13114 Iran
| | - Abdollah Amirkhani
- School of Automotive Engineering, Iran University of Science and Technology, Tehran, 16846-13114 Iran
| | - Shahriar B. Shokouhi
- School of Electrical Engineering, Iran University of Science and Technology, Tehran, 16846-13114 Iran
| |
Collapse
|
28
|
Córdova-Palomera A, Siffel C, DeBoever C, Wong E, Diogo D, Szalma S. Assessing the potential of polygenic scores to strengthen medical risk prediction models of COVID-19. PLoS One 2023; 18:e0285991. [PMID: 37235597 DOI: 10.1371/journal.pone.0285991] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2022] [Accepted: 05/05/2023] [Indexed: 05/28/2023] Open
Abstract
As findings on the epidemiological and genetic risk factors for coronavirus disease-19 (COVID-19) continue to accrue, their joint power and significance for prospective clinical applications remains virtually unexplored. Severity of symptoms in individuals affected by COVID-19 spans a broad spectrum, reflective of heterogeneous host susceptibilities across the population. Here, we assessed the utility of epidemiological risk factors to predict disease severity prospectively, and interrogated genetic information (polygenic scores) to evaluate whether they can provide further insights into symptom heterogeneity. A standard model was trained to predict severe COVID-19 based on principal component analysis and logistic regression based on information from eight known medical risk factors for COVID-19 measured before 2018. In UK Biobank participants of European ancestry, the model achieved a relatively high performance (area under the receiver operating characteristic curve ~90%). Polygenic scores for COVID-19 computed from summary statistics of the Covid19 Host Genetics Initiative displayed significant associations with COVID-19 in the UK Biobank (p-values as low as 3.96e-9, all with R2 under 1%), but were unable to robustly improve predictive performance of the non-genetic factors. However, error analysis of the non-genetic models suggested that affected individuals misclassified by the medical risk factors (predicted low risk but actual high risk) display a small but consistent increase in polygenic scores. Overall, the results indicate that simple models based on health-related epidemiological factors measured years before COVID-19 onset can achieve high predictive power. Associations between COVID-19 and genetic factors were statistically robust, but currently they have limited predictive power for translational settings. Despite that, the outcomes also suggest that severely affected cases with a medical history profile of low risk might be partly explained by polygenic factors, prompting development of boosted COVID-19 polygenic models based on new data and tools to aid risk-prediction.
Collapse
Affiliation(s)
- Aldo Córdova-Palomera
- Takeda Development Center Americas, Inc., San Diego, California, United States of America
| | - Csaba Siffel
- Takeda Development Center Americas, Inc., San Diego, California, United States of America
| | - Chris DeBoever
- Takeda Development Center Americas, Inc., San Diego, California, United States of America
| | - Emily Wong
- Takeda Development Center Americas, Inc., San Diego, California, United States of America
| | - Dorothée Diogo
- Takeda Development Center Americas, Inc., Cambridge, Massachusetts, United States of America
| | - Sandor Szalma
- Takeda Development Center Americas, Inc., San Diego, California, United States of America
| |
Collapse
|
29
|
Motta PC, Cortez PC, Silva BRS, Yang G, de Albuquerque VHC. Automatic COVID-19 and Common-Acquired Pneumonia Diagnosis Using Chest CT Scans. Bioengineering (Basel) 2023; 10:529. [PMID: 37237599 PMCID: PMC10215490 DOI: 10.3390/bioengineering10050529] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2023] [Revised: 04/22/2023] [Accepted: 04/24/2023] [Indexed: 05/28/2023] Open
Abstract
Even with over 80% of the population being vaccinated against COVID-19, the disease continues to claim victims. Therefore, it is crucial to have a secure Computer-Aided Diagnostic system that can assist in identifying COVID-19 and determining the necessary level of care. This is especially important in the Intensive Care Unit to monitor disease progression or regression in the fight against this epidemic. To accomplish this, we merged public datasets from the literature to train lung and lesion segmentation models with five different distributions. We then trained eight CNN models for COVID-19 and Common-Acquired Pneumonia classification. If the examination was classified as COVID-19, we quantified the lesions and assessed the severity of the full CT scan. To validate the system, we used Resnetxt101 Unet++ and Mobilenet Unet for lung and lesion segmentation, respectively, achieving accuracy of 98.05%, F1-score of 98.70%, precision of 98.7%, recall of 98.7%, and specificity of 96.05%. This was accomplished in just 19.70 s per full CT scan, with external validation on the SPGC dataset. Finally, when classifying these detected lesions, we used Densenet201 and achieved accuracy of 90.47%, F1-score of 93.85%, precision of 88.42%, recall of 100.0%, and specificity of 65.07%. The results demonstrate that our pipeline can correctly detect and segment lesions due to COVID-19 and Common-Acquired Pneumonia in CT scans. It can differentiate these two classes from normal exams, indicating that our system is efficient and effective in identifying the disease and assessing the severity of the condition.
Collapse
Affiliation(s)
- Pedro Crosara Motta
- Department of Teleinformatics Engineering, Federal University of Ceará, Fortaleza 60455-970, Brazil; (P.C.M.); (P.C.C.); (B.R.S.S.)
| | - Paulo César Cortez
- Department of Teleinformatics Engineering, Federal University of Ceará, Fortaleza 60455-970, Brazil; (P.C.M.); (P.C.C.); (B.R.S.S.)
| | - Bruno R. S. Silva
- Department of Teleinformatics Engineering, Federal University of Ceará, Fortaleza 60455-970, Brazil; (P.C.M.); (P.C.C.); (B.R.S.S.)
| | - Guang Yang
- National Heart and Lung Institute, Imperial College London, London SW7 2AZ, UK
| | - Victor Hugo C. de Albuquerque
- Department of Teleinformatics Engineering, Federal University of Ceará, Fortaleza 60455-970, Brazil; (P.C.M.); (P.C.C.); (B.R.S.S.)
| |
Collapse
|
30
|
Amiri M, Ranjbar M, Mohammadi GF. Automatic Diagnosis of COVID-19 Pneumonia using Artificial Intelligence Deep Learning Algorithm Based on Lung Computed Tomography Images. JOURNAL OF MEDICAL SIGNALS & SENSORS 2023; 13:110-117. [PMID: 37448542 PMCID: PMC10336915 DOI: 10.4103/jmss.jmss_146_21] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2021] [Revised: 12/20/2021] [Accepted: 01/02/2022] [Indexed: 07/15/2023]
Abstract
Background The lung computed tomography (CT) scan contains valuable information and patterns that provide the possibility of early diagnosis of COVID-19 disease as a global pandemic by the image processing software. In this research, based on deep learning of artificial intelligence, the software has been designed that is used clinically to diagnose COVID-19 disease with high accuracy. Methods Convolutional neural network architecture developed based on Inception-V3 for deep learning of lung image patterns, feature extraction, and image classification. The theory of transfer learning was utilized to increase the learning power of the system. Changes applied in the network layers to increase the detection power. The process of learning was repeated 30 times. All diagnostic statistical parameters of the diagnostic were analyzed to validate the software. Results Based on the data of Imam Khomeini Hospital in Sari, the validity, sensitivity, and accuracy of the software in diagnosing of affected to COVID-19 and nonaffected to it were obtained 98%, 98%, and 98%, respectively. Diagnostic statistical parameters on some data were 100%. The modified algorithm of Inception-V3 applied to heterogeneous data also had acceptable precision. Conclusion The proposed basic architecture of Inception-v3 utilized for this research has an admissible speed and exactness in learning CT scan images of patients' lungs, and diagnosis of COVID-19 pneumonia, which can be utilized clinically as a powerful diagnostic tool.
Collapse
Affiliation(s)
- Mohammad Amiri
- Assistant Professor, Department of Computer Engineering, Technical and Vocational University, Tehran, Iran
| | - Manizheh Ranjbar
- Lecturer, Department of Computer Engineering, Technical and Vocational University, Tehran, Iran
| | | |
Collapse
|
31
|
Wahid KA, Lin D, Sahin O, Cislo M, Nelms BE, He R, Naser MA, Duke S, Sherer MV, Christodouleas JP, Mohamed ASR, Murphy JD, Fuller CD, Gillespie EF. Large scale crowdsourced radiotherapy segmentations across a variety of cancer anatomic sites. Sci Data 2023; 10:161. [PMID: 36949088 PMCID: PMC10033824 DOI: 10.1038/s41597-023-02062-w] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2022] [Accepted: 03/10/2023] [Indexed: 03/24/2023] Open
Abstract
Clinician generated segmentation of tumor and healthy tissue regions of interest (ROIs) on medical images is crucial for radiotherapy. However, interobserver segmentation variability has long been considered a significant detriment to the implementation of high-quality and consistent radiotherapy dose delivery. This has prompted the increasing development of automated segmentation approaches. However, extant segmentation datasets typically only provide segmentations generated by a limited number of annotators with varying, and often unspecified, levels of expertise. In this data descriptor, numerous clinician annotators manually generated segmentations for ROIs on computed tomography images across a variety of cancer sites (breast, sarcoma, head and neck, gynecologic, gastrointestinal; one patient per cancer site) for the Contouring Collaborative for Consensus in Radiation Oncology challenge. In total, over 200 annotators (experts and non-experts) contributed using a standardized annotation platform (ProKnow). Subsequently, we converted Digital Imaging and Communications in Medicine data into Neuroimaging Informatics Technology Initiative format with standardized nomenclature for ease of use. In addition, we generated consensus segmentations for experts and non-experts using the Simultaneous Truth and Performance Level Estimation method. These standardized, structured, and easily accessible data are a valuable resource for systematically studying variability in segmentation applications.
Collapse
Affiliation(s)
- Kareem A Wahid
- Department of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, Texas, USA
| | - Diana Lin
- Department of Radiation Oncology, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | - Onur Sahin
- Department of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, Texas, USA
| | - Michael Cislo
- Department of Radiation Oncology, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | | | - Renjie He
- Department of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, Texas, USA
| | - Mohammed A Naser
- Department of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, Texas, USA
| | - Simon Duke
- Department of Radiation Oncology, Cambridge University Hospitals, Cambridge, UK
| | - Michael V Sherer
- Department of Radiation Medicine and Applied Sciences, University of California San Diego, La Jolla, CA, USA
| | - John P Christodouleas
- Department of Radiation Oncology, The University of Pennsylvania Cancer Center, Philadelphia, PA, USA
- Elekta, Atlanta, GA, USA
| | - Abdallah S R Mohamed
- Department of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, Texas, USA
| | - James D Murphy
- Department of Radiation Medicine and Applied Sciences, University of California San Diego, La Jolla, CA, USA
| | - Clifton D Fuller
- Department of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, Texas, USA.
| | - Erin F Gillespie
- Department of Radiation Oncology, Memorial Sloan Kettering Cancer Center, New York, NY, USA.
- Fred Hutchinson Cancer Center, Seattle, WA, USA.
| |
Collapse
|
32
|
Khademi S, Heidarian S, Afshar P, Enshaei N, Naderkhani F, Rafiee MJ, Oikonomou A, Shafiee A, Babaki Fard F, plataniotis KN, Mohammadi A. Robust framework for COVID-19 identication from a multicenter dataset of chest CT scans. PLoS One 2023; 18:e0282121. [PMID: 36862633 PMCID: PMC9980818 DOI: 10.1371/journal.pone.0282121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2022] [Accepted: 02/07/2023] [Indexed: 03/03/2023] Open
Abstract
The main objective of this study is to develop a robust deep learning-based framework to distinguish COVID-19, Community-Acquired Pneumonia (CAP), and Normal cases based on volumetric chest CT scans, which are acquired in different imaging centers using different scanners and technical settings. We demonstrated that while our proposed model is trained on a relatively small dataset acquired from only one imaging center using a specific scanning protocol, it performs well on heterogeneous test sets obtained by multiple scanners using different technical parameters. We also showed that the model can be updated via an unsupervised approach to cope with the data shift between the train and test sets and enhance the robustness of the model upon receiving a new external dataset from a different center. More specifically, we extracted the subset of the test images for which the model generated a confident prediction and used the extracted subset along with the training set to retrain and update the benchmark model (the model trained on the initial train set). Finally, we adopted an ensemble architecture to aggregate the predictions from multiple versions of the model. For initial training and development purposes, an in-house dataset of 171 COVID-19, 60 CAP, and 76 Normal cases was used, which contained volumetric CT scans acquired from one imaging center using a single scanning protocol and standard radiation dose. To evaluate the model, we collected four different test sets retrospectively to investigate the effects of the shifts in the data characteristics on the model's performance. Among the test cases, there were CT scans with similar characteristics as the train set as well as noisy low-dose and ultra-low-dose CT scans. In addition, some test CT scans were obtained from patients with a history of cardiovascular diseases or surgeries. This dataset is referred to as the "SPGC-COVID" dataset. The entire test dataset used in this study contains 51 COVID-19, 28 CAP, and 51 Normal cases. Experimental results indicate that our proposed framework performs well on all test sets achieving total accuracy of 96.15% (95%CI: [91.25-98.74]), COVID-19 sensitivity of 96.08% (95%CI: [86.54-99.5]), CAP sensitivity of 92.86% (95%CI: [76.50-99.19]), Normal sensitivity of 98.04% (95%CI: [89.55-99.95]) while the confidence intervals are obtained using the significance level of 0.05. The obtained AUC values (One class vs Others) are 0.993 (95%CI: [0.977-1]), 0.989 (95%CI: [0.962-1]), and 0.990 (95%CI: [0.971-1]) for COVID-19, CAP, and Normal classes, respectively. The experimental results also demonstrate the capability of the proposed unsupervised enhancement approach in improving the performance and robustness of the model when being evaluated on varied external test sets.
Collapse
Affiliation(s)
- Sadaf Khademi
- Concordia Institute for Information Systems Engineering, Concordia University, Montreal, Canada
| | - Shahin Heidarian
- Department of Electrical and Computer Engineering, Concordia University, Montreal, QC, Canada
| | - Parnian Afshar
- Concordia Institute for Information Systems Engineering, Concordia University, Montreal, Canada
| | - Nastaran Enshaei
- Concordia Institute for Information Systems Engineering, Concordia University, Montreal, Canada
| | - Farnoosh Naderkhani
- Concordia Institute for Information Systems Engineering, Concordia University, Montreal, Canada
| | - Moezedin Javad Rafiee
- Department of Medicine and Diagnostic Radiology, McGill University, Montreal, QC, Canada
| | - Anastasia Oikonomou
- Department of Medical Imaging, Sunnybrook Health Sciences Center, Toronto, Canada
| | - Akbar Shafiee
- Department of Cardiovascular Research, Tehran Heart Center, Cardiovascular Diseases Research Institute, Tehran University of Medical Sciences, Tehran, Iran
| | | | | | - Arash Mohammadi
- Concordia Institute for Information Systems Engineering, Concordia University, Montreal, Canada
- * E-mail:
| |
Collapse
|
33
|
da Silveira TLT, Pinto PGL, Lermen TS, Jung CR. Omnidirectional 2.5D representation for COVID-19 diagnosis using chest CTs. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION 2023; 91:103775. [PMID: 36741546 PMCID: PMC9886432 DOI: 10.1016/j.jvcir.2023.103775] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/24/2022] [Revised: 01/18/2023] [Accepted: 01/27/2023] [Indexed: 06/18/2023]
Abstract
The Coronavirus Disease 2019 (COVID-19) has drastically overwhelmed most countries in the last two years, and image-based approaches using computerized tomography (CT) have been used to identify pulmonary infections. Recent methods based on deep learning either require time-consuming per-slice annotations (2D) or are highly data- and hardware-demanding (3D). This work proposes a novel omnidirectional 2.5D representation of volumetric chest CTs that allows exploring efficient 2D deep learning architectures while requiring volume-level annotations only. Our learning approach uses a siamese feature extraction backbone applied to each lung. It combines these features into a classification head that explores a novel combination of Squeeze-and-Excite strategies with Class Activation Maps. We experimented with public and in-house datasets and compared our results with state-of-the-art techniques. Our analyses show that our method provides better or comparable prediction quality and accurately distinguishes COVID-19 infections from other kinds of pneumonia and healthy lungs.
Collapse
Affiliation(s)
- Thiago L T da Silveira
- Institute of Informatics - Federal University of Rio Grande do Sul, Porto Alegre, 91501-970, Brazil
| | - Paulo G L Pinto
- Institute of Informatics - Federal University of Rio Grande do Sul, Porto Alegre, 91501-970, Brazil
| | - Thiago S Lermen
- Institute of Informatics - Federal University of Rio Grande do Sul, Porto Alegre, 91501-970, Brazil
| | - Cláudio R Jung
- Institute of Informatics - Federal University of Rio Grande do Sul, Porto Alegre, 91501-970, Brazil
| |
Collapse
|
34
|
Bhattacharjya U, Sarma KK, Medhi JP, Choudhury BK, Barman G. Automated diagnosis of COVID-19 using radiological modalities and Artificial Intelligence functionalities: A retrospective study based on chest HRCT database. Biomed Signal Process Control 2023; 80:104297. [PMID: 36275840 PMCID: PMC9576693 DOI: 10.1016/j.bspc.2022.104297] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2022] [Revised: 09/12/2022] [Accepted: 10/08/2022] [Indexed: 11/16/2022]
Abstract
Background and Objective The spread of coronavirus has been challenging for the healthcare system's proper management and diagnosis during the rapid spread and control of the infection. Real-time reverse transcription-polymerase chain reaction (RT-PCR), though considered the standard testing measure, has low sensitivity and is time-consuming, which restricts the fast screening of individuals. Therefore, computer tomography (CT) is used to complement the traditional approaches and provide fast and effective screening over other diagnostic methods. This work aims to appraise the importance of chest CT findings of COVID-19 and post-COVID in the diagnosis and prognosis of infected patients and to explore the ways and means to integrate CT findings for the development of advanced Artificial Intelligence (AI) tool-based predictive diagnostic techniques. Methods The retrospective study includes a 188 patient database with COVID-19 infection confirmed by RT-PCR testing, including post-COVID patients. Patients underwent chest high-resolution computer tomography (HRCT), where the images were evaluated for common COVID-19 findings and involvement of the lung and its lobes based on the coverage region. The radiological modalities analyzed in this study may help the researchers in generating a predictive model based on AI tools for further classification with a high degree of reliability. Results Mild to moderate ground glass opacities (GGO) with or without consolidation, crazy paving patterns, and halo signs were common COVID-19 related findings. A CT score is assigned to every patient based on the severity of lung lobe involvement. Conclusion Typical multifocal, bilateral, and peripheral distributions of GGO are the main characteristics related to COVID-19 pneumonia. Chest HRCT can be considered a standard method for timely and efficient assessment of disease progression and management severity. With its fusion with AI tools, chest HRCT can be used as a one-stop platform for radiological investigation and automated diagnosis system.
Collapse
Affiliation(s)
- Upasana Bhattacharjya
- Department of Electronics and Communication Engineering, Gauhati University, Guwahati, Assam, India
| | - Kandarpa Kumar Sarma
- Department of Electronics and Communication Engineering, Gauhati University, Guwahati, Assam, India
| | - Jyoti Prakash Medhi
- Department of Electronics and Communication Engineering, Gauhati University, Guwahati, Assam, India
| | - Binoy Kumar Choudhury
- Department of Radio Diagnosis and Imaging, Dr. Bhubaneswar Borooah Cancer Institute, Guwahati, Assam, India
| | - Geetanjali Barman
- Department of Radio Diagnosis and Imaging, Dr. Bhubaneswar Borooah Cancer Institute, Guwahati, Assam, India
| |
Collapse
|
35
|
Hayat A, Baglat P, Mendonça F, Mostafa SS, Morgado-Dias F. Novel Comparative Study for the Detection of COVID-19 Using CT Scan and Chest X-ray Images. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2023; 20:1268. [PMID: 36674023 PMCID: PMC9858730 DOI: 10.3390/ijerph20021268] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/21/2022] [Revised: 01/04/2023] [Accepted: 01/05/2023] [Indexed: 06/17/2023]
Abstract
The number of coronavirus disease (COVID-19) cases is constantly rising as the pandemic continues, with new variants constantly emerging. Therefore, to prevent the virus from spreading, coronavirus cases must be diagnosed as soon as possible. The COVID-19 pandemic has had a devastating impact on people's health and the economy worldwide. For COVID-19 detection, reverse transcription-polymerase chain reaction testing is the benchmark. However, this test takes a long time and necessitates a lot of laboratory resources. A new trend is emerging to address these limitations regarding the use of machine learning and deep learning techniques for automatic analysis, as these can attain high diagnosis results, especially by using medical imaging techniques. However, a key question arises whether a chest computed tomography scan or chest X-ray can be used for COVID-19 detection. A total of 17,599 images were examined in this work to develop the models used to classify the occurrence of COVID-19 infection, while four different classifiers were studied. These are the convolutional neural network (proposed architecture (named, SCovNet) and Resnet18), support vector machine, and logistic regression. Out of all four models, the proposed SCoVNet architecture reached the best performance with an accuracy of almost 99% and 98% on chest computed tomography scan images and chest X-ray images, respectively.
Collapse
Affiliation(s)
- Ahatsham Hayat
- University of Madeira, 9000-082 Funchal, Portugal
- Interactive Technologies Institute (ITI/LARSyS and ARDITI), 9020-105 Funchal, Portugal
| | - Preety Baglat
- University of Madeira, 9000-082 Funchal, Portugal
- Interactive Technologies Institute (ITI/LARSyS and ARDITI), 9020-105 Funchal, Portugal
| | - Fábio Mendonça
- University of Madeira, 9000-082 Funchal, Portugal
- Interactive Technologies Institute (ITI/LARSyS and ARDITI), 9020-105 Funchal, Portugal
| | | | - Fernando Morgado-Dias
- University of Madeira, 9000-082 Funchal, Portugal
- Interactive Technologies Institute (ITI/LARSyS and ARDITI), 9020-105 Funchal, Portugal
| |
Collapse
|
36
|
Mishra S, Dash TK, Panda G. Speech phoneme and spectral smearing based non-invasive COVID-19 detection. Front Artif Intell 2023; 5:1035805. [PMID: 36686850 PMCID: PMC9847386 DOI: 10.3389/frai.2022.1035805] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/03/2022] [Accepted: 11/18/2022] [Indexed: 01/05/2023] Open
Abstract
COVID-19 is a deadly viral infection that mainly affects the nasopharyngeal and oropharyngeal cavities before the lung in the human body. Early detection followed by immediate treatment can potentially reduce lung invasion and decrease fatality. Recently, several COVID-19 detections methods have been proposed using cough and breath sounds. However, very little study has been done on the use of phoneme analysis and the smearing of the audio signal in COVID-19 detection. In this paper, this problem has been addressed and the classification of speech samples has been carried out in COVID-19-positive and healthy audio samples. Additionally, the grouping of the phonemes based on reference classification accuracies have been proposed for effectiveness and faster detection of the disease at a primary stage. The Mel and Gammatone Cepstral coefficients and their derivatives are used as the features for five standard machine learning-based classifiers. It is observed that the generalized additive model provides the highest accuracy of 97.22% for the phoneme grouping "/t//r//n//g//l/." This smearing-based phoneme classification technique can also be used in the future to classify other speech-related disease detections.
Collapse
Affiliation(s)
- Soumya Mishra
- Department of Electronics and Communication Engineering, C. V. Raman Global University, Bhubaneswar, India
| | - Tusar Kanti Dash
- Department of Electronics and Communication Engineering, C. V. Raman Global University, Bhubaneswar, India
| | - Ganapati Panda
- Department of Electronics and Communication Engineering, C. V. Raman Global University, Bhubaneswar, India
| |
Collapse
|
37
|
Hasan MM, Islam MU, Sadeq MJ, Fung WK, Uddin J. Review on the Evaluation and Development of Artificial Intelligence for COVID-19 Containment. SENSORS (BASEL, SWITZERLAND) 2023; 23:527. [PMID: 36617124 PMCID: PMC9824505 DOI: 10.3390/s23010527] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/28/2022] [Revised: 12/23/2022] [Accepted: 12/29/2022] [Indexed: 06/17/2023]
Abstract
Artificial intelligence has significantly enhanced the research paradigm and spectrum with a substantiated promise of continuous applicability in the real world domain. Artificial intelligence, the driving force of the current technological revolution, has been used in many frontiers, including education, security, gaming, finance, robotics, autonomous systems, entertainment, and most importantly the healthcare sector. With the rise of the COVID-19 pandemic, several prediction and detection methods using artificial intelligence have been employed to understand, forecast, handle, and curtail the ensuing threats. In this study, the most recent related publications, methodologies and medical reports were investigated with the purpose of studying artificial intelligence's role in the pandemic. This study presents a comprehensive review of artificial intelligence with specific attention to machine learning, deep learning, image processing, object detection, image segmentation, and few-shot learning studies that were utilized in several tasks related to COVID-19. In particular, genetic analysis, medical image analysis, clinical data analysis, sound analysis, biomedical data classification, socio-demographic data analysis, anomaly detection, health monitoring, personal protective equipment (PPE) observation, social control, and COVID-19 patients' mortality risk approaches were used in this study to forecast the threatening factors of COVID-19. This study demonstrates that artificial-intelligence-based algorithms integrated into Internet of Things wearable devices were quite effective and efficient in COVID-19 detection and forecasting insights which were actionable through wide usage. The results produced by the study prove that artificial intelligence is a promising arena of research that can be applied for disease prognosis, disease forecasting, drug discovery, and to the development of the healthcare sector on a global scale. We prove that artificial intelligence indeed played a significantly important role in helping to fight against COVID-19, and the insightful knowledge provided here could be extremely beneficial for practitioners and research experts in the healthcare domain to implement the artificial-intelligence-based systems in curbing the next pandemic or healthcare disaster.
Collapse
Affiliation(s)
- Md. Mahadi Hasan
- Department of Computer Science and Engineering, Asian University of Bangladesh, Ashulia 1349, Bangladesh
| | - Muhammad Usama Islam
- School of Computing and Informatics, University of Louisiana at Lafayette, Lafayette, LA 70504, USA
| | - Muhammad Jafar Sadeq
- Department of Computer Science and Engineering, Asian University of Bangladesh, Ashulia 1349, Bangladesh
| | - Wai-Keung Fung
- Department of Applied Computing and Engineering, Cardiff School of Technologies, Cardiff Metropolitan University, Cardiff CF5 2YB, UK
| | - Jasim Uddin
- Department of Applied Computing and Engineering, Cardiff School of Technologies, Cardiff Metropolitan University, Cardiff CF5 2YB, UK
| |
Collapse
|
38
|
Podder P, Das SR, Mondal MRH, Bharati S, Maliha A, Hasan MJ, Piltan F. LDDNet: A Deep Learning Framework for the Diagnosis of Infectious Lung Diseases. SENSORS (BASEL, SWITZERLAND) 2023; 23:480. [PMID: 36617076 PMCID: PMC9824583 DOI: 10.3390/s23010480] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/08/2022] [Revised: 12/25/2022] [Accepted: 12/27/2022] [Indexed: 06/17/2023]
Abstract
This paper proposes a new deep learning (DL) framework for the analysis of lung diseases, including COVID-19 and pneumonia, from chest CT scans and X-ray (CXR) images. This framework is termed optimized DenseNet201 for lung diseases (LDDNet). The proposed LDDNet was developed using additional layers of 2D global average pooling, dense and dropout layers, and batch normalization to the base DenseNet201 model. There are 1024 Relu-activated dense layers and 256 dense layers using the sigmoid activation method. The hyper-parameters of the model, including the learning rate, batch size, epochs, and dropout rate, were tuned for the model. Next, three datasets of lung diseases were formed from separate open-access sources. One was a CT scan dataset containing 1043 images. Two X-ray datasets comprising images of COVID-19-affected lungs, pneumonia-affected lungs, and healthy lungs exist, with one being an imbalanced dataset with 5935 images and the other being a balanced dataset with 5002 images. The performance of each model was analyzed using the Adam, Nadam, and SGD optimizers. The best results have been obtained for both the CT scan and CXR datasets using the Nadam optimizer. For the CT scan images, LDDNet showed a COVID-19-positive classification accuracy of 99.36%, a 100% precision recall of 98%, and an F1 score of 99%. For the X-ray dataset of 5935 images, LDDNet provides a 99.55% accuracy, 73% recall, 100% precision, and 85% F1 score using the Nadam optimizer in detecting COVID-19-affected patients. For the balanced X-ray dataset, LDDNet provides a 97.07% classification accuracy. For a given set of parameters, the performance results of LDDNet are better than the existing algorithms of ResNet152V2 and XceptionNet.
Collapse
Affiliation(s)
- Prajoy Podder
- Institute of Information and Communication Technology, Bangladesh University of Engineering and Technology, Dhaka 1205, Bangladesh
| | - Sanchita Rani Das
- Institute of Information and Communication Technology, Bangladesh University of Engineering and Technology, Dhaka 1205, Bangladesh
| | - M. Rubaiyat Hossain Mondal
- Institute of Information and Communication Technology, Bangladesh University of Engineering and Technology, Dhaka 1205, Bangladesh
| | - Subrato Bharati
- Institute of Information and Communication Technology, Bangladesh University of Engineering and Technology, Dhaka 1205, Bangladesh
| | - Azra Maliha
- Faculty of Engineering and IT, The British University in Dubai, Dubai P.O. Box 345015, United Arab Emirates
| | - Md Junayed Hasan
- National Subsea Centre, Robert Gordon University, Aberdeen AB10 7AQ, UK
| | - Farzin Piltan
- Ulsan Industrial Artificial Intelligence (UIAI) Lab, Department of Electrical, Electronics and Computer Engineering, University of Ulsan, Ulsan 44610, Republic of Korea
| |
Collapse
|
39
|
Niranjan K, Shankar Kumar S, Vedanth S, Chitrakala DS. An Explainable AI driven Decision Support System for COVID-19 Diagnosis using Fused Classification and Segmentation. PROCEDIA COMPUTER SCIENCE 2023; 218:1915-1925. [PMID: 36743792 PMCID: PMC9886321 DOI: 10.1016/j.procs.2023.01.168] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/01/2023]
Abstract
The coronavirus has caused havoc on billions of people worldwide. The Reverse Transcription Polymerase Chain Reaction(RT-PCR) test is widely accepted as a standard diagnostic tool for detecting infection, however, the severity of infection can't be measured accurately with RT-PCR results. Chest CT Scans of infected patients can manifest the presence of lesions with high sensitivity. During the pandemic, there is a dearth of competent doctors to examine chest CT images. Therefore, a Guided Gradcam based Explainable Classification and Segmentation system (GGECS) which is a real-time explainable classification and lesion identification decision support system is proposed in this work. The classification model used in the proposed GGECS system is inspired by Res2Net. Explainable AI techniques like GradCam and Guided GradCam are used to demystify Convolutional Neural Networks (CNNs). These explainable systems can assist in localizing the regions in the CT scan that contribute significantly to the system's prediction. The segmentation model can further reliably localize infected regions. The segmentation model is a fusion between the VGG-16 and the classification network. The proposed classification model in GGECS obtains an overall accuracy of 98.51 % and the segmentation model achieves an IoU score of 0.595.
Collapse
Affiliation(s)
- K Niranjan
- Computer Science and Engineering, College of Engineering Guindy, Anna University, Chennai, India
| | - S Shankar Kumar
- Computer Science and Engineering, College of Engineering Guindy, Anna University, Chennai, India
| | - S Vedanth
- Computer Science and Engineering, College of Engineering Guindy, Anna University, Chennai, India
| | - Dr. S. Chitrakala
- Computer Science and Engineering, College of Engineering Guindy, Anna University, Chennai, India
| |
Collapse
|
40
|
Bhatele KR, Jha A, Tiwari D, Bhatele M, Sharma S, Mithora MR, Singhal S. COVID-19 Detection: A Systematic Review of Machine and Deep Learning-Based Approaches Utilizing Chest X-Rays and CT Scans. Cognit Comput 2022; 16:1-38. [PMID: 36593991 PMCID: PMC9797382 DOI: 10.1007/s12559-022-10076-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2022] [Accepted: 11/15/2022] [Indexed: 12/30/2022]
Abstract
This review study presents the state-of-the-art machine and deep learning-based COVID-19 detection approaches utilizing the chest X-rays or computed tomography (CT) scans. This study aims to systematically scrutinize as well as to discourse challenges and limitations of the existing state-of-the-art research published in this domain from March 2020 to August 2021. This study also presents a comparative analysis of the performance of four majorly used deep transfer learning (DTL) models like VGG16, VGG19, ResNet50, and DenseNet over the COVID-19 local CT scans dataset and global chest X-ray dataset. A brief illustration of the majorly used chest X-ray and CT scan datasets of COVID-19 patients utilized in state-of-the-art COVID-19 detection approaches are also presented for future research. The research databases like IEEE Xplore, PubMed, and Web of Science are searched exhaustively for carrying out this survey. For the comparison analysis, four deep transfer learning models like VGG16, VGG19, ResNet50, and DenseNet are initially fine-tuned and trained using the augmented local CT scans and global chest X-ray dataset in order to observe their performance. This review study summarizes major findings like AI technique employed, type of classification performed, used datasets, results in terms of accuracy, specificity, sensitivity, F1 score, etc., along with the limitations, and future work for COVID-19 detection in tabular manner for conciseness. The performance analysis of the four majorly used deep transfer learning models affirms that Visual Geometry Group 19 (VGG19) model delivered the best performance over both COVID-19 local CT scans dataset and global chest X-ray dataset.
Collapse
Affiliation(s)
| | - Anand Jha
- RJIT BSF Academy, Tekanpur, Gwalior India
| | | | | | | | | | | |
Collapse
|
41
|
Huang Y, Si Y, Hu B, Zhang Y, Wu S, Wu D, Wang Q. Transformer-based factorized encoder for classification of pneumoconiosis on 3D CT images. Comput Biol Med 2022; 150:106137. [PMID: 36191395 DOI: 10.1016/j.compbiomed.2022.106137] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2022] [Revised: 09/13/2022] [Accepted: 09/18/2022] [Indexed: 11/22/2022]
Abstract
In the past decade, deep learning methods have been implemented in the medical image fields and have achieved good performance. Recently, deep learning algorithms have been successful in the evaluation of diagnosis on lung images. Although chest radiography (CR) is the standard data modality for diagnosing pneumoconiosis, computed tomography (CT) typically provides more details of the lesions in the lung. Thus, a transformer-based factorized encoder (TBFE) was proposed and first applied for the classification of pneumoconiosis depicted on 3D CT images. Specifically, a factorized encoder consists of two transformer encoders. The first transformer encoder enables the interaction of intra-slice by encoding feature maps from the same slice of CT. The second transformer encoder explores the inter-slice interaction by encoding feature maps from different slices. In addition, the lack of grading standards on CT for labeling the pneumoconiosis lesions. Thus, an acknowledged CR-based grading system was applied to mark the corresponding pneumoconiosis CT stage. Then, we pre-trained the 3D convolutional autoencoder on the public LIDC-IDRI dataset and fixed the parameters of the last convolutional layer of the encoder to extract CT feature maps with underlying spatial structural information from our 3D CT dataset. Experimental results demonstrated the superiority of the TBFE over other 3D-CNN networks, achieving an accuracy of 97.06%, a recall of 89.33%, precision of 90%, and an F1-score of 93.33%, using 10-fold cross-validation.
Collapse
Affiliation(s)
- Yingying Huang
- Key Laboratory of Spectral Imaging Technology, Xi'an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, Xi'an 710119, Shanxi, China; University of Chinese Academy of Sciences, Beijing 100049, China; Key laboratory of Biomedical Spectroscopy, Xi'an 710119, Shanxi, China.
| | - Yang Si
- Sichuan Academy of Medical Science and Sichuan Provincial People's Hospital, Department of Neurology, Chengdu, Sichuan, China; University of Electronic Science and Technology of China, Chengdu, Sichuan, China.
| | - Bingliang Hu
- Key laboratory of Biomedical Spectroscopy, Xi'an 710119, Shanxi, China.
| | - Yan Zhang
- Department of Radiology, West China School of Public Health and West China Fourth Hospital, Sichuan University, Chengdu, Sichuan, China.
| | - Shuang Wu
- Department of Radiology, West China School of Public Health and West China Fourth Hospital, Sichuan University, Chengdu, Sichuan, China.
| | - Dongsheng Wu
- Department of Radiology, West China School of Public Health and West China Fourth Hospital, Sichuan University, Chengdu, Sichuan, China; Research Center of Artificial Intelligence in Medicine, West China-PUMC C.C. Chen Institute of Health, Sichuan University, Chengdu, Sichuan, China.
| | - Quan Wang
- Key Laboratory of Spectral Imaging Technology, Xi'an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, Xi'an 710119, Shanxi, China; Key laboratory of Biomedical Spectroscopy, Xi'an 710119, Shanxi, China.
| |
Collapse
|
42
|
Xu B, Martín D, Khishe M, Boostani R. COVID-19 diagnosis using chest CT scans and deep convolutional neural networks evolved by IP-based sine-cosine algorithm. Med Biol Eng Comput 2022; 60:2931-2949. [PMID: 35962266 PMCID: PMC9374292 DOI: 10.1007/s11517-022-02637-6] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/16/2021] [Accepted: 06/15/2022] [Indexed: 11/25/2022]
Abstract
The prevalence of the COVID-19 virus and its variants has influenced all aspects of our life, and therefore, the precise diagnosis of this disease is vital. If a polymerase chain reaction test for a subject is negative, but he/she cannot easily breathe, taking a computed tomography (CT) image from his/her lung is urgently recommended. This study aims to optimize a deep convolution neural network (DCNN) structure to increase the COVID-19 diagnosis accuracy in lung CT images. This paper employs the sine-cosine algorithm (SCA) to optimize the structure of DCNN to take raw CT images and determine their status. Three improvements based on regular SCA are proposed to enhance both the accuracy and speed of the results. First, a new encoding approach is proposed based on the internet protocol (IP) address. Then, an enfeebled layer is proposed to generate a variable-length DCNN. The suggested model is examined over the COVID-CT and SARS-CoV-2 datasets. The proposed method is compared to a standard DCNN and seven variable-length models in terms of five known metrics, including sensitivity, accuracy, specificity, F1-score, precision, and receiver operative curve (ROC) and precision-recall curves. The results demonstrate that the proposed DCNN-IPSCA surpasses other benchmarks, achieving final accuracy of (98.32% and 98.01%), the sensitivity of (97.22% and 96.23%), and specificity of (96.77% and 96.44%) on the SARS-CoV-2 and COVID-CT datasets, respectively. Also, the proposed DCNN-IPSCA performs much better than the standard DCNN, with GPU and CPU training times, which are 387.69 and 63.10 times faster, respectively.
Collapse
Affiliation(s)
- Binfeng Xu
- Guangdong Food and Drug Vocational College, Guangzhou, 510520, Guangdong, China.
| | - Diego Martín
- ETSI Telecomunicación, Universidad Politécnica de Madrid, Av. Complutense 30, 28040, Madrid, Spain
| | - Mohammad Khishe
- Department of Electrical Engineering, Imam Khomeini Marine Science University, Nowshahr, Iran.
| | - Reza Boostani
- CSE & IT Department, Electrical and Computer Engineering Faculty, Shiraz University, Shiraz, Iran
| |
Collapse
|
43
|
Yazdani A, Zahmatkeshan M, Ravangard R, Sharifian R, Shirdeli M. Supervised Machine Learning Approach to COVID-19 Detection Based on Clinical Data. Med J Islam Repub Iran 2022; 36:110. [PMID: 36447543 PMCID: PMC9700415 DOI: 10.47176/mjiri.36.110] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/07/2021] [Indexed: 09/10/2024] Open
Abstract
Background: The new coronavirus has been spreading since the beginning of 2020, and many efforts have been made to develop vaccines to help patients recover. It is now clear that the world needs a rapid solution to curb the spread of COVID-19 worldwide with non-clinical approaches such as artificial intelligence techniques. These approaches can be effective in reducing the burden on the health care system to provide the best possible way to diagnose the COVID-19 epidemic. This study was conducted to use Machine Learning (ML) algorithms for the early detection of COVID-19 in patients. Methods: This retrospective study used data from hospitals affiliated with Shiraz University of Medical Sciences in Iran. This dataset was collected in the period March to October 2020 andcontained 10055 cases with 63 features. We selected and compared six algorithms: C4.5, support vector machine (SVM), Naive Bayes, logistic Regression (LR), Random Forest, and K-Nearest Neighbor algorithm using Rapid Miner software. The performance of algorithms was measured using evaluation metrics, such as precision, recall, accuracy, and f-measure. Results: The results of the study show that among the various used classification methods in the diagnosis of coronavirus, SVM (93.41% accuracy) and C4.5 (91.87% accuracy) achieved the highest performance. According to the C4.5 decision tree, "contact with a person who has COVID-19" was considered the most important diagnostic criterion based on the Gini index. Conclusion: We found that ML approaches enable a reasonable level of accuracy in the diagnosis of COVID-19.
Collapse
Affiliation(s)
- Azita Yazdani
- Department of Health Information Management, Clinical Education Research Center, Health Human Resources Research Center, School of Health Management and Information Sciences, Shiraz University of Medical Sciences, Shiraz, Iran
| | - Maryam Zahmatkeshan
- Noncommunicable Diseases Research Center, Fasa University of Medical Sciences, Fasa, Iran
- School of Allied Medical Sciences, Fasa University of Medical Sciences, Fasa, Iran
| | - Ramin Ravangard
- Department of Health Services Management, Health Human Resources Research Center, School of Health Management and Information Sciences, Shiraz University of Medical Sciences, Shiraz, Iran
| | - Roxana Sharifian
- Department of Health Information Management, Health Human Resources Research Center, School of Health Management and Information Sciences, Shiraz University of Medical Sciences, Shiraz, Iran
| | - Mohammad Shirdeli
- Department of Health Information Management, Student Research Committee, Health Human Resources Research Center, School of Health Management and Information Sciences, Shiraz University of Medical Sciences, Shiraz, Iran
| |
Collapse
|
44
|
Anilkumar B, Srividya K, Mary Sowjanya A. Covid-19 classification using sigmoid based hyper-parameter modified DNN for CT scans and chest X-rays. MULTIMEDIA TOOLS AND APPLICATIONS 2022; 82:12513-12536. [PMID: 36157352 PMCID: PMC9485800 DOI: 10.1007/s11042-022-13783-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/18/2021] [Revised: 07/22/2022] [Accepted: 09/05/2022] [Indexed: 06/16/2023]
Abstract
Coronavirus disease (COVID-19) is an infectious disease caused by the SARS-CoV-2 virus. Diagnosis of Computed Tomography (CT), and Chest X-rays (CXR) contains the problem of overfitting, earlier diagnosis, and mode collapse. In this work, we predict the classification of the Corona in CT and CXR images. Initially, the images of the dataset are pre-processed using the function of an adaptive Gaussian filter for de-nosing the image. Once the image is pre-processed it goes to Sigmoid Based Hyper-Parameter Modified DNN(SHMDNN). The hyperparameter modification makes use of the optimization algorithm of adaptive grey wolf optimization (AGWO). Finally, classification takes place and classifies the CT and CXR images into 3 categories namely normal, Pneumonia, and COVID-19 images. Better accuracy of 99.9% is reached when compared to different DNN networks.
Collapse
Affiliation(s)
- B Anilkumar
- Department of ECE, GMR Institute of Technology, Rajam, India
| | - K Srividya
- Department of CSE, GMR Institute of Technology, Rajam, India
| | - A Mary Sowjanya
- Department of CS&SE, Andhra University College of Engineering, Visakhapatnam, India
| |
Collapse
|
45
|
Zhao M, Li J, Xiang L, Zhang ZH, Peng SL. A diagnosis model of dementia via machine learning. Front Aging Neurosci 2022; 14:984894. [PMID: 36158565 PMCID: PMC9490175 DOI: 10.3389/fnagi.2022.984894] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/02/2022] [Accepted: 08/11/2022] [Indexed: 11/13/2022] Open
Abstract
As the aging population poses serious challenges to families and societies, the issue of dementia has also received increasing attention. Dementia detection often requires a series of complex tests and lengthy questionnaires, which are time-consuming. In order to solve this problem, this article aims at the diagnosis method of questionnaire survey, hoping to establish a diagnosis model to help doctors make a diagnosis through machine learning method, and use feature selection method to select important questions to reduce the number of questions in the questionnaire, so as to reduce medical and time costs. In this article, Clinical Dementia Rating (CDR) is used as the data source, and various methods are used for modeling and feature selection, so as to combine similar attributes in the data set, reduce the categories, and finally use the confusion matrix to judge the effect. The experimental results show that the model established by the bagging method has the best effect, and the accuracy rate can reach 80% of the true diagnosis rate; in terms of feature selection, the principal component analysis (PCA) has the best effect compared with other methods.
Collapse
Affiliation(s)
- Ming Zhao
- School of Computer Science, Yangtze University, Jingzhou, China
| | - Jie Li
- School of Computer Science, Yangtze University, Jingzhou, China
| | - Liuqing Xiang
- School of Computer Science, Yangtze University, Jingzhou, China
| | - Zu-hai Zhang
- Department of Ophthalmology, The First Affiliated Hospital of Yangtze University, Jingzhou, China
- *Correspondence: Zu-hai Zhang,
| | - Sheng-Lung Peng
- Department of Creative Technologies and Product Design, National Taipei University of Business, Taipei, Taiwan
| |
Collapse
|
46
|
Heidari A, Jafari Navimipour N, Unal M, Toumaj S. Machine learning applications for COVID-19 outbreak management. Neural Comput Appl 2022; 34:15313-15348. [PMID: 35702664 PMCID: PMC9186489 DOI: 10.1007/s00521-022-07424-w] [Citation(s) in RCA: 22] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2021] [Accepted: 05/10/2022] [Indexed: 12/29/2022]
Abstract
Recently, the COVID-19 epidemic has resulted in millions of deaths and has impacted practically every area of human life. Several machine learning (ML) approaches are employed in the medical field in many applications, including detecting and monitoring patients, notably in COVID-19 management. Different medical imaging systems, such as computed tomography (CT) and X-ray, offer ML an excellent platform for combating the pandemic. Because of this need, a significant quantity of study has been carried out; thus, in this work, we employed a systematic literature review (SLR) to cover all aspects of outcomes from related papers. Imaging methods, survival analysis, forecasting, economic and geographical issues, monitoring methods, medication development, and hybrid apps are the seven key uses of applications employed in the COVID-19 pandemic. Conventional neural networks (CNNs), long short-term memory networks (LSTM), recurrent neural networks (RNNs), generative adversarial networks (GANs), autoencoders, random forest, and other ML techniques are frequently used in such scenarios. Next, cutting-edge applications related to ML techniques for pandemic medical issues are discussed. Various problems and challenges linked with ML applications for this pandemic were reviewed. It is expected that additional research will be conducted in the upcoming to limit the spread and catastrophe management. According to the data, most papers are evaluated mainly on characteristics such as flexibility and accuracy, while other factors such as safety are overlooked. Also, Keras was the most often used library in the research studied, accounting for 24.4 percent of the time. Furthermore, medical imaging systems are employed for diagnostic reasons in 20.4 percent of applications.
Collapse
Affiliation(s)
- Arash Heidari
- Department of Computer Engineering, Tabriz Branch, Islamic Azad University, Tabriz, Iran
- Department of Computer Engineering, Shabestar Branch, Islamic Azad University, Shabestar, Iran
| | | | - Mehmet Unal
- Department of Computer Engineering, Nisantasi University, Istanbul, Turkey
| | - Shiva Toumaj
- Urmia University of Medical Sciences, Urmia, Iran
| |
Collapse
|
47
|
Ali Ahmed SA, Yavuz MC, Şen MU, Gülşen F, Tutar O, Korkmazer B, Samancı C, Şirolu S, Hamid R, Eryürekli AE, Mammadov T, Yanikoglu B. Comparison and ensemble of 2D and 3D approaches for COVID-19 detection in CT images. Neurocomputing 2022; 488:457-469. [PMID: 35345875 PMCID: PMC8942080 DOI: 10.1016/j.neucom.2022.02.018] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/09/2021] [Revised: 11/06/2021] [Accepted: 02/03/2022] [Indexed: 12/31/2022]
Abstract
Detecting COVID-19 in computed tomography (CT) or radiography images has been proposed as a supplement to the RT-PCR test. We compare slice-based (2D) and volume-based (3D) approaches to this problem and propose a deep learning ensemble, called IST-CovNet, combining the best 2D and 3D systems with novel preprocessing and attention modules and the use of a bidirectional Long Short-Term Memory model for combining slice-level decisions. The proposed ensemble obtains 90.80% accuracy and 0.95 AUC score overall on the newly collected IST-C dataset in detecting COVID-19 among normal controls and other types of lung pathologies; and 93.69% accuracy and 0.99 AUC score on the publicly available MosMedData dataset that consists of COVID-19 scans and normal controls only. The system also obtains state-of-art results (90.16% accuracy and 0.94 AUC) on the COVID-CT-MD dataset which is only used for testing. The system is deployed at Istanbul University Cerrahpaşa School of Medicine where it is used to automatically screen CT scans of patients, while waiting for RT-PCR tests or radiologist evaluation.
Collapse
Affiliation(s)
- Sara Atito Ali Ahmed
- Faculty of Engineering and Natural Sciences, Sabancı University, Istanbul 34956, Turkey
- Centre for Vision, Speech and Signal Processing, University of Surrey, Guildford GU2 7XH, U.K.7XH, UK
| | - Mehmet Can Yavuz
- Faculty of Engineering and Natural Sciences, Sabancı University, Istanbul 34956, Turkey
| | - Mehmet Umut Şen
- Faculty of Engineering and Natural Sciences, Sabancı University, Istanbul 34956, Turkey
| | - Fatih Gülşen
- Istanbul University-Cerrahpaşa, Cerrahpaşa Faculty of Medicine, Istanbul 34096, Turkey
| | - Onur Tutar
- Istanbul University-Cerrahpaşa, Cerrahpaşa Faculty of Medicine, Istanbul 34096, Turkey
| | - Bora Korkmazer
- Istanbul University-Cerrahpaşa, Cerrahpaşa Faculty of Medicine, Istanbul 34096, Turkey
| | - Cesur Samancı
- Istanbul University-Cerrahpaşa, Cerrahpaşa Faculty of Medicine, Istanbul 34096, Turkey
| | - Sabri Şirolu
- Istanbul University-Cerrahpaşa, Cerrahpaşa Faculty of Medicine, Istanbul 34096, Turkey
| | - Rauf Hamid
- Istanbul University-Cerrahpaşa, Cerrahpaşa Faculty of Medicine, Istanbul 34096, Turkey
| | - Ali Ergun Eryürekli
- Istanbul University-Cerrahpaşa, Cerrahpaşa Faculty of Medicine, Istanbul 34096, Turkey
| | - Toghrul Mammadov
- Istanbul University-Cerrahpaşa, Cerrahpaşa Faculty of Medicine, Istanbul 34096, Turkey
| | - Berrin Yanikoglu
- Faculty of Engineering and Natural Sciences, Sabancı University, Istanbul 34956, Turkey
| |
Collapse
|
48
|
Heidari A, Toumaj S, Navimipour NJ, Unal M. A privacy-aware method for COVID-19 detection in chest CT images using lightweight deep conventional neural network and blockchain. Comput Biol Med 2022; 145:105461. [PMID: 35366470 PMCID: PMC8958272 DOI: 10.1016/j.compbiomed.2022.105461] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/03/2022] [Revised: 03/13/2022] [Accepted: 03/24/2022] [Indexed: 12/16/2022]
Abstract
With the global spread of the COVID-19 epidemic, a reliable method is required for identifying COVID-19 victims. The biggest issue in detecting the virus is a lack of testing kits that are both reliable and affordable. Due to the virus's rapid dissemination, medical professionals have trouble finding positive patients. However, the next real-life issue is sharing data with hospitals around the world while considering the organizations' privacy concerns. The primary worries for training a global Deep Learning (DL) model are creating a collaborative platform and personal confidentiality. Another challenge is exchanging data with health care institutions while protecting the organizations' confidentiality. The primary concerns for training a universal DL model are creating a collaborative platform and preserving privacy. This paper provides a model that receives a small quantity of data from various sources, like organizations or sections of hospitals, and trains a global DL model utilizing blockchain-based Convolutional Neural Networks (CNNs). In addition, we use the Transfer Learning (TL) technique to initialize layers rather than initialize randomly and discover which layers should be removed before selection. Besides, the blockchain system verifies the data, and the DL method trains the model globally while keeping the institution's confidentiality. Furthermore, we gather the actual and novel COVID-19 patients. Finally, we run extensive experiments utilizing Python and its libraries, such as Scikit-Learn and TensorFlow, to assess the proposed method. We evaluated works using five different datasets, including Boukan Dr. Shahid Gholipour hospital, Tabriz Emam Reza hospital, Mahabad Emam Khomeini hospital, Maragheh Dr.Beheshti hospital, and Miandoab Abbasi hospital datasets, and our technique outperform state-of-the-art methods on average in terms of precision (2.7%), recall (3.1%), F1 (2.9%), and accuracy (2.8%).
Collapse
Affiliation(s)
- Arash Heidari
- Department of Computer Engineering, Tabriz Branch, Islamic Azad University, Tabriz, Iran; Department of Computer Engineering, Shabestar Branch, Islamic Azad University, Shabestar, Iran
| | - Shiva Toumaj
- Urmia University of Medical Sciences, Urmia, Iran
| | | | - Mehmet Unal
- Department of Computer Engineering, Nisantasi University, Istanbul, Turkey
| |
Collapse
|
49
|
Liu B, Nie X, Li Z, Yang S, Tian Y. Evolving deep convolutional neural networks by IP-based marine predator algorithm for COVID-19 diagnosis using chest CT scans. JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING 2022; 15:1-14. [PMID: 35646192 PMCID: PMC9127492 DOI: 10.1007/s12652-022-03901-1] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/08/2021] [Accepted: 05/04/2022] [Indexed: 05/27/2023]
Abstract
This paper proposes an optimal structured deep convolutional neural network (DCNN) based on the marine predator algorithm (MPA) to construct a novel automatic diagnosis platform that may help radiologists identify COVID-19 and non-COVID-19 patients based on CT scan categorization and analysis. The goal is met with the help of three modifications based on the regular MPA. First, a novel encoding scheme based on Internet Protocol (IP) addresses is proposed, followed by introducing an Enfeebled layer to build a variable-length DCNN. Finally, the learning process divides big datasets into smaller chunks that are randomly evaluated. The proposed model is compared to the COVID-CT and SARS-CoV-2 datasets to undertake a complete evaluation. Following that, the performance of the developed model (DCNN-IPMPA) is compared to that of a typical DCNN and seven variable-length models using five well-known comparison metrics, as well as the receiver operating characteristic and precision-recall curves. The results show that the DCNN-IPMPA outperforms other benchmarks, with a final accuracy of 97.21% on the SARS-CoV-2 dataset and 97.94% on the COVID-CT dataset. Also, timing analysis indicates that the DCNN processing time is the best among all benchmarks as expected; however, DCNN-IPMPA represents a competitive result compared to the standard DCNN.
Collapse
Affiliation(s)
- Bing Liu
- School of Software, Northwestern Polytechnical University, Xi’an, Shaanxi Province China
| | - Xuan Nie
- School of Software, Northwestern Polytechnical University, Xi’an, Shaanxi Province China
| | - Zhongxian Li
- School of Software, Northwestern Polytechnical University, Xi’an, Shaanxi Province China
| | - Shihong Yang
- School of Mechanical Engineering, Northwestern Polytechnical University, Xi’an, Shaanxi Province China
| | - Yushu Tian
- Guiyang Fourth People’s Hospital, Guiyang City, Guizhou province China
| |
Collapse
|
50
|
Ragab M, Alshehri S, Alhakamy NA, Mansour RF, Koundal D. Multiclass Classification of Chest X-Ray Images for the Prediction of COVID-19 Using Capsule Network. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:6185013. [PMID: 35634055 PMCID: PMC9135545 DOI: 10.1155/2022/6185013] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/30/2022] [Revised: 03/30/2022] [Accepted: 04/12/2022] [Indexed: 01/09/2023]
Abstract
It is critical to establish a reliable method for detecting people infected with COVID-19 since the pandemic has numerous harmful consequences worldwide. If the patient is infected with COVID-19, a chest X-ray can be used to determine this. In this work, an X-ray showing a COVID-19 infection is classified by the capsule neural network model we trained to recognise. 6310 chest X-ray pictures were used to train the models, separated into three categories: normal, pneumonia, and COVID-19. This work is considered an improved deep learning model for the classification of COVID-19 disease through X-ray images. Viewpoint invariance, fewer parameters, and better generalisation are some of the advantages of CapsNet compared with the classic convolutional neural network (CNN) models. The proposed model has achieved an accuracy greater than 95% during the model's training, which is better than the other state-of-the-art algorithms. Furthermore, to aid in detecting COVID-19 in a chest X-ray, the model could provide extra information.
Collapse
Affiliation(s)
- Mahmoud Ragab
- Department of Information Technology, King Abdulaziz University, Jeddah 21589, Saudi Arabia
- Centre for Artificial Intelligence in Precision Medicines, King Abdulaziz University, Jeddah 21589, Saudi Arabia
- Department of Mathematics, Al-Azhar University, Nasercity 11884, Cairo, Egypt
| | - Samah Alshehri
- Department of Pharmacy Practice, King Abdulaziz University, Jeddah, Saudi Arabia
| | - Nabil A. Alhakamy
- Department of Pharmaceutics, King Abdulaziz University, Jeddah, Saudi Arabia
- Center of Excellence for Drug Research and Pharmaceutical Industries, King Abdulaziz University, Jeddah 21589, Saudi Arabia
- Mohamed Saeed Tamer Chair for Pharmaceutical Industries, King Abdulaziz University, Jeddah 21589, Saudi Arabia
| | - Romany F. Mansour
- Department of Mathematics, New Valley University, El-Kharga 72511, Egypt
| | - Deepika Koundal
- Department of Systemics, School of Computer Science, University of Petroleum and Energy Studies, Dehradun, India
| |
Collapse
|