1
|
Khan R, Taj S, Ma X, Noor A, Zhu H, Khan J, Khan ZU, Khan SU. Advanced federated ensemble internet of learning approach for cloud based medical healthcare monitoring system. Sci Rep 2024; 14:26068. [PMID: 39478132 PMCID: PMC11526108 DOI: 10.1038/s41598-024-77196-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2024] [Accepted: 10/21/2024] [Indexed: 11/02/2024] Open
Abstract
Medical image machines serve as a valuable tool to monitor and diagnose a variety of diseases. However, manual and centralized interpretation are both error-prone and time-consuming due to malicious attacks. Numerous diagnostic algorithms have been developed to improve precision and prevent poisoning attacks by integrating symptoms, test methods, and imaging data. But in today's digital technology world, it is necessary to have a global cloud-based diagnostic artificial intelligence model that is efficient in diagnosis and preventing poisoning attacks and might be used for multiple purposes. We propose the Healthcare Federated Ensemble Internet of Learning Cloud Doctor System (FDEIoL) model, which integrates different Internet of Things (IoT) devices to provide precise and accurate interpretation without poisoning attack problems, thereby facilitating IoT-enabled remote patient monitoring for smart healthcare systems. Furthermore, the FDEIoL system model uses a federated ensemble learning strategy to provide an automatic, up-to-date global prediction model based on input local models from the medical specialist. This assures biomedical security by safeguarding patient data and preserving the integrity of diagnostic processes. The FDEIoL system model utilizes local model feature selection to discriminate between malicious and non-malicious local models, and ensemble strategies use positive and negative samples to optimize the performance of the test dataset, enhancing its capability for remote patient monitoring. The FDEIoL system model achieved an exceptional accuracy rate of 99.24% on the Chest X-ray dataset and 99.0% on the MRI dataset of brain tumors compared to centralized models, demonstrating its ability for precision diagnosis in IoT-enabled healthcare systems.
Collapse
Affiliation(s)
- Rahim Khan
- College of Information and Communication Engineering, Harbin Engineering University, Harbin150001, China
| | - Sher Taj
- Software College, Northeastern University, Shenyang, 110169, China
| | - Xuefei Ma
- College of Information and Communication Engineering, Harbin Engineering University, Harbin150001, China.
| | - Alam Noor
- CISTER Research Center, Porto, Portugal
| | - Haifeng Zhu
- College of Information and Communication Engineering, Harbin Engineering University, Harbin150001, China
| | - Javed Khan
- Department of software Engineering, University of Science and Technology, Bannu, KPK, Pakistan
| | - Zahid Ullah Khan
- College of Information and Communication Engineering, Harbin Engineering University, Harbin150001, China
| | - Sajid Ullah Khan
- Department of Information Systems, College of Computer Engineering and Sciences, Prince Sattam bin Abdulaziz University, Alkharj, KSA, Saudi Arabia
| |
Collapse
|
2
|
Nair SSK, David LR, Shariff A, Maskari SA, Mawali AA, Weis S, Fouad T, Ozsahin DU, Alshuweihi A, Obaideen A, Elshami W. CovMediScanX: A medical imaging solution for COVID-19 diagnosis from chest X-ray images. J Med Imaging Radiat Sci 2024; 55:272-280. [PMID: 38594085 DOI: 10.1016/j.jmir.2024.03.046] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2023] [Revised: 02/17/2024] [Accepted: 03/19/2024] [Indexed: 04/11/2024]
Abstract
INTRODUCTION Radiologists have extensively employed the interpretation of chest X-rays (CXR) to identify visual markers indicative of COVID-19 infection, offering an alternative approach for the screening of infected individuals. This research article presents CovMediScanX, a deep learning-based framework designed for a rapid and automated diagnosis of COVID-19 from CXR scan images. METHODS The proposed approach encompasses gathering and preprocessing CXR image datasets, training deep learning-based custom-made Convolutional Neural Network (CNN), pre-trained and hybrid transfer learning models, identifying the highest-performing model based on key evaluation metrics, and embedding this model into a web interface called CovMediScanX, designed for radiologists to detect the COVID-19 status in new CXR images. RESULTS The custom-made CNN model obtained a remarkable testing accuracy of 94.32% outperforming other models. CovMediScanX, employing the custom-made CNN underwent evaluation with an independent dataset also. The images in the independent dataset are sourced from a scanning machine that is entirely different from those used for the training dataset, highlighting a clear distinction of datasets in their origins. The evaluation outcome highlighted the framework's capability to accurately detect COVID-19 cases, showcasing encouraging results with a precision of 73% and a recall of 84% for positive cases. However, the model requires further enhancement, particularly in improving its detection of normal cases, as evidenced by lower precision and recall rates. CONCLUSION The research proposes CovMediScanX framework that demonstrates promising potential in automatically identifying COVID-19 cases from CXR images. While the model's overall performance on independent data needs improvement, it is evident that addressing bias through the inclusion of diverse data sources during training could further enhance accuracy and reliability.
Collapse
Affiliation(s)
| | - Leena R David
- Department of Medical Diagnostic Imaging, College of Health Sciences, University of Sharjah, United Arab Emirates.
| | - Abdulwahid Shariff
- Department of Postgraduate Studies, University of Dar es Salaam, Tanzania
| | - Saqar Al Maskari
- Department of Computing and Electronics Engineering, Middle East College, Sultanate of Oman
| | - Adhra Al Mawali
- Quality Assurance and Planning, German University of Technology (GUtech), Sultanate of Oman
| | - Sammy Weis
- University Hospital, Sharjah, United Arab Emirates
| | - Taha Fouad
- University Hospital, Sharjah, United Arab Emirates
| | - Dilber Uzun Ozsahin
- Department of Medical Diagnostic Imaging, College of Health Sciences, University of Sharjah, United Arab Emirates
| | | | | | - Wiam Elshami
- Department of Medical Diagnostic Imaging, College of Health Sciences, University of Sharjah, United Arab Emirates
| |
Collapse
|
3
|
Liu Q, Tian Y, Zhou T, Lyu K, Xin R, Shang Y, Liu Y, Ren J, Li J. A few-shot disease diagnosis decision making model based on meta-learning for general practice. Artif Intell Med 2024; 147:102718. [PMID: 38184346 DOI: 10.1016/j.artmed.2023.102718] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2023] [Revised: 10/12/2023] [Accepted: 11/12/2023] [Indexed: 01/08/2024]
Abstract
BACKGROUND Diagnostic errors have become the biggest threat to the safety of patients in primary health care. General practitioners, as the "gatekeepers" of primary health care, have a responsibility to accurately diagnose patients. However, many general practitioners have insufficient knowledge and clinical experience in some diseases. Clinical decision making tools need to be developed to effectively improve the diagnostic process in primary health care. The long-tailed class distributions of medical datasets are challenging for many popular decision making models based on deep learning, which have difficulty predicting few-shot diseases. Meta-learning is a new strategy for solving few-shot problems. METHODS AND MATERIALS In this study, a few-shot disease diagnosis decision making model based on a model-agnostic meta-learning algorithm (FSDD-MAML) is proposed. The MAML algorithm is applied in a knowledge graph-based disease diagnosis model to find the optimal model parameters. Moreover, FSDD-MAML can learn learning rates for all modules of the knowledge graph-based disease diagnosis model. For n-way, k-shot learning tasks, the inner loop of FSDD-MAML performs multiple gradient update steps to learn internal features in disease classification tasks using n×k examples, and the outer loop of FSDD-MAML optimizes the meta-objective to find the associated optimal parameters and learning rates. FSDD-MAML is compared with the original knowledge graph-based disease diagnosis model and other meta-learning algorithms based on an abdominal disease dataset. RESULT Meta-learning algorithms can greatly improve the performance of models in top-1 evaluation compared with top-3, top-5, and top-10 evaluations. The proposed decision making model FSDD-MAML outperforms all the other models, with a precision@1 of 90.02 %. We achieve state-of-the-art performance in the diagnosis of all diseases, and the prediction performance for few-shot diseases is greatly improved. For the two groups with the fewest examples of diseases, FSDD-MAML achieves relative increases in precision@1 of 29.13 % and 21.63 % compared with the original knowledge graph-based disease diagnosis model. In addition, we analyze the reasoning process of several few-shot disease predictions and provide an explanation for the results. CONCLUSION The decision making model based on meta-learning proposed in this paper can support the rapid diagnosis of diseases in general practice and is especially capable of helping general practitioners diagnose few-shot diseases. This study is of profound significance for the exploration and application of meta-learning to few-shot disease assessment in general practice.
Collapse
Affiliation(s)
- Qianghua Liu
- Engineering Research Center of EMR and Intelligent Expert System, Ministry of Education, Key Laboratory for Biomedical Engineering of Ministry of Education, College of Biomedical Engineering and Instrument Science, Zhejiang University, No. 38 Zheda Road, Hangzhou 310027, Zhejiang Province, China
| | - Yu Tian
- Engineering Research Center of EMR and Intelligent Expert System, Ministry of Education, Key Laboratory for Biomedical Engineering of Ministry of Education, College of Biomedical Engineering and Instrument Science, Zhejiang University, No. 38 Zheda Road, Hangzhou 310027, Zhejiang Province, China
| | - Tianshu Zhou
- Research Center for Healthcare Data Science, Zhejiang Laboratory, Hangzhou 311100, China
| | - Kewei Lyu
- Engineering Research Center of EMR and Intelligent Expert System, Ministry of Education, Key Laboratory for Biomedical Engineering of Ministry of Education, College of Biomedical Engineering and Instrument Science, Zhejiang University, No. 38 Zheda Road, Hangzhou 310027, Zhejiang Province, China
| | - Ran Xin
- Research Center for Healthcare Data Science, Zhejiang Laboratory, Hangzhou 311100, China
| | - Yong Shang
- Research Center for Healthcare Data Science, Zhejiang Laboratory, Hangzhou 311100, China
| | - Ying Liu
- General Practice Department, the First Affiliated Hospital, College of Medicine, Zhejiang University, Hangzhou 310003, China
| | - Jingjing Ren
- General Practice Department, the First Affiliated Hospital, College of Medicine, Zhejiang University, Hangzhou 310003, China
| | - Jingsong Li
- Engineering Research Center of EMR and Intelligent Expert System, Ministry of Education, Key Laboratory for Biomedical Engineering of Ministry of Education, College of Biomedical Engineering and Instrument Science, Zhejiang University, No. 38 Zheda Road, Hangzhou 310027, Zhejiang Province, China; Research Center for Healthcare Data Science, Zhejiang Laboratory, Hangzhou 311100, China.
| |
Collapse
|
4
|
Diagnosis of COVID-19 from X-rays using combined CNN-RNN architecture with transfer learning. BENCHCOUNCIL TRANSACTIONS ON BENCHMARKS, STANDARDS AND EVALUATIONS 2023:100088. [PMCID: PMC10010001 DOI: 10.1016/j.tbench.2023.100088] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/16/2023]
Abstract
Combating the COVID-19 pandemic has emerged as one of the most promising issues in global healthcare. Accurate and fast diagnosis of COVID-19 cases is required for the right medical treatment to control this pandemic. Chest radiography imaging techniques are more effective than the reverse-transcription polymerase chain reaction (RT-PCR) method in detecting coronavirus. Due to the limited availability of medical images, transfer learning is better suited to classify patterns in medical images. This paper presents a combined architecture of convolutional neural network (CNN) and recurrent neural network (RNN) to diagnose COVID-19 patients from chest X-rays. The deep transfer techniques used in this experiment are VGG19, DenseNet121, InceptionV3, and Inception-ResNetV2, where CNN is used to extract complex features from samples and classify them using RNN. In our experiments, the VGG19-RNN architecture outperformed all other networks in terms of accuracy. Finally, decision-making regions of images were visualized using gradient-weighted class activation mapping (Grad-CAM). The system achieved promising results compared to other existing systems and might be validated in the future when more samples would be available. The experiment demonstrated a good alternative method to diagnose COVID-19 for medical staff. All the data used during the study are openly available from the Mendeley data repository at https://data.mendeley.com/datasets/mxc6vb7svm. For further research, we have made the source code publicly available at https://github.com/Asraf047/COVID19-CNN-RNN.
Collapse
|
5
|
A Super-resolution-based Approach for the Detection of Covid—19 Infection From Chest X-ray Images. RESONANCE 2023. [PMCID: PMC9844160 DOI: 10.1007/s12045-023-1530-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/19/2023]
|
6
|
Hasan MM, Islam MU, Sadeq MJ, Fung WK, Uddin J. Review on the Evaluation and Development of Artificial Intelligence for COVID-19 Containment. SENSORS (BASEL, SWITZERLAND) 2023; 23:527. [PMID: 36617124 PMCID: PMC9824505 DOI: 10.3390/s23010527] [Citation(s) in RCA: 18] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/28/2022] [Revised: 12/23/2022] [Accepted: 12/29/2022] [Indexed: 06/17/2023]
Abstract
Artificial intelligence has significantly enhanced the research paradigm and spectrum with a substantiated promise of continuous applicability in the real world domain. Artificial intelligence, the driving force of the current technological revolution, has been used in many frontiers, including education, security, gaming, finance, robotics, autonomous systems, entertainment, and most importantly the healthcare sector. With the rise of the COVID-19 pandemic, several prediction and detection methods using artificial intelligence have been employed to understand, forecast, handle, and curtail the ensuing threats. In this study, the most recent related publications, methodologies and medical reports were investigated with the purpose of studying artificial intelligence's role in the pandemic. This study presents a comprehensive review of artificial intelligence with specific attention to machine learning, deep learning, image processing, object detection, image segmentation, and few-shot learning studies that were utilized in several tasks related to COVID-19. In particular, genetic analysis, medical image analysis, clinical data analysis, sound analysis, biomedical data classification, socio-demographic data analysis, anomaly detection, health monitoring, personal protective equipment (PPE) observation, social control, and COVID-19 patients' mortality risk approaches were used in this study to forecast the threatening factors of COVID-19. This study demonstrates that artificial-intelligence-based algorithms integrated into Internet of Things wearable devices were quite effective and efficient in COVID-19 detection and forecasting insights which were actionable through wide usage. The results produced by the study prove that artificial intelligence is a promising arena of research that can be applied for disease prognosis, disease forecasting, drug discovery, and to the development of the healthcare sector on a global scale. We prove that artificial intelligence indeed played a significantly important role in helping to fight against COVID-19, and the insightful knowledge provided here could be extremely beneficial for practitioners and research experts in the healthcare domain to implement the artificial-intelligence-based systems in curbing the next pandemic or healthcare disaster.
Collapse
Affiliation(s)
- Md. Mahadi Hasan
- Department of Computer Science and Engineering, Asian University of Bangladesh, Ashulia 1349, Bangladesh
| | - Muhammad Usama Islam
- School of Computing and Informatics, University of Louisiana at Lafayette, Lafayette, LA 70504, USA
| | - Muhammad Jafar Sadeq
- Department of Computer Science and Engineering, Asian University of Bangladesh, Ashulia 1349, Bangladesh
| | - Wai-Keung Fung
- Department of Applied Computing and Engineering, Cardiff School of Technologies, Cardiff Metropolitan University, Cardiff CF5 2YB, UK
| | - Jasim Uddin
- Department of Applied Computing and Engineering, Cardiff School of Technologies, Cardiff Metropolitan University, Cardiff CF5 2YB, UK
| |
Collapse
|
7
|
Jing R, Yin XL, Xie XL, Lian HQ, Li J, Zhang G, Yang WH, Sun TS, Xu YC. Morphologic identification of clinically encountered moulds using a residual neural network. Front Microbiol 2022; 13:1021236. [PMID: 36312928 PMCID: PMC9614265 DOI: 10.3389/fmicb.2022.1021236] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/18/2022] [Accepted: 09/30/2022] [Indexed: 11/04/2022] Open
Abstract
The use of morphology to diagnose invasive mould infections in China still faces substantial challenges, which often leads to delayed diagnosis or misdiagnosis. We developed a model called XMVision Fungus AI to identify mould infections by training, testing, and evaluating a ResNet-50 model. Our research achieved the rapid identification of nine common clinical moulds: Aspergillus fumigatus complex, Aspergillus flavus complex, Aspergillus niger complex, Aspergillus terreus complex, Aspergillus nidulans, Aspergillus sydowii/Aspergillus versicolor, Syncephalastrum racemosum, Fusarium spp., and Penicillium spp. In our study, the adaptive image contrast enhancement enabling XMVision Fungus AI as a promising module by effectively improve the identification performance. The overall identification accuracy of XMVision Fungus AI was up to 93.00% (279/300), which was higher than that of human readers. XMVision Fungus AI shows intrinsic advantages in the identification of clinical moulds and can be applied to improve human identification efficiency through training. Moreover, it has great potential for clinical application because of its convenient operation and lower cost. This system will be suitable for primary hospitals in China and developing countries.
Collapse
Affiliation(s)
- Ran Jing
- Department of Laboratory Medicine, State Key Laboratory of Complex Severe and Rare Diseases, Peking Union Medical College Hospital, Chinese Academy of Medical Science and Peking Union Medical College, Beijing, China
- Graduate School, Chinese Academy of Medical Science and Peking Union Medical College, Beijing, China
- Beijing Key Laboratory for Mechanisms Research and Precision Diagnosis of Invasive Fungal Diseases, Beijing, China
| | - Xiang-Long Yin
- Beijing Hao Chen Xing Yue Technology Co., Ltd., Beijing, China
| | - Xiu-Li Xie
- Department of Laboratory Medicine, State Key Laboratory of Complex Severe and Rare Diseases, Peking Union Medical College Hospital, Chinese Academy of Medical Science and Peking Union Medical College, Beijing, China
- Beijing Key Laboratory for Mechanisms Research and Precision Diagnosis of Invasive Fungal Diseases, Beijing, China
| | - He-Qing Lian
- Beijing Xiaoying Technology Co., Ltd., Beijing, China
| | - Jin Li
- Department of Laboratory Medicine, State Key Laboratory of Complex Severe and Rare Diseases, Peking Union Medical College Hospital, Chinese Academy of Medical Science and Peking Union Medical College, Beijing, China
- Beijing Key Laboratory for Mechanisms Research and Precision Diagnosis of Invasive Fungal Diseases, Beijing, China
| | - Ge Zhang
- Department of Laboratory Medicine, State Key Laboratory of Complex Severe and Rare Diseases, Peking Union Medical College Hospital, Chinese Academy of Medical Science and Peking Union Medical College, Beijing, China
- Beijing Key Laboratory for Mechanisms Research and Precision Diagnosis of Invasive Fungal Diseases, Beijing, China
| | - Wen-Hang Yang
- Department of Laboratory Medicine, State Key Laboratory of Complex Severe and Rare Diseases, Peking Union Medical College Hospital, Chinese Academy of Medical Science and Peking Union Medical College, Beijing, China
- Beijing Key Laboratory for Mechanisms Research and Precision Diagnosis of Invasive Fungal Diseases, Beijing, China
| | - Tian-Shu Sun
- Beijing Key Laboratory for Mechanisms Research and Precision Diagnosis of Invasive Fungal Diseases, Beijing, China
- Medical Research Center, State Key Laboratory of Complex Severe and Rare Diseases, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Ying-Chun Xu
- Department of Laboratory Medicine, State Key Laboratory of Complex Severe and Rare Diseases, Peking Union Medical College Hospital, Chinese Academy of Medical Science and Peking Union Medical College, Beijing, China
- Graduate School, Chinese Academy of Medical Science and Peking Union Medical College, Beijing, China
- Beijing Key Laboratory for Mechanisms Research and Precision Diagnosis of Invasive Fungal Diseases, Beijing, China
| |
Collapse
|
8
|
Ghose P, Alavi M, Tabassum M, Ashraf Uddin M, Biswas M, Mahbub K, Gaur L, Mallik S, Zhao Z. Detecting COVID-19 infection status from chest X-ray and CT scan via single transfer learning-driven approach. Front Genet 2022; 13:980338. [PMID: 36212141 PMCID: PMC9533058 DOI: 10.3389/fgene.2022.980338] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2022] [Accepted: 08/18/2022] [Indexed: 11/17/2022] Open
Abstract
COVID-19 has caused over 528 million infected cases and over 6.25 million deaths since its outbreak in 2019. The uncontrolled transmission of the SARS-CoV-2 virus has caused human suffering and the death of uncountable people. Despite the continuous effort by the researchers and laboratories, it has been difficult to develop reliable efficient and stable vaccines to fight against the rapidly evolving virus strains. Therefore, effectively preventing the transmission in the community and globally has remained an urgent task since its outbreak. To avoid the rapid spread of infection, we first need to identify the infected individuals and isolate them. Therefore, screening computed tomography (CT scan) and X-ray can better separate the COVID-19 infected patients from others. However, one of the main challenges is to accurately identify infection from a medical image. Even experienced radiologists often have failed to do it accurately. On the other hand, deep learning algorithms can tackle this task much easier, faster, and more accurately. In this research, we adopt the transfer learning method to identify the COVID-19 patients from normal individuals when there is an inadequacy of medical image data to save time by generating reliable results promptly. Furthermore, our model can perform both X-rays and CT scan. The experimental results found that the introduced model can achieve 99.59% accuracy for X-rays and 99.95% for CT scan images. In summary, the proposed method can effectively identify COVID-19 infected patients, could be a great way which will help to classify COVID-19 patients quickly and prevent the viral transmission in the community.
Collapse
Affiliation(s)
- Partho Ghose
- Department of Computer Science and Engineering, Bangladesh University of Business and Technology, Dhaka, Bangladesh
| | - Muhaddid Alavi
- Department of Computer Science and Engineering, Jagannath University, Dhaka, Bangladesh
| | - Mehnaz Tabassum
- Center for Health Informatics, Macquarie University, Sydney, NSW, Australia
| | - Md. Ashraf Uddin
- Department of Computer Science and Engineering, Jagannath University, Dhaka, Bangladesh
| | - Milon Biswas
- Department of Computer Science and Engineering, Bangladesh University of Business and Technology, Dhaka, Bangladesh
| | - Kawsher Mahbub
- Department of Computer Science and Engineering, Bangladesh University of Business and Technology, Dhaka, Bangladesh
| | - Loveleen Gaur
- Amity International Business School, Amity University, Noida, India
| | - Saurav Mallik
- Department of Environmental Health, Harvard T H Chan School of Public Health, Boston, MA, United States
| | - Zhongming Zhao
- Department of Environmental Health, Harvard T H Chan School of Public Health, Boston, MA, United States
- Human Genetics Center, School of Public Health, The University of Texas Health Science Center at Houston, Houston, TX, United States
| |
Collapse
|
9
|
Deep feature fusion classification network (DFFCNet): Towards accurate diagnosis of COVID-19 using chest X-rays images. Biomed Signal Process Control 2022; 76:103677. [PMID: 35432578 PMCID: PMC9005442 DOI: 10.1016/j.bspc.2022.103677] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2021] [Revised: 03/22/2022] [Accepted: 04/09/2022] [Indexed: 12/12/2022]
|
10
|
Elazab A, Elfattah MA, Zhang Y. Novel multi-site graph convolutional network with supervision mechanism for COVID-19 diagnosis from X-ray radiographs. Appl Soft Comput 2022; 114:108041. [PMID: 34803550 PMCID: PMC8592887 DOI: 10.1016/j.asoc.2021.108041] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/28/2021] [Revised: 10/26/2021] [Accepted: 11/03/2021] [Indexed: 12/12/2022]
Abstract
The novel Coronavirus disease 2019 (COVID-2019) has become a global pandemic and affected almost all aspects of our daily life. The total number of positive COVID-2019 cases has exponentially increased in the last few months due to the easy transmissibility of the virus. It can be detected using the nucleic acid test or the antibodies blood test which are not always available and take several hours to get the results. Therefore, researchers proposed computer-aided diagnosis systems using the state-of-the-art artificial intelligence techniques to learn imaging biomarkers from chest computed tomography and X-ray radiographs to effectively diagnose COVID-19. However, previous methods either adopted transfer learning from a pre-trained model on natural images or were trained on limited datasets. Either cases may lead to accuracy deficiency or overfitting. In addition, feature space suffers from noise and outliers when collecting X-ray images from multiple datasets. In this paper, we overcome the previous limitations by firstly collecting a large-scale X-ray dataset from multiple resources. Our dataset includes 11,312 images collected from 10 different data repositories. To alleviate the effect of the noise, we suppress it in the feature space of our new dataset. Secondly, we introduce a supervision mechanism and combine it with the VGG-16 network to consider the differences between the COVID-19 and healthy cases in the feature space. Thirdly, we propose a multi-site (center) COVID-19 graph convolutional network (GCN) that exploits dataset information, the status of training samples, and initial scores to effectively classify the disease status. Extensive experiments using different convolutional neural network-based methods with and without the supervision mechanism and different classifiers are performed. Results demonstrate the effectiveness of the proposed supervision mechanism in all models and superior performance with the proposed GCN.
Collapse
Affiliation(s)
- Ahmed Elazab
- School of Biomedical Engineering, Health Science Center, Shenzhen University, Shenzhen, 518060, China
- Computer Science Department, Misr Higher Institute for Commerce and Computers, Mansoura, Egypt
| | - Mohamed Abd Elfattah
- Computer Science Department, Misr Higher Institute for Commerce and Computers, Mansoura, Egypt
| | - Yuexin Zhang
- School of Automation, Guangdong Polytechnic Normal University, Guangzhou, 510665, China
| |
Collapse
|
11
|
Zhuang Y, Rahman MF, Wen Y, Pokojovy M, McCaffrey P, Vo A, Walser E, Moen S, Xu H, Tseng TLB. An interpretable multi-task system for clinically applicable COVID-19 diagnosis using CXR. JOURNAL OF X-RAY SCIENCE AND TECHNOLOGY 2022; 30:847-862. [PMID: 35634810 DOI: 10.3233/xst-221151] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
BACKGROUND With the emergence of continuously mutating variants of coronavirus, it is urgent to develop a deep learning model for automatic COVID-19 diagnosis at early stages from chest X-ray images. Since laboratory testing is time-consuming and requires trained laboratory personal, diagnosis using chest X-ray (CXR) is a befitting option. OBJECTIVE In this study, we proposed an interpretable multi-task system for automatic lung detection and COVID-19 screening in chest X-rays to find an alternate method of testing which are reliable, fast and easily accessible, and able to generate interpretable predictions that are strongly correlated with radiological findings. METHODS The proposed system consists of image preprocessing and an unsupervised machine learning (UML) algorithm for lung region detection, as well as a truncated CNN model based on deep transfer learning (DTL) to classify chest X-rays into three classes of COVID-19, pneumonia, and normal. The Grad-CAM technique was applied to create class-specific heatmap images in order to establish trust in the medical AI system. RESULTS Experiments were performed with 15,884 frontal CXR images to show that the proposed system achieves an accuracy of 91.94% in a test dataset with 2,680 images including a sensitivity of 94.48% on COVID-19 cases, a specificity of 88.46% on normal cases, and a precision of 88.01% on pneumonia cases. Our system also produced state-of-the-art outcomes with a sensitivity of 97.40% on public test data and 88.23% on a previously unseen clinical data (1,000 cases) for binary classification of COVID-19-positive and COVID-19-negative films. CONCLUSION Our automatic computerized evaluation for grading lung infections exhibited sensitivity comparable to that of radiologist interpretation in clinical applicability. Therefore, the proposed solution can be used as one element of patient evaluation along with gold-standard clinical and laboratory testing.
Collapse
Affiliation(s)
- Yan Zhuang
- Department of Electrical and Computer Engineering, The University of Texas at El Paso, El Paso, TX, USA
- Department of Biomedical Engineering, Sichuan University, Chengdu, Sichuan, China
| | - Md Fashiar Rahman
- Department of Industrial, Manufacturing & Systems Engineering, The University of Texas at El Paso, El Paso, TX, USA
| | - Yuxin Wen
- Department of Electrical Engineering and Computer Science, Chapman University, Los Angeles, CA, USA
| | - Michael Pokojovy
- Department of Mathematical Sciences, The University of Texas at El Paso, El Paso, TX, USA
| | | | - Alexander Vo
- University of Texas Medical Branch, Galveston, TX, USA
| | - Eric Walser
- University of Texas Medical Branch, Galveston, TX, USA
| | - Scott Moen
- University of Texas Medical Branch, Galveston, TX, USA
| | - Honglun Xu
- Department of Industrial, Manufacturing & Systems Engineering, The University of Texas at El Paso, El Paso, TX, USA
| | - Tzu-Liang Bill Tseng
- Department of Industrial, Manufacturing & Systems Engineering, The University of Texas at El Paso, El Paso, TX, USA
| |
Collapse
|
12
|
Gudigar A, Raghavendra U, Nayak S, Ooi CP, Chan WY, Gangavarapu MR, Dharmik C, Samanth J, Kadri NA, Hasikin K, Barua PD, Chakraborty S, Ciaccio EJ, Acharya UR. Role of Artificial Intelligence in COVID-19 Detection. SENSORS (BASEL, SWITZERLAND) 2021; 21:8045. [PMID: 34884045 PMCID: PMC8659534 DOI: 10.3390/s21238045] [Citation(s) in RCA: 19] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/05/2021] [Revised: 11/26/2021] [Accepted: 11/26/2021] [Indexed: 12/15/2022]
Abstract
The global pandemic of coronavirus disease (COVID-19) has caused millions of deaths and affected the livelihood of many more people. Early and rapid detection of COVID-19 is a challenging task for the medical community, but it is also crucial in stopping the spread of the SARS-CoV-2 virus. Prior substantiation of artificial intelligence (AI) in various fields of science has encouraged researchers to further address this problem. Various medical imaging modalities including X-ray, computed tomography (CT) and ultrasound (US) using AI techniques have greatly helped to curb the COVID-19 outbreak by assisting with early diagnosis. We carried out a systematic review on state-of-the-art AI techniques applied with X-ray, CT, and US images to detect COVID-19. In this paper, we discuss approaches used by various authors and the significance of these research efforts, the potential challenges, and future trends related to the implementation of an AI system for disease detection during the COVID-19 pandemic.
Collapse
Affiliation(s)
- Anjan Gudigar
- Department of Instrumentation and Control Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal 576104, India; (A.G.); (S.N.); (M.R.G.); (C.D.)
| | - U Raghavendra
- Department of Instrumentation and Control Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal 576104, India; (A.G.); (S.N.); (M.R.G.); (C.D.)
| | - Sneha Nayak
- Department of Instrumentation and Control Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal 576104, India; (A.G.); (S.N.); (M.R.G.); (C.D.)
| | - Chui Ping Ooi
- School of Science and Technology, Singapore University of Social Sciences, Singapore 599494, Singapore;
| | - Wai Yee Chan
- Department of Biomedical Imaging, Faculty of Medicine, University of Malaya, Kuala Lumpur 50603, Malaysia;
| | - Mokshagna Rohit Gangavarapu
- Department of Instrumentation and Control Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal 576104, India; (A.G.); (S.N.); (M.R.G.); (C.D.)
| | - Chinmay Dharmik
- Department of Instrumentation and Control Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal 576104, India; (A.G.); (S.N.); (M.R.G.); (C.D.)
| | - Jyothi Samanth
- Department of Cardiovascular Technology, Manipal College of Health Professions, Manipal Academy of Higher Education, Manipal 576104, India;
| | - Nahrizul Adib Kadri
- Department of Biomedical Engineering, Faculty of Engineering, University of Malaya, Kuala Lumpur 50603, Malaysia; (N.A.K.); (K.H.)
| | - Khairunnisa Hasikin
- Department of Biomedical Engineering, Faculty of Engineering, University of Malaya, Kuala Lumpur 50603, Malaysia; (N.A.K.); (K.H.)
| | - Prabal Datta Barua
- Cogninet Brain Team, Cogninet Australia, Sydney, NSW 2010, Australia;
- School of Business (Information Systems), Faculty of Business, Education, Law & Arts, University of Southern Queensland, Toowoomba, QLD 4350, Australia
- Faculty of Engineering and Information Technology, University of Technology Sydney, Sydney, NSW 2007, Australia;
| | - Subrata Chakraborty
- Faculty of Engineering and Information Technology, University of Technology Sydney, Sydney, NSW 2007, Australia;
- Faculty of Science, Agriculture, Business and Law, University of New England, Armidale, NSW 2351, Australia
| | - Edward J. Ciaccio
- Department of Medicine, Columbia University Medical Center, New York, NY 10032, USA;
| | - U. Rajendra Acharya
- School of Engineering, Ngee Ann Polytechnic, Singapore 599489, Singapore;
- Department of Biomedical Informatics and Medical Engineering, Asia University, Taichung 41354, Taiwan
- International Research Organization for Advanced Science and Technology (IROAST), Kumamoto University, Kumamoto 860-8555, Japan
| |
Collapse
|
13
|
Prakash NB, Murugappan M, Hemalakshmi GR, Jayalakshmi M, Mahmud M. Deep transfer learning for COVID-19 detection and infection localization with superpixel based segmentation. SUSTAINABLE CITIES AND SOCIETY 2021; 75:103252. [PMID: 34422549 PMCID: PMC8364837 DOI: 10.1016/j.scs.2021.103252] [Citation(s) in RCA: 18] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/28/2021] [Revised: 08/01/2021] [Accepted: 08/09/2021] [Indexed: 05/07/2023]
Abstract
The evolution the novel corona virus disease (COVID-19) as a pandemic has inflicted several thousand deaths per day endangering the lives of millions of people across the globe. In addition to thermal scanning mechanisms, chest imaging examinations provide valuable insights to the detection of this virus, diagnosis and prognosis of the infections. Though Chest CT and Chest X-ray imaging are common in the clinical protocols of COVID-19 management, the latter is highly preferred, attributed to its simple image acquisition procedure and mobility of the imaging mechanism. However, Chest X-ray images are found to be less sensitive compared to Chest CT images in detecting infections in the early stages. In this paper, we propose a deep learning based framework to enhance the diagnostic values of these images for improved clinical outcomes. It is realized as a variant of the conventional SqueezeNet classifier with segmentation capabilities, which is trained with deep features extracted from the Chest X-ray images of a standard dataset for binary and multi class classification. The binary classifier achieves an accuracy of 99.53% in the discrimination of COVID-19 and Non COVID-19 images. Similarly, the multi class classifier performs classification of COVID-19, Viral Pneumonia and Normal cases with an accuracy of 99.79%. This model called the COVID-19 Super pixel SqueezNet (COVID-SSNet) performs super pixel segmentation of the activation maps to extract the regions of interest which carry perceptual image features and constructs an overlay of the Chest X-ray images with these regions. The proposed classifier model adds significant value to the Chest X-rays for an integral examination of the image features and the image regions influencing the classifier decisions to expedite the COVID-19 treatment regimen.
Collapse
Affiliation(s)
- N B Prakash
- Department of Electrical and Electronics Engineering, National Engineering College, Tamil Nadu, India
| | - M Murugappan
- Intelligent Signal Processing (ISP) Research Lab, Department of Electronics and Communication Engineering, Kuwait College of Science and Technology, Kuwait
| | - G R Hemalakshmi
- Department of Computer Science and Engineering, National Engineering College, Tamil Nadu, India
| | - M Jayalakshmi
- Department of Computer Science and Engineering, National Engineering College, Tamil Nadu, India
| | - Mufti Mahmud
- Department of Computer Science, Nottingham Trent University, Clifton, Nottingham NG11 8NS, UK
- Medical Technologies Innovation Facility, Nottingham Trent University, Clifton, Nottingham NG11 8NS, UK
- Computing and Informatics Research Centre, Nottingham Trent University, Clifton, Nottingham NG11 8NS, UK
| |
Collapse
|
14
|
Mohanty F, Dora C. An optimized KELM approach for the diagnosis of COVID-19 from 2D-SSA reconstructed CXR Images. OPTIK 2021; 244:167572. [PMID: 34248209 PMCID: PMC8260491 DOI: 10.1016/j.ijleo.2021.167572] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/04/2021] [Accepted: 06/30/2021] [Indexed: 05/17/2023]
Abstract
The COVID-19 is proved to be the most infectious disease of the current century with a high mortality rate world-wide. The current RT-PCR test standard for the diagnosis of COVID-19 is an invasive and time-consuming procedure, whereas the chest X-ray (CXR) images provide a non-invasive and time/cost-effective method for COVID-19 diagnosis. The current existing deep learning methods for the detection and diagnosis of CXR images provide biased results for the small size dataset available. Hence, in the present work, a conventional yet efficient method is proposed classifying the CXR images into COVID-19, Pneumonia, and Normal. The proposed approach pre-processes the CXR images using 2D singular spectrum analysis (SSA) for image reconstruction which enhances the feature inputs to the classifier. The features are extracted from the reconstructed images using a block-based GLCM approach. Then, a grasshopper-based Kernel extreme learning machine (KELM) is proposed which finds the optimal features and kernel parameters of KELM at the same instance. From the experimental analysis, it is seen that the present work outperforms that of other competent schemes in terms of classification accuracy with a minimal set of features extracted from the first 2 eigen components of the 2D-SSA reconstructed image with 5 × 5 decomposition.
Collapse
Affiliation(s)
- Figlu Mohanty
- School of Engineering & Technology, Centurion University of Technology & Management, Odisha, India
| | - Chinmayee Dora
- School of Engineering & Technology, Centurion University of Technology & Management, Odisha, India
| |
Collapse
|
15
|
A Hybrid Deep Learning Approach for COVID-19 Diagnosis via CT and X-ray Medical Images. IOCA 2021 2021. [DOI: 10.3390/ioca2021-10909] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/22/2023]
|
16
|
Fabietti M, Mahmud M, Lotfi A, Kaiser MS, Averna A, Guggenmos DJ, Nudo RJ, Chiappalone M, Chen J. SANTIA: a Matlab-based open-source toolbox for artifact detection and removal from extracellular neuronal signals. Brain Inform 2021; 8:14. [PMID: 34283328 PMCID: PMC8292498 DOI: 10.1186/s40708-021-00135-3] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2021] [Accepted: 06/29/2021] [Indexed: 12/11/2022] Open
Abstract
Neuronal signals generally represent activation of the neuronal networks and give insights into brain functionalities. They are considered as fingerprints of actions and their processing across different structures of the brain. These recordings generate a large volume of data that are susceptible to noise and artifacts. Therefore, the review of these data to ensure high quality by automatically detecting and removing the artifacts is imperative. Toward this aim, this work proposes a custom-developed automatic artifact removal toolbox named, SANTIA (SigMate Advanced: a Novel Tool for Identification of Artifacts in Neuronal Signals). Developed in Matlab, SANTIA is an open-source toolbox that applies neural network-based machine learning techniques to label and train models to detect artifacts from the invasive neuronal signals known as local field potentials.
Collapse
Affiliation(s)
- Marcos Fabietti
- Department of Computer Science, Nottingham Trent University, Clifton Lane, Nottingham, NG11 8NS, UK
| | - Mufti Mahmud
- Department of Computer Science, Nottingham Trent University, Clifton Lane, Nottingham, NG11 8NS, UK.
- Medical Technologies Innovation Facility, Nottingham Trent University, Clifton Lane, Nottingham, NG11 8NS, UK.
- Computing and Informatics Research Centre, Nottingham Trent University, Clifton Lane, Nottingham, NG11 8NS, UK.
| | - Ahmad Lotfi
- Department of Computer Science, Nottingham Trent University, Clifton Lane, Nottingham, NG11 8NS, UK
| | - M Shamim Kaiser
- Institute of Information Technology, Jahangirnagar University, Savar, Dhaka, 1342, Bangladesh
| | - Alberto Averna
- Department of Health Sciences, University of Milan, Via di Rudinì, 8, 20142, Milan, Italy
| | - David J Guggenmos
- Department of Physical Medicine and Rehabilitation, University of Kansas Medical Center, 3901 Rainbow Blvd, Kansas City, 66160, USA
| | - Randolph J Nudo
- Department of Physical Medicine and Rehabilitation, University of Kansas Medical Center, 3901 Rainbow Blvd, Kansas City, 66160, USA
| | - Michela Chiappalone
- Department of informatics, Bioengineering, Robotics and System Engineering-DIBRIS, University of Genova, Via All'Opera Pia, 13, 16145, Genoa, Italy
| | - Jianhui Chen
- Faculty of Information Technology, International WIC Institute, Beijing University of Technology, Beijing, 100124, China
- Beijing International Collaboration Base on Brain Informatics and Wisdom Services, Beijing, 100124, China
| |
Collapse
|
17
|
Short-Term Prediction of COVID-19 Cases Using Machine Learning Models. APPLIED SCIENCES-BASEL 2021. [DOI: 10.3390/app11094266] [Citation(s) in RCA: 27] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
Abstract
The first case in Bangladesh of the novel coronavirus disease (COVID-19) was reported on 8 March 2020, with the number of confirmed cases rapidly rising to over 175,000 by July 2020. In the absence of effective treatment, an essential tool of health policy is the modeling and forecasting of the progress of the pandemic. We, therefore, developed a cloud-based machine learning short-term forecasting model for Bangladesh, in which several regression-based machine learning models were applied to infected case data to estimate the number of COVID-19-infected people over the following seven days. This approach can accurately forecast the number of infected cases daily by training the prior 25 days sample data recorded on our web application. The outcomes of these efforts could aid the development and assessment of prevention strategies and identify factors that most affect the spread of COVID-19 infection in Bangladesh.
Collapse
|
18
|
Kumar S, Viral R, Deep V, Sharma P, Kumar M, Mahmud M, Stephan T. Forecasting major impacts of COVID-19 pandemic on country-driven sectors: challenges, lessons, and future roadmap. PERSONAL AND UBIQUITOUS COMPUTING 2021; 27:807-830. [PMID: 33815032 PMCID: PMC7996129 DOI: 10.1007/s00779-021-01530-7] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/14/2020] [Accepted: 01/27/2021] [Indexed: 05/27/2023]
Abstract
The pandemic caused by the coronavirus disease 2019 (COVID-19) has produced a global health calamity that has a profound impact on the way of perceiving the world and everyday lives. This has appeared as the greatest threat of the time for the entire world in terms of its impact on human mortality rate and many other societal fronts or driving forces whose estimations are yet to be known. Therefore, this study focuses on the most crucial sectors that are severely impacted due to the COVID-19 pandemic, in particular reference to India. Considered based on their direct link to a country's overall economy, these sectors include economic and financial, educational, healthcare, industrial, power and energy, oil market, employment, and environment. Based on available data about the pandemic and the above-mentioned sectors, as well as forecasted data about COVID-19 spreading, four inclusive mathematical models, namely-exponential smoothing, linear regression, Holt, and Winters, are used to analyse the gravity of the impacts due to this COVID-19 outbreak which is also graphically visualized. All the models are tested using data such as COVID-19 infection rate, number of daily cases and deaths, GDP of India, and unemployment. Comparing the obtained results, the best prediction model is presented. This study aims to evaluate the impact of this pandemic on country-driven sectors and recommends some strategies to lessen these impacts on a country's economy.
Collapse
Affiliation(s)
- Saket Kumar
- Amity School of Engineering and Technology, Amity University Uttar Pradesh, Noida, India
| | - Rajkumar Viral
- Amity School of Engineering and Technology, Amity University Uttar Pradesh, Noida, India
| | - Vikas Deep
- Amity School of Engineering and Technology, Amity University Uttar Pradesh, Noida, India
| | - Purushottam Sharma
- Amity School of Engineering and Technology, Amity University Uttar Pradesh, Noida, India
| | - Manoj Kumar
- School of Computer Science, University of Petroleum, Energy Studies (UPES), Bidoli, Dehradun, India
| | - Mufti Mahmud
- Department of Computer Science, Nottingham Trent University, Clifton Campus, Clifton, Nottingham, NG11 8NS UK
- Medical Technologies Innovation Facility, Nottingham Trent University, Clifton Campus, Clifton, Nottingham, NG11 8NS UK
| | - Thompson Stephan
- Department of Computer Science and Engineering, Faculty of Engineering and Technology, M. S. Ramaiah University of Applied Sciences, Bangalore, Karnataka India
| |
Collapse
|