1
|
Zhang Q, Shao D, Lin L, Gong G, Xu R, Kido S, Cui H. Feature Separation in Diffuse Lung Disease Image Classification by Using Evolutionary Algorithm-Based NAS. IEEE J Biomed Health Inform 2025; 29:2706-2717. [PMID: 39405149 DOI: 10.1109/jbhi.2024.3481012] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2024]
Abstract
In the field of diagnosing lung diseases, the application of neural networks (NNs) in image classification exhibits significant potential. However, NNs are considered "black boxes," making it difficult to discern their decision-making processes, thereby leading to skepticism and concern regarding NNs. This compromises model reliability and hampers intelligent medicine's development. To tackle this issue, we introduce the Evolutionary Neural Architecture Search (EvoNAS). In image classification tasks, EvoNAS initially utilizes an Evolutionary Algorithm to explore various Convolutional Neural Networks, ultimately yielding an optimized network that excels at separating between redundant texture features and the most discriminative ones. Retaining the most discriminative features improves classification accuracy, particularly in distinguishing similar features. This approach illuminates the intrinsic mechanics of classification, thereby enhancing the accuracy of the results. Subsequently, we incorporate a Differential Evolution algorithm based on distribution estimation, significantly enhancing search efficiency. Employing visualization techniques, we demonstrate the effectiveness of EvoNAS, endowing the model with interpretability. Finally, we conduct experiments on the diffuse lung disease texture dataset using EvoNAS. Compared to the original network, the classification accuracy increases by 0.56%. Moreover, our EvoNAS approach demonstrates significant advantages over existing methods in the same dataset.
Collapse
|
2
|
Hudu SA, Alshrari AS, Abu-Shoura EJI, Osman A, Jimoh AO. A Critical Review of the Prospect of Integrating Artificial Intelligence in Infectious Disease Diagnosis and Prognosis. Interdiscip Perspect Infect Dis 2025; 2025:6816002. [PMID: 40225950 PMCID: PMC11991796 DOI: 10.1155/ipid/6816002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2024] [Accepted: 02/20/2025] [Indexed: 04/15/2025] Open
Abstract
This paper explores the transformative potential of integrating artificial intelligence (AI) in the diagnosis and prognosis of infectious diseases. By analyzing diverse datasets, including clinical symptoms, laboratory results, and imaging data, AI algorithms can significantly enhance early detection and personalized treatment strategies. This paper reviews how AI-driven models improve diagnostic accuracy, predict patient outcomes, and contribute to effective disease management. It also addresses the challenges and ethical considerations associated with AI, including data privacy, algorithmic bias, and equitable access to healthcare. Highlighting case studies and recent advancements, the paper underscores AI's role in revolutionizing infectious disease management and its implications for future healthcare delivery.
Collapse
Affiliation(s)
- Shuaibu Abdullahi Hudu
- Department of Basic and Clinical Medical Sciences, Faculty of Dentistry, Zarqa University, Zarqa 13110, Jordan
| | - Ahmed Subeh Alshrari
- Department of Medical Laboratory Technology, Faculty of Applied Medical Science, Northern Border University, Arar 91431, Saudi Arabia
| | | | - Amira Osman
- Department of Basic and Clinical Medical Sciences, Faculty of Dentistry, Zarqa University, Zarqa 13110, Jordan
- Department of Histology and Cell Biology, Faculty of Medicine, Kafrelsheikh University, Kafr El Sheikh, Egypt
| | - Abdulgafar Olayiwola Jimoh
- Department of Pharmacology and Therapeutics, Faculty of Basic Clinical Sciences, College of Health Sciences, Usmanu Danfodiyo University, Sokoto 840232, Sokoto State, Nigeria
| |
Collapse
|
3
|
Pal M, Mohapatra RK, Sarangi AK, Sahu AR, Mishra S, Patel A, Bhoi SK, Elnaggar AY, El Azab IH, Alissa M, El-Bahy SM. A comparative analysis of the binary and multiclass classified chest X-ray images of pneumonia and COVID-19 with ML and DL models. Open Med (Wars) 2025; 20:20241110. [PMID: 39927166 PMCID: PMC11806240 DOI: 10.1515/med-2024-1110] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2024] [Revised: 11/11/2024] [Accepted: 11/17/2024] [Indexed: 02/11/2025] Open
Abstract
Background The highly infectious coronavirus disease 2019 (COVID-19) is caused by severe acute respiratory syndrome coronavirus 2, the seventh coronavirus. It is the longest pandemic in recorded history worldwide. Many countries are still reporting COVID-19 cases even in the fifth year of its emergence. Objective The performance of various machine learning (ML) and deep learning (DL) models was studied for image-based classification of the lungs infected with COVID-19, pneumonia (viral and bacterial), and normal cases from the chest X-rays (CXRs). Methods The K-nearest neighbour and logistics regression as the two ML models, and Visual Geometry Group-19, Vision transformer, and ConvMixer as the three DL models were included in the investigation to compare the brevity of the detection and classification of the cases. Results Among the investigated models, ConvMixer returned the best result in terms of accuracy, recall, precision, F1-score and area under the curve for both binary as well as multiclass classification. The pre-trained ConvMixer model outperformed the other four models in classifying. As per the performance observations, there was 97.1% accuracy for normal and COVID-19 + pneumonia-infected lungs, 98% accuracy for normal and COVID-19 infected lungs, 82% accuracy for normal + bacterial + viral infected lungs, and 98% accuracy for normal + pneumonia infected lungs. The DL models performed better than the ML models for binary and multiclass classification. The performance of these studied models was tried on other CXR image databases. Conclusion The suggested network effectively detected COVID-19 and different types of pneumonia by using CXR imagery. This could help medical sciences for timely and accurate diagnoses of the cases through bioimaging technology and the use of high-end bioinformatics tools.
Collapse
Affiliation(s)
- Madhumita Pal
- Department of Electrical Engineering, Government College of Engineering,
Keonjhar, Odisha, India
| | - Ranjan K. Mohapatra
- Department of Chemistry, Government College of Engineering,
Keonjhar, 758 002, Odisha, India
| | - Ashish K. Sarangi
- Department of Chemistry, School of Applied Sciences, Centurion University of Technology and Management, Balangir, Odisha, India
| | - Alok Ranjan Sahu
- Department of Botany, Vikash Degree College, Barahaguda, Canal Chowk,
Bargarh, Odisha, India
| | - Snehasish Mishra
- School of Biotechnology, Campus-11, KIIT Deemed-to-be-University,
Bhubaneswar, Odisha, India
| | - Alok Patel
- Department of Civil Engineering, Government College of Engineering, Keonjhar, Odisha, India
| | - Sushil Kumar Bhoi
- Department of Electrical Engineering, Government College of Engineering Kalahandi, Kalahandi, Bhawanipatna, 766 003, Odisha, India
| | - Ashraf Y. Elnaggar
- Department of Food Sciences and Nutrition, College of Science, Taif University, Taif, Saudi Arabia
| | - Islam H. El Azab
- Department of Food Sciences and Nutrition, College of Science, Taif University, Taif, Saudi Arabia
| | - Mohammed Alissa
- Department of Medical Laboratory, College of Applied Medical Sciences, Prince Sattam bin Abdulaziz University,
Al-Kharj, Saudi Arabia
| | - Salah M. El-Bahy
- Department of Chemistry, Turabah University College, Taif University, Taif, Saudi Arabia
| |
Collapse
|
4
|
Tabassum S, Khan MJ, Iqbal J, Waris A, Ijaz MA. Automated karyogram analysis for early detection of genetic and neurodegenerative disorders: a hybrid machine learning approach. Front Comput Neurosci 2025; 18:1525895. [PMID: 39911161 PMCID: PMC11794836 DOI: 10.3389/fncom.2024.1525895] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/10/2024] [Accepted: 12/30/2024] [Indexed: 02/07/2025] Open
Abstract
Anomalous chromosomes are the cause of genetic diseases such as cancer, Alzheimer's, Parkinson's, epilepsy, and autism. Karyotype analysis is the standard procedure for diagnosing genetic disorders. Identifying anomalies is often costly, time-consuming, heavily reliant on expert interpretation, and requires considerable manual effort. Efforts are being made to automate karyogram analysis. However, the unavailability of large datasets, particularly those including samples with chromosomal abnormalities, presents a significant challenge. The development of automated models requires extensive labeled and incredibly abnormal data to accurately identify and analyze abnormalities, which are difficult to obtain in sufficient quantities. Although the deep learning-based architecture has yielded state-of-the-art performance in medical image anomaly detection, it cannot be generalized well because of the lack of anomalous datasets. This study introduces a novel hybrid approach that combines unsupervised and supervised learning techniques to overcome the challenges of limited labeled data and scalability in chromosomal analysis. An Autoencoder-based system is initially trained with unlabeled data to identify chromosome patterns. It is fine-tuned on labeled data, followed by a classification step using a Convolutional Neural Network (CNN). A unique dataset of 234,259 chromosome images, including the training, validation, and test sets, was used. Marking a significant achievement in the scale of chromosomal analysis. The proposed hybrid system accurately detects structural anomalies in individual chromosome images, achieving 99.3% accuracy in classifying normal and abnormal chromosomes. We also used a structural similarity index measure and template matching to identify the part of the abnormal chromosome that differed from the normal one. This automated model has the potential to significantly contribute to the early detection and diagnosis of chromosome-related disorders that affect both genetic health and neurological behavior.
Collapse
Affiliation(s)
- Sumaira Tabassum
- Department of Robotics and Artificial Intelligence, School of Mechanical and Manufacturing Engineering, National University of Sciences and Technology, Islamabad, Pakistan
| | | | | | | | | |
Collapse
|
5
|
Hadhoud Y, Mekhaznia T, Bennour A, Amroune M, Kurdi NA, Aborujilah AH, Al-Sarem M. From Binary to Multi-Class Classification: A Two-Step Hybrid CNN-ViT Model for Chest Disease Classification Based on X-Ray Images. Diagnostics (Basel) 2024; 14:2754. [PMID: 39682662 DOI: 10.3390/diagnostics14232754] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2024] [Revised: 12/03/2024] [Accepted: 12/04/2024] [Indexed: 12/18/2024] Open
Abstract
BACKGROUND/OBJECTIVES Chest disease identification for Tuberculosis and Pneumonia diseases presents diagnostic challenges due to overlapping radiographic features and the limited availability of expert radiologists, especially in developing countries. The present study aims to address these challenges by developing a Computer-Aided Diagnosis (CAD) system to provide consistent and objective analyses of chest X-ray images, thereby reducing potential human error. By leveraging the complementary strengths of convolutional neural networks (CNNs) and vision transformers (ViTs), we propose a hybrid model for the accurate detection of Tuberculosis and for distinguishing between Tuberculosis and Pneumonia. METHODS We designed a two-step hybrid model that integrates the ResNet-50 CNN with the ViT-b16 architecture. It uses the transfer learning on datasets from Guangzhou Women's and Children's Medical Center for Pneumonia cases and datasets from Qatar and Dhaka (Bangladesh) universities for Tuberculosis cases. CNNs capture hierarchical structures in images, while ViTs, with their self-attention mechanisms, excel at identifying relationships between features. Combining these approaches enhances the model's performance on binary and multi-class classification tasks. RESULTS Our hybrid CNN-ViT model achieved a binary classification accuracy of 98.97% for Tuberculosis detection. For multi-class classification, distinguishing between Tuberculosis, viral Pneumonia, and bacterial Pneumonia, the model achieved an accuracy of 96.18%. These results underscore the model's potential in improving diagnostic accuracy and reliability for chest disease classification based on X-ray images. CONCLUSIONS The proposed hybrid CNN-ViT model demonstrates substantial potential in advancing the accuracy and robustness of CAD systems for chest disease diagnosis. By integrating CNN and ViT architectures, our approach enhances the diagnostic precision, which may help to alleviate the burden on healthcare systems in resource-limited settings and improve patient outcomes in chest disease diagnosis.
Collapse
Affiliation(s)
- Yousra Hadhoud
- LAMIS Laboratory, Larbi Tebessi University, Tebessa 12002, Algeria
| | - Tahar Mekhaznia
- LAMIS Laboratory, Larbi Tebessi University, Tebessa 12002, Algeria
| | - Akram Bennour
- LAMIS Laboratory, Larbi Tebessi University, Tebessa 12002, Algeria
| | - Mohamed Amroune
- LAMIS Laboratory, Larbi Tebessi University, Tebessa 12002, Algeria
| | - Neesrin Ali Kurdi
- College of Computer Science and Engineering, Taibah University, Medina 41477, Saudi Arabia
| | - Abdulaziz Hadi Aborujilah
- Department of Management Information Systems, College of Commerce & Business Administration, Dhofar University, Salalaha 211, Oman
| | - Mohammed Al-Sarem
- Department of Information Technology, Aylol University College, Yarim 547, Yemen
| |
Collapse
|
6
|
Lan XH, Zhang YX, Yuan WH, Shi F, Guo WL. Image-based deep learning in diagnosing mycoplasma pneumonia on pediatric chest X-rays. BMC Pediatr 2024; 24:720. [PMID: 39529076 PMCID: PMC11552354 DOI: 10.1186/s12887-024-05204-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/29/2024] [Accepted: 11/02/2024] [Indexed: 11/16/2024] Open
Abstract
BACKGROUND Correctly diagnosing and accurately distinguishing mycoplasma pneumonia in children has consistently posed a challenge in clinical practice, as it can directly impact the prognosis of affected children. To address this issue, we analyzed chest X-rays (CXR) using various deep learning models to diagnose pediatric mycoplasma pneumonia. METHODS We collected 578 cases of children with mycoplasma infection and 191 cases of children with virus infection, with available CXR sets. Three deep convolutional neural networks (ResNet50, DenseNet121, and EfficientNetv2-S) were used to distinguish mycoplasma pneumonia from viral pneumonia based on CXR. Accuracy, area under the curve (AUC), sensitivity, and specificity were used to evaluate the performance of the model. Visualization was also achieved through the use of Class Activation Mapping (CAM), providing more transparent and interpretable classification results. RESULTS Of the three models evaluated, ResNet50 outperformed the others. Pretrained with the ZhangLabData dataset, the ResNet50 model achieved 80.00% accuracy in the validation set. The model also showed robustness in two test sets, with accuracy of 82.65 and 83.27%, and AUC values of 0.822 and 0.758. In the test results using ImageNet pre-training weights, the accuracy of the ResNet50 model in the validation set was 80.00%; the accuracy in the two test sets was 81.63 and 62.91%; and the corresponding AUC values were 0.851 and 0.776. The sensitivity values were 0.884 and 0.595, and the specificity values were 0.655 and 0.814. CONCLUSIONS This study demonstrates that deep convolutional networks utilizing transfer learning are effective in detecting mycoplasma pneumonia based on chest X-rays (CXR). This suggests that, in the near future, such computer-aided detection approaches can be employed for the early screening of pneumonia pathogens. This has significant clinical implications for the rapid diagnosis and appropriate medical intervention of pneumonia, potentially enhancing the prognosis for affected children.
Collapse
Affiliation(s)
- Xing-Hao Lan
- Radiology department, Children's Hospital of Soochow University, Suzhou, 215025, China
| | - Yun-Xu Zhang
- School of Electronic and Information Engineering, Soochow University, Suzhou, 215006, China
| | - Wei-Hua Yuan
- Radiology department, Changzhou Children's Hospital of Nantong University, Changzhou, 213000, China.
| | - Fei Shi
- School of Electronic and Information Engineering, Soochow University, Suzhou, 215006, China.
| | - Wan-Liang Guo
- Radiology department, Children's Hospital of Soochow University, Suzhou, 215025, China.
| |
Collapse
|
7
|
Khan R, Taj S, Ma X, Noor A, Zhu H, Khan J, Khan ZU, Khan SU. Advanced federated ensemble internet of learning approach for cloud based medical healthcare monitoring system. Sci Rep 2024; 14:26068. [PMID: 39478132 PMCID: PMC11526108 DOI: 10.1038/s41598-024-77196-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2024] [Accepted: 10/21/2024] [Indexed: 11/02/2024] Open
Abstract
Medical image machines serve as a valuable tool to monitor and diagnose a variety of diseases. However, manual and centralized interpretation are both error-prone and time-consuming due to malicious attacks. Numerous diagnostic algorithms have been developed to improve precision and prevent poisoning attacks by integrating symptoms, test methods, and imaging data. But in today's digital technology world, it is necessary to have a global cloud-based diagnostic artificial intelligence model that is efficient in diagnosis and preventing poisoning attacks and might be used for multiple purposes. We propose the Healthcare Federated Ensemble Internet of Learning Cloud Doctor System (FDEIoL) model, which integrates different Internet of Things (IoT) devices to provide precise and accurate interpretation without poisoning attack problems, thereby facilitating IoT-enabled remote patient monitoring for smart healthcare systems. Furthermore, the FDEIoL system model uses a federated ensemble learning strategy to provide an automatic, up-to-date global prediction model based on input local models from the medical specialist. This assures biomedical security by safeguarding patient data and preserving the integrity of diagnostic processes. The FDEIoL system model utilizes local model feature selection to discriminate between malicious and non-malicious local models, and ensemble strategies use positive and negative samples to optimize the performance of the test dataset, enhancing its capability for remote patient monitoring. The FDEIoL system model achieved an exceptional accuracy rate of 99.24% on the Chest X-ray dataset and 99.0% on the MRI dataset of brain tumors compared to centralized models, demonstrating its ability for precision diagnosis in IoT-enabled healthcare systems.
Collapse
Affiliation(s)
- Rahim Khan
- College of Information and Communication Engineering, Harbin Engineering University, Harbin150001, China
| | - Sher Taj
- Software College, Northeastern University, Shenyang, 110169, China
| | - Xuefei Ma
- College of Information and Communication Engineering, Harbin Engineering University, Harbin150001, China.
| | - Alam Noor
- CISTER Research Center, Porto, Portugal
| | - Haifeng Zhu
- College of Information and Communication Engineering, Harbin Engineering University, Harbin150001, China
| | - Javed Khan
- Department of software Engineering, University of Science and Technology, Bannu, KPK, Pakistan
| | - Zahid Ullah Khan
- College of Information and Communication Engineering, Harbin Engineering University, Harbin150001, China
| | - Sajid Ullah Khan
- Department of Information Systems, College of Computer Engineering and Sciences, Prince Sattam bin Abdulaziz University, Alkharj, KSA, Saudi Arabia
| |
Collapse
|
8
|
Elhassan T, Osman AH, Mohd Rahim MS, Mohd Hashim SZ, Ali A, Elhassan E, Elkamali Y, Aljurf M. CAE-ResVGG FusionNet: A Feature Extraction Framework Integrating Convolutional Autoencoders and Transfer Learning for Immature White Blood Cells in Acute Myeloid Leukemia. Heliyon 2024; 10:e37745. [PMID: 39386823 PMCID: PMC11462284 DOI: 10.1016/j.heliyon.2024.e37745] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/22/2024] [Revised: 09/09/2024] [Accepted: 09/09/2024] [Indexed: 10/12/2024] Open
Abstract
Acute myeloid leukemia (AML) is a highly aggressive cancer form that affects myeloid cells, leading to the excessive growth of immature white blood cells (WBCs) in both bone marrow and peripheral blood. Timely AML detection is crucial for effective treatment and patient well-being. Currently, AML diagnosis relies on the manual recognition of immature WBCs through peripheral blood smear analysis, which is time-consuming, prone to errors, and subject to inter-observers' variation. This study aimed to develop a computer-aided diagnostic framework for AML, called "CAE-ResVGG FusionNet", that precisely identifies and classifies immature WBCs into their respective subtypes. The proposed framework leverages an integrated approach, by combining a convolutional autoencoder (CAE) with finely tuned adaptations of the VGG19 and ResNet50 architectures to extract features from CAE-derived embeddings. The process begins with a binary classification model distinguishing between mature and immature WBCs followed by a multiclassifier further classifying immature cells into four subtypes: myeloblasts, monoblasts, erythroblasts, and promyelocytes. The CAE-ResVGG FusionNet workflow comprises four primary stages, including data preprocessing, feature extraction, classification, and validation. The preprocessing phase involves applying data augmentation methods using geometric transformations and synthetic image generation using the CAE to address imbalance in the WBC distribution. Feature extraction involves image embedding and transfer learning, where CAE-derived image representations are used by a custom integrated model of VGG19 and ResNet50 pretrained models. The classification phase employs a weighted ensemble approach that leverages VGG19 and ResNet50, where the optimal weighting parameters are selected using a grid search. The model performance was assessed during the validation phase using the overall accuracy, precision, and sensitivity, while the area under the receiver characteristic curve (AUC) was used to evaluate the model's discriminatory capability. The proposed framework exhibited notable results, achieving an average accuracy of 99.9%, sensitivity of 91.7%, and precision of 98.8%. The model demonstrated exceptional discriminatory ability, as evidenced by an AUC of 99.6%. Significantly, the proposed system outperformed previous methods, indicating its superior diagnostic ability.
Collapse
Affiliation(s)
- Tusneem Elhassan
- Cancer Center of Excellence, King Faisal Specialist Hospital and Research Center, Riyadh 11564, Saudi Arabia
| | - Ahmed Hamza Osman
- Department of Information Systems, Faculty of Computing and Information Technology, King Abdulaziz University Rabigh, Saudi Arabia
| | - Mohd Shafry Mohd Rahim
- School of Computing, Universiti Teknologi Malaysia, Johor Bahru 81310, Johor, Malaysia
- Faculty of Computer & Information Technology, Sohar University, Sohar, Oman
| | | | - Abdulalem Ali
- Institute of Computer Science and Digital Innovation, UCSI University, Federal Territory of Kuala Lumpur
| | - Esmaeil Elhassan
- School of Computing, Universiti Teknologi Malaysia, Johor Bahru 81310, Johor, Malaysia
| | - Yusra Elkamali
- Faculty of mathematical science, university of Khartoum, Sudan
| | - Mahmoud Aljurf
- Dept of Hematology, Stem Cell Transplantation and Cellular Therapy, King Faisal Specialist Hospital & Research Centre, Riyadh, Saudi Arabia
| |
Collapse
|
9
|
Siddiqi R, Javaid S. Deep Learning for Pneumonia Detection in Chest X-ray Images: A Comprehensive Survey. J Imaging 2024; 10:176. [PMID: 39194965 DOI: 10.3390/jimaging10080176] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/11/2024] [Revised: 07/15/2024] [Accepted: 07/19/2024] [Indexed: 08/29/2024] Open
Abstract
This paper addresses the significant problem of identifying the relevant background and contextual literature related to deep learning (DL) as an evolving technology in order to provide a comprehensive analysis of the application of DL to the specific problem of pneumonia detection via chest X-ray (CXR) imaging, which is the most common and cost-effective imaging technique available worldwide for pneumonia diagnosis. This paper in particular addresses the key period associated with COVID-19, 2020-2023, to explain, analyze, and systematically evaluate the limitations of approaches and determine their relative levels of effectiveness. The context in which DL is applied as both an aid to and an automated substitute for existing expert radiography professionals, who often have limited availability, is elaborated in detail. The rationale for the undertaken research is provided, along with a justification of the resources adopted and their relevance. This explanatory text and the subsequent analyses are intended to provide sufficient detail of the problem being addressed, existing solutions, and the limitations of these, ranging in detail from the specific to the more general. Indeed, our analysis and evaluation agree with the generally held view that the use of transformers, specifically, vision transformers (ViTs), is the most promising technique for obtaining further effective results in the area of pneumonia detection using CXR images. However, ViTs require extensive further research to address several limitations, specifically the following: biased CXR datasets, data and code availability, the ease with which a model can be explained, systematic methods of accurate model comparison, the notion of class imbalance in CXR datasets, and the possibility of adversarial attacks, the latter of which remains an area of fundamental research.
Collapse
Affiliation(s)
- Raheel Siddiqi
- Computer Science Department, Karachi Campus, Bahria University, Karachi 73500, Pakistan
| | - Sameena Javaid
- Computer Science Department, Karachi Campus, Bahria University, Karachi 73500, Pakistan
| |
Collapse
|
10
|
Li Y, Zhang L, Yu H, Wang J, Wang S, Liu J, Zheng Q. A comprehensive segmentation of chest X-ray improves deep learning-based WHO radiologically confirmed pneumonia diagnosis in children. Eur Radiol 2024; 34:3471-3482. [PMID: 37930411 DOI: 10.1007/s00330-023-10367-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/25/2023] [Revised: 08/29/2023] [Accepted: 08/31/2023] [Indexed: 11/07/2023]
Abstract
OBJECTIVES To investigate a comprehensive segmentation of chest X-ray (CXR) in promoting deep learning-based World Health Organization's (WHO) radiologically confirmed pneumonia diagnosis in children. METHODS A total of 4400 participants between January 2016 and June 2021were identified for a cross-sectional study and divided into primary endpoint pneumonia (PEP), other infiltrates, and normal groups according to WHO's diagnostic criteria. The CXR was divided into six segments of left lung, right lung, mediastinum, diaphragm, ext-left lung, and ext-right lung by adopting the RA-UNet. To demonstrate the benefits of lung field segmentation in pneumonia diagnosis, the segmented images and images that were not segmented, which constituted seven segmentation combinations, were fed into the CBAM-ResNet under a three-category classification comparison. The interpretability of the CBAM-ResNet for pneumonia diagnosis was also performed by adopting a Grad-CAM module. RESULTS The RA-UNet achieved a high spatial overlap between manual and automatic segmentation (averaged DSC = 0.9639). The CBAM-ResNet when fed with the six segments achieved superior three-category diagnosis performance (accuracy = 0.8243) over other segmentation combinations and deep learning models under comparison, which was increased by around 6% in accuracy, precision, specificity, sensitivity, F1-score, and around 3% in AUC. The Grad-CAM could capture the pneumonia lesions more accurately, generating a more interpretable visualization and enhancing the superiority and reliability of our study in assisting pediatric pneumonia diagnosis. CONCLUSIONS The comprehensive segmentation of CXR could improve deep learning-based pneumonia diagnosis in childhood with a more reasonable WHO's radiological standardized pneumonia classification instead of conventional dichotomous bacterial pneumonia and viral pneumonia. CLINICAL RELEVANCE STATEMENT The comprehensive segmentation of chest X-ray improves deep learning-based WHO confirmed pneumonia diagnosis in children, laying a strong foundation for the potential inclusion of computer-aided pediatric CXR readings in precise classification of pneumonia and PCV vaccine trials efficacy in children. KEY POINTS • The chest X-ray was comprehensively segmented into six anatomical structures of left lung, right lung, mediastinum, diaphragm, ext-left lung, and ext-right lung. • The comprehensive segmentation improved the three-category classification of primary endpoint pneumonia, other infiltrates, and normal with an increase by around 6% in accuracy, precision, specificity, sensitivity, F1-score, and around 3% in AUC. • The comprehensive segmentation gave rise to a more accurate and interpretable visualization results in capturing the pneumonia lesions.
Collapse
Affiliation(s)
- Yuemei Li
- School of Computer and Control Engineering, Yantai University, Yantai, 264005, China
| | - Lin Zhang
- Department of Radiology, Xiamen Children's Hospital, Children's Hospital of Fudan University at Xiamen, Xiamen, Fujian, China
| | - Hu Yu
- School of Computer and Control Engineering, Yantai University, Yantai, 264005, China
| | - Jian Wang
- Department of Radiology, Xiamen Children's Hospital, Children's Hospital of Fudan University at Xiamen, Xiamen, Fujian, China
| | - Shuo Wang
- Yantai University Trier College of Sustainable Technology, Yantai, 264005, Shandong Province, China
- Trier University of Applied Sciences, D-54208, Trier, Germany
| | - Jungang Liu
- Department of Radiology, Xiamen Children's Hospital, Children's Hospital of Fudan University at Xiamen, Xiamen, Fujian, China.
| | - Qiang Zheng
- School of Computer and Control Engineering, Yantai University, Yantai, 264005, China.
| |
Collapse
|
11
|
Ghaderinia M, Abadijoo H, Mahdavian A, Kousha E, Shakibi R, Taheri SMR, Simaee H, Khatibi A, Moosavi-Movahedi AA, Khayamian MA. Smartphone-based device for point-of-care diagnostics of pulmonary inflammation using convolutional neural networks (CNNs). Sci Rep 2024; 14:6912. [PMID: 38519489 PMCID: PMC10959990 DOI: 10.1038/s41598-024-54939-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/14/2023] [Accepted: 02/19/2024] [Indexed: 03/25/2024] Open
Abstract
In pulmonary inflammation diseases, like COVID-19, lung involvement and inflammation determine the treatment regime. Respiratory inflammation is typically arisen due to the cytokine storm and the leakage of the vessels for immune cells recruitment. Currently, such a situation is detected by the clinical judgment of a specialist or precisely by a chest CT scan. However, the lack of accessibility to the CT machines in many poor medical centers as well as its expensive service, demands more accessible methods for fast and cheap detection of lung inflammation. Here, we have introduced a novel method for tracing the inflammation and lung involvement in patients with pulmonary inflammation, such as COVID-19, by a simple electrolyte detection in their sputum samples. The presence of the electrolyte in the sputum sample results in the fern-like structures after air-drying. These fern patterns are different in the CT positive and negative cases that are detected by an AI application on a smartphone and using a low-cost and portable mini-microscope. Evaluating 160 patient-derived sputum sample images, this method demonstrated an interesting accuracy of 95%, as confirmed by CT-scan results. This finding suggests that the method has the potential to serve as a promising and reliable approach for recognizing lung inflammatory diseases, such as COVID-19.
Collapse
Affiliation(s)
- Mohammadreza Ghaderinia
- Institute of Biochemistry and Biophysics, University of Tehran, Tehran, 1417614335, Iran
- Integrated Biophysics and Bioengineering Lab (iBL), Institute of Biochemistry and Biophysics, University of Tehran, Tehran, 1417614335, Iran
- Nano Electronic Center of Excellence, Nano Bio Electronics Devices Lab, School of Electrical and Computer Engineering, University of Tehran, P.O. Box 14395/515, Tehran, Iran
| | - Hamed Abadijoo
- Institute of Biochemistry and Biophysics, University of Tehran, Tehran, 1417614335, Iran
- Integrated Biophysics and Bioengineering Lab (iBL), Institute of Biochemistry and Biophysics, University of Tehran, Tehran, 1417614335, Iran
- Nano Electronic Center of Excellence, Nano Bio Electronics Devices Lab, School of Electrical and Computer Engineering, University of Tehran, P.O. Box 14395/515, Tehran, Iran
| | - Ashkan Mahdavian
- Nano Electronic Center of Excellence, Nano Bio Electronics Devices Lab, School of Electrical and Computer Engineering, University of Tehran, P.O. Box 14395/515, Tehran, Iran
| | - Ebrahim Kousha
- Institute of Biochemistry and Biophysics, University of Tehran, Tehran, 1417614335, Iran
- Integrated Biophysics and Bioengineering Lab (iBL), Institute of Biochemistry and Biophysics, University of Tehran, Tehran, 1417614335, Iran
- Nano Electronic Center of Excellence, Nano Bio Electronics Devices Lab, School of Electrical and Computer Engineering, University of Tehran, P.O. Box 14395/515, Tehran, Iran
| | - Reyhaneh Shakibi
- Department of Biophysics, Faculty of Biological Sciences, Tarbiat Modares University, Tehran, Iran
| | - S Mohammad-Reza Taheri
- Groningen university, University medical center Groningen, Antonius Deusinglaan 1, 9713AW, Groningen, The Netherlands
- Condensed Matter National Laboratory, Institute for Research in Fundamental Sciences (IPM), Tehran, Iran
| | - Hossein Simaee
- Cardiac Primary Prevention Research Center, Cardiovascular Diseases Research Institute, Tehran University of Medical Sciences, Tehran, Iran
| | - Ali Khatibi
- Department of Biotechnology, Faculty of Biological Sciences, Alzahra University, Tehran, Iran
| | | | - Mohammad Ali Khayamian
- Institute of Biochemistry and Biophysics, University of Tehran, Tehran, 1417614335, Iran.
- Integrated Biophysics and Bioengineering Lab (iBL), Institute of Biochemistry and Biophysics, University of Tehran, Tehran, 1417614335, Iran.
| |
Collapse
|
12
|
Karthick S, Gomathi N. IoT-based COVID-19 detection using recalling-enhanced recurrent neural network optimized with golden eagle optimization algorithm. Med Biol Eng Comput 2024; 62:925-940. [PMID: 38095786 DOI: 10.1007/s11517-023-02973-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2023] [Accepted: 11/15/2023] [Indexed: 02/22/2024]
Abstract
New potential for healthcare has been made possible by the development of the Internet of Medical Things (IoMT) with deep learning. This is applied for a broad range of applications. Normal medical devices together with sensors can gather important data when connected to the Internet, and deep learning uses this data to reveal symptoms and patterns and activate remote care. In recent years, the COVID-19 pandemic caused more mortality. Millions of people have been affected by this virus, and the number of infections is continually rising daily. To detect COVID-19, researchers attempt to utilize medical imaging and deep learning-based methods. Several methodologies were suggested utilizing chest X-ray (CXR) images for COVID-19 diagnosis. But these methodologies do not provide satisfactory accuracy. To overcome these drawbacks, a recalling-enhanced recurrent neural network optimized with golden eagle optimization algorithm (RERNN-GEO) is proposed in this paper. The intention of this work is to provide IoT-based deep learning method for the premature identification of COVID-19. This paradigm can be able to ease the workload of radiologists and medical specialists and also help with pandemic control. RERNN-GEO is a deep learning-based method; this is utilized in chest X-ray (CXR) images for COVID-19 diagnosis. Here, the Gray-Level Co-Occurrence Matrix (GLCM) window adaptive algorithm is used for extracting features to enable accurate diagnosis. By utilizing this algorithm, the proposed method attains better accuracy (33.84%, 28.93%, and 33.03%) and lower execution time (11.06%, 33.26%, and 23.33%) compared with the existing methods. This method can be capable of helping the clinician/radiologist to validate the initial assessment related to COVID-19.
Collapse
Affiliation(s)
- Karthick S
- Department of Computer Science and Engineering, SRM Institute of Science and Technology, Delhi - NCR Campus, Ghaziabad, India.
| | - Gomathi N
- Department of Computer Science and Engineering, Vel Tech Rangarajan Dr. Sagunthala R&D Institute of Science and Technology, Chennai, Tamil Nadu, 600062, India
| |
Collapse
|
13
|
Vinothini R, Niranjana G, Yakub F. A Novel Classification Model Using Optimal Long Short-Term Memory for Classification of COVID-19 from CT Images. J Digit Imaging 2023; 36:2480-2493. [PMID: 37491543 PMCID: PMC10584759 DOI: 10.1007/s10278-023-00852-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2023] [Revised: 05/13/2023] [Accepted: 05/15/2023] [Indexed: 07/27/2023] Open
Abstract
The human respiratory system is affected when an individual is infected with COVID-19, which became a global pandemic in 2020 and affected millions of people worldwide. However, accurate diagnosis of COVID-19 can be challenging due to small variations in typical and COVID-19 pneumonia, as well as the complexities involved in classifying infection regions. Currently, various deep learning (DL)-based methods are being introduced for the automatic detection of COVID-19 using computerized tomography (CT) scan images. In this paper, we propose the pelican optimization algorithm-based long short-term memory (POA-LSTM) method for classifying coronavirus using CT scan images. The data preprocessing technique is used to convert raw image data into a suitable format for subsequent steps. Here, we develop a general framework called no new U-Net (nnU-Net) for region of interest (ROI) segmentation in medical images. We apply a set of heuristic guidelines derived from the domain to systematically optimize the ROI segmentation task, which represents the dataset's key properties. Furthermore, high-resolution net (HRNet) is a standard neural network design developed for feature extraction. HRNet chooses the top-down strategy over the bottom-up method after considering the two options. It first detects the subject, generates a bounding box around the object and then estimates the relevant feature. The POA is used to minimize the subjective influence of manually selected parameters and enhance the LSTM's parameters. Thus, the POA-LSTM is used for the classification process, achieving higher performance for each performance metric such as accuracy, sensitivity, F1-score, precision, and specificity of 99%, 98.67%, 98.88%, 98.72%, and 98.43%, respectively.
Collapse
Affiliation(s)
- R Vinothini
- Department of Computing Technologies, SRM Institute of Science and Technology, Kattankulathur, India.
| | - G Niranjana
- SRM Institute of Science and Technology, Kattankulathur, India
| | - Fitri Yakub
- Electronic System Engineering Department, Malaysia-Japan International Institute of Technology, Kuala Lumpur, Malaysia
| |
Collapse
|
14
|
Yigci D, Atçeken N, Yetisen AK, Tasoglu S. Loop-Mediated Isothermal Amplification-Integrated CRISPR Methods for Infectious Disease Diagnosis at Point of Care. ACS OMEGA 2023; 8:43357-43373. [PMID: 38027359 PMCID: PMC10666231 DOI: 10.1021/acsomega.3c04422] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/21/2023] [Accepted: 09/26/2023] [Indexed: 12/01/2023]
Abstract
Infectious diseases continue to pose an imminent threat to global public health, leading to high numbers of deaths every year and disproportionately impacting developing countries where access to healthcare is limited. Biological, environmental, and social phenomena, including climate change, globalization, increased population density, and social inequity, contribute to the emergence of novel communicable diseases. Rapid and accurate diagnoses of infectious diseases are essential to preventing the transmission of infectious diseases. Although some commonly used diagnostic technologies provide highly sensitive and specific measurements, limitations including the requirement for complex equipment/infrastructure and refrigeration, the need for trained personnel, long sample processing times, and high cost remain unresolved. To ensure global access to affordable diagnostic methods, loop-mediated isothermal amplification (LAMP) integrated clustered regularly interspaced short palindromic repeat (CRISPR) based pathogen detection has emerged as a promising technology. Here, LAMP-integrated CRISPR-based nucleic acid detection methods are discussed in point-of-care (PoC) pathogen detection platforms, and current limitations and future directions are also identified.
Collapse
Affiliation(s)
- Defne Yigci
- School
of Medicine, Koç University, Istanbul 34450, Turkey
| | - Nazente Atçeken
- Koç
University Translational Medicine Research Center (KUTTAM), Koç University, Istanbul 34450, Turkey
| | - Ali K. Yetisen
- Department
of Chemical Engineering, Imperial College
London, London SW7 2AZ, U.K.
| | - Savas Tasoglu
- Koç
University Translational Medicine Research Center (KUTTAM), Koç University, Istanbul 34450, Turkey
- Boğaziçi
Institute of Biomedical Engineering, Boğaziçi
University, Istanbul 34684, Turkey
- Koç
University Arçelik Research Center for Creative Industries
(KUAR), Koç University, Istanbul 34450, Turkey
- Physical
Intelligence Department, Max Planck Institute
for Intelligent Systems, Stuttgart 70569, Germany
| |
Collapse
|
15
|
Nizam NB, Siddiquee SM, Shirin M, Bhuiyan MIH, Hasan T. COVID-19 Severity Prediction from Chest X-ray Images Using an Anatomy-Aware Deep Learning Model. J Digit Imaging 2023; 36:2100-2112. [PMID: 37369941 PMCID: PMC10502002 DOI: 10.1007/s10278-023-00861-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2023] [Revised: 05/17/2023] [Accepted: 05/25/2023] [Indexed: 06/29/2023] Open
Abstract
The COVID-19 pandemic has been adversely affecting the patient management systems in hospitals around the world. Radiological imaging, especially chest x-ray and lung Computed Tomography (CT) scans, plays a vital role in the severity analysis of hospitalized COVID-19 patients. However, with an increasing number of patients and a lack of skilled radiologists, automated assessment of COVID-19 severity using medical image analysis has become increasingly important. Chest x-ray (CXR) imaging plays a significant role in assessing the severity of pneumonia, especially in low-resource hospitals, and is the most frequently used diagnostic imaging in the world. Previous methods that automatically predict the severity of COVID-19 pneumonia mainly focus on feature pooling from pre-trained CXR models without explicitly considering the underlying human anatomical attributes. This paper proposes an anatomy-aware (AA) deep learning model that learns the generic features from x-ray images considering the underlying anatomical information. Utilizing a pre-trained model and lung segmentation masks, the model generates a feature vector including disease-level features and lung involvement scores. We have used four different open-source datasets, along with an in-house annotated test set for training and evaluation of the proposed method. The proposed method improves the geographical extent score by 11% in terms of mean squared error (MSE) while preserving the benchmark result in lung opacity score. The results demonstrate the effectiveness of the proposed AA model in COVID-19 severity prediction from chest X-ray images. The algorithm can be used in low-resource setting hospitals for COVID-19 severity prediction, especially where there is a lack of skilled radiologists.
Collapse
Affiliation(s)
- Nusrat Binta Nizam
- mHealth Research Group, Department of Biomedical Engineering, Bangladesh University of Engineering and Technology (BUET), Dhaka, 1205, Bangladesh
| | - Sadi Mohammad Siddiquee
- mHealth Research Group, Department of Biomedical Engineering, Bangladesh University of Engineering and Technology (BUET), Dhaka, 1205, Bangladesh
| | - Mahbuba Shirin
- Department of Radiology and Imaging, Bangabandhu Sheikh Mujib Medical University, Shahbagh, Dhaka, 1000, Bangladesh
| | - Mohammed Imamul Hassan Bhuiyan
- Department of Electrical and Electronics Engineering (EEE), Bangladesh University of Engineering and Technology, Dhaka, 1205, Bangladesh
| | - Taufiq Hasan
- mHealth Research Group, Department of Biomedical Engineering, Bangladesh University of Engineering and Technology (BUET), Dhaka, 1205, Bangladesh.
- Center for Bioengineering Innovation and Design (CBID), Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD, USA.
| |
Collapse
|
16
|
Malik H, Anees T, Al-Shamaylehs AS, Alharthi SZ, Khalil W, Akhunzada A. Deep Learning-Based Classification of Chest Diseases Using X-rays, CT Scans, and Cough Sound Images. Diagnostics (Basel) 2023; 13:2772. [PMID: 37685310 PMCID: PMC10486427 DOI: 10.3390/diagnostics13172772] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2023] [Revised: 08/14/2023] [Accepted: 08/21/2023] [Indexed: 09/10/2023] Open
Abstract
Chest disease refers to a variety of lung disorders, including lung cancer (LC), COVID-19, pneumonia (PNEU), tuberculosis (TB), and numerous other respiratory disorders. The symptoms (i.e., fever, cough, sore throat, etc.) of these chest diseases are similar, which might mislead radiologists and health experts when classifying chest diseases. Chest X-rays (CXR), cough sounds, and computed tomography (CT) scans are utilized by researchers and doctors to identify chest diseases such as LC, COVID-19, PNEU, and TB. The objective of the work is to identify nine different types of chest diseases, including COVID-19, edema (EDE), LC, PNEU, pneumothorax (PNEUTH), normal, atelectasis (ATE), and consolidation lung (COL). Therefore, we designed a novel deep learning (DL)-based chest disease detection network (DCDD_Net) that uses a CXR, CT scans, and cough sound images for the identification of nine different types of chest diseases. The scalogram method is used to convert the cough sounds into an image. Before training the proposed DCDD_Net model, the borderline (BL) SMOTE is applied to balance the CXR, CT scans, and cough sound images of nine chest diseases. The proposed DCDD_Net model is trained and evaluated on 20 publicly available benchmark chest disease datasets of CXR, CT scan, and cough sound images. The classification performance of the DCDD_Net is compared with four baseline models, i.e., InceptionResNet-V2, EfficientNet-B0, DenseNet-201, and Xception, as well as state-of-the-art (SOTA) classifiers. The DCDD_Net achieved an accuracy of 96.67%, a precision of 96.82%, a recall of 95.76%, an F1-score of 95.61%, and an area under the curve (AUC) of 99.43%. The results reveal that DCDD_Net outperformed the other four baseline models in terms of many performance evaluation metrics. Thus, the proposed DCDD_Net model can provide significant assistance to radiologists and medical experts. Additionally, the proposed model was also shown to be resilient by statistical evaluations of the datasets using McNemar and ANOVA tests.
Collapse
Affiliation(s)
- Hassaan Malik
- School of Systems and Technology, University of Management and Technology, Lahore 54770, Pakistan; (H.M.); (T.A.)
| | - Tayyaba Anees
- School of Systems and Technology, University of Management and Technology, Lahore 54770, Pakistan; (H.M.); (T.A.)
| | - Ahmad Sami Al-Shamaylehs
- Department of Networks and Cybersecurity, Faculty of Information Technology, Al-Ahliyya Amman University, Amman 19328, Jordan;
| | - Salman Z. Alharthi
- Department of Information System, College of Computers and Information Systems, Al-Lith Campus, Umm AL-Qura University, P.O. Box 7745, AL-Lith 21955, Saudi Arabia
| | - Wajeeha Khalil
- Department of Computer Science and Information Technology, University of Engineering and Technology Peshawar, Peshawar 25000, Pakistan;
| | - Adnan Akhunzada
- College of Computing & IT, University of Doha for Science and Technology, Doha P.O. Box 24449, Qatar;
| |
Collapse
|
17
|
Zaeri N. Artificial intelligence and machine learning responses to COVID-19 related inquiries. J Med Eng Technol 2023; 47:301-320. [PMID: 38625639 DOI: 10.1080/03091902.2024.2321846] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/14/2021] [Accepted: 02/18/2024] [Indexed: 04/17/2024]
Abstract
Researchers and scientists can use computational-based models to turn linked data into useful information, aiding in disease diagnosis, examination, and viral containment due to recent artificial intelligence and machine learning breakthroughs. In this paper, we extensively study the role of artificial intelligence and machine learning in delivering efficient responses to the COVID-19 pandemic almost four years after its start. In this regard, we examine a large number of critical studies conducted by various academic and research communities from multiple disciplines, as well as practical implementations of artificial intelligence algorithms that suggest potential solutions in investigating different COVID-19 decision-making scenarios. We identify numerous areas where artificial intelligence and machine learning can impact this context, including diagnosis (using chest X-ray imaging and CT imaging), severity, tracking, treatment, and the drug industry. Furthermore, we analyse the dilemma's limits, restrictions, and hazards.
Collapse
Affiliation(s)
- Naser Zaeri
- Faculty of Computer Studies, Arab Open University, Kuwait
| |
Collapse
|
18
|
Cui B, Wang H, Li R, Xiang L, Du J, Zhao H, Li S, Zhao X, Yin G, Cheng X, Ma Y, Huo H, Zuo P, Han G, Du C. Long-sequence voltage series forecasting for internal short circuit early detection of lithium-ion batteries. PATTERNS (NEW YORK, N.Y.) 2023; 4:100732. [PMID: 37409054 PMCID: PMC10318363 DOI: 10.1016/j.patter.2023.100732] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/15/2022] [Revised: 11/07/2022] [Accepted: 03/24/2023] [Indexed: 07/07/2023]
Abstract
Accurate early detection of internal short circuits (ISCs) is indispensable for safe and reliable application of lithium-ion batteries (LiBs). However, the major challenge is finding a reliable standard to judge whether the battery suffers from ISCs. In this work, a deep learning approach with multi-head attention and a multi-scale hierarchical learning mechanism based on encoder-decoder architecture is developed to accurately forecast voltage and power series. By using the predicted voltage without ISCs as the standard and detecting the consistency of the collected and predicted voltage series, we develop a method to detect ISCs quickly and accurately. In this way, we achieve an average percentage accuracy of 86% on the dataset, including different batteries and the equivalent ISC resistance from 1,000 Ω to 10 Ω, indicating successful application of the ISC detection method.
Collapse
Affiliation(s)
- Binghan Cui
- MIIT Key Laboratory of Critical Materials Technology for New Energy Conversion and Storage, School of Chemistry and Chemical Engineering, Harbin Institute of Technology, Harbin 150001, China
| | - Han Wang
- MIIT Key Laboratory of Critical Materials Technology for New Energy Conversion and Storage, School of Chemistry and Chemical Engineering, Harbin Institute of Technology, Harbin 150001, China
| | - Renlong Li
- MIIT Key Laboratory of Critical Materials Technology for New Energy Conversion and Storage, School of Chemistry and Chemical Engineering, Harbin Institute of Technology, Harbin 150001, China
| | - Lizhi Xiang
- MIIT Key Laboratory of Critical Materials Technology for New Energy Conversion and Storage, School of Chemistry and Chemical Engineering, Harbin Institute of Technology, Harbin 150001, China
| | - Jiannan Du
- MIIT Key Laboratory of Critical Materials Technology for New Energy Conversion and Storage, School of Chemistry and Chemical Engineering, Harbin Institute of Technology, Harbin 150001, China
| | - Huaian Zhao
- MIIT Key Laboratory of Critical Materials Technology for New Energy Conversion and Storage, School of Chemistry and Chemical Engineering, Harbin Institute of Technology, Harbin 150001, China
| | - Sai Li
- MIIT Key Laboratory of Critical Materials Technology for New Energy Conversion and Storage, School of Chemistry and Chemical Engineering, Harbin Institute of Technology, Harbin 150001, China
| | - Xinyue Zhao
- MIIT Key Laboratory of Critical Materials Technology for New Energy Conversion and Storage, School of Chemistry and Chemical Engineering, Harbin Institute of Technology, Harbin 150001, China
| | - Geping Yin
- MIIT Key Laboratory of Critical Materials Technology for New Energy Conversion and Storage, School of Chemistry and Chemical Engineering, Harbin Institute of Technology, Harbin 150001, China
| | - Xinqun Cheng
- MIIT Key Laboratory of Critical Materials Technology for New Energy Conversion and Storage, School of Chemistry and Chemical Engineering, Harbin Institute of Technology, Harbin 150001, China
| | - Yulin Ma
- MIIT Key Laboratory of Critical Materials Technology for New Energy Conversion and Storage, School of Chemistry and Chemical Engineering, Harbin Institute of Technology, Harbin 150001, China
| | - Hua Huo
- MIIT Key Laboratory of Critical Materials Technology for New Energy Conversion and Storage, School of Chemistry and Chemical Engineering, Harbin Institute of Technology, Harbin 150001, China
| | - Pengjian Zuo
- MIIT Key Laboratory of Critical Materials Technology for New Energy Conversion and Storage, School of Chemistry and Chemical Engineering, Harbin Institute of Technology, Harbin 150001, China
| | - Guokang Han
- MIIT Key Laboratory of Critical Materials Technology for New Energy Conversion and Storage, School of Chemistry and Chemical Engineering, Harbin Institute of Technology, Harbin 150001, China
| | - Chunyu Du
- MIIT Key Laboratory of Critical Materials Technology for New Energy Conversion and Storage, School of Chemistry and Chemical Engineering, Harbin Institute of Technology, Harbin 150001, China
| |
Collapse
|
19
|
Reshan MSA, Gill KS, Anand V, Gupta S, Alshahrani H, Sulaiman A, Shaikh A. Detection of Pneumonia from Chest X-ray Images Utilizing MobileNet Model. Healthcare (Basel) 2023; 11:healthcare11111561. [PMID: 37297701 DOI: 10.3390/healthcare11111561] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/08/2023] [Revised: 05/24/2023] [Accepted: 05/24/2023] [Indexed: 06/12/2023] Open
Abstract
Pneumonia has been directly responsible for a huge number of deaths all across the globe. Pneumonia shares visual features with other respiratory diseases, such as tuberculosis, which can make it difficult to distinguish between them. Moreover, there is significant variability in the way chest X-ray images are acquired and processed, which can impact the quality and consistency of the images. This can make it challenging to develop robust algorithms that can accurately identify pneumonia in all types of images. Hence, there is a need to develop robust, data-driven algorithms that are trained on large, high-quality datasets and validated using a range of imaging techniques and expert radiological analysis. In this research, a deep-learning-based model is demonstrated for differentiating between normal and severe cases of pneumonia. This complete proposed system has a total of eight pre-trained models, namely, ResNet50, ResNet152V2, DenseNet121, DenseNet201, Xception, VGG16, EfficientNet, and MobileNet. These eight pre-trained models were simulated on two datasets having 5856 images and 112,120 images of chest X-rays. The best accuracy is obtained on the MobileNet model with values of 94.23% and 93.75% on two different datasets. Key hyperparameters including batch sizes, number of epochs, and different optimizers have all been considered during comparative interpretation of these models to determine the most appropriate model.
Collapse
Affiliation(s)
- Mana Saleh Al Reshan
- Department of Information Systems, College of Computer Science and Information Systems, Najran University, Najran 61441, Saudi Arabia
| | - Kanwarpartap Singh Gill
- Chitkara University Institute of Engineering and Technology, Chitkara University, Punjab 140401, India
| | - Vatsala Anand
- Chitkara University Institute of Engineering and Technology, Chitkara University, Punjab 140401, India
| | - Sheifali Gupta
- Chitkara University Institute of Engineering and Technology, Chitkara University, Punjab 140401, India
| | - Hani Alshahrani
- Department of Computer Science, College of Computer Science and Information Systems, Najran University, Najran 61441, Saudi Arabia
| | - Adel Sulaiman
- Department of Computer Science, College of Computer Science and Information Systems, Najran University, Najran 61441, Saudi Arabia
| | - Asadullah Shaikh
- Department of Information Systems, College of Computer Science and Information Systems, Najran University, Najran 61441, Saudi Arabia
| |
Collapse
|
20
|
Hu J, Mougiakakou S, Xue S, Afshar-Oromieh A, Hautz W, Christe A, Sznitman R, Rominger A, Ebner L, Shi K. Artificial intelligence for reducing the radiation burden of medical imaging for the diagnosis of coronavirus disease. EUROPEAN PHYSICAL JOURNAL PLUS 2023; 138:391. [PMID: 37192839 PMCID: PMC10165296 DOI: 10.1140/epjp/s13360-023-03745-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/31/2022] [Accepted: 01/25/2023] [Indexed: 05/18/2023]
Abstract
Medical imaging has been intensively employed in screening, diagnosis and monitoring during the COVID-19 pandemic. With the improvement of RT-PCR and rapid inspection technologies, the diagnostic references have shifted. Current recommendations tend to limit the application of medical imaging in the acute setting. Nevertheless, efficient and complementary values of medical imaging have been recognized at the beginning of the pandemic when facing unknown infectious diseases and a lack of sufficient diagnostic tools. Optimizing medical imaging for pandemics may still have encouraging implications for future public health, especially for long-lasting post-COVID-19 syndrome theranostics. A critical concern for the application of medical imaging is the increased radiation burden, particularly when medical imaging is used for screening and rapid containment purposes. Emerging artificial intelligence (AI) technology provides the opportunity to reduce the radiation burden while maintaining diagnostic quality. This review summarizes the current AI research on dose reduction for medical imaging, and the retrospective identification of their potential in COVID-19 may still have positive implications for future public health.
Collapse
Affiliation(s)
- Jiaxi Hu
- Department of Nuclear Medicine, Inselspital, Bern University Hospital, University of Bern, Freiburgstrasse 18, 3010 Bern, Switzerland
- ARTORG Center for Biomedical Engineering Research, University of Bern, Murtenstrasse 50, 3008 Bern, Switzerland
| | - Stavroula Mougiakakou
- ARTORG Center for Biomedical Engineering Research, University of Bern, Murtenstrasse 50, 3008 Bern, Switzerland
| | - Song Xue
- ARTORG Center for Biomedical Engineering Research, University of Bern, Murtenstrasse 50, 3008 Bern, Switzerland
| | - Ali Afshar-Oromieh
- Department of Nuclear Medicine, Inselspital, Bern University Hospital, University of Bern, Freiburgstrasse 18, 3010 Bern, Switzerland
| | - Wolf Hautz
- Department of University Emergency Center of Inselspital, University of Bern, Freiburgstrasse 15, 3010 Bern, Switzerland
| | - Andreas Christe
- Department of Radiology, Inselspital, Bern University Hospital, University of Bern, 3012 Bern, Switzerland
| | - Raphael Sznitman
- ARTORG Center for Biomedical Engineering Research, University of Bern, Murtenstrasse 50, 3008 Bern, Switzerland
| | - Axel Rominger
- Department of Nuclear Medicine, Inselspital, Bern University Hospital, University of Bern, Freiburgstrasse 18, 3010 Bern, Switzerland
| | - Lukas Ebner
- Department of Radiology, Inselspital, Bern University Hospital, University of Bern, 3012 Bern, Switzerland
| | - Kuangyu Shi
- Department of Nuclear Medicine, Inselspital, Bern University Hospital, University of Bern, Freiburgstrasse 18, 3010 Bern, Switzerland
| |
Collapse
|
21
|
Hasan MM, Islam MU, Sadeq MJ, Fung WK, Uddin J. Review on the Evaluation and Development of Artificial Intelligence for COVID-19 Containment. SENSORS (BASEL, SWITZERLAND) 2023; 23:527. [PMID: 36617124 PMCID: PMC9824505 DOI: 10.3390/s23010527] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/28/2022] [Revised: 12/23/2022] [Accepted: 12/29/2022] [Indexed: 06/17/2023]
Abstract
Artificial intelligence has significantly enhanced the research paradigm and spectrum with a substantiated promise of continuous applicability in the real world domain. Artificial intelligence, the driving force of the current technological revolution, has been used in many frontiers, including education, security, gaming, finance, robotics, autonomous systems, entertainment, and most importantly the healthcare sector. With the rise of the COVID-19 pandemic, several prediction and detection methods using artificial intelligence have been employed to understand, forecast, handle, and curtail the ensuing threats. In this study, the most recent related publications, methodologies and medical reports were investigated with the purpose of studying artificial intelligence's role in the pandemic. This study presents a comprehensive review of artificial intelligence with specific attention to machine learning, deep learning, image processing, object detection, image segmentation, and few-shot learning studies that were utilized in several tasks related to COVID-19. In particular, genetic analysis, medical image analysis, clinical data analysis, sound analysis, biomedical data classification, socio-demographic data analysis, anomaly detection, health monitoring, personal protective equipment (PPE) observation, social control, and COVID-19 patients' mortality risk approaches were used in this study to forecast the threatening factors of COVID-19. This study demonstrates that artificial-intelligence-based algorithms integrated into Internet of Things wearable devices were quite effective and efficient in COVID-19 detection and forecasting insights which were actionable through wide usage. The results produced by the study prove that artificial intelligence is a promising arena of research that can be applied for disease prognosis, disease forecasting, drug discovery, and to the development of the healthcare sector on a global scale. We prove that artificial intelligence indeed played a significantly important role in helping to fight against COVID-19, and the insightful knowledge provided here could be extremely beneficial for practitioners and research experts in the healthcare domain to implement the artificial-intelligence-based systems in curbing the next pandemic or healthcare disaster.
Collapse
Affiliation(s)
- Md. Mahadi Hasan
- Department of Computer Science and Engineering, Asian University of Bangladesh, Ashulia 1349, Bangladesh
| | - Muhammad Usama Islam
- School of Computing and Informatics, University of Louisiana at Lafayette, Lafayette, LA 70504, USA
| | - Muhammad Jafar Sadeq
- Department of Computer Science and Engineering, Asian University of Bangladesh, Ashulia 1349, Bangladesh
| | - Wai-Keung Fung
- Department of Applied Computing and Engineering, Cardiff School of Technologies, Cardiff Metropolitan University, Cardiff CF5 2YB, UK
| | - Jasim Uddin
- Department of Applied Computing and Engineering, Cardiff School of Technologies, Cardiff Metropolitan University, Cardiff CF5 2YB, UK
| |
Collapse
|
22
|
Deepak G, Madiajagan M, Kulkarni S, Ahmed AN, Gopatoti A, Ammisetty V. MCSC-Net: COVID-19 detection using deep-Q-neural network classification with RFNN-based hybrid whale optimization. JOURNAL OF X-RAY SCIENCE AND TECHNOLOGY 2023; 31:483-509. [PMID: 36872839 DOI: 10.3233/xst-221360] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/16/2023]
Abstract
BACKGROUND COVID-19 is the most dangerous virus, and its accurate diagnosis saves lives and slows its spread. However, COVID-19 diagnosis takes time and requires trained professionals. Therefore, developing a deep learning (DL) model on low-radiated imaging modalities like chest X-rays (CXRs) is needed. OBJECTIVE The existing DL models failed to diagnose COVID-19 and other lung diseases accurately. This study implements a multi-class CXR segmentation and classification network (MCSC-Net) to detect COVID-19 using CXR images. METHODS Initially, a hybrid median bilateral filter (HMBF) is applied to CXR images to reduce image noise and enhance the COVID-19 infected regions. Then, a skip connection-based residual network-50 (SC-ResNet50) is used to segment (localize) COVID-19 regions. The features from CXRs are further extracted using a robust feature neural network (RFNN). Since the initial features contain joint COVID-19, normal, pneumonia bacterial, and viral properties, the conventional methods fail to separate the class of each disease-based feature. To extract the distinct features of each class, RFNN includes a disease-specific feature separate attention mechanism (DSFSAM). Furthermore, the hunting nature of the Hybrid whale optimization algorithm (HWOA) is used to select the best features in each class. Finally, the deep-Q-neural network (DQNN) classifies CXRs into multiple disease classes. RESULTS The proposed MCSC-Net shows the enhanced accuracy of 99.09% for 2-class, 99.16% for 3-class, and 99.25% for 4-class classification of CXR images compared to other state-of-art approaches. CONCLUSION The proposed MCSC-Net enables to conduct multi-class segmentation and classification tasks applying to CXR images with high accuracy. Thus, together with gold-standard clinical and laboratory tests, this new method is promising to be used in future clinical practice to evaluate patients.
Collapse
Affiliation(s)
- Gerard Deepak
- Department of Computer Science and Engineering, Manipal Institute of Technology Bengaluru, Manipal Academy of Higher Education, Manipal, India
| | - M Madiajagan
- School of Computer Science and Engineering, Vellore Institute of Technology, Vellore, Tamil Nadu, India
| | - Sanjeev Kulkarni
- Department of Information Science and Engineering, Yenepoya Institute of Technology, Mangalore, Karnataka, India
| | - Ahmed Najat Ahmed
- Department of Computer Engineering, Lebanese French University, Erbil, Iraq
| | - Anandbabu Gopatoti
- Department of Electronics and Communication Engineering, Hindusthan College of Engineering and Technology, Coimbatore, Tamil Nadu, India
| | - Veeraswamy Ammisetty
- Department of Computer Science and Engineering, Koneru Lakshmaiah Education Foundation, Vaddeswaram, Guntur, Andhra Pradesh, India
| |
Collapse
|
23
|
Irkham I, Ibrahim AU, Nwekwo CW, Al-Turjman F, Hartati YW. Current Technologies for Detection of COVID-19: Biosensors, Artificial Intelligence and Internet of Medical Things (IoMT): Review. SENSORS (BASEL, SWITZERLAND) 2022; 23:426. [PMID: 36617023 PMCID: PMC9824404 DOI: 10.3390/s23010426] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/26/2022] [Revised: 12/14/2022] [Accepted: 12/21/2022] [Indexed: 06/17/2023]
Abstract
Despite the fact that COVID-19 is no longer a global pandemic due to development and integration of different technologies for the diagnosis and treatment of the disease, technological advancement in the field of molecular biology, electronics, computer science, artificial intelligence, Internet of Things, nanotechnology, etc. has led to the development of molecular approaches and computer aided diagnosis for the detection of COVID-19. This study provides a holistic approach on COVID-19 detection based on (1) molecular diagnosis which includes RT-PCR, antigen-antibody, and CRISPR-based biosensors and (2) computer aided detection based on AI-driven models which include deep learning and transfer learning approach. The review also provide comparison between these two emerging technologies and open research issues for the development of smart-IoMT-enabled platforms for the detection of COVID-19.
Collapse
Affiliation(s)
- Irkham Irkham
- Department of Chemistry, Faculty of Mathematics and Natural Sciences, Padjadjaran University, Bandung 40173, Indonesia
| | | | - Chidi Wilson Nwekwo
- Department of Biomedical Engineering, Near East University, Mersin 99138, Turkey
| | - Fadi Al-Turjman
- Research Center for AI and IoT, Faculty of Engineering, University of Kyrenia, Mersin 99138, Turkey
- Artificial Intelligence Engineering Department, AI and Robotics Institute, Near East University, Mersin 99138, Turkey
| | - Yeni Wahyuni Hartati
- Department of Chemistry, Faculty of Mathematics and Natural Sciences, Padjadjaran University, Bandung 40173, Indonesia
| |
Collapse
|
24
|
Preliminary Stages for COVID-19 Detection Using Image Processing. Diagnostics (Basel) 2022; 12:diagnostics12123171. [PMID: 36553177 PMCID: PMC9777505 DOI: 10.3390/diagnostics12123171] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2022] [Revised: 11/30/2022] [Accepted: 12/08/2022] [Indexed: 12/23/2022] Open
Abstract
COVID-19 was first discovered in December 2019 in Wuhan. There have been reports of thousands of illnesses and hundreds of deaths in almost every region of the world. Medical images, when combined with cutting-edge technology such as artificial intelligence, have the potential to improve the efficiency of the public health system and deliver faster and more reliable findings in the detection of COVID-19. The process of developing the COVID-19 diagnostic system begins with image accusation and proceeds via preprocessing, feature extraction, and classification. According to literature review, several attempts to develop taxonomies for COVID-19 detection using image processing methods have been introduced. However, most of these adhere to a standard category that exclusively considers classification methods. Therefore, in this study a new taxonomy for the early stages of COVID-19 detection is proposed. It attempts to offer a full grasp of image processing in COVID-19 while considering all phases required prior to classification. The survey concludes with a discussion of outstanding concerns and future directions.
Collapse
|
25
|
Kibriya H, Amin R. A residual network-based framework for COVID-19 detection from CXR images. Neural Comput Appl 2022; 35:8505-8516. [PMID: 36536673 PMCID: PMC9754308 DOI: 10.1007/s00521-022-08127-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2021] [Accepted: 11/28/2022] [Indexed: 12/23/2022]
Abstract
In late 2019, a new Coronavirus disease (COVID-19) appeared in Wuhan, Hubei Province, China. The virus began to spread throughout many countries, affecting a large population. Polymerase chain reaction is currently being utilized to diagnose COVID-19 in suspected patients; however, its sensitivity is quite low. The researchers also developed automated approaches for reliably and timely identifying COVID-19 from X-ray images. However, traditional machine learning-based image classification algorithms necessitate manual image segmentation and feature extraction, which is a time-consuming task. Due to promising results and robust performance, Convolutional Neural Network (CNN)-based techniques are being used widely to classify COVID-19 from Chest X-rays (CXR). This study explores CNN-based COVID-19 classification methods. A series of experiments aimed at COVID-19 detection and classification validates the viability of our proposed framework. Initially, the dataset is preprocessed and then fed into two Residual Network (ResNet) architectures for deep feature extraction, such as ResNet18 and ResNet50, whereas support vector machines with its multiple kernels, including Quadratic, Linear, Gaussian and Cubic, are used to classify these features. The experimental results suggest that the proposed framework efficiently detects COVID-19 from CXR images. The proposed framework obtained the best accuracy of 97.3% using ResNet50.
Collapse
Affiliation(s)
- Hareem Kibriya
- grid.442854.bDepartment of Computer Sciences, University of Engineering and Technology, Taxila, Pakistan
| | - Rashid Amin
- grid.442854.bDepartment of Computer Sciences, University of Engineering and Technology, Taxila, Pakistan
- Department of Computer Science, University of Chakwal, Chakwal, 48800, Pakistan
| |
Collapse
|
26
|
Reis HC, Turk V. COVID-DSNet: A novel deep convolutional neural network for detection of coronavirus (SARS-CoV-2) cases from CT and Chest X-Ray images. Artif Intell Med 2022; 134:102427. [PMID: 36462906 PMCID: PMC9574866 DOI: 10.1016/j.artmed.2022.102427] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2022] [Revised: 10/07/2022] [Accepted: 10/13/2022] [Indexed: 12/14/2022]
Abstract
COVID-19 (SARS-CoV-2), which causes acute respiratory syndrome, is a contagious and deadly disease that has devastating effects on society and human life. COVID-19 can cause serious complications, especially in patients with pre-existing chronic health problems such as diabetes, hypertension, lung cancer, weakened immune systems, and the elderly. The most critical step in the fight against COVID-19 is the rapid diagnosis of infected patients. Computed Tomography (CT), chest X-ray (CXR), and RT-PCR diagnostic kits are frequently used to diagnose the disease. However, due to difficulties such as the inadequacy of RT-PCR test kits and false negative (FN) results in the early stages of the disease, the time-consuming examination of medical images obtained from CT and CXR imaging techniques by specialists/doctors, and the increasing workload on specialists, it is challenging to detect COVID-19. Therefore, researchers have suggested searching for new methods in COVID- 19 detection. In analysis studies with CT and CXR radiography images, it was determined that COVID-19-infected patients experienced abnormalities related to COVID-19. The anomalies observed here are the primary motivation for artificial intelligence researchers to develop COVID-19 detection applications with deep convolutional neural networks. Here, convolutional neural network-based deep learning algorithms from artificial intelligence technologies with high discrimination capabilities can be considered as an alternative approach in the disease detection process. This study proposes a deep convolutional neural network, COVID-DSNet, to diagnose typical pneumonia (bacterial, viral) and COVID-19 diseases from CT, CXR, hybrid CT + CXR images. In the multi-classification study with the CT dataset, 97.60 % accuracy and 97.60 % sensitivity values were obtained from the COVID-DSNet model, and 100 %, 96.30 %, and 96.58 % sensitivity values were obtained in the detection of typical, common pneumonia and COVID-19, respectively. The proposed model is an economical, practical deep learning network that data scientists can benefit from and develop. Although it is not a definitive solution in disease diagnosis, it may help experts as it produces successful results in detecting pneumonia and COVID-19.
Collapse
Affiliation(s)
- Hatice Catal Reis
- Department of Geomatics Engineering, Gumushane University, Gumushane 2900, Turkey,Corresponding author at: Department of Geomatics Engineering, Gumushane University, Gumushane 2900, Turkey
| | - Veysel Turk
- Department of Computer Engineering, University of Harran, Sanliurfa, Turkey
| |
Collapse
|
27
|
Ukwuoma CC, Qin Z, Heyat MBB, Akhtar F, Smahi A, Jackson JK, Furqan Qadri S, Muaad AY, Monday HN, Nneji GU. Automated Lung-Related Pneumonia and COVID-19 Detection Based on Novel Feature Extraction Framework and Vision Transformer Approaches Using Chest X-ray Images. Bioengineering (Basel) 2022; 9:709. [PMID: 36421110 PMCID: PMC9687434 DOI: 10.3390/bioengineering9110709] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2022] [Revised: 11/04/2022] [Accepted: 11/16/2022] [Indexed: 11/22/2022] Open
Abstract
According to research, classifiers and detectors are less accurate when images are blurry, have low contrast, or have other flaws which raise questions about the machine learning model's ability to recognize items effectively. The chest X-ray image has proven to be the preferred image modality for medical imaging as it contains more information about a patient. Its interpretation is quite difficult, nevertheless. The goal of this research is to construct a reliable deep-learning model capable of producing high classification accuracy on chest x-ray images for lung diseases. To enable a thorough study of the chest X-ray image, the suggested framework first derived richer features using an ensemble technique, then a global second-order pooling is applied to further derive higher global features of the images. Furthermore, the images are then separated into patches and position embedding before analyzing the patches individually via a vision transformer approach. The proposed model yielded 96.01% sensitivity, 96.20% precision, and 98.00% accuracy for the COVID-19 Radiography Dataset while achieving 97.84% accuracy, 96.76% sensitivity and 96.80% precision, for the Covid-ChestX-ray-15k dataset. The experimental findings reveal that the presented models outperform traditional deep learning models and other state-of-the-art approaches provided in the literature.
Collapse
Affiliation(s)
- Chiagoziem C. Ukwuoma
- School of Information and Software Engineering, University of Electronic Science and Technology of China, Chengdu 610054, China
| | - Zhiguang Qin
- School of Information and Software Engineering, University of Electronic Science and Technology of China, Chengdu 610054, China
| | - Md Belal Bin Heyat
- IoT Research Center, College of Computer Science and Software Engineering, Shenzhen University, Shenzhen 518060, China
- Centre for VLSI and Embedded System Technologies, International Institute of Information Technology, Hyderabad 500032, India
- Department of Science and Engineering, Novel Global Community Educational Foundation, Hebersham, NSW 2770, Australia
| | - Faijan Akhtar
- School of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu 610054, China
| | - Abla Smahi
- School of Electronic and Computer Engineering, Peking University Shenzhen Graduate School, Peking University, Shenzhen 518060, China
| | - Jehoiada K. Jackson
- School of Information and Software Engineering, University of Electronic Science and Technology of China, Chengdu 610054, China
| | - Syed Furqan Qadri
- Research Center for Healthcare Data Science, Zhejiang Lab, Hangzhou 311121, China
| | | | - Happy N. Monday
- School of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu 610054, China
| | - Grace U. Nneji
- School of Information and Software Engineering, University of Electronic Science and Technology of China, Chengdu 610054, China
| |
Collapse
|
28
|
Shibu George G, Raj Mishra P, Sinha P, Ranjan Prusty M. COVID-19 Detection on Chest X-Ray Images Using Homomorphic Transformation and VGG Inspired Deep Convolutional Neural Network. Biocybern Biomed Eng 2022; 43:1-16. [PMID: 36447948 PMCID: PMC9684127 DOI: 10.1016/j.bbe.2022.11.003] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2022] [Revised: 11/01/2022] [Accepted: 11/18/2022] [Indexed: 11/25/2022]
Abstract
COVID-19 had caused the whole world to come to a standstill. The current detection methods are time consuming as well as costly. Using Chest X-rays (CXRs) is a solution to this problem, however, manual examination of CXRs is a cumbersome and difficult process needing specialization in the domain. Most of existing methods used for this application involve the usage of pretrained models such as VGG19, ResNet, DenseNet, Xception, and EfficeintNet which were trained on RGB image datasets. X-rays are fundamentally single channel images, hence using RGB trained model is not appropriate since it increases the operations by involving three channels instead of one. A way of using pretrained model for grayscale images is by replicating the one channel image data to three channel which introduces redundancy and another way is by altering the input layer of pretrained model to take in one channel image data, which comprises the weights in the forward layers that were trained on three channel images which weakens the use of pre-trained weights in a transfer learning approach. A novel approach for identification of COVID-19 using CXRs, Contrast Limited Adaptive Histogram Equalization (CLAHE) along with Homomorphic Transformation Filter which is used to process the pixel data in images and extract features from the CXRs is suggested in this paper. These processed images are then provided as input to a VGG inspired deep Convolutional Neural Network (CNN) model which takes one channel image data as input (grayscale images) to categorize CXRs into three class labels, namely, No-Findings, COVID-19, and Pneumonia. Evaluation of the suggested model is done with the help of two publicly available datasets; one to obtain COVID-19 and No-Finding images and the other to obtain Pneumonia CXRs. The dataset comprises 6750 images in total; 2250 images for each class. Results obtained show that the model has achieved 96.56% for multi-class classification and 98.06% accuracy for binary classification using 5-fold stratified cross validation (CV) method. This result is competitive and up to the mark when compared with the performance shown by existing approaches for COVID-19 classification.
Collapse
Affiliation(s)
- Gerosh Shibu George
- School of Computer Science and Engineering, Vellore Institute of Technology, Chennai, Tamil Nadu 600127, India
| | - Pratyush Raj Mishra
- School of Computer Science and Engineering, Vellore Institute of Technology, Chennai, Tamil Nadu 600127, India
| | - Panav Sinha
- School of Computer Science and Engineering, Vellore Institute of Technology, Chennai, Tamil Nadu 600127, India
| | - Manas Ranjan Prusty
- Centre for Cyber Physical Systems, School of Computer Science and Engineering, Vellore Institute of Technology, Chennai, Tamil Nadu 600127, India
| |
Collapse
|
29
|
Arun Prakash J, Asswin CR, Ravi V, Sowmya V, Soman KP. Pediatric pneumonia diagnosis using stacked ensemble learning on multi-model deep CNN architectures. MULTIMEDIA TOOLS AND APPLICATIONS 2022; 82:21311-21351. [PMID: 36281318 PMCID: PMC9581770 DOI: 10.1007/s11042-022-13844-6] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/30/2022] [Revised: 06/17/2022] [Accepted: 09/06/2022] [Indexed: 05/27/2023]
Abstract
Pediatric pneumonia has drawn immense awareness due to the high mortality rates over recent years. The acute respiratory infection caused by bacteria, viruses, or fungi infects the lung region and hinders oxygen transport, making breathing difficult due to inflamed or pus and fluid-filled alveoli. Being non-invasive and painless, chest X-rays are the most common modality for pediatric pneumonia diagnosis. However, the low radiation levels for diagnosis in children make accurate detection challenging. This challenge initiates the need for an unerring computer-aided diagnosis model. Our work proposes Contrast Limited Adaptive Histogram Equalization for image enhancement and a stacking classifier based on the fusion of deep learning-based features for pediatric pneumonia diagnosis. The extracted features from the global average pooling layers of the fine-tuned MobileNet, DenseNet121, DenseNet169, and DenseNet201 are concatenated for the final classification using a stacked ensemble classifier. The stacking classifier uses Support Vector Classifier, Nu-SVC, Logistic Regression, K-Nearest Neighbor, Random Forest Classifier, Gaussian Naïve Bayes, AdaBoost classifier, Bagging Classifier, and Extra-trees Classifier for the first stage, and Nu-SVC as the meta-classifier. The stacking classifier validated using Stratified K-Fold cross-validation achieves an accuracy of 98.62%, precision of 98.99%, recall of 99.53%, F1 score of 99.26%, and an AUC score of 93.17% on the publicly available pediatric pneumonia dataset. We expect this model to greatly help the real-time diagnosis of pediatric pneumonia.
Collapse
Affiliation(s)
- J Arun Prakash
- Center for Computational Engineering and Networking (CEN), Amrita School of Engineering, Amrita Vishwa Vidyapeetham, Coimbatore, India
| | - CR Asswin
- Center for Computational Engineering and Networking (CEN), Amrita School of Engineering, Amrita Vishwa Vidyapeetham, Coimbatore, India
| | - Vinayakumar Ravi
- Center for Artificial Intelligence, Prince Mohammad Bin Fahd University, Khobar, Saudi Arabia
| | - V Sowmya
- Center for Computational Engineering and Networking (CEN), Amrita School of Engineering, Amrita Vishwa Vidyapeetham, Coimbatore, India
| | - KP Soman
- Center for Computational Engineering and Networking (CEN), Amrita School of Engineering, Amrita Vishwa Vidyapeetham, Coimbatore, India
| |
Collapse
|
30
|
Pramanik R, Sarkar S, Sarkar R. An adaptive and altruistic PSO-based deep feature selection method for Pneumonia detection from Chest X-rays. Appl Soft Comput 2022; 128:109464. [PMID: 35966452 PMCID: PMC9364947 DOI: 10.1016/j.asoc.2022.109464] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2022] [Revised: 07/11/2022] [Accepted: 07/29/2022] [Indexed: 12/23/2022]
Abstract
Pneumonia is one of the major reasons for child mortality especially in income-deprived regions of the world. Although it can be detected and treated with very less sophisticated instruments and medication, Pneumonia detection still remains a major concern in developing countries. Computer-aided based diagnosis (CAD) systems can be used in such countries due to their lower operating costs than professional medical experts. In this paper, we propose a CAD system for Pneumonia detection from Chest X-rays, using the concepts of deep learning and a meta-heuristic algorithm. We first extract deep features from the pre-trained ResNet50, fine-tuned on a target Pneumonia dataset. Then, we propose a feature selection technique based on particle swarm optimization (PSO), which is modified using a memory-based adaptation parameter, and enriched by incorporating an altruistic behavior into the agents. We name our feature selection method as adaptive and altruistic PSO (AAPSO). The proposed method successfully eliminates non-informative features obtained from the ResNet50 model, thereby improving the Pneumonia detection ability of the overall framework. Extensive experimentation and thorough analysis on a publicly available Pneumonia dataset establish the superiority of the proposed method over several other frameworks used for Pneumonia detection. Apart from Pneumonia detection, AAPSO is further evaluated on some standard UCI datasets, gene expression datasets for cancer prediction and a COVID-19 prediction dataset. The overall results are satisfactory, thereby confirming the usefulness of AAPSO in dealing with varied real-life problems. The supporting source codes of this work can be found at https://github.com/rishavpramanik/AAPSO.
Collapse
Affiliation(s)
- Rishav Pramanik
- Department of Computer Science and Engineering, Jadavpur University, Kolkata, 700032, India
| | - Sourodip Sarkar
- Department of Electronics and Communication Engineering, Heritage Institute of Technology, Kolkata, 700107, India
| | - Ram Sarkar
- Department of Computer Science and Engineering, Jadavpur University, Kolkata, 700032, India
| |
Collapse
|
31
|
Umar Ibrahim A, Al-Turjman F, Ozsoz M, Serte S. Computer aided detection of tuberculosis using two classifiers. BIOMED ENG-BIOMED TE 2022; 67:513-524. [PMID: 36165698 DOI: 10.1515/bmt-2021-0310] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2021] [Accepted: 09/13/2022] [Indexed: 11/15/2022]
Abstract
OBJECTIVES Tuberculosis caused by Mycobacterium tuberculosis have been a major challenge for medical and healthcare sectors in many underdeveloped countries with limited diagnosis tools. Tuberculosis can be detected from microscopic slides and chest X-ray but as a result of the high cases of tuberculosis, this method can be tedious for both microbiologist and Radiologist and can lead to miss-diagnosis. The main objective of this study is to addressed these challenges by employing Computer Aided Detection (CAD) using Artificial Intelligence-driven models which learn features based on convolution and result in an output with high accuracy. METHOD In this paper, we described automated discrimination of X-ray and microscopic slide images of tuberculosis into positive and negative cases using pretrained AlexNet Models. The study employed Chest X-ray dataset made available on Kaggle repository and microscopic slide images from both Near East university hospital and Kaggle repository. RESULTS For classification of tuberculosis and healthy microscopic slide using AlexNet+Softmax, the model achieved accuracy of 98.14%. For classification of tuberculosis and healthy microscopic slide using AlexNet+SVM, the model achieved 98.73% accuracy. For classification of tuberculosis and healthy chest X-ray images using AlexNet+Softmax, the model achieved accuracy of 98.19%. For classification of tuberculosis and healthy chest X-ray images using AlexNet+SVM, the model achieved 98.38% accuracy. CONCLUSION The result obtained has shown to outperformed several studies in the current literature. Future studies will attempt to integrate Internet of Medical Things (IoMT) for the design of IoMT/AI-enabled platform for detection of Tuberculosis from both X-ray and Microscopic slide images.
Collapse
Affiliation(s)
| | - Fadi Al-Turjman
- Department of Artificial Intelligence, Research Center for AI and IoT, Near East University, Nicosia, Turkey
| | - Mehmet Ozsoz
- Department of Biomedical Engineering, Near East University, Nicosia, Turkey
| | - Sertan Serte
- Department of Electrical and Electronics Engineering, Near East University, Nicosia, Turkey
| |
Collapse
|
32
|
Costa YMG, Silva SA, Teixeira LO, Pereira RM, Bertolini D, Britto AS, Oliveira LS, Cavalcanti GDC. COVID-19 Detection on Chest X-ray and CT Scan: A Review of the Top-100 Most Cited Papers. SENSORS (BASEL, SWITZERLAND) 2022; 22:7303. [PMID: 36236402 PMCID: PMC9570662 DOI: 10.3390/s22197303] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/09/2022] [Revised: 09/13/2022] [Accepted: 09/19/2022] [Indexed: 06/16/2023]
Abstract
Since the beginning of the COVID-19 pandemic, many works have been published proposing solutions to the problems that arose in this scenario. In this vein, one of the topics that attracted the most attention is the development of computer-based strategies to detect COVID-19 from thoracic medical imaging, such as chest X-ray (CXR) and computerized tomography scan (CT scan). By searching for works already published on this theme, we can easily find thousands of them. This is partly explained by the fact that the most severe worldwide pandemic emerged amid the technological advances recently achieved, and also considering the technical facilities to deal with the large amount of data produced in this context. Even though several of these works describe important advances, we cannot overlook the fact that others only use well-known methods and techniques without a more relevant and critical contribution. Hence, differentiating the works with the most relevant contributions is not a trivial task. The number of citations obtained by a paper is probably the most straightforward and intuitive way to verify its impact on the research community. Aiming to help researchers in this scenario, we present a review of the top-100 most cited papers in this field of investigation according to the Google Scholar search engine. We evaluate the distribution of the top-100 papers taking into account some important aspects, such as the type of medical imaging explored, learning settings, segmentation strategy, explainable artificial intelligence (XAI), and finally, the dataset and code availability.
Collapse
Affiliation(s)
- Yandre M. G. Costa
- Departamento de Informática, Universidade Estadual de Maringá, Maringá 87020-900, Brazil
| | - Sergio A. Silva
- Departamento de Informática, Universidade Estadual de Maringá, Maringá 87020-900, Brazil
| | - Lucas O. Teixeira
- Departamento de Informática, Universidade Estadual de Maringá, Maringá 87020-900, Brazil
| | | | - Diego Bertolini
- Departamento Acadêmico de Ciência da Computação, Universidade Tecnológica Federal do Paraná, Campo Mourão 87301-899, Brazil
| | - Alceu S. Britto
- Departmento de Ciência da Computação, Pontifícia Universidade Católica do Paraná, Curitiba 80215-901, Brazil
| | - Luiz S. Oliveira
- Departamento de Informática, Universidade Federal do Paraná, Curitiba 81531-980, Brazil
| | | |
Collapse
|
33
|
Muzoğlu N, Halefoğlu AM, Avci MO, Kaya Karaaslan M, Yarman BSB. Detection of COVID-19 and its pulmonary stage using Bayesian hyperparameter optimization and deep feature selection methods. EXPERT SYSTEMS 2022; 40:e13141. [PMID: 36245832 PMCID: PMC9537791 DOI: 10.1111/exsy.13141] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 04/06/2022] [Revised: 07/25/2022] [Accepted: 09/05/2022] [Indexed: 06/16/2023]
Abstract
Since the first case of COVID-19 was reported in December 2019, many studies have been carried out on artificial intelligence for the rapid diagnosis of the disease to support health services. Therefore, in this study, we present a powerful approach to detect COVID-19 and COVID-19 findings from computed tomography images using pre-trained models using two different datasets. COVID-19, influenza A (H1N1) pneumonia, bacterial pneumonia and healthy lung image classes were used in the first dataset. Consolidation, crazy-paving pattern, ground-glass opacity, ground-glass opacity and consolidation, ground-glass opacity and nodule classes were used in the second dataset. The study consists of four steps. In the first two steps, distinctive features were extracted from the final layers of the pre-trained ShuffleNet, GoogLeNet and MobileNetV2 models trained with the datasets. In the next steps, the most relevant features were selected from the models using the Sine-Cosine optimization algorithm. Then, the hyperparameters of the Support Vector Machines were optimized with the Bayesian optimization algorithm and used to reclassify the feature subset that achieved the highest accuracy in the third step. The overall accuracy obtained for the first and second datasets is 99.46% and 99.82%, respectively. Finally, the performance of the results visualized with Occlusion Sensitivity Maps was compared with Gradient-weighted class activation mapping. The approach proposed in this paper outperformed other methods in detecting COVID-19 from multiclass viral pneumonia. Moreover, detecting the stages of COVID-19 in the lungs was an innovative and successful approach.
Collapse
Affiliation(s)
- Nedim Muzoğlu
- Department of Biomedical Engineering, Faculty of EngineeringIstanbul University‐CerrahpasaIstanbulTurkey
| | - Ahmet Mesrur Halefoğlu
- Department of RadiologySisli Hamidiye Etfal Training and Research Hospital, Health Sciences UniversityIstanbulTurkey
| | - Muhammed Onur Avci
- Department of Biomedical Engineering, Faculty of EngineeringIstanbul University‐CerrahpasaIstanbulTurkey
| | - Melike Kaya Karaaslan
- Department of Biomedical SciencesFaculty of Engineering, Kocaeli UniversityKocaeliTurkey
| | - Bekir Sıddık Binboğa Yarman
- Department of Electrical‐Electronics Engineering, Faculty of EngineeringIstanbul University‐CerrahpasaIstanbulTurkey
| |
Collapse
|
34
|
Jangam E, Annavarapu CSR, Barreto AAD. A multi-class classification framework for disease screening and disease diagnosis of COVID-19 from chest X-ray images. MULTIMEDIA TOOLS AND APPLICATIONS 2022; 82:14367-14401. [PMID: 36157353 PMCID: PMC9490695 DOI: 10.1007/s11042-022-13710-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/14/2021] [Revised: 05/05/2022] [Accepted: 08/24/2022] [Indexed: 06/16/2023]
Abstract
To accurately diagnose multiple lung diseases from chest X-rays, the critical aspect is to identify lung diseases with high sensitivity and specificity. This study proposed a novel multi-class classification framework that minimises either false positives or false negatives that is useful in computer aided diagnosis or computer aided detection respectively. To minimise false positives or false negatives, we generated respective stacked ensemble from pre-trained models and fully connected layers using selection metric and systematic method. The diversity of base classifiers was based on diverse set of false positives or false negatives generated. The proposed multi-class framework was evaluated on two chest X-ray datasets, and the performance was compared with the existing models and base classifiers. Moreover, we used LIME (Local Interpretable Model-agnostic Explanations) to locate the regions focused by the multi-class classification framework.
Collapse
Affiliation(s)
- Ebenezer Jangam
- Department of Information Technology, Velagapudi Ramakrishna Siddhartha Engineering College, Vijayawada, Andhra Pradesh India
- Department of Computer Science Engineering, Indian Institute of Technology(ISM), Dhanbad, Jharkhand India
| | | | | |
Collapse
|
35
|
Bhosale YH, Patnaik KS. Application of Deep Learning Techniques in Diagnosis of Covid-19 (Coronavirus): A Systematic Review. Neural Process Lett 2022; 55:1-53. [PMID: 36158520 PMCID: PMC9483290 DOI: 10.1007/s11063-022-11023-0] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 08/29/2022] [Indexed: 01/09/2023]
Abstract
Covid-19 is now one of the most incredibly intense and severe illnesses of the twentieth century. Covid-19 has already endangered the lives of millions of people worldwide due to its acute pulmonary effects. Image-based diagnostic techniques like X-ray, CT, and ultrasound are commonly employed to get a quick and reliable clinical condition. Covid-19 identification out of such clinical scans is exceedingly time-consuming, labor-intensive, and susceptible to silly intervention. As a result, radiography imaging approaches using Deep Learning (DL) are consistently employed to achieve great results. Various artificial intelligence-based systems have been developed for the early prediction of coronavirus using radiography pictures. Specific DL methods such as CNN and RNN noticeably extract extremely critical characteristics, primarily in diagnostic imaging. Recent coronavirus studies have used these techniques to utilize radiography image scans significantly. The disease, as well as the present pandemic, was studied using public and private data. A total of 64 pre-trained and custom DL models concerning imaging modality as taxonomies are selected from the studied articles. The constraints relevant to DL-based techniques are the sample selection, network architecture, training with minimal annotated database, and security issues. This includes evaluating causal agents, pathophysiology, immunological reactions, and epidemiological illness. DL-based Covid-19 detection systems are the key focus of this review article. Covid-19 work is intended to be accelerated as a result of this study.
Collapse
Affiliation(s)
- Yogesh H. Bhosale
- Department of Computer Science and Engineering, Birla Institute of Technology, Mesra, Ranchi 835215 India
| | - K. Sridhar Patnaik
- Department of Computer Science and Engineering, Birla Institute of Technology, Mesra, Ranchi 835215 India
| |
Collapse
|
36
|
Ukwuoma CC, Qin Z, Belal Bin Heyat M, Akhtar F, Bamisile O, Muad AY, Addo D, Al-Antari MA. A Hybrid Explainable Ensemble Transformer Encoder for Pneumonia Identification from Chest X-ray Images. J Adv Res 2022:S2090-1232(22)00202-8. [PMID: 36084812 DOI: 10.1016/j.jare.2022.08.021] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2022] [Revised: 08/11/2022] [Accepted: 08/31/2022] [Indexed: 10/14/2022] Open
Abstract
INTRODUCTION Pneumonia is a microorganism infection that causes chronic inflammation of the human lung cells. Chest X-ray imaging is the most well-known screening approach used for detecting pneumonia in the early stages. While chest-Xray images are mostly blurry with low illumination, a strong feature extraction approach is required for promising identification performance. OBJECTIVES A new hybrid explainable deep learning framework is proposed for accurate pneumonia disease identification using chest X-ray images. METHODS The proposed hybrid workflow is developed by fusing the capabilities of both ensemble convolutional networks and the Transformer Encoder mechanism. The ensemble learning backbone is used to extract strong features from the raw input X-ray images in two different scenarios: ensemble A (i.e., DenseNet201, VGG16, and GoogleNet) and ensemble B (i.e., DenseNet201, InceptionResNetV2, and Xception). Whereas, the Transformer Encoder is built based on the self-attention mechanism with multilayer perceptron (MLP) for accurate disease identification. The visual explainable saliency maps are derived to emphasize the crucial predicted regions on the input X-ray images. The end-to-end training process of the proposed deep learning models over all scenarios is performed for binary and multi-class classification tasks. RESULTS The proposed hybrid deep learning model recorded 99.21% classification performance in terms of overall accuracy and F1-score for the binary classification task, while it achieved 98.19% accuracy and 97.29% F1-score for multi-classification task. For the ensemble binary identification scenario, ensemble A recorded 97.22% accuracy and 97.14% F1-score, while ensemble B achieved 96.44% for both accuracy and F1-score. For the ensemble, multiclass identification scenario, ensemble A recorded 97.2% accuracy and 95.8% F1-score, while ensemble B recorded 96.4% accuracy and 94.9% F1-score. CONCLUSION The proposed hybrid deep learning framework could provide promising and encouraging explainable identification performance comparing with individual, ensemble models, or even the latest models in the literature. The code is available here: https://github.com/chiagoziemchima/Pneumonia_Identificaton.
Collapse
Affiliation(s)
- Chiagoziem C Ukwuoma
- School of Information and Software Engineering, University of Electronic Science and Technology of China, Chengdu, Sichuan, China
| | - Zhiguang Qin
- School of Information and Software Engineering, University of Electronic Science and Technology of China, Chengdu, Sichuan, China.
| | - Md Belal Bin Heyat
- IoT Research Center, College of Computer Science and Software Engineering, Shenzhen University, Shenzhen, Guangdong 518060, China; International Institute of Information Technology, Hyderabad, Telangana 500032, India; Department of Science and Engineering, Novel Global Community Educational Foundation, Hebersham, NSW 2770, Australia
| | - Faijan Akhtar
- School of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu, Sichuan 611731, China
| | - Olusola Bamisile
- Sichuan Industrial Internet Intelligent Monitoring and Application Engineering Technology Research Center, Chengdu University of Technology, China
| | - Abdullah Y Muad
- Department of Studies in Computer Science, University of Mysore, Manasagangothri, Mysore, India
| | - Daniel Addo
- School of Information and Software Engineering, University of Electronic Science and Technology of China, Chengdu, Sichuan, China
| | - Mugahed A Al-Antari
- Department of Artificial Intelligence, College of Software & Convergence Technology, Daeyang AI Center, Sejong University, Seoul 05006, Korea.
| |
Collapse
|
37
|
Hamza A, Attique Khan M, Wang SH, Alqahtani A, Alsubai S, Binbusayyis A, Hussein HS, Martinetz TM, Alshazly H. COVID-19 classification using chest X-ray images: A framework of CNN-LSTM and improved max value moth flame optimization. Front Public Health 2022; 10:948205. [PMID: 36111186 PMCID: PMC9468600 DOI: 10.3389/fpubh.2022.948205] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2022] [Accepted: 08/01/2022] [Indexed: 01/21/2023] Open
Abstract
Coronavirus disease 2019 (COVID-19) is a highly contagious disease that has claimed the lives of millions of people worldwide in the last 2 years. Because of the disease's rapid spread, it is critical to diagnose it at an early stage in order to reduce the rate of spread. The images of the lungs are used to diagnose this infection. In the last 2 years, many studies have been introduced to help with the diagnosis of COVID-19 from chest X-Ray images. Because all researchers are looking for a quick method to diagnose this virus, deep learning-based computer controlled techniques are more suitable as a second opinion for radiologists. In this article, we look at the issue of multisource fusion and redundant features. We proposed a CNN-LSTM and improved max value features optimization framework for COVID-19 classification to address these issues. The original images are acquired and the contrast is increased using a combination of filtering algorithms in the proposed architecture. The dataset is then augmented to increase its size, which is then used to train two deep learning networks called Modified EfficientNet B0 and CNN-LSTM. Both networks are built from scratch and extract information from the deep layers. Following the extraction of features, the serial based maximum value fusion technique is proposed to combine the best information of both deep models. However, a few redundant information is also noted; therefore, an improved max value based moth flame optimization algorithm is proposed. Through this algorithm, the best features are selected and finally classified through machine learning classifiers. The experimental process was conducted on three publically available datasets and achieved improved accuracy than the existing techniques. Moreover, the classifiers based comparison is also conducted and the cubic support vector machine gives better accuracy.
Collapse
Affiliation(s)
- Ameer Hamza
- Department of Computer Science, HITEC University, Taxila, Pakistan
| | | | - Shui-Hua Wang
- Department of Mathematics, University of Leicester, Leicester, United Kingdom
| | - Abdullah Alqahtani
- College of Computer Engineering and Sciences, Prince Sattam Bin Abdulaziz University, Al-Kharj, Saudi Arabia
| | - Shtwai Alsubai
- College of Computer Engineering and Sciences, Prince Sattam Bin Abdulaziz University, Al-Kharj, Saudi Arabia
| | - Adel Binbusayyis
- College of Computer Engineering and Sciences, Prince Sattam Bin Abdulaziz University, Al-Kharj, Saudi Arabia
| | - Hany S. Hussein
- Department of Electrical Engineering, College of Engineering, King Khalid University, Abha, Saudi Arabia
- Department of Electrical Engineering, Faculty of Engineering, Aswan University, Aswan, Egypt
| | | | - Hammam Alshazly
- Faculty of Computers and Information, South Valley University, Qena, Egypt
| |
Collapse
|
38
|
Smadi AA, Abugabah A, Al-Smadi AM, Almotairi S. SEL-COVIDNET: An intelligent application for the diagnosis of COVID-19 from chest X-rays and CT-scans. INFORMATICS IN MEDICINE UNLOCKED 2022; 32:101059. [PMID: 36033909 PMCID: PMC9398554 DOI: 10.1016/j.imu.2022.101059] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/18/2022] [Revised: 08/17/2022] [Accepted: 08/17/2022] [Indexed: 11/06/2022] Open
Abstract
COVID-19 detection from medical imaging is a difficult challenge that has piqued the interest of experts worldwide. Chest X-rays and computed tomography (CT) scanning are the essential imaging modalities for diagnosing COVID-19. All researchers focus their efforts on developing viable methods and rapid treatment procedures for this pandemic. Fast and accurate automated detection approaches have been devised to alleviate the need for medical professionals. Deep Learning (DL) technologies have successfully recognized COVID-19 situations. This paper proposes a developed set of nine deep learning models for diagnosing COVID-19 based on transfer learning and implementation in a novel architecture (SEL-COVIDNET). We include a global average pooling layer, flattening, and two dense layers that are fully connected. The model’s effectiveness is evaluated using balanced and unbalanced COVID-19 radiography datasets. After that, our model’s performance is analyzed using six evaluation measures: accuracy, sensitivity, specificity, precision, F1-score, and Matthew’s correlation coefficient (MCC). Experiments demonstrated that the proposed SEL-COVIDNET with tuned DenseNet121, InceptionResNetV2, and MobileNetV3Large models outperformed the results of comparative SOTA for multi-class classification (COVID-19 vs. No-finding vs. Pneumonia) in terms of accuracy (98.52%), specificity (98.5%), sensitivity (98.5%), precision (98.7%), F1-score (98.7%), and MCC (97.5%). For the COVID-19 vs. No-finding classification, our method had an accuracy of 99.77%, a specificity of 99.85%, a sensitivity of 99.85%, a precision of 99.55%, an F1-score of 99.7%, and an MCC of 99.4%. The proposed model offers an accurate approach for detecting COVID-19 patients, which aids in the containment of the COVID-19 pandemic.
Collapse
Affiliation(s)
- Ahmad Al Smadi
- School of Artificial Intelligence, Xidian University, No. 2 South Taibai Road, Xian, 710071, China.,College of Technological Innovation, Zayed University, Abu Dhabi Campus, UAE
| | - Ahed Abugabah
- College of Technological Innovation, Zayed University, Abu Dhabi Campus, UAE
| | - Ahmad Mohammad Al-Smadi
- Department of Computer Science, Al-Balqa Applied University, Ajloun University College, Jordan
| | - Sultan Almotairi
- Faculty of Community College, Majmaah University, Al Majma'ah, Saudi Arabia
| |
Collapse
|
39
|
Bodapati JD, Rohith VN, Dondeti V. Ensemble of deep capsule neural networks: an application to pediatric pneumonia prediction. Phys Eng Sci Med 2022; 45:949-959. [PMID: 35997924 DOI: 10.1007/s13246-022-01169-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2021] [Accepted: 07/27/2022] [Indexed: 10/15/2022]
Abstract
Pneumonia disease accounts for 15% of all deaths in children under the age of five and early detection of the disease significantly improves survival chances. In this work, we introduce a novel deep neural network model for evaluating pediatric pneumonia from chest radio-graph images. The proposed network is an ensemble of multiple candidate networks, each with interleaved convolutional and capsule layers. Individual networks are stitched together with dense layers and trained as a single model to minimize joint loss. The proposed approach is validated through extensive experimentation on the benchmark pneumonia dataset, and the results demonstrate that the model captures higher level abstractions as well as hidden low-level features from the input radio-graphic images. Our comparison studies reveal that the proposed model produces more generic predictions than existing approaches, with an accuracy of 94.84%. The proposed model produces better scores than the existing models and is extremely useful in assisting clinicians in pneumonia diagnosis.
Collapse
Affiliation(s)
- Jyostna Devi Bodapati
- Department of Computer Science and Engineering, Vignan's Foundation for Science Technology and Research, Vadlamudi, Guntur, Andhra Pradesh, 522213, India.
| | - V N Rohith
- Department of Computer Science and Engineering, Vignan's Foundation for Science Technology and Research, Vadlamudi, Guntur, Andhra Pradesh, 522213, India
| | - Venkatesulu Dondeti
- Department of Computer Science and Engineering, Vignan's Foundation for Science Technology and Research, Vadlamudi, Guntur, Andhra Pradesh, 522213, India
| |
Collapse
|
40
|
Mahaboob Basha S, Lira Neto AV, Alshathri S, Elaziz MA, Hashmitha Mohisin S, De Albuquerque VHC. Multithreshold Segmentation and Machine Learning Based Approach to Differentiate COVID-19 from Viral Pneumonia. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:2728866. [PMID: 36039344 PMCID: PMC9420061 DOI: 10.1155/2022/2728866] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/30/2022] [Revised: 06/13/2022] [Accepted: 07/05/2022] [Indexed: 11/17/2022]
Abstract
Coronavirus disease (COVID-19) has created an unprecedented devastation and the loss of millions of lives globally. Contagious nature and fatalities invariably pose challenges to physicians and healthcare support systems. Clinical diagnostic evaluation using reverse transcription-polymerase chain reaction and other approaches are currently in use. The Chest X-ray (CXR) and CT images were effectively utilized in screening purposes that could provide relevant data on localized regions affected by the infection. A step towards automated screening and diagnosis using CXR and CT could be of considerable importance in these turbulent times. The main objective is to probe a simple threshold-based segmentation approach to identify possible infection regions in CXR images and investigate intensity-based, wavelet transform (WT)-based, and Laws based texture features with statistical measures. Further feature selection strategy using Random Forest (RF) then selected features used to create Machine Learning (ML) representation with Support Vector Machine (SVM) and a Random Forest (RF) to make different COVID-19 from viral pneumonia (VP). The results obtained clearly indicate that the intensity and WT-based features vary in the two pathologies that are better differentiated with the combined features trained using SVM and RF classifiers. Classifier performance measures like an Area Under the Curve (AUC) of 0.97 and by and large classification accuracy of 0.9 using the RF model clearly indicate that the methodology implemented is useful in characterizing COVID-19 and Viral Pneumonia.
Collapse
Affiliation(s)
- Shaik Mahaboob Basha
- Department of Electronics and Communication Engineering, Geethanjali Institute of Science and Technology, Nellore, India
- Graduation Program in Telecommunication Engineering, Federal Institute of Ceará, Fortaleza, CE, Brazil
| | - Aloísio Vieira Lira Neto
- Graduation Program in Telecommunication Engineering, Federal Institute of Ceará, Fortaleza, CE, Brazil
| | - Samah Alshathri
- Department of Information Technology, College of Computer and Information Sciences, Princess Nourah bint Abdulrahman University, P.O. Box 84428, Riyadh 11671, Saudi Arabia
| | - Mohamed Abd Elaziz
- Faculty of Computer Science and Engineering, Galala University, Suez 435611, Egypt
| | - Shaik Hashmitha Mohisin
- Department of Electrical and Electronics Engineering, National Institute of Technology Calicut, Kozhikode 673601, India
| | | |
Collapse
|
41
|
Pneumonia Detection in Chest X-Ray Images Using Enhanced Restricted Boltzmann Machine. JOURNAL OF HEALTHCARE ENGINEERING 2022; 2022:1678000. [PMID: 35991297 PMCID: PMC9391129 DOI: 10.1155/2022/1678000] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/14/2021] [Revised: 01/11/2022] [Accepted: 03/22/2022] [Indexed: 11/24/2022]
Abstract
The process of pneumonia detection has been the focus of researchers as it has proved itself to be one of the most dangerous and life-threatening disorders. In recent years, many machine learning and deep learning algorithms have been applied in an attempt to automate this process but none of them has been successful significantly to achieve the highest possible accuracy. In a similar attempt, we propose an enhanced approach of a deep learning model called restricted Boltzmann machine (RBM) which is named enhanced RBM (ERBM). One of the major drawbacks associated with the standard format of RBM is its random weight initialization which leads to improper feature learning of the model during the training phase, resulting in poor performance of the machine. This problem has been tried to eliminate in this work by finding the differences between the means of a specific feature vector and the means of all features given as inputs to the machine. By performing this process, the reconstruction of the actual features is increased which ultimately reduces the error generated during the training phase of the model. The developed model has been applied to three different datasets of pneumonia diseases and the results have been compared with other state of the art techniques using different performance evaluation parameters. The proposed model gave highest accuracy of 98.56% followed by standard RBM, SVM, KNN, and decision tree which gave accuracies of 97.53%, 92.62%, 91.64%, and 88.77%, respectively, for dataset named dataset 2. Similarly, for the dataset 1, the highest accuracy of 96.66 has been observed for the eRBM followed by srRBM, KNN, decision tree, and SVM which gave accuracies of 90.22%, 89.34%, 87.65%, and 86.55%, respectively. In the same way, the accuracies observed for the dataset 3 by eRBM, standard RBM, KNN, decision tree, and SVM are 92.45%, 90.98%, 87.54%, 85.49%, and 84.54%, respectively. Similar observations can also be seen for other performance parameters showing the efficiency of the proposed model. As revealed in the results obtained, a significant improvement has been observed in the working of the RBM by introducing a new method of weight initialization during the training phase. The results show that the improved model outperforms other models in terms of different performance evaluation parameters, namely, accuracy, sensitivity, specificity, F1-score, and ROC curve.
Collapse
|
42
|
Sharma A, Mishra PK. Image enhancement techniques on deep learning approaches for automated diagnosis of COVID-19 features using CXR images. MULTIMEDIA TOOLS AND APPLICATIONS 2022; 81:42649-42690. [PMID: 35938148 PMCID: PMC9340712 DOI: 10.1007/s11042-022-13486-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/30/2021] [Revised: 09/16/2021] [Accepted: 07/13/2022] [Indexed: 06/15/2023]
Abstract
The outbreak of novel coronavirus (COVID-19) disease has infected more than 135.6 million people globally. For its early diagnosis, researchers consider chest X-ray examinations as a standard screening technique in addition to RT-PCR test. Majority of research work till date focused only on application of deep learning approaches that is relevant but lacking in better pre-processing of CXR images. Towards this direction, this study aims to explore cumulative effects of image denoising and enhancement approaches on the performance of deep learning approaches. Regarding pre-processing, suitable methods for X-ray images, Histogram equalization, CLAHE and gamma correction have been tested individually and along with adaptive median filter, median filter, total variation filter and gaussian denoising filters. Proposed study compared eleven combinations in exploration of most coherent approach in greedy manner. For more robust analysis, we compared ten CNN architectures for performance evaluation with and without enhancement approaches. These models are InceptionV3, InceptionResNetV2, MobileNet, MobileNetV2, Vgg19, NASNetMobile, ResNet101, DenseNet121, DenseNet169, DenseNet201. These models are trained in 4-way (COVID-19 pneumonia vs Viral vs Bacterial pneumonia vs Normal) and 3-way classification scenario (COVID-19 vs Pneumonia vs Normal) on two benchmark datasets. The proposed methodology determines with TVF + Gamma, models achieve higher classification accuracy and sensitivity. In 4-way classification MobileNet with TVF + Gamma achieves top accuracy of 93.25% with 1.91% improvement in accuracy score, COVID-19 sensitivity of 98.72% and F1-score of 92.14%. In 3-way classification our DenseNet201 with TVF + Gamma gains accuracy of 91.10% with improvement of 1.47%, COVID-19 sensitivity of 100% and F1-score of 91.09%. Proposed study concludes that deep learning modes with gamma correction and TVF + Gamma has superior performance compared to state-of-the-art models. This not only minimizes overlapping between COVID-19 and virus pneumonia but advantageous in time required to converge best possible results.
Collapse
Affiliation(s)
- Ajay Sharma
- Department of Computer Science, Institute of Science, Banaras Hindu University, Varanasi, 221005 India
| | - Pramod Kumar Mishra
- Department of Computer Science, Institute of Science, Banaras Hindu University, Varanasi, 221005 India
| |
Collapse
|
43
|
Non-iterative learning machine for identifying CoViD19 using chest X-ray images. Sci Rep 2022; 12:11880. [PMID: 35831332 PMCID: PMC9279431 DOI: 10.1038/s41598-022-15268-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2021] [Accepted: 06/21/2022] [Indexed: 11/24/2022] Open
Abstract
CoViD19 is a novel disease which has created panic worldwide by infecting millions of people around the world. The last significant variant of this virus, called as omicron, contributed to majority of cases in the third wave across globe. Though lesser in severity as compared to its predecessor, the delta variant, this mutation has shown higher communicable rate. This novel virus with symptoms of pneumonia is dangerous as it is communicable and hence, has engulfed entire world in a very short span of time. With the help of machine learning techniques, entire process of detection can be automated so that direct contacts can be avoided. Therefore, in this paper, experimentation is performed on CoViD19 chest X-ray images using higher order statistics with iterative and non-iterative models. Higher order statistics provide a way of analyzing the disturbances in the chest X-ray images. The results obtained are quite good with 96.64% accuracy using a non-iterative model. For fast testing of the patients, non-iterative model is preferred because it has advantage over iterative model in terms of speed. Comparison with some of the available state-of-the-art methods and some iterative methods proves efficacy of the work.
Collapse
|
44
|
Saha P, Neogy S. Concat_CNN: A Model to Detect COVID-19 from Chest X-ray Images with Deep Learning. SN COMPUTER SCIENCE 2022; 3:305. [PMID: 35647557 PMCID: PMC9125955 DOI: 10.1007/s42979-022-01182-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/02/2021] [Accepted: 04/27/2022] [Indexed: 12/15/2022]
Abstract
COVID-19 is creating havoc on the lives of human beings all around the world. It continues to affect the normal lives of people. As number of cases are high, a cost effective and fast system is required to detect COVID-19 at appropriate time to provide the necessary healthcare. Chest X-rays have emerged as an easiest way to detect COVID-19 in no time as RT-PCR takes time to detect the infection. In this paper we propose a concatenation-based CNN model that will detect COVID-19 from chest X-rays. We have developed a multiclass classification problem which can detect and classify a chest X-ray image as either COVID + ve, or viral pneumonia, or normal. We have used chest X-rays collected from different open sources. To maintain class balancing, we took 500 images of COVID, 500 normal images, and 500 pneumonia images. We divided our dataset in training, validation, and test set in 70:10:20 ratio respectively. We used four CNNs as feature extractors from the images and concatenated their feature maps to get better efficiency of the network. After training our model for 5 folds, we have obtained around 96.31% accuracy, 95.8% precision, 92.99% recall, and 98.02% AUC. We have compared our work with state-of-the-art pretrained transfer learning algorithms and other state-of-the-art CNN models referred in different research papers. The proposed model (Concat_CNN) exhibits better accuracy than the state-of-the-art models. We hope our proposed model will help to classify chest X-rays effectively and help medical professionals with their treatment.
Collapse
Affiliation(s)
- Priyanka Saha
- Depatment of Computer Science and Engineering, Jadavpur University, Kolkata, 700032 India
| | - Sarmistha Neogy
- Depatment of Computer Science and Engineering, Jadavpur University, Kolkata, 700032 India
| |
Collapse
|
45
|
Mannepalli DP, Namdeo V. An effective detection of COVID-19 using adaptive dual-stage horse herd bidirectional long short-term memory framework. INTERNATIONAL JOURNAL OF IMAGING SYSTEMS AND TECHNOLOGY 2022; 32:1049-1067. [PMID: 35937036 PMCID: PMC9347606 DOI: 10.1002/ima.22747] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/17/2021] [Revised: 04/05/2022] [Accepted: 04/22/2022] [Indexed: 05/08/2023]
Abstract
COVID-19 is a quickly increasing severe viral disease that affects the human beings as well as animals. The increasing amount of infection and death due to COVID-19 needs timely detection. This work presented an innovative deep learning methodology for the prediction of COVID-19 patients with chest x-ray images. Chest x-ray is the most effective imaging technique for predicting the lung associated diseases. An effective approach with adaptive dual-stage horse herd bidirectional LSTM model is presented for the classification of images into normal, lung opacity, viral pneumonia, and COVID-19. Initially, the input images are preprocessed using modified histogram equalization approach. This is utilized to improve the contrast of the images by changing low-resolution images into high-resolution images. Subsequently, an extended dual tree complex wavelet with trigonometric transform is introduced to extract the high-density features to decrease the complexity of features. Moreover, the dimensionality of the features reduced by adaptive beetle antennae search optimization is utilized. This approach enhances the performance of disease classification by reducing the computational complexity. Finally, an adaptive dual-stage horse herd bidirectional LSTM model is utilized for the classification of images into normal, viral pneumonia, lung opacity, and COVID-19. The implementation platform used in the work is PYTHON. The performance of the presented approach is proved by comparing with the existing approaches in accuracy (99.07%), sensitivity (97.6%), F-measure (97.1%), specificity (99.36%), kappa coefficient (97.7%), precision (98.56%), and area under the receiver operating characteristic curve (99%) for COVID-19 chest x-ray database.
Collapse
Affiliation(s)
- Durga Prasad Mannepalli
- Department of Computer Science and EngineeringSarvepalli Radhakrishna UniversityBhopalMadhya PradeshIndia
| | - Varsha Namdeo
- Department of Computer Science and EngineeringSarvepalli Radhakrishna UniversityBhopalMadhya PradeshIndia
| |
Collapse
|
46
|
Qu Y, Meng Y, Fan H, Xu RX. Low-cost thermal imaging with machine learning for non-invasive diagnosis and therapeutic monitoring of pneumonia. INFRARED PHYSICS & TECHNOLOGY 2022; 123:104201. [PMID: 35599723 PMCID: PMC9106596 DOI: 10.1016/j.infrared.2022.104201] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/09/2021] [Revised: 05/01/2022] [Accepted: 05/01/2022] [Indexed: 06/15/2023]
Abstract
Rapid screening and early treatment of lung infection are essential for effective control of many epidemics such as Coronavirus Disease 2019 (COVID-19). Recent studies have demonstrated the potential correlation between lung infection and the change of back skin temperature distribution. Based on these findings, we propose to use low-cost, portable and rapid thermal imaging in combination with image-processing algorithms and machine learning analysis for non-invasive and safe detection of pneumonia. The proposed method was tested in 69 subjects (30 normal adults, 11 cases of fever without pneumonia, 19 cases of general pneumonia and 9 cases of COVID-19) where both RGB and thermal images were acquired from the back of each subject. The acquired images were processed automatically in order to extract multiple location and shape features that distinguish normal subjects from pneumonia patients at a high accuracy of 93 % . Furthermore, daily assessment of two pneumonia patients by the proposed method accurately predicted the clinical outcomes, coincident with those of laboratory tests. Our pilot study demonstrated the technical feasibility of portable and intelligent thermal imaging for screening and therapeutic assessment of pneumonia. The method can be potentially implemented in under-resourced regions for more effective control of respiratory epidemics.
Collapse
Affiliation(s)
- Yingjie Qu
- Department of Intelligence Science and Technology, Anhui Polytechnic University, Wuhu, Anhui 241000, China
| | - Yuquan Meng
- Department of Mechanical Science and Engineering, University of Illinois at Urbana-Champaign, Urbana, IL 61801, USA
| | - Hua Fan
- Department of Hepatobiliary Surgery, The First Affiliated Hospital of University of Science and Technology of China, Hefei, Anhui 230036, China
| | - Ronald X Xu
- Suzhou Institute for Advanced Research, University of Science and Technology of China, Suzhou, Jiangshu 215009, China
| |
Collapse
|
47
|
Kong L, Cheng J. Classification and Detection of COVID-19 X-Ray Images based on DenseNet and VGG16 Feature Fusion. Biomed Signal Process Control 2022; 77:103772. [PMID: 35573817 PMCID: PMC9080057 DOI: 10.1016/j.bspc.2022.103772] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/02/2022] [Revised: 04/22/2022] [Accepted: 04/27/2022] [Indexed: 12/12/2022]
Abstract
Since December 2019, the novel coronavirus disease (COVID-19) caused by the syndrome coronavirus 2 (SARS-CoV-2) strain has spread widely around the world and has become a serious global public health problem. For this high-speed infectious disease, the application of X-ray to chest diagnosis plays a key role. In this study, we propose a chest X-ray image classification method based on feature fusion of a dense convolutional network (DenseNet) and a visual geometry group network (VGG16). This paper adds an attention mechanism (global attention machine block and category attention block) to the model to extract deep features. A residual network (ResNet) is used to segment effective image information to quickly achieve accurate classification. The average accuracy of our model in detecting binary classification can reach 98.0%. The average accuracy for three category classification can reach 97.3%. The experimental results show that the proposed model has good results in this work. Therefore, the use of deep learning and feature fusion technology in the classification of chest X-ray images can become an auxiliary tool for clinicians and radiologists.
Collapse
Affiliation(s)
- Lingzhi Kong
- School of Computer Science and Technology, Qilu University of Technology (Shandong Academy of Sciences), Jinan 250000, China
| | - Jinyong Cheng
- School of Computer Science and Technology, Qilu University of Technology (Shandong Academy of Sciences), Jinan 250000, China
| |
Collapse
|
48
|
Deep features to detect pulmonary abnormalities in chest X-rays due to infectious diseaseX: Covid-19, pneumonia, and tuberculosis. Inf Sci (N Y) 2022; 592:389-401. [DOI: 10.1016/j.ins.2022.01.062] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/16/2021] [Revised: 01/28/2022] [Accepted: 01/30/2022] [Indexed: 12/12/2022]
|
49
|
Awassa L, Jdey I, Dhahri H, Hcini G, Mahmood A, Othman E, Haneef M. Study of Different Deep Learning Methods for Coronavirus (COVID-19) Pandemic: Taxonomy, Survey and Insights. SENSORS (BASEL, SWITZERLAND) 2022; 22:1890. [PMID: 35271037 PMCID: PMC8915023 DOI: 10.3390/s22051890] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/05/2022] [Revised: 02/12/2022] [Accepted: 02/21/2022] [Indexed: 12/15/2022]
Abstract
COVID-19 has evolved into one of the most severe and acute illnesses. The number of deaths continues to climb despite the development of vaccines and new strains of the virus have appeared. The early and precise recognition of COVID-19 are key in viably treating patients and containing the pandemic on the whole. Deep learning technology has been shown to be a significant tool in diagnosing COVID-19 and in assisting radiologists to detect anomalies and numerous diseases during this epidemic. This research seeks to provide an overview of novel deep learning-based applications for medical imaging modalities, computer tomography (CT) and chest X-rays (CXR), for the detection and classification COVID-19. First, we give an overview of the taxonomy of medical imaging and present a summary of types of deep learning (DL) methods. Then, utilizing deep learning techniques, we present an overview of systems created for COVID-19 detection and classification. We also give a rundown of the most well-known databases used to train these networks. Finally, we explore the challenges of using deep learning algorithms to detect COVID-19, as well as future research prospects in this field.
Collapse
Affiliation(s)
- Lamia Awassa
- Faculty of Sciences and Technology of Sidi Bouzid, University of Kairouan, Kairouan 3100, Tunisia; (L.A.); (I.J.); (G.H.)
| | - Imen Jdey
- Faculty of Sciences and Technology of Sidi Bouzid, University of Kairouan, Kairouan 3100, Tunisia; (L.A.); (I.J.); (G.H.)
| | - Habib Dhahri
- Faculty of Sciences and Technology of Sidi Bouzid, University of Kairouan, Kairouan 3100, Tunisia; (L.A.); (I.J.); (G.H.)
- Department of Information Science, College of Applied Computer Sciences, King Saud University, Riyadh 11451, Saudi Arabia; (A.M.); (E.O.)
| | - Ghazala Hcini
- Faculty of Sciences and Technology of Sidi Bouzid, University of Kairouan, Kairouan 3100, Tunisia; (L.A.); (I.J.); (G.H.)
| | - Awais Mahmood
- Department of Information Science, College of Applied Computer Sciences, King Saud University, Riyadh 11451, Saudi Arabia; (A.M.); (E.O.)
| | - Esam Othman
- Department of Information Science, College of Applied Computer Sciences, King Saud University, Riyadh 11451, Saudi Arabia; (A.M.); (E.O.)
| | - Muhammad Haneef
- Department of Electrical Engineering, Foundation University Islamabad, Islamabad 44000, Pakistan;
| |
Collapse
|
50
|
Mannepalli DP, Namdeo V. A cad system design based on HybridMultiscale convolutional Mantaray network for pneumonia diagnosis. MULTIMEDIA TOOLS AND APPLICATIONS 2022; 81:12857-12881. [PMID: 35221779 PMCID: PMC8863100 DOI: 10.1007/s11042-022-12547-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/01/2021] [Revised: 08/02/2021] [Accepted: 01/31/2022] [Indexed: 06/14/2023]
Abstract
Pneumonia is one of the diseases that people may encounter in any period of their lives. Recently, researches and developers all around the world are focussing on deep learning and image processing strategies to quicken the pneumonia diagnosis as those strategies are capable of processing numerous X-ray and computed tomography (CT) images. Clinicians need more time and appropriate experiences for making a diagnosis. Hence, a precise, reckless, and less expensive tool to detect pneumonia is necessary. Thus, this research focuses on classifying the pneumonia chest X-ray images by proposing a very efficient stacked approach to improve the image quality and hybridmultiscale convolutional mantaray feature extraction network model with high accuracy. The input dataset is restructured with the sake of a hybrid fuzzy colored and stacking approach. Then the deep feature extraction stage is processed with the aid of stacking dataset by hybrid multiscale feature extraction unit to extract multiple features. Also, the features and network size are diminished by the self-attention module (SAM) based convolutional neural network (CNN). In addition to this, the error in the proposed network model will get reduced with the aid of adaptivemantaray foraging optimization (AMRFO) approach. Finally, the support vector regression (SVR) is suggested to classify the presence of pneumonia. The proposed module has been compared with existing technique to prove the overall efficiency of the system. The huge collection of chest X-ray images from the kaggle dataset was emphasized to validate the proposed work. The experimental results reveal an outstanding performance of accuracy (97%), precision (95%) and f-score (96%) progressively.
Collapse
Affiliation(s)
- Durga Prasad Mannepalli
- Research Scholar, Department of Computer Science & Engineering, Sarvepalli Radhakrishnan University, Bhopal, Madhya Pradesh India
| | - Varsha Namdeo
- Department of Computer Science & Engineering, Sarvepalli Radhakrishnan University, Bhopal, Madhya Pradesh India
| |
Collapse
|