1
|
Ou CC, Liu YC, Lin KP, Yen TH, Huang WN. Classification method for nailfold capillary images using an optimized sugeno fuzzy ensemble of convolutional neural networks. Comput Biol Med 2025; 189:109975. [PMID: 40054169 DOI: 10.1016/j.compbiomed.2025.109975] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2024] [Revised: 02/27/2025] [Accepted: 03/03/2025] [Indexed: 04/01/2025]
Abstract
This study developed a novel binary classification method for analyzing nailfold capillary images associated with the risk of developing sclerosis. The proposed approach combined a Sugeno fuzzy integral inference system with an ensemble of convolutional neural networks (CNNs), including GoogLeNet, ResNet, and DenseNet. Nailfold capillary images are highly valuable for diagnosing and monitoring various systemic diseases. They can reveal early indicators of systemic sclerosis, such as capillary enlargement, loss, or hemorrhages. The study obtained nailfold capillary images from a hospital in Taiwan, with 80 % allocated for model training and the remaining 20 % reserved for testing purposes. The proposed method achieved a high performance with an accuracy of 85 %, a recall of 81.82 %, a precision of 90 %, and an F1 score of 85.17 %. In comparison, individual CNN models (GoogLeNet, ResNet, and DenseNet) achieved accuracies of 73.33 %, 67.96 %, and 70.83 %, respectively. These results demonstrate that the proposed integrated method outperforms single-model approaches in classifying nailfold capillary images more accurately and efficiency. Using CNN models as a novel application opens new avenues for research in related image analysis fields.
Collapse
Affiliation(s)
- Chiao-Chi Ou
- Department of Industrial Engineering and Enterprise Information, Tunghai University, Taichung City, Taiwan; Department of Medical Research, Taichung Veterans General Hospital, Taichung, Taiwan; Division of Allergy, Immunology, and Rheumatology, Department of Internal Medicine, Taichung Veterans General Hospital, No.1650, Sec. 4, Taiwan Blvd., Xitun Dist., Taichung City, Taiwan.
| | - Yun-Chi Liu
- Department of Industrial Engineering and Enterprise Information, Tunghai University, Taichung City, Taiwan.
| | - Kuo-Ping Lin
- Department of Industrial Engineering and Enterprise Information, Tunghai University, Taichung City, Taiwan; School of Accounting, University of Economics Ho Chi Minh City, Ho Chi Minh City, Viet Nam.
| | - Tsai-Hung Yen
- Division of Allergy, Immunology, and Rheumatology, Department of Internal Medicine, Taichung Veterans General Hospital, No.1650, Sec. 4, Taiwan Blvd., Xitun Dist., Taichung City, Taiwan; Division of General Medicine, Department of Internal Medicine, Taichung Veterans General Hospital, Taichung, Taiwan.
| | - Wen-Nan Huang
- Division of Allergy, Immunology, and Rheumatology, Department of Internal Medicine, Taichung Veterans General Hospital, No.1650, Sec. 4, Taiwan Blvd., Xitun Dist., Taichung City, Taiwan; School of Medical, College of Medicine, National Yang Ming Chiao Tung University, Taipei, Taiwan; Department of Post-Baccalaureate Medicine, College of Medicine, National Chung Hsing University, Taichung, Taiwan.
| |
Collapse
|
2
|
Öztürk D, Aydoğan S, Kök İ, Akın Bülbül I, Özdemir S, Özdemir S, Akay D. Linguistic summarization of visual attention and developmental functioning of young children with autism spectrum disorder. Health Inf Sci Syst 2024; 12:39. [PMID: 39022602 PMCID: PMC11252111 DOI: 10.1007/s13755-024-00297-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/29/2023] [Accepted: 07/06/2024] [Indexed: 07/20/2024] Open
Abstract
Diagnosing autism spectrum disorder (ASD) in children poses significant challenges due to its complex nature and impact on social communication development. While numerous data analytics techniques have been proposed for ASD evaluation, the process remains time-consuming and lacks clarity. Eye tracking (ET) data has emerged as a valuable resource for ASD risk assessment, yet existing literature predominantly focuses on predictive methods rather than descriptive techniques that offer human-friendly insights. Interpretation of ET data and Bayley scales, a widely used assessment tool, is challenging for ASD assessment of children. It should be understood clearly to perform better analytic tasks on ASD screening. Therefore, this study addresses this gap by employing linguistic summarization techniques to generate easily understandable summaries from raw ET data and Bayley scales. By integrating ET data and Bayley scores, the study aims to improve the identification of children with ASD from typically developing children (TD). Notably, this research represents one of the pioneering efforts to linguistically summarize ET data alongside Bayley scales, presenting comparative results between children with ASD and TD. Through linguistic summarization, this study facilitates the creation of simple, natural language statements, offering a first and unique approach to enhance ASD screening and contribute to our understanding of neurodevelopmental disorders.
Collapse
Affiliation(s)
- Demet Öztürk
- Department of Industrial Engineering, Gazi University, Ankara, Turkey
| | - Sena Aydoğan
- Department of Industrial Engineering, Gazi University, Ankara, Turkey
| | - İbrahim Kök
- Department of Computer Engineering, Pamukkale University, Denizli, Turkey
| | - Işık Akın Bülbül
- Department of Special Education, Gazi University, Ankara, Turkey
| | - Selda Özdemir
- Department of Special Education, Hacettepe University, Ankara, Turkey
| | - Suat Özdemir
- Department of Computer Engineering, Hacettepe University, Ankara, Turkey
| | - Diyar Akay
- Department of Industrial Engineering, Hacettepe University, Ankara, Turkey
| |
Collapse
|
3
|
Hao B, Hu Y, Adams WG, Assoumou SA, Hsu HE, Bhadelia N, Paschalidis IC. A GPT-based EHR modeling system for unsupervised novel disease detection. J Biomed Inform 2024; 157:104706. [PMID: 39121932 PMCID: PMC12067473 DOI: 10.1016/j.jbi.2024.104706] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2024] [Revised: 07/17/2024] [Accepted: 08/06/2024] [Indexed: 08/12/2024]
Abstract
OBJECTIVE To develop an Artificial Intelligence (AI)-based anomaly detection model as a complement of an "astute physician" in detecting novel disease cases in a hospital and preventing emerging outbreaks. METHODS Data included hospitalized patients (n = 120,714) at a safety-net hospital in Massachusetts. A novel Generative Pre-trained Transformer (GPT)-based clinical anomaly detection system was designed and further trained using Empirical Risk Minimization (ERM), which can model a hospitalized patient's Electronic Health Records (EHR) and detect atypical patients. Methods and performance metrics, similar to the ones behind the recent Large Language Models (LLMs), were leveraged to capture the dynamic evolution of the patient's clinical variables and compute an Out-Of-Distribution (OOD) anomaly score. RESULTS In a completely unsupervised setting, hospitalizations for Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2) infection could have been predicted by our GPT model at the beginning of the COVID-19 pandemic, with an Area Under the Receiver Operating Characteristic Curve (AUC) of 92.2 %, using 31 extracted clinical variables and a 3-day detection window. Our GPT achieves individual patient-level anomaly detection and mortality prediction AUC of 78.3 % and 94.7 %, outperforming traditional linear models by 6.6 % and 9 %, respectively. Different types of clinical trajectories of a SARS-CoV-2 infection are captured by our model to make interpretable detections, while a trend of over-pessimistic outcome prediction yields a more effective detection pathway. Furthermore, our comprehensive GPT model can potentially assist clinicians with forecasting patient clinical variables and developing personalized treatment plans. CONCLUSION This study demonstrates that an emerging outbreak can be accurately detected within a hospital, by using a GPT to model patient EHR time sequences and labeling them as anomalous when actual outcomes are not supported by the model. Such a GPT is also a comprehensive model with the functionality of generating future patient clinical variables, which can potentially assist clinicians in developing personalized treatment plans.
Collapse
Affiliation(s)
- Boran Hao
- Department of Electrical and Computer Engineering, Boston University, Boston, MA, USA
| | - Yang Hu
- Department of Electrical and Computer Engineering, Boston University, Boston, MA, USA
| | - William G Adams
- Department of Pediatrics, Boston Medical Center, Boston, MA, USA; Chobanian & Avedisian School of Medicine, Boston University, Boston, MA, USA
| | - Sabrina A Assoumou
- Department of Medicine, Boston Medical Center, Boston, MA, USA; Chobanian & Avedisian School of Medicine, Boston University, Boston, MA, USA
| | - Heather E Hsu
- Department of Pediatrics, Boston Medical Center, Boston, MA, USA; Chobanian & Avedisian School of Medicine, Boston University, Boston, MA, USA
| | - Nahid Bhadelia
- Chobanian & Avedisian School of Medicine, Boston University, Boston, MA, USA; Center for Emerging Infectious Diseases Policy and Research, Boston University, Boston, MA, USA
| | - Ioannis Ch Paschalidis
- Department of Electrical and Computer Engineering, Boston University, Boston, MA, USA; Department of Biomedical Engineering, Division of Systems Engineering, Faculty of Computing & Data Sciences, and Hariri Institute for Computing and Computational Science & Engineering, Boston University, Boston, MA, USA.
| |
Collapse
|
4
|
He F, Li G, Song H. Morphological classification of neurons based on Sugeno fuzzy integration and multi-classifier fusion. Sci Rep 2024; 14:16003. [PMID: 38992081 PMCID: PMC11239936 DOI: 10.1038/s41598-024-66797-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/29/2024] [Accepted: 07/04/2024] [Indexed: 07/13/2024] Open
Abstract
In order to extract more important morphological features of neuron images and achieve accurate classification of the neuron type, a method is proposed that uses Sugeno fuzzy integral integration of three optimized deep learning models, namely AlexNet, VGG11_bn, and ResNet-50. Firstly, using the pre-trained model of AlexNet and the output layer is fine-tuned to improve the model's performance. Secondly, in the VGG11_bn network, Global Average Pooling (GAP) is adopted to replace the traditional fully connected layer to reduce the number of parameters. Additionally, the generalization ability of the model is improved by transfer learning. Thirdly, the SE(squeeze and excitation) module is added to the ResNet-50 variant ResNeXt-50 to adjust the channel weight and capture the key information of the input data. The GELU activation function is used to better fit the data distribution. Finally, Sugeno fuzzy integral is used to fuse the output of each model to get the final classification result. The experimental results showed that on the Img_raw, Img_resample and Img_XYalign dataset, the accuracy of 4-category classification reached 98.04%, 91.75% and 93.13%, respectively, and the accuracy of 12-category classification reached 97.82%, 85.68% and 87.60%, respectively. The proposed method has good classification performance in the morphological classification of neurons.
Collapse
Affiliation(s)
- Fuyun He
- School of Electronic and Information Engineering, Guangxi Normal University, Guilin, 541004, China.
- Guangxi Key Laboratory of Brain-inspired Computing and Intelligent Chips, Guangxi Normal University, Guilin, 541004, China.
| | - Guanglian Li
- School of Electronic and Information Engineering, Guangxi Normal University, Guilin, 541004, China
| | - Haixing Song
- School of Electronic and Information Engineering, Guangxi Normal University, Guilin, 541004, China
| |
Collapse
|
5
|
Sahoo P, Sharma SK, Saha S, Jain D, Mondal S. A multistage framework for respiratory disease detection and assessing severity in chest X-ray images. Sci Rep 2024; 14:12380. [PMID: 38811599 PMCID: PMC11137152 DOI: 10.1038/s41598-024-60861-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/29/2023] [Accepted: 04/29/2024] [Indexed: 05/31/2024] Open
Abstract
Chest Radiography is a non-invasive imaging modality for diagnosing and managing chronic lung disorders, encompassing conditions such as pneumonia, tuberculosis, and COVID-19. While it is crucial for disease localization and severity assessment, existing computer-aided diagnosis (CAD) systems primarily focus on classification tasks, often overlooking these aspects. Additionally, prevalent approaches rely on class activation or saliency maps, providing only a rough localization. This research endeavors to address these limitations by proposing a comprehensive multi-stage framework. Initially, the framework identifies relevant lung areas by filtering out extraneous regions. Subsequently, an advanced fuzzy-based ensemble approach is employed to categorize images into specific classes. In the final stage, the framework identifies infected areas and quantifies the extent of infection in COVID-19 cases, assigning severity scores ranging from 0 to 3 based on the infection's severity. Specifically, COVID-19 images are classified into distinct severity levels, such as mild, moderate, severe, and critical, determined by the modified RALE scoring system. The study utilizes publicly available datasets, surpassing previous state-of-the-art works. Incorporating lung segmentation into the proposed ensemble-based classification approach enhances the overall classification process. This solution can be a valuable alternative for clinicians and radiologists, serving as a secondary reader for chest X-rays, reducing reporting turnaround times, aiding clinical decision-making, and alleviating the workload on hospital staff.
Collapse
Affiliation(s)
- Pranab Sahoo
- Department of Computer Science & Engineering, Indian Institute of Technology Patna, Patna, 801106, India.
| | | | - Sriparna Saha
- Department of Computer Science & Engineering, Indian Institute of Technology Patna, Patna, 801106, India
| | - Deepak Jain
- Mount Sinai Hospital and Icahn School of Medicine, New York, USA
| | - Samrat Mondal
- Department of Computer Science & Engineering, Indian Institute of Technology Patna, Patna, 801106, India
| |
Collapse
|
6
|
Tian Z, Cheng Y, Zhao S, Li R, Zhou J, Sun Q, Wang D. Deep learning radiomics-based prediction model of metachronous distant metastasis following curative resection for retroperitoneal leiomyosarcoma: a bicentric study. Cancer Imaging 2024; 24:52. [PMID: 38627828 PMCID: PMC11020328 DOI: 10.1186/s40644-024-00697-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2023] [Accepted: 03/29/2024] [Indexed: 04/19/2024] Open
Abstract
BACKGROUND Combining conventional radiomics models with deep learning features can result in superior performance in predicting the prognosis of patients with tumors; however, this approach has never been evaluated for the prediction of metachronous distant metastasis (MDM) among patients with retroperitoneal leiomyosarcoma (RLS). Thus, the purpose of this study was to develop and validate a preoperative contrast-enhanced computed tomography (CECT)-based deep learning radiomics model for predicting the occurrence of MDM in patients with RLS undergoing complete surgical resection. METHODS A total of 179 patients who had undergone surgery for the treatment of histologically confirmed RLS were retrospectively recruited from two tertiary sarcoma centers. Semantic segmentation features derived from a convolutional neural network deep learning model as well as conventional hand-crafted radiomics features were extracted from preoperative three-phase CECT images to quantify the sarcoma phenotypes. A conventional radiomics signature (RS) and a deep learning radiomics signature (DLRS) that incorporated hand-crafted radiomics and deep learning features were developed to predict the risk of MDM. Additionally, a deep learning radiomics nomogram (DLRN) was established to evaluate the incremental prognostic significance of the DLRS in combination with clinico-radiological predictors. RESULTS The comparison of the area under the curve (AUC) values in the external validation set, as determined by the DeLong test, demonstrated that the integrated DLRN, DLRS, and RS models all exhibited superior predictive performance compared with that of the clinical model (AUC 0.786 [95% confidence interval 0.649-0.923] vs. 0.822 [0.692-0.952] vs. 0.733 [0.573-0.892] vs. 0.511 [0.359-0.662]; both P < 0.05). The decision curve analyses graphically indicated that utilizing the DLRN for risk stratification provided greater net benefits than those achieved using the DLRS, RS and clinical models. Good alignment with the calibration curve indicated that the DLRN also exhibited good performance. CONCLUSIONS The novel CECT-based DLRN developed in this study demonstrated promising performance in the preoperative prediction of the risk of MDM following curative resection in patients with RLS. The DLRN, which outperformed the other three models, could provide valuable information for predicting surgical efficacy and tailoring individualized treatment plans in this patient population. TRIAL REGISTRATION Not applicable.
Collapse
Affiliation(s)
- Zhen Tian
- Northern Jiangsu People's Hospital, Clinical Teaching Hospital of Medical School, Nanjing University, Yangzhou, China
- Department of General Surgery, Northern Jiangsu People's Hospital, Yangzhou, China
| | - Yifan Cheng
- Northern Jiangsu People's Hospital, Clinical Teaching Hospital of Medical School, Nanjing University, Yangzhou, China
- Department of General Surgery, Northern Jiangsu People's Hospital, Yangzhou, China
| | - Shuai Zhao
- Northern Jiangsu People's Hospital, Clinical Teaching Hospital of Medical School, Nanjing University, Yangzhou, China
- Department of General Surgery, Northern Jiangsu People's Hospital, Yangzhou, China
| | - Ruiqi Li
- Northern Jiangsu People's Hospital, Clinical Teaching Hospital of Medical School, Nanjing University, Yangzhou, China
- Department of General Surgery, Northern Jiangsu People's Hospital, Yangzhou, China
| | - Jiajie Zhou
- Northern Jiangsu People's Hospital, Clinical Teaching Hospital of Medical School, Nanjing University, Yangzhou, China
- Department of General Surgery, Northern Jiangsu People's Hospital, Yangzhou, China
| | - Qiannan Sun
- Department of General Surgery, Northern Jiangsu People's Hospital, Yangzhou, China
- General Surgery Institute of Yangzhou, Yangzhou University, Yangzhou, China
| | - Daorong Wang
- Northern Jiangsu People's Hospital, Clinical Teaching Hospital of Medical School, Nanjing University, Yangzhou, China.
- Department of General Surgery, Northern Jiangsu People's Hospital, Yangzhou, China.
- General Surgery Institute of Yangzhou, Yangzhou University, Yangzhou, China.
- Yangzhou Key Laboratory of Basic and Clinical Transformation of Digestive and Metabolic Diseases, Yangzhou, China.
| |
Collapse
|
7
|
Li Y, Sadée CY, Carrillo-Perez F, Selby HM, Thieme AH, Gevaert O. A 3D lung lesion variational autoencoder. CELL REPORTS METHODS 2024; 4:100695. [PMID: 38278157 PMCID: PMC10921017 DOI: 10.1016/j.crmeth.2024.100695] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/12/2023] [Revised: 12/15/2023] [Accepted: 12/29/2023] [Indexed: 01/28/2024]
Abstract
In this study, we develop a 3D beta variational autoencoder (beta-VAE) to advance lung cancer imaging analysis, countering the constraints of conventional radiomics methods. The autoencoder extracts information from public lung computed tomography (CT) datasets without additional labels. It reconstructs 3D lung nodule images with high quality (structural similarity: 0.774, peak signal-to-noise ratio: 26.1, and mean-squared error: 0.0008). The model effectively encodes lesion sizes in its latent embeddings, with a significant correlation with lesion size found after applying uniform manifold approximation and projection (UMAP) for dimensionality reduction. Additionally, the beta-VAE can synthesize new lesions of varying sizes by manipulating the latent features. The model can predict multiple clinical endpoints, including pathological N stage or KRAS mutation status, on the Stanford radiogenomics lung cancer dataset. Comparisons with other methods show that the beta-VAE performs equally well in these tasks, suggesting its potential as a pretrained model for predicting patient outcomes in medical imaging.
Collapse
Affiliation(s)
- Yiheng Li
- Stanford Center for Biomedical Informatics Research (BMIR), Department of Medicine, Stanford University, Stanford, CA 94305, USA
| | - Christoph Y Sadée
- Stanford Center for Biomedical Informatics Research (BMIR), Department of Medicine, Stanford University, Stanford, CA 94305, USA
| | - Francisco Carrillo-Perez
- Stanford Center for Biomedical Informatics Research (BMIR), Department of Medicine, Stanford University, Stanford, CA 94305, USA; Department of Architecture and Computer Technology (ATC), University of Granada, C. Periodista Daniel Saucedo Aranda, s/n, Granada, 18014 Granada, Spain
| | - Heather M Selby
- Stanford Center for Biomedical Informatics Research (BMIR), Department of Medicine, Stanford University, Stanford, CA 94305, USA
| | - Alexander H Thieme
- Stanford Center for Biomedical Informatics Research (BMIR), Department of Medicine, Stanford University, Stanford, CA 94305, USA
| | - Olivier Gevaert
- Stanford Center for Biomedical Informatics Research (BMIR), Department of Medicine, Stanford University, Stanford, CA 94305, USA; Department of Biomedical Data Science, Stanford University, Stanford, CA 94305, USA.
| |
Collapse
|
8
|
Santosh KC, GhoshRoy D, Nakarmi S. A Systematic Review on Deep Structured Learning for COVID-19 Screening Using Chest CT from 2020 to 2022. Healthcare (Basel) 2023; 11:2388. [PMID: 37685422 PMCID: PMC10486542 DOI: 10.3390/healthcare11172388] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/12/2023] [Revised: 08/16/2023] [Accepted: 08/22/2023] [Indexed: 09/10/2023] Open
Abstract
The emergence of the COVID-19 pandemic in Wuhan in 2019 led to the discovery of a novel coronavirus. The World Health Organization (WHO) designated it as a global pandemic on 11 March 2020 due to its rapid and widespread transmission. Its impact has had profound implications, particularly in the realm of public health. Extensive scientific endeavors have been directed towards devising effective treatment strategies and vaccines. Within the healthcare and medical imaging domain, the application of artificial intelligence (AI) has brought significant advantages. This study delves into peer-reviewed research articles spanning the years 2020 to 2022, focusing on AI-driven methodologies for the analysis and screening of COVID-19 through chest CT scan data. We assess the efficacy of deep learning algorithms in facilitating decision making processes. Our exploration encompasses various facets, including data collection, systematic contributions, emerging techniques, and encountered challenges. However, the comparison of outcomes between 2020 and 2022 proves intricate due to shifts in dataset magnitudes over time. The initiatives aimed at developing AI-powered tools for the detection, localization, and segmentation of COVID-19 cases are primarily centered on educational and training contexts. We deliberate on their merits and constraints, particularly in the context of necessitating cross-population train/test models. Our analysis encompassed a review of 231 research publications, bolstered by a meta-analysis employing search keywords (COVID-19 OR Coronavirus) AND chest CT AND (deep learning OR artificial intelligence OR medical imaging) on both the PubMed Central Repository and Web of Science platforms.
Collapse
Affiliation(s)
- KC Santosh
- 2AI: Applied Artificial Intelligence Research Lab, Vermillion, SD 57069, USA
| | - Debasmita GhoshRoy
- School of Automation, Banasthali Vidyapith, Tonk 304022, Rajasthan, India;
| | - Suprim Nakarmi
- Department of Computer Science, University of South Dakota, Vermillion, SD 57069, USA;
| |
Collapse
|
9
|
Soni S, Seal A, Mohanty SK, Sakurai K. Electroencephalography signals-based sparse networks integration using a fuzzy ensemble technique for depression detection. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2023.104873] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/29/2023]
|
10
|
Chattopadhyay S, Singh PK, Ijaz MF, Kim S, Sarkar R. SnapEnsemFS: a snapshot ensembling-based deep feature selection model for colorectal cancer histological analysis. Sci Rep 2023; 13:9937. [PMID: 37336964 PMCID: PMC10279666 DOI: 10.1038/s41598-023-36921-8] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/03/2023] [Accepted: 06/12/2023] [Indexed: 06/21/2023] Open
Abstract
Colorectal cancer is the third most common type of cancer diagnosed annually, and the second leading cause of death due to cancer. Early diagnosis of this ailment is vital for preventing the tumours to spread and plan treatment to possibly eradicate the disease. However, population-wide screening is stunted by the requirement of medical professionals to analyse histological slides manually. Thus, an automated computer-aided detection (CAD) framework based on deep learning is proposed in this research that uses histological slide images for predictions. Ensemble learning is a popular strategy for fusing the salient properties of several models to make the final predictions. However, such frameworks are computationally costly since it requires the training of multiple base learners. Instead, in this study, we adopt a snapshot ensemble method, wherein, instead of the traditional method of fusing decision scores from the snapshots of a Convolutional Neural Network (CNN) model, we extract deep features from the penultimate layer of the CNN model. Since the deep features are extracted from the same CNN model but for different learning environments, there may be redundancy in the feature set. To alleviate this, the features are fed into Particle Swarm Optimization, a popular meta-heuristic, for dimensionality reduction of the feature space and better classification. Upon evaluation on a publicly available colorectal cancer histology dataset using a five-fold cross-validation scheme, the proposed method obtains a highest accuracy of 97.60% and F1-Score of 97.61%, outperforming existing state-of-the-art methods on the same dataset. Further, qualitative investigation of class activation maps provide visual explainability to medical practitioners, as well as justifies the use of the CAD framework in screening of colorectal histology. Our source codes are publicly accessible at: https://github.com/soumitri2001/SnapEnsemFS .
Collapse
Affiliation(s)
- Soumitri Chattopadhyay
- Department of Information Technology, Jadavpur University, Jadavpur University Second Campus, Plot No. 8, Salt Lake Bypass, LB Block, Sector III, Salt Lake City, Kolkata, 700106, West Bengal, India
| | - Pawan Kumar Singh
- Department of Information Technology, Jadavpur University, Jadavpur University Second Campus, Plot No. 8, Salt Lake Bypass, LB Block, Sector III, Salt Lake City, Kolkata, 700106, West Bengal, India
| | - Muhammad Fazal Ijaz
- Department of Mechanical Engineering, Faculty of Engineering and Information Technology, The University of Melbourne, Grattam Street, Parkville, VIC, 3010, Australia.
| | - SeongKi Kim
- National Centre of Excellence in Software, Sangmyung University, Seoul, 03016, Korea.
| | - Ram Sarkar
- Department of Computer Science & Engineering, Jadavpur University, Kolkata, 700032, India
| |
Collapse
|
11
|
Dubey AK, Chabert GL, Carriero A, Pasche A, Danna PSC, Agarwal S, Mohanty L, Nillmani, Sharma N, Yadav S, Jain A, Kumar A, Kalra MK, Sobel DW, Laird JR, Singh IM, Singh N, Tsoulfas G, Fouda MM, Alizad A, Kitas GD, Khanna NN, Viskovic K, Kukuljan M, Al-Maini M, El-Baz A, Saba L, Suri JS. Ensemble Deep Learning Derived from Transfer Learning for Classification of COVID-19 Patients on Hybrid Deep-Learning-Based Lung Segmentation: A Data Augmentation and Balancing Framework. Diagnostics (Basel) 2023; 13:1954. [PMID: 37296806 PMCID: PMC10252539 DOI: 10.3390/diagnostics13111954] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2023] [Revised: 05/22/2023] [Accepted: 05/29/2023] [Indexed: 06/12/2023] Open
Abstract
BACKGROUND AND MOTIVATION Lung computed tomography (CT) techniques are high-resolution and are well adopted in the intensive care unit (ICU) for COVID-19 disease control classification. Most artificial intelligence (AI) systems do not undergo generalization and are typically overfitted. Such trained AI systems are not practical for clinical settings and therefore do not give accurate results when executed on unseen data sets. We hypothesize that ensemble deep learning (EDL) is superior to deep transfer learning (TL) in both non-augmented and augmented frameworks. METHODOLOGY The system consists of a cascade of quality control, ResNet-UNet-based hybrid deep learning for lung segmentation, and seven models using TL-based classification followed by five types of EDL's. To prove our hypothesis, five different kinds of data combinations (DC) were designed using a combination of two multicenter cohorts-Croatia (80 COVID) and Italy (72 COVID and 30 controls)-leading to 12,000 CT slices. As part of generalization, the system was tested on unseen data and statistically tested for reliability/stability. RESULTS Using the K5 (80:20) cross-validation protocol on the balanced and augmented dataset, the five DC datasets improved TL mean accuracy by 3.32%, 6.56%, 12.96%, 47.1%, and 2.78%, respectively. The five EDL systems showed improvements in accuracy of 2.12%, 5.78%, 6.72%, 32.05%, and 2.40%, thus validating our hypothesis. All statistical tests proved positive for reliability and stability. CONCLUSION EDL showed superior performance to TL systems for both (a) unbalanced and unaugmented and (b) balanced and augmented datasets for both (i) seen and (ii) unseen paradigms, validating both our hypotheses.
Collapse
Affiliation(s)
- Arun Kumar Dubey
- Bharati Vidyapeeth’s College of Engineering, New Delhi 110063, India
| | - Gian Luca Chabert
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), 09123 Cagliari, Italy
| | - Alessandro Carriero
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), 09123 Cagliari, Italy
| | - Alessio Pasche
- Department of Radiology, “Maggiore della Carità” Hospital, University of Piemonte Orientale, Via Solaroli 17, 28100 Novara, Italy
| | - Pietro S. C. Danna
- Department of Radiology, “Maggiore della Carità” Hospital, University of Piemonte Orientale, Via Solaroli 17, 28100 Novara, Italy
| | - Sushant Agarwal
- Advanced Knowledge Engineering Centre, GBTI, Roseville, CA 95661, USA
| | - Lopamudra Mohanty
- ABES Engineering College, Ghaziabad 201009, India
- Department of Computer Science Engineering, Bennett University, Greater Noida 201310, India
| | - Nillmani
- School of Biomedical Engineering, Indian Institute of Technology (BHU), Varanasi 221005, India
| | - Neeraj Sharma
- School of Biomedical Engineering, Indian Institute of Technology (BHU), Varanasi 221005, India
| | - Sarita Yadav
- Bharati Vidyapeeth’s College of Engineering, New Delhi 110063, India
| | - Achin Jain
- Bharati Vidyapeeth’s College of Engineering, New Delhi 110063, India
| | - Ashish Kumar
- Department of Computer Science Engineering, Bennett University, Greater Noida 201310, India
| | - Mannudeep K. Kalra
- Department of Radiology, Massachusetts General Hospital, Boston, MA 02115, USA
| | - David W. Sobel
- Men’s Health Centre, Miriam Hospital Providence, Providence, RI 02906, USA
| | - John R. Laird
- Heart and Vascular Institute, Adventist Health St. Helena, St. Helena, CA 94574, USA
| | - Inder M. Singh
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA 95661, USA
| | - Narpinder Singh
- Department of Food Science and Technology, Graphic Era, Deemed to be University, Dehradun 248002, India
| | - George Tsoulfas
- Department of Surgery, Aristoteleion University of Thessaloniki, 54124 Thessaloniki, Greece
| | - Mostafa M. Fouda
- Department of Electrical and Computer Engineering, Idaho State University, Pocatello, ID 83209, USA
| | - Azra Alizad
- Department of Physiology & Biomedical Engineering, Mayo Clinic College of Medicine and Science, Rochester, MN 55905, USA
| | - George D. Kitas
- Academic Affairs, Dudley Group NHS Foundation Trust, Dudley DY1 2HQ, UK
| | - Narendra N. Khanna
- Department of Cardiology, Indraprastha APOLLO Hospitals, New Delhi 110001, India
| | - Klaudija Viskovic
- Department of Radiology and Ultrasound, University Hospital for Infectious Diseases, 10000 Zagreb, Croatia
| | - Melita Kukuljan
- Department of Interventional and Diagnostic Radiology, Clinical Hospital Center Rijeka, 51000 Rijeka, Croatia
| | - Mustafa Al-Maini
- Allergy, Clinical Immunology & Rheumatology Institute, Toronto, ON L4Z 4C4, Canada
| | - Ayman El-Baz
- Biomedical Engineering Department, University of Louisville, Louisville, KY 40292, USA
| | - Luca Saba
- Department of Radiology, Azienda Ospedaliero Universitaria (A.O.U.), 09123 Cagliari, Italy
| | - Jasjit S. Suri
- Stroke Monitoring and Diagnostic Division, AtheroPoint™, Roseville, CA 95661, USA
| |
Collapse
|
12
|
Ajagbe SA, Adigun MO. Deep learning techniques for detection and prediction of pandemic diseases: a systematic literature review. MULTIMEDIA TOOLS AND APPLICATIONS 2023:1-35. [PMID: 37362693 PMCID: PMC10226029 DOI: 10.1007/s11042-023-15805-z] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/17/2022] [Revised: 03/06/2023] [Accepted: 05/10/2023] [Indexed: 06/28/2023]
Abstract
Deep learning (DL) is becoming a fast-growing field in the medical domain and it helps in the timely detection of any infectious disease (IDs) and is essential to the management of diseases and the prediction of future occurrences. Many scientists and scholars have implemented DL techniques for the detection and prediction of pandemics, IDs and other healthcare-related purposes, these outcomes are with various limitations and research gaps. For the purpose of achieving an accurate, efficient and less complicated DL-based system for the detection and prediction of pandemics, therefore, this study carried out a systematic literature review (SLR) on the detection and prediction of pandemics using DL techniques. The survey is anchored by four objectives and a state-of-the-art review of forty-five papers out of seven hundred and ninety papers retrieved from different scholarly databases was carried out in this study to analyze and evaluate the trend of DL techniques application areas in the detection and prediction of pandemics. This study used various tables and graphs to analyze the extracted related articles from various online scholarly repositories and the analysis showed that DL techniques have a good tool in pandemic detection and prediction. Scopus and Web of Science repositories are given attention in this current because they contain suitable scientific findings in the subject area. Finally, the state-of-the-art review presents forty-four (44) studies of various DL technique performances. The challenges identified from the literature include the low performance of the model due to computational complexities, improper labeling and the absence of a high-quality dataset among others. This survey suggests possible solutions such as the development of improved DL-based techniques or the reduction of the output layer of DL-based architecture for the detection and prediction of pandemic-prone diseases as future considerations.
Collapse
Affiliation(s)
- Sunday Adeola Ajagbe
- Department of Computer & Industrial Production Engineering, First Technical University Ibadan, Ibadan, 200255 Nigeria
- Department of Computer Science, University of Zululand, Kwadlangezwa, 3886 South Africa
| | - Matthew O. Adigun
- Department of Computer Science, University of Zululand, Kwadlangezwa, 3886 South Africa
| |
Collapse
|
13
|
Rao Y, Lv Q, Zeng S, Yi Y, Huang C, Gao Y, Cheng Z, Sun J. COVID-19 CT ground-glass opacity segmentation based on attention mechanism threshold. Biomed Signal Process Control 2023; 81:104486. [PMID: 36505089 PMCID: PMC9721288 DOI: 10.1016/j.bspc.2022.104486] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/15/2022] [Revised: 11/23/2022] [Accepted: 12/01/2022] [Indexed: 12/12/2022]
Abstract
The ground glass opacity (GGO) of the lung is one of the essential features of COVID-19. The GGO in computed tomography (CT) images has various features and low-intensity contrast between the GGO and edge structures. These problems pose significant challenges for segmenting the GGO. To tackle these problems, we propose a new threshold method for accurate segmentation of GGO. Specifically, we offer a framework for adjusting the threshold parameters according to the image contrast. Three functions include Attention mechanism threshold, Contour equalization, and Lung segmentation (ACL). The lung is divided into three areas using the attention mechanism threshold. Further, the segmentation parameters of the attention mechanism thresholds of the three parts are adaptively adjusted according to the image contrast. Only the segmentation regions restricted by the lung segmentation results are retained. Extensive experiments on four COVID datasets show that ACL can segment GGO images at low contrast well. Compared with the state-of-the-art methods, the similarity Dice of the ACL segmentation results is improved by 8.9%, the average symmetry surface distance ASD is reduced by 23%, and the required computational power F L O P s are only 0.09% of those of deep learning models. For GGO segmentation, ACL is more lightweight, and the accuracy is higher. Code will be released at https://github.com/Lqs-github/ACL.
Collapse
Affiliation(s)
- Yunbo Rao
- School of Information and Software Engineering, University of Electronic Science and Technology of China, Chengdu, 611731, China
| | - Qingsong Lv
- School of Information and Software Engineering, University of Electronic Science and Technology of China, Chengdu, 611731, China
| | - Shaoning Zeng
- Yangtze Delta Region Institute (Huzhou), University of Electronic Science and Technology of China, Huzhou, 313000, China
| | - Yuling Yi
- School of Information and Software Engineering, University of Electronic Science and Technology of China, Chengdu, 611731, China
| | - Cheng Huang
- Fifth Clinical College of Chongqing Medical University, Chongqing, 402177, China
| | - Yun Gao
- Chongqing University of Posts and Telecommunications, Chongqing, 400065, China
| | - Zhanglin Cheng
- Advanced Technology Chinese Academy of Sciences, Shenzhen, 610042, China
| | - Jihong Sun
- Sir Run Run Shaw Hospital, Zhejiang University School of Medicine, Hangzhou, 310014, China
| |
Collapse
|
14
|
Chen X, Bai Y, Wang P, Luo J. Data augmentation based semi-supervised method to improve COVID-19 CT classification. MATHEMATICAL BIOSCIENCES AND ENGINEERING : MBE 2023; 20:6838-6852. [PMID: 37161130 DOI: 10.3934/mbe.2023294] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/11/2023]
Abstract
The Coronavirus (COVID-19) outbreak of December 2019 has become a serious threat to people around the world, creating a health crisis that infected millions of lives, as well as destroying the global economy. Early detection and diagnosis are essential to prevent further transmission. The detection of COVID-19 computed tomography images is one of the important approaches to rapid diagnosis. Many different branches of deep learning methods have played an important role in this area, including transfer learning, contrastive learning, ensemble strategy, etc. However, these works require a large number of samples of expensive manual labels, so in order to save costs, scholars adopted semi-supervised learning that applies only a few labels to classify COVID-19 CT images. Nevertheless, the existing semi-supervised methods focus primarily on class imbalance and pseudo-label filtering rather than on pseudo-label generation. Accordingly, in this paper, we organized a semi-supervised classification framework based on data augmentation to classify the CT images of COVID-19. We revised the classic teacher-student framework and introduced the popular data augmentation method Mixup, which widened the distribution of high confidence to improve the accuracy of selected pseudo-labels and ultimately obtain a model with better performance. For the COVID-CT dataset, our method makes precision, F1 score, accuracy and specificity 21.04%, 12.95%, 17.13% and 38.29% higher than average values for other methods respectively, For the SARS-COV-2 dataset, these increases were 8.40%, 7.59%, 9.35% and 12.80% respectively. For the Harvard Dataverse dataset, growth was 17.64%, 18.89%, 19.81% and 20.20% respectively. The codes are available at https://github.com/YutingBai99/COVID-19-SSL.
Collapse
Affiliation(s)
- Xiangtao Chen
- College of Computer Science and Electronic Engineering, Hunan University, Changsha 410082, Hunan, China
| | - Yuting Bai
- College of Computer Science and Electronic Engineering, Hunan University, Changsha 410082, Hunan, China
| | - Peng Wang
- College of Computer Science and Engineering, Hunan Institute of Technology, Hengyang 421002, China
| | - Jiawei Luo
- College of Computer Science and Electronic Engineering, Hunan University, Changsha 410082, Hunan, China
| |
Collapse
|
15
|
Esmi N, Golshan Y, Asadi S, Shahbahrami A, Gaydadjiev G. A fuzzy fine-tuned model for COVID-19 diagnosis. Comput Biol Med 2023; 153:106483. [PMID: 36621192 PMCID: PMC9811914 DOI: 10.1016/j.compbiomed.2022.106483] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2022] [Revised: 12/16/2022] [Accepted: 12/25/2022] [Indexed: 01/06/2023]
Abstract
The COVID-19 disease pandemic spread rapidly worldwide and caused extensive human death and financial losses. Therefore, finding accurate, accessible, and inexpensive methods for diagnosing the disease has challenged researchers. To automate the process of diagnosing COVID-19 disease through images, several strategies based on deep learning, such as transfer learning and ensemble learning, have been presented. However, these techniques cannot deal with noises and their propagation in different layers. In addition, many of the datasets already being used are imbalanced, and most techniques have used binary classification, COVID-19, from normal cases. To address these issues, we use the blind/referenceless image spatial quality evaluator to filter out inappropriate data in the dataset. In order to increase the volume and diversity of the data, we merge two datasets. This combination of two datasets allows multi-class classification between the three states of normal, COVID-19, and types of pneumonia, including bacterial and viral types. A weighted multi-class cross-entropy is used to reduce the effect of data imbalance. In addition, a fuzzy fine-tuned Xception model is applied to reduce the noise propagation in different layers. Quantitative analysis shows that our proposed model achieves 96.60% accuracy on the merged test set, which is more accurate than previously mentioned state-of-the-art methods.
Collapse
Affiliation(s)
- Nima Esmi
- Faculty of Science and Engineering, University of Groningen, Netherlands.
| | - Yasaman Golshan
- Department of Computer Engineering, Faculty of Engineering, University of Guilan, Rasht, Iran.
| | - Sara Asadi
- Department of Computer Engineering, Faculty of Engineering, University of Guilan, Rasht, Iran.
| | - Asadollah Shahbahrami
- Faculty of Science and Engineering, University of Groningen, Netherlands; Department of Computer Engineering, Faculty of Engineering, University of Guilan, Rasht, Iran.
| | - Georgi Gaydadjiev
- Faculty of Science and Engineering, University of Groningen, Netherlands.
| |
Collapse
|
16
|
Alaiad AI, Mugdadi EA, Hmeidi II, Obeidat N, Abualigah L. Predicting the Severity of COVID-19 from Lung CT Images Using Novel Deep Learning. J Med Biol Eng 2023; 43:135-146. [PMID: 37077696 PMCID: PMC10010231 DOI: 10.1007/s40846-023-00783-2] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2022] [Accepted: 02/16/2023] [Indexed: 04/21/2023]
Abstract
Purpose Coronavirus 2019 (COVID-19) had major social, medical, and economic impacts globally. The study aims to develop a deep-learning model that can predict the severity of COVID-19 in patients based on CT images of their lungs. Methods COVID-19 causes lung infections, and qRT-PCR is an essential tool used to detect virus infection. However, qRT-PCR is inadequate for detecting the severity of the disease and the extent to which it affects the lung. In this paper, we aim to determine the severity level of COVID-19 by studying lung CT scans of people diagnosed with the virus. Results We used images from King Abdullah University Hospital in Jordan; we collected our dataset from 875 cases with 2205 CT images. A radiologist classified the images into four levels of severity: normal, mild, moderate, and severe. We used various deep-learning algorithms to predict the severity of lung diseases. The results show that the best deep-learning algorithm used is Resnet101, with an accuracy score of 99.5% and a data loss rate of 0.03%. Conclusion The proposed model assisted in diagnosing and treating COVID-19 patients and helped improve patient outcomes.
Collapse
Affiliation(s)
- Ahmad Imwafak Alaiad
- Computer Information System, Jordan University of Science and Technology, Irbid, Jordan
| | - Esraa Ahmad Mugdadi
- Computer Information System, Jordan University of Science and Technology, Irbid, Jordan
| | - Ismail Ibrahim Hmeidi
- Computer Information System, Jordan University of Science and Technology, Irbid, Jordan
| | - Naser Obeidat
- Department of Diagnostic Radiology and Nuclear Medicine, Faculty of Medicine, Jordan University of Science and Technology, Irbid, Jordan
| | - Laith Abualigah
- Computer Science Department, Prince Hussein Bin Abdullah Faculty for Information Technology, Al al-Bayt University, Mafraq, 25113 Jordan
- College of Engineering, Yuan Ze University, Taoyuan, Taiwan
- Hourani Center for Applied Scientific Research, Al-Ahliyya Amman University, Amman, 19328 Jordan
- Faculty of Information Technology, Middle East University, Amman, 11831 Jordan
- Applied Science Research Center, Applied Science Private University, Amman, 11931 Jordan
- School of Computer Sciences, Universiti Sains Malaysia, 11800 Pulau Pinang, Malaysia
| |
Collapse
|
17
|
Xu Y, Lam HK, Jia G, Jiang J, Liao J, Bao X. Improving COVID-19 CT classification of CNNs by learning parameter-efficient representation. Comput Biol Med 2023; 152:106417. [PMID: 36543003 PMCID: PMC9750504 DOI: 10.1016/j.compbiomed.2022.106417] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/08/2022] [Revised: 11/22/2022] [Accepted: 12/04/2022] [Indexed: 12/23/2022]
Abstract
The COVID-19 pandemic continues to spread rapidly over the world and causes a tremendous crisis in global human health and the economy. Its early detection and diagnosis are crucial for controlling the further spread. Many deep learning-based methods have been proposed to assist clinicians in automatic COVID-19 diagnosis based on computed tomography imaging. However, challenges still remain, including low data diversity in existing datasets, and unsatisfied detection resulting from insufficient accuracy and sensitivity of deep learning models. To enhance the data diversity, we design augmentation techniques of incremental levels and apply them to the largest open-access benchmark dataset, COVIDx CT-2A. Meanwhile, similarity regularization (SR) derived from contrastive learning is proposed in this study to enable CNNs to learn more parameter-efficient representations, thus improve the accuracy and sensitivity of CNNs. The results on seven commonly used CNNs demonstrate that CNN performance can be improved stably through applying the designed augmentation and SR techniques. In particular, DenseNet121 with SR achieves an average test accuracy of 99.44% in three trials for three-category classification, including normal, non-COVID-19 pneumonia, and COVID-19 pneumonia. The achieved precision, sensitivity, and specificity for the COVID-19 pneumonia category are 98.40%, 99.59%, and 99.50%, respectively. These statistics suggest that our method has surpassed the existing state-of-the-art methods on the COVIDx CT-2A dataset. Source code is available at https://github.com/YujiaKCL/COVID-CT-Similarity-Regularization.
Collapse
Affiliation(s)
- Yujia Xu
- Department of Engineering, King's College London, Strand, London, WC2R 2LS, United Kingdom.
| | - Hak-Keung Lam
- Department of Engineering, King's College London, Strand, London, WC2R 2LS, United Kingdom.
| | - Guangyu Jia
- Department of Engineering, King's College London, Strand, London, WC2R 2LS, United Kingdom.
| | - Jian Jiang
- Department of Engineering, King's College London, Strand, London, WC2R 2LS, United Kingdom.
| | - Junkai Liao
- Department of Engineering, King's College London, Strand, London, WC2R 2LS, United Kingdom.
| | - Xinqi Bao
- Department of Engineering, King's College London, Strand, London, WC2R 2LS, United Kingdom.
| |
Collapse
|
18
|
Ahuja S, Panigrahi BK, Dey N, Taneja A, Gandhi TK. McS-Net: Multi-class Siamese network for severity of COVID-19 infection classification from lung CT scan slices. Appl Soft Comput 2022; 131:109683. [PMID: 36277300 PMCID: PMC9573862 DOI: 10.1016/j.asoc.2022.109683] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2022] [Revised: 08/25/2022] [Accepted: 09/22/2022] [Indexed: 11/29/2022]
Abstract
Worldwide COVID-19 is a highly infectious and rapidly spreading disease in almost all age groups. The Computed Tomography (CT) scans of lungs are found to be accurate for the timely diagnosis of COVID-19 infection. In the proposed work, a deep learning-based P-shot N-ways Siamese network along with prototypical nearest neighbor classifiers is implemented for the classification of COVID-19 infection from lung CT scan slices. For this, a Siamese network with an identical sub-network (weight sharing) is used for image classification with a limited dataset for each class. The feature vectors are obtained from the pre-trained sub-networks having weight sharing. The performance of the proposed methodology is evaluated on the benchmark MosMed dataset having categories zero (healthy control) and numerous COVID-19 infections. The proposed methodology is evaluated on (a) chest CT scans provided by medical hospitals in Moscow, Russia for 1110 patients, and (b) case study of low-dose CT scans of 42 patients provided by Avtaran healthcare in India. The deep learning-based Siamese network (15-shot 5-ways) obtained an accuracy of 98.07%, the sensitivity of 95.66%, specificity of 98.83%, and F1-score of 95.10%. The proposed work outperforms the COVID-19 infection severity classification with limited scans availability for numerous infection categories.
Collapse
Affiliation(s)
- Sakshi Ahuja
- Electrical Engineering Department, Indian Institute of Technology Delhi, New Delhi, 110016, India
| | - Bijaya Ketan Panigrahi
- Electrical Engineering Department, Indian Institute of Technology Delhi, New Delhi, 110016, India
| | - Nilanjan Dey
- Department of Computer Science and Engineering, Techno International New Town, Kolkata, 700156, India
| | - Arpit Taneja
- Department of Radiology, Avtaran Healthcare LLP, Kurukshetra, 136118, India
| | - Tapan Kumar Gandhi
- Electrical Engineering Department, Indian Institute of Technology Delhi, New Delhi, 110016, India
| |
Collapse
|
19
|
RFI-GAN: A Reference-guided Fuzzy Integral Network for Ultrasound Image Augmentation. Inf Sci (N Y) 2022. [DOI: 10.1016/j.ins.2022.12.026] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/25/2022]
|
20
|
Banerjee A, Sarkar A, Roy S, Singh PK, Sarkar R. COVID-19 chest X-ray detection through blending ensemble of CNN snapshots. Biomed Signal Process Control 2022; 78:104000. [PMID: 35855489 PMCID: PMC9283670 DOI: 10.1016/j.bspc.2022.104000] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2022] [Revised: 06/23/2022] [Accepted: 07/11/2022] [Indexed: 12/04/2022]
Abstract
The novel COVID-19 pandemic, has effectively turned out to be one of the deadliest events in modern history, with unprecedented loss of human life, major economic and financial setbacks and has set the entire world back quite a few decades. However, detection of the COVID-19 virus has become increasingly difficult due to the mutating nature of the virus, and the rise in asymptomatic cases. To counteract this and contribute to the research efforts for a more accurate screening of COVID-19, we have planned this work. Here, we have proposed an ensemble methodology for deep learning models to solve the task of COVID-19 detection from chest X-rays (CXRs) to assist Computer-Aided Detection (CADe) for medical practitioners. We leverage the strategy of transfer learning for Convolutional Neural Networks (CNNs), widely adopted in recent literature, and further propose an efficient ensemble network for their combination. The DenseNet-201 architecture has been trained only once to generate multiple snapshots, offering diverse information about the extracted features from CXRs. We follow the strategy of decision-level fusion to combine the decision scores using the blending algorithm through a Random Forest (RF) meta-learner. Experimental results confirm the efficacy of the proposed ensemble method, as shown through impressive results upon two open access COVID-19 CXR datasets - the largest COVID-X dataset, as well as a smaller scale dataset. On the large COVID-X dataset, the proposed model has achieved an accuracy score of 94.55% and on the smaller dataset by Chowdhury et al., the proposed model has achieved a 98.13% accuracy score.
Collapse
Affiliation(s)
- Avinandan Banerjee
- Department of Information Technology, Jadavpur University, Jadavpur University Second Campus, Plot No. 8, Salt Lake Bypass, LB Block, Sector III, Salt Lake City, Kolkata 700106, West Bengal, India
| | - Arya Sarkar
- Department of Computer Science, University of Engineering and Management, University Area, Plot No. III - B/5, New Town, Action Area - III, Kolkata 700160, West Bengal, India
| | - Sayantan Roy
- Department of Information Technology, Jadavpur University, Jadavpur University Second Campus, Plot No. 8, Salt Lake Bypass, LB Block, Sector III, Salt Lake City, Kolkata 700106, West Bengal, India
| | - Pawan Kumar Singh
- Department of Information Technology, Jadavpur University, Jadavpur University Second Campus, Plot No. 8, Salt Lake Bypass, LB Block, Sector III, Salt Lake City, Kolkata 700106, West Bengal, India
| | - Ram Sarkar
- Department of Computer Science and Engineering, Jadavpur University, 188, Raja S.C. Mallick Road, Kolkata 700032, West Bengal, India
| |
Collapse
|
21
|
Kurmi A, Biswas S, Sen S, Sinitca A, Kaplun D, Sarkar R. An Ensemble of CNN Models for Parkinson’s Disease Detection Using DaTscan Images. Diagnostics (Basel) 2022; 12:diagnostics12051173. [PMID: 35626328 PMCID: PMC9139649 DOI: 10.3390/diagnostics12051173] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2022] [Revised: 04/09/2022] [Accepted: 05/04/2022] [Indexed: 12/04/2022] Open
Abstract
Parkinson’s Disease (PD) is a progressive central nervous system disorder that is caused due to the neural degeneration mainly in the substantia nigra in the brain. It is responsible for the decline of various motor functions due to the loss of dopamine-producing neurons. Tremors in hands is usually the initial symptom, followed by rigidity, bradykinesia, postural instability, and impaired balance. Proper diagnosis and preventive treatment can help patients improve their quality of life. We have proposed an ensemble of Deep Learning (DL) models to predict Parkinson’s using DaTscan images. Initially, we have used four DL models, namely, VGG16, ResNet50, Inception-V3, and Xception, to classify Parkinson’s disease. In the next stage, we have applied a Fuzzy Fusion logic-based ensemble approach to enhance the overall result of the classification model. The proposed model is assessed on a publicly available database provided by the Parkinson’s Progression Markers Initiative (PPMI). The achieved recognition accuracy, Precision, Sensitivity, Specificity, F1-score from the proposed model are 98.45%, 98.84%, 98.84%, 97.67%, and 98.84%, respectively which are higher than the individual model. We have also developed a Graphical User Interface (GUI)-based software tool for public use that instantly detects all classes using Magnetic Resonance Imaging (MRI) with reasonable accuracy. The proposed method offers better performance compared to other state-of-the-art methods in detecting PD. The developed GUI-based software tool can play a significant role in detecting the disease in real-time.
Collapse
Affiliation(s)
- Ankit Kurmi
- Department of Computer Science and Engineering, Kalyani Government Engineering College, Kalyani 741235, West Bengal, India;
| | - Shreya Biswas
- Department of Electronics and Telecommunication Engineering, Jadavpur University, Kolkata 700032, West Bengal, India;
| | - Shibaprasad Sen
- Department of Computer Science and Technology, University of Engineering and Management, Kolkata 700160, West Bengal, India;
| | - Aleksandr Sinitca
- Research Centre for Digital Telecommunication Technologies, Saint Petersburg Electrotechnical University ”LETI”, 197022 St. Petersburg, Russia;
| | - Dmitrii Kaplun
- Department of Automation and Control Processes, Saint Petersburg Electrotechnical University ”LETI”, 197022 St. Petersburg, Russia;
| | - Ram Sarkar
- Department of Computer Science and Engineering, Jadavpur University, Kolkata 700032, West Bengal, India
- Correspondence:
| |
Collapse
|
22
|
Baghdadi NA, Malki A, Abdelaliem SF, Magdy Balaha H, Badawy M, Elhosseini M. An automated diagnosis and classification of COVID-19 from chest CT images using a transfer learning-based convolutional neural network. Comput Biol Med 2022; 144:105383. [PMID: 35290811 PMCID: PMC8906898 DOI: 10.1016/j.compbiomed.2022.105383] [Citation(s) in RCA: 34] [Impact Index Per Article: 11.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/15/2022] [Revised: 02/15/2022] [Accepted: 03/02/2022] [Indexed: 02/06/2023]
Abstract
Researchers have developed more intelligent, highly responsive, and efficient detection methods owing to the COVID-19 demands for more widespread diagnosis. The work done deals with developing an AI-based framework that can help radiologists and other healthcare professionals diagnose COVID-19 cases at a high level of accuracy. However, in the absence of publicly available CT datasets, the development of such AI tools can prove challenging. Therefore, an algorithm for performing automatic and accurate COVID-19 classification using Convolutional Neural Network (CNN), pre-trained model, and Sparrow search algorithm (SSA) on CT lung images was proposed. The pre-trained CNN models used are SeresNext50, SeresNext101, SeNet154, MobileNet, MobileNetV2, MobileNetV3Small, and MobileNetV3Large. In addition, the SSA will be used to optimize the different CNN and transfer learning(TL) hyperparameters to find the best configuration for the pre-trained model used and enhance its performance. Two datasets are used in the experiments. There are two classes in the first dataset, while three in the second. The authors combined two publicly available COVID-19 datasets as the first dataset, namely the COVID-19 Lung CT Scans and COVID-19 CT Scan Dataset. In total, 14,486 images were included in this study. The authors analyzed the Large COVID-19 CT scan slice dataset in the second dataset, which utilized 17,104 images. Compared to other pre-trained models on both classes datasets, MobileNetV3Large pre-trained is the best model. As far as the three-classes dataset is concerned, a model trained on SeNet154 is the best available. Results show that, when compared to other CNN models like LeNet-5 CNN, COVID faster R–CNN, Light CNN, Fuzzy + CNN, Dynamic CNN, CNN and Optimized CNN, the proposed Framework achieves the best accuracy of 99.74% (two classes) and 98% (three classes).
Collapse
Affiliation(s)
- Nadiah A Baghdadi
- Princess Nourah bint Abdulrahman University, College of Nursing, Riyadh, 11671, Riyadh, P.O. BOX 84428, Saudi Arabia.
| | - Amer Malki
- Taibah University, College of Computer Science and Engineering, Yanbu, 46421, Saudi Arabia
| | - Sally F Abdelaliem
- Princess Nourah bint Abdulrahman University, College of Nursing, Riyadh, 11671, Riyadh, P.O. BOX 84428, Saudi Arabia
| | - Hossam Magdy Balaha
- Mansoura University, Faculty of Engineering, Computers and Control Systems Engineering Department, Mansoura, 46421, Egypt
| | - Mahmoud Badawy
- Mansoura University, Faculty of Engineering, Computers and Control Systems Engineering Department, Mansoura, 46421, Egypt.
| | - Mostafa Elhosseini
- Taibah University, College of Computer Science and Engineering, Yanbu, 46421, Saudi Arabia; Mansoura University, Faculty of Engineering, Computers and Control Systems Engineering Department, Mansoura, 46421, Egypt
| |
Collapse
|
23
|
Basu A, Sheikh KH, Cuevas E, Sarkar R. COVID-19 detection from CT scans using a two-stage framework. EXPERT SYSTEMS WITH APPLICATIONS 2022; 193:116377. [PMID: 35002099 PMCID: PMC8720180 DOI: 10.1016/j.eswa.2021.116377] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/16/2021] [Revised: 11/09/2021] [Accepted: 12/04/2021] [Indexed: 05/04/2023]
Abstract
Coronavirus disease 2019 (COVID-19) is a contagious disease caused by severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). It may cause serious ailments in infected individuals and complications may lead to death. X-rays and Computed Tomography (CT) scans can be used for the diagnosis of the disease. In this context, various methods have been proposed for the detection of COVID-19 from radiological images. In this work, we propose an end-to-end framework consisting of deep feature extraction followed by feature selection (FS) for the detection of COVID-19 from CT scan images. For feature extraction, we utilize three deep learning based Convolutional Neural Networks (CNNs). For FS, we use a meta-heuristic optimization algorithm, Harmony Search (HS), combined with a local search method, Adaptive β -Hill Climbing (A β HC) for better performance. We evaluate the proposed approach on the SARS-COV-2 CT-Scan Dataset consisting of 2482 CT scan images and an updated version of the previous dataset containing 2926 CT scan images. For comparison, we use a few state-of-the-art optimization algorithms. The best accuracy scores obtained by the present approach are 97.30% and 98.87% respectively on the said datasets, which are better than many of the algorithms used for comparison. The performances are also at par with some recent works which use the same datasets. The codes for the FS algorithms are available at: https://github.com/khalid0007/Metaheuristic-Algorithms.
Collapse
Affiliation(s)
- Arpan Basu
- Department of Computer Science and Engineering, Jadavpur University, Kolkata 700032, India
| | - Khalid Hassan Sheikh
- Department of Computer Science and Engineering, Jadavpur University, Kolkata 700032, India
| | - Erik Cuevas
- Departamento de Electrónica, Universidad de Guadalajara, CUCEI, Av. Revolución 1500, Guadalajara, Jal, Mexico
| | - Ram Sarkar
- Department of Computer Science and Engineering, Jadavpur University, Kolkata 700032, India
| |
Collapse
|
24
|
Mahanty C, Kumar R, Patro SGK. Internet of Medical Things-Based COVID-19 Detection in CT Images Fused with Fuzzy Ensemble and Transfer Learning Models. NEW GENERATION COMPUTING 2022; 40:1125-1141. [PMID: 35730008 PMCID: PMC9202670 DOI: 10.1007/s00354-022-00176-0] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/29/2022] [Accepted: 05/24/2022] [Indexed: 05/12/2023]
Abstract
One of the most difficult research areas in today's healthcare industry to combat the coronavirus pandemic is accurate COVID-19 detection. Because of its low infection miss rate and high sensitivity, chest computed tomography (CT) imaging has been recommended as a viable technique for COVID-19 diagnosis in a number of recent clinical investigations. This article presents an Internet of Medical Things (IoMT)-based platform for improving and speeding up COVID-19 identification. Clinical devices are connected to network resources in the suggested IoMT platform using cloud computing. The method enables patients and healthcare experts to work together in real time to diagnose and treat COVID-19, potentially saving time and effort for both patients and physicians. In this paper, we introduce a technique for classifying chest CT scan images into COVID, pneumonia, and normal classes that use a Sugeno fuzzy integral ensemble across three transfer learning models, namely SqueezeNet, DenseNet-201, and MobileNetV2. The suggested fuzzy ensemble techniques outperform each individual transfer learning methodology as well as trainable ensemble strategies in terms of accuracy. The suggested MobileNetV2 fused with Sugeno fuzzy integral ensemble model has a 99.15% accuracy rate. In the present research, this framework was utilized to identify COVID-19, but it may also be implemented and used for medical imaging analyses of other disorders.
Collapse
Affiliation(s)
| | - Raghvendra Kumar
- Department of Computer Science and Engineering, GIET University, Gunupur, India
| | - S. Gopal Krishna Patro
- Department of Computer Science and Engineering, Koneru Lakshmaiah Education Foundation, Vaddeswaram, Andhra Pradesh India
| |
Collapse
|