1
|
Jin J, Zhou S, Li Y, Zhu T, Fan C, Zhang H, Li P. Reinforced Collaborative-Competitive Representation for Biomedical Image Recognition. Interdiscip Sci 2025; 17:215-230. [PMID: 39841320 DOI: 10.1007/s12539-024-00683-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2024] [Revised: 12/04/2024] [Accepted: 12/05/2024] [Indexed: 01/23/2025]
Abstract
Artificial intelligence technology has demonstrated remarkable diagnostic efficacy in modern biomedical image analysis. However, the practical application of artificial intelligence is significantly limited by the presence of similar pathologies among different diseases and the diversity of pathologies within the same disease. To address this issue, this paper proposes a reinforced collaborative-competitive representation classification (RCCRC) method. RCCRC enhances the contribution of different classes by introducing dual competitive constraints into the objective function. The first constraint integrates the collaborative space representation akin to holistic data, promoting the representation contribution of similar classes. The second constraint introduces specific class subspace representations to encourage competition among all classes, enhancing the discriminative nature of representation vectors. By unifying these two constraints, RCCRC effectively explores both global and specific data features in the reconstruction space. Extensive experiments on various biomedical image databases are conducted to exhibit the advantage of the proposed method in comparison with several state-of-the-art classification algorithms.
Collapse
Affiliation(s)
- Junwei Jin
- The Key Laboratory of Grain Information Processing and Control (Henan University of Technology), Ministry of Education, Zhengzhou, 450001, China
- Henan Key Laboratory of Grain Storage Information Intelligent Perception and Decision Making, Henan University of Technology, Zhengzhou, 450001, China
- School of Artificial Intelligence and Big Data, Henan University of Technology, Zhengzhou, 450001, China
- Institute for Complexity Science, Henan University of Technology, Zhengzhou, 450001, China
| | - Songbo Zhou
- School of Artificial Intelligence and Big Data, Henan University of Technology, Zhengzhou, 450001, China
| | - Yanting Li
- School of Computer and Communication Engineering, Zhengzhou University of Light Industry, Zhengzhou, 450001, China.
| | - Tanxin Zhu
- School of Computer and Communication Engineering, Zhengzhou University of Light Industry, Zhengzhou, 450001, China
| | - Chao Fan
- School of Artificial Intelligence and Big Data, Henan University of Technology, Zhengzhou, 450001, China
- Institute for Complexity Science, Henan University of Technology, Zhengzhou, 450001, China
| | - Hua Zhang
- Institute for Complexity Science, Henan University of Technology, Zhengzhou, 450001, China
| | - Peng Li
- Institute for Complexity Science, Henan University of Technology, Zhengzhou, 450001, China.
| |
Collapse
|
2
|
Fu Z, Xi J, Ji Z, Zhang R, Wang J, Shi R, Pu X, Yu J, Xue F, Liu J, Wang Y, Zhong H, Feng J, Zhang M, He Y. Analysis of anterior segment in primary angle closure suspect with deep learning models. BMC Med Inform Decis Mak 2024; 24:251. [PMID: 39251987 PMCID: PMC11385134 DOI: 10.1186/s12911-024-02658-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2024] [Accepted: 08/29/2024] [Indexed: 09/11/2024] Open
Abstract
OBJECTIVE To analyze primary angle closure suspect (PACS) patients' anatomical characteristics of anterior chamber configuration, and to establish artificial intelligence (AI)-aided diagnostic system for PACS screening. METHODS A total of 1668 scans of 839 patients were included in this cross-sectional study. The subjects were divided into two groups: PACS group and normal group. With anterior segment optical coherence tomography scans, the anatomical diversity between two groups was compared, and anterior segment structure features of PACS were extracted. Then, AI-aided diagnostic system was constructed, which based different algorithms such as classification and regression tree (CART), random forest (RF), logistic regression (LR), VGG-16 and Alexnet. Then the diagnostic efficiencies of different algorithms were evaluated, and compared with junior physicians and experienced ophthalmologists. RESULTS RF [sensitivity (Se) = 0.84; specificity (Sp) = 0.92; positive predict value (PPV) = 0.82; negative predict value (NPV) = 0.95; area under the curve (AUC) = 0.90] and CART (Se = 0.76, Sp = 0.93, PPV = 0.85, NPV = 0.92, AUC = 0.90) showed better performance than LR (Se = 0.68, Sp = 0.91, PPV = 0.79, NPV = 0.90, AUC = 0.86). In convolutional neural networks (CNN), Alexnet (Se = 0.83, Sp = 0.95, PPV = 0.92, NPV = 0.87, AUC = 0.85) was better than VGG-16 (Se = 0.84, Sp = 0.90, PPV = 0.85, NPV = 0.90, AUC = 0.79). The performance of 2 CNN algorithms was better than 5 junior physicians, and the mean value of diagnostic indicators of 2 CNN algorithm was similar to experienced ophthalmologists. CONCLUSION PACS patients have distinct anatomical characteristics compared with health controls. AI models for PACS screening are reliable and powerful, equivalent to experienced ophthalmologists.
Collapse
Affiliation(s)
- Ziwei Fu
- The Second Affiliated Hospital of Xi'an Medical University, Xi'an, Shaanxi, 710038, China
- Xi'an Medical University, Xi'an, Shaanxi, 710021, China
- Xi'an Key Laboratory for the Prevention and Treatment of Eye and Brain Neurological Related Diseases, Xi'an, Shaanxi, 710038, China
| | - Jinwei Xi
- The Second Affiliated Hospital of Xi'an Medical University, Xi'an, Shaanxi, 710038, China
| | - Zhi Ji
- The Second Affiliated Hospital of Xi'an Medical University, Xi'an, Shaanxi, 710038, China
- Xi'an Medical University, Xi'an, Shaanxi, 710021, China
| | - Ruxue Zhang
- School of Mathematics, Northwest University, Xi'an, 710127, China
| | - Jianping Wang
- Shaanxi Provincial People's Hospital, Xi'an, Shaanxi, 710068, China
| | - Rui Shi
- Shaanxi Provincial People's Hospital, Xi'an, Shaanxi, 710068, China
| | - Xiaoli Pu
- Xianyang First People's Hospital, Xianyang, Shaanxi Province, 712000, China
| | - Jingni Yu
- Xi'an People's Hospital, Xi'an, Shaanxi, 712099, China
| | - Fang Xue
- Xi'an Medical University, Xi'an, Shaanxi, 710021, China
| | - Jianrong Liu
- Xi'an People's Hospital, Xi'an, Shaanxi, 712099, China
| | - Yanrong Wang
- Yan'an People's Hospital, Yan'an, Shaanxi, 716099, China
| | - Hua Zhong
- The First Affiliated Hospital of Kunming Medical University, Kunming, Yunnan Province, 650032, China
| | - Jun Feng
- School of Mathematics, Northwest University, Xi'an, 710127, China
| | - Min Zhang
- School of Mathematics, Northwest University, Xi'an, 710127, China.
| | - Yuan He
- The Second Affiliated Hospital of Xi'an Medical University, Xi'an, Shaanxi, 710038, China.
- Xi'an Medical University, Xi'an, Shaanxi, 710021, China.
- Xi'an Key Laboratory for the Prevention and Treatment of Eye and Brain Neurological Related Diseases, Xi'an, Shaanxi, 710038, China.
| |
Collapse
|
3
|
Talib MA, Afadar Y, Nasir Q, Nassif AB, Hijazi H, Hasasneh A. A tree-based explainable AI model for early detection of Covid-19 using physiological data. BMC Med Inform Decis Mak 2024; 24:179. [PMID: 38915001 PMCID: PMC11194929 DOI: 10.1186/s12911-024-02576-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2024] [Accepted: 06/13/2024] [Indexed: 06/26/2024] Open
Abstract
With the outbreak of COVID-19 in 2020, countries worldwide faced significant concerns and challenges. Various studies have emerged utilizing Artificial Intelligence (AI) and Data Science techniques for disease detection. Although COVID-19 cases have declined, there are still cases and deaths around the world. Therefore, early detection of COVID-19 before the onset of symptoms has become crucial in reducing its extensive impact. Fortunately, wearable devices such as smartwatches have proven to be valuable sources of physiological data, including Heart Rate (HR) and sleep quality, enabling the detection of inflammatory diseases. In this study, we utilize an already-existing dataset that includes individual step counts and heart rate data to predict the probability of COVID-19 infection before the onset of symptoms. We train three main model architectures: the Gradient Boosting classifier (GB), CatBoost trees, and TabNet classifier to analyze the physiological data and compare their respective performances. We also add an interpretability layer to our best-performing model, which clarifies prediction results and allows a detailed assessment of effectiveness. Moreover, we created a private dataset by gathering physiological data from Fitbit devices to guarantee reliability and avoid bias.The identical set of models was then applied to this private dataset using the same pre-trained models, and the results were documented. Using the CatBoost tree-based method, our best-performing model outperformed previous studies with an accuracy rate of 85% on the publicly available dataset. Furthermore, this identical pre-trained CatBoost model produced an accuracy of 81% when applied to the private dataset. You will find the source code in the link: https://github.com/OpenUAE-LAB/Covid-19-detection-using-Wearable-data.git .
Collapse
Affiliation(s)
- Manar Abu Talib
- Department of Computer Science, College of Computing and Informatics, University of Sharjah, P.O. Box 27272, Sharjah, UAE.
| | - Yaman Afadar
- Department of Computer Engineering, College of Computing and Informatics, University of Sharjah, Sharjah, UAE
| | - Qassim Nasir
- Department of Computer Engineering, College of Computing and Informatics, University of Sharjah, Sharjah, UAE
| | - Ali Bou Nassif
- Department of Computer Engineering, College of Computing and Informatics, University of Sharjah, Sharjah, UAE
| | - Haytham Hijazi
- Centre for Informatics and Systems of the University of Coimbra (CISUC), University of Coimbra, Coimbra, P-3030-290, Portugal
- Intelligent Systems Department, Ahliya University, Bethlehem, P-150-199, Palestine
| | - Ahmad Hasasneh
- Department of Natural, Engineering and Technology Sciences, Faculty of Graduate Studies, Arab American University, P.O. Box 240, Ramallah, Palestine
| |
Collapse
|
4
|
Malik H, Anees T. Multi-modal deep learning methods for classification of chest diseases using different medical imaging and cough sounds. PLoS One 2024; 19:e0296352. [PMID: 38470893 DOI: 10.1371/journal.pone.0296352] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2023] [Accepted: 12/11/2023] [Indexed: 03/14/2024] Open
Abstract
Chest disease refers to a wide range of conditions affecting the lungs, such as COVID-19, lung cancer (LC), consolidation lung (COL), and many more. When diagnosing chest disorders medical professionals may be thrown off by the overlapping symptoms (such as fever, cough, sore throat, etc.). Additionally, researchers and medical professionals make use of chest X-rays (CXR), cough sounds, and computed tomography (CT) scans to diagnose chest disorders. The present study aims to classify the nine different conditions of chest disorders, including COVID-19, LC, COL, atelectasis (ATE), tuberculosis (TB), pneumothorax (PNEUTH), edema (EDE), pneumonia (PNEU). Thus, we suggested four novel convolutional neural network (CNN) models that train distinct image-level representations for nine different chest disease classifications by extracting features from images. Furthermore, the proposed CNN employed several new approaches such as a max-pooling layer, batch normalization layers (BANL), dropout, rank-based average pooling (RBAP), and multiple-way data generation (MWDG). The scalogram method is utilized to transform the sounds of coughing into a visual representation. Before beginning to train the model that has been developed, the SMOTE approach is used to calibrate the CXR and CT scans as well as the cough sound images (CSI) of nine different chest disorders. The CXR, CT scan, and CSI used for training and evaluating the proposed model come from 24 publicly available benchmark chest illness datasets. The classification performance of the proposed model is compared with that of seven baseline models, namely Vgg-19, ResNet-101, ResNet-50, DenseNet-121, EfficientNetB0, DenseNet-201, and Inception-V3, in addition to state-of-the-art (SOTA) classifiers. The effectiveness of the proposed model is further demonstrated by the results of the ablation experiments. The proposed model was successful in achieving an accuracy of 99.01%, making it superior to both the baseline models and the SOTA classifiers. As a result, the proposed approach is capable of offering significant support to radiologists and other medical professionals.
Collapse
Affiliation(s)
- Hassaan Malik
- Department of Computer Science, School of Systems and Technology, University of Management and Technology, Lahore, Pakistan
| | - Tayyaba Anees
- Department of Software Engineering, School of Systems and Technology, University of Management and Technology, Lahore, Pakistan
| |
Collapse
|
5
|
Singh S, Kumar M, Kumar A, Verma BK, Abhishek K, Selvarajan S. Efficient pneumonia detection using Vision Transformers on chest X-rays. Sci Rep 2024; 14:2487. [PMID: 38291130 PMCID: PMC10827725 DOI: 10.1038/s41598-024-52703-2] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2023] [Accepted: 01/22/2024] [Indexed: 02/01/2024] Open
Abstract
Pneumonia is a widespread and acute respiratory infection that impacts people of all ages. Early detection and treatment of pneumonia are essential for avoiding complications and enhancing clinical results. We can reduce mortality, improve healthcare efficiency, and contribute to the global battle against a disease that has plagued humanity for centuries by devising and deploying effective detection methods. Detecting pneumonia is not only a medical necessity but also a humanitarian imperative and a technological frontier. Chest X-rays are a frequently used imaging modality for diagnosing pneumonia. This paper examines in detail a cutting-edge method for detecting pneumonia implemented on the Vision Transformer (ViT) architecture on a public dataset of chest X-rays available on Kaggle. To acquire global context and spatial relationships from chest X-ray images, the proposed framework deploys the ViT model, which integrates self-attention mechanisms and transformer architecture. According to our experimentation with the proposed Vision Transformer-based framework, it achieves a higher accuracy of 97.61%, sensitivity of 95%, and specificity of 98% in detecting pneumonia from chest X-rays. The ViT model is preferable for capturing global context, comprehending spatial relationships, and processing images that have different resolutions. The framework establishes its efficacy as a robust pneumonia detection solution by surpassing convolutional neural network (CNN) based architectures.
Collapse
Affiliation(s)
| | - Manoj Kumar
- JSS Academy of Technical Education, Noida, India
| | - Abhay Kumar
- National Institute of Technology Patna, Patna, India
| | | | | | - Shitharth Selvarajan
- School of Built Environment, Engineering and Computing, Leeds Beckett University, LS1 3HE, Leeds, UK.
| |
Collapse
|
6
|
Talukder MA, Layek MA, Kazi M, Uddin MA, Aryal S. Empowering COVID-19 detection: Optimizing performance through fine-tuned EfficientNet deep learning architecture. Comput Biol Med 2024; 168:107789. [PMID: 38042105 DOI: 10.1016/j.compbiomed.2023.107789] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/23/2023] [Revised: 11/21/2023] [Accepted: 11/28/2023] [Indexed: 12/04/2023]
Abstract
The worldwide COVID-19 pandemic has profoundly influenced the health and everyday experiences of individuals across the planet. It is a highly contagious respiratory disease requiring early and accurate detection to curb its rapid transmission. Initial testing methods primarily revolved around identifying the genetic composition of the coronavirus, exhibiting a relatively low detection rate and requiring a time-intensive procedure. To address this challenge, experts have suggested using radiological imagery, particularly chest X-rays, as a valuable approach within the diagnostic protocol. This study investigates the potential of leveraging radiographic imaging (X-rays) with deep learning algorithms to swiftly and precisely identify COVID-19 patients. The proposed approach elevates the detection accuracy by fine-tuning with appropriate layers on various established transfer learning models. The experimentation was conducted on a COVID-19 X-ray dataset containing 2000 images. The accuracy rates achieved were impressive of 99.55%, 97.32%, 99.11%, 99.55%, 99.11% and 100% for Xception, InceptionResNetV2, ResNet50 , ResNet50V2, EfficientNetB0 and EfficientNetB4 respectively. The fine-tuned EfficientNetB4 achieved an excellent accuracy score, showcasing its potential as a robust COVID-19 detection model. Furthermore, EfficientNetB4 excelled in identifying Lung disease using Chest X-ray dataset containing 4,350 Images, achieving remarkable performance with an accuracy of 99.17%, precision of 99.13%, recall of 99.16%, and f1-score of 99.14%. These results highlight the promise of fine-tuned transfer learning for efficient lung detection through medical imaging, especially with X-ray images. This research offers radiologists an effective means of aiding rapid and precise COVID-19 diagnosis and contributes valuable assistance for healthcare professionals in accurately identifying affected patients.
Collapse
Affiliation(s)
- Md Alamin Talukder
- Department of Computer Science and Engineering, Jagannath University, Dhaka, Bangladesh.
| | - Md Abu Layek
- Department of Computer Science and Engineering, Jagannath University, Dhaka, Bangladesh.
| | - Mohsin Kazi
- Department of Pharmaceutics, College of Pharmacy, King Saud University, P.O. Box-2457, Riyadh 11451, Saudi Arabia.
| | - Md Ashraf Uddin
- School of Information Technology, Deakin University, Waurn Ponds Campus, Geelong, Australia.
| | - Sunil Aryal
- School of Information Technology, Deakin University, Waurn Ponds Campus, Geelong, Australia.
| |
Collapse
|
7
|
Nizam NB, Siddiquee SM, Shirin M, Bhuiyan MIH, Hasan T. COVID-19 Severity Prediction from Chest X-ray Images Using an Anatomy-Aware Deep Learning Model. J Digit Imaging 2023; 36:2100-2112. [PMID: 37369941 PMCID: PMC10502002 DOI: 10.1007/s10278-023-00861-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2023] [Revised: 05/17/2023] [Accepted: 05/25/2023] [Indexed: 06/29/2023] Open
Abstract
The COVID-19 pandemic has been adversely affecting the patient management systems in hospitals around the world. Radiological imaging, especially chest x-ray and lung Computed Tomography (CT) scans, plays a vital role in the severity analysis of hospitalized COVID-19 patients. However, with an increasing number of patients and a lack of skilled radiologists, automated assessment of COVID-19 severity using medical image analysis has become increasingly important. Chest x-ray (CXR) imaging plays a significant role in assessing the severity of pneumonia, especially in low-resource hospitals, and is the most frequently used diagnostic imaging in the world. Previous methods that automatically predict the severity of COVID-19 pneumonia mainly focus on feature pooling from pre-trained CXR models without explicitly considering the underlying human anatomical attributes. This paper proposes an anatomy-aware (AA) deep learning model that learns the generic features from x-ray images considering the underlying anatomical information. Utilizing a pre-trained model and lung segmentation masks, the model generates a feature vector including disease-level features and lung involvement scores. We have used four different open-source datasets, along with an in-house annotated test set for training and evaluation of the proposed method. The proposed method improves the geographical extent score by 11% in terms of mean squared error (MSE) while preserving the benchmark result in lung opacity score. The results demonstrate the effectiveness of the proposed AA model in COVID-19 severity prediction from chest X-ray images. The algorithm can be used in low-resource setting hospitals for COVID-19 severity prediction, especially where there is a lack of skilled radiologists.
Collapse
Affiliation(s)
- Nusrat Binta Nizam
- mHealth Research Group, Department of Biomedical Engineering, Bangladesh University of Engineering and Technology (BUET), Dhaka, 1205, Bangladesh
| | - Sadi Mohammad Siddiquee
- mHealth Research Group, Department of Biomedical Engineering, Bangladesh University of Engineering and Technology (BUET), Dhaka, 1205, Bangladesh
| | - Mahbuba Shirin
- Department of Radiology and Imaging, Bangabandhu Sheikh Mujib Medical University, Shahbagh, Dhaka, 1000, Bangladesh
| | - Mohammed Imamul Hassan Bhuiyan
- Department of Electrical and Electronics Engineering (EEE), Bangladesh University of Engineering and Technology, Dhaka, 1205, Bangladesh
| | - Taufiq Hasan
- mHealth Research Group, Department of Biomedical Engineering, Bangladesh University of Engineering and Technology (BUET), Dhaka, 1205, Bangladesh.
- Center for Bioengineering Innovation and Design (CBID), Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD, USA.
| |
Collapse
|
8
|
Mabrouk A, Díaz Redondo RP, Abd Elaziz M, Kayed M. Ensemble Federated Learning: An approach for collaborative pneumonia diagnosis. Appl Soft Comput 2023; 144:110500. [DOI: 10.1016/j.asoc.2023.110500] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/01/2023]
|