Combining CNN and Grad-Cam for COVID-19 Disease Prediction and Visual Explanation

Shapley-based saliency maps improve interpretability of vertebral compression fractures classification: multicenter study

PURPOSE

Evaluate the classification performance and interpretability of the Vision Transformer (ViT) model on acute and chronic vertebral compression fractures using Shapley significance maps.

MATERIALS AND METHODS

This retrospective study utilized medical imaging data from December 2018 to December 2023 from three hospitals in China. The study included 942 patients, with imaging data comprising X-rays, CTs, and MRIs. Patients were divided into training, validation, and test sets with a ratio of 7:2:1. The ViT model variant, SimpleViT, was fine-tuned on the training dataset. Statistical analyses were performed using the PixelMedAI platform, focusing on metrics such as ROC curves, sensitivity, specificity, and AUC values, with statistical significance assessed using the DeLong test.

RESULTS

A total of 942 patients (mean age 69.17 ± 10.61 years) were included, with 1076 vertebral fractures analyzed (705 acute, 371 chronic). In the test set, the ViT model demonstrated superior performance over the ResNet18 model, with an accuracy of 0.880 and an AUC of 0.901 compared to 0.843 and 0.833, respectively. The use of ViT Shapley saliency maps significantly enhanced diagnostic sensitivity and specificity, reaching 0.883 (95% CI: 0.800, 0.963) and 0.950 (95% CI: 0.891, 1.00), respectively.

CONCLUSION

In vertebral compression fractures classification, Vision Transformer outperformed Convolutional Neural Network, providing more effective Shapley-based saliency maps that were favored by radiologists over GradCAM.

Accurate and visualiable discrimination of Chenpi age using 2D-CNN and Grad-CAM++ based on infrared spectral images

Dried tangerine peel ("Chenpi"), has numerous clinical and nutritional benefits, with its quality being significantly influenced by its storage age, referred to as "Chen Jiu Zhe Liang" in Chinese. Concequently, the rapid and accurate identification of Chenpi's age is important for consumers. In this study, Fourier transform infrared spectroscopy (FTIR) was employed to capture spectral images of Chenpi. These FTIR images were then analyzed using a two-dimensional convolutional neural networks (2D-CNN) model, achieving a discrimination accuracy of 97.92%. To address the "black box" nature of the 2D-CNN, Gradient-weighted Class Activation Mapping Plus Plus (Grad-CAM++) was utilized to highlight the important regions contributing to the model's performance. Additionally, six other machine learning models were developped using features identified by the 2D-CNN to validate their effectiveness. The results demonstrated that the combination of FTIR spectral images and 2D-CNN provides a highly effective method for accurately determining the age of Chenpi.

Deep Learning-Based System Combining Chest X-Ray and Computerized Tomography Images for COVID-19 Diagnosis

Aims/Background: The coronavirus disease 2019 (COVID-19) pandemic has highlighted the need for accurate and efficient diagnostic methods. This study aims to improve COVID-19 detection by integrating chest X-ray (CXR) and computerized tomography (CT) images using deep learning techniques, further improving diagnostic accuracy by using a combined imaging approach. Methods: The study used two publicly accessible databases, COVID-19 Questionnaires for Understanding the Exposure (COVID-QU-Ex) and Integrated Clinical and Translational Cancer Foundation (iCTCF), containing CXR and CT images, respectively. The proposed system employed convolutional neural networks (CNNs) for classification, specifically EfficientNet and ResNet architectures. The data underwent preprocessing steps, including image resizing, Gaussian noise addition, and data augmentation. The dataset was divided into training, validation, and test sets. Gradient-weighted Class Activation Mapping (Grad-CAM) was used for model interpretability. Results: The EfficientNet-based models outperformed the ResNet-based models across all metrics. The highest accuracy achieved was 99.44% for CXR images and 99.81% for CT images with EfficientNetB5. The models also demonstrated high precision, recall, and F1 scores. For statistical significance, the p-values were less than 0.05, indicating that the results are significant. Conclusion: Integrating CXR and CT images using deep learning significantly improves the accuracy of COVID-19 diagnosis. The EfficientNet-based models, with their superior feature extraction capabilities, show better performance than ResNet models. Grad-CAM Visualizations provide insights into the model's decision-making process, potentially reducing diagnostic errors and accelerating diagnosis processes. This approach can improve patient care and support healthcare systems in managing the pandemic more effectively.

Pixel-Wise Interstitial Lung Disease Interval Change Analysis: A Quantitative Evaluation Method for Chest Radiographs Using Weakly Supervised Learning

Interstitial lung disease (ILD) is characterized by progressive pathological changes that require timely and accurate diagnosis. The early detection and progression assessment of ILD are important for effective management. This study introduces a novel quantitative evaluation method utilizing chest radiographs to analyze pixel-wise changes in ILD. Using a weakly supervised learning framework, the approach incorporates the contrastive unpaired translation model and a newly developed ILD extent scoring algorithm for more precise and objective quantification of disease changes than conventional visual assessments. The ILD extent score calculated through this method demonstrated a classification accuracy of 92.98% between ILD and normal classes. Additionally, using an ILD follow-up dataset for interval change analysis, this method assessed disease progression with an accuracy of 85.29%. These findings validate the reliability of the ILD extent score as a tool for ILD monitoring. The results of this study suggest that the proposed quantitative method may improve the monitoring and management of ILD.

Advances in artificial intelligence in thyroid-associated ophthalmopathy

Thyroid-associated ophthalmopathy (TAO), also referred to as Graves' ophthalmopathy, is a medical condition wherein ocular complications arise due to autoimmune thyroid illness. The diagnosis of TAO, reliant on imaging, typical ocular symptoms, and abnormalities in thyroid function or thyroid-associated antibodies, is generally graded and staged. In recent years, Artificial intelligence(AI), particularly deep learning(DL) technology, has gained widespread use in the diagnosis and treatment of ophthalmic diseases. This paper presents a discussion on specific studies involving AI, specifically DL, in the context of TAO, highlighting their applications in TAO diagnosis, staging, grading, and treatment decisions. Additionally, it addresses certain limitations in AI research on TAO and potential future directions for the field.

AI-powered COVID-19 forecasting: a comprehensive comparison of advanced deep learning methods

BACKGROUND

The coronavirus disease 2019 (COVID-19) pandemic continues to pose significant challenges to the public health sector, including that of the United Arab Emirates (UAE). The objective of this study was to assess the efficiency and accuracy of various deep-learning models in forecasting COVID-19 cases within the UAE, thereby aiding the nation's public health authorities in informed decision-making.

METHODS

This study utilized a comprehensive dataset encompassing confirmed COVID-19 cases, demographic statistics, and socioeconomic indicators. Several advanced deep learning models, including long short-term memory (LSTM), bidirectional LSTM, convolutional neural network (CNN), CNN-LSTM, multilayer perceptron, and recurrent neural network (RNN) models, were trained and evaluated. Bayesian optimization was also implemented to fine-tune these models.

RESULTS

The evaluation framework revealed that each model exhibited different levels of predictive accuracy and precision. Specifically, the RNN model outperformed the other architectures even without optimization. Comprehensive predictive and perspective analytics were conducted to scrutinize the COVID-19 dataset.

CONCLUSION

This study transcends academic boundaries by offering critical insights that enable public health authorities in the UAE to deploy targeted data-driven interventions. The RNN model, which was identified as the most reliable and accurate for this specific context, can significantly influence public health decisions. Moreover, the broader implications of this research validate the capability of deep learning techniques in handling complex datasets, thus offering the transformative potential for predictive accuracy in the public health and healthcare sectors.

An Explainable AI Paradigm for Alzheimer's Diagnosis Using Deep Transfer Learning

Alzheimer's disease (AD) is a progressive neurodegenerative disorder that affects millions of individuals worldwide, causing severe cognitive decline and memory impairment. The early and accurate diagnosis of AD is crucial for effective intervention and disease management. In recent years, deep learning techniques have shown promising results in medical image analysis, including AD diagnosis from neuroimaging data. However, the lack of interpretability in deep learning models hinders their adoption in clinical settings, where explainability is essential for gaining trust and acceptance from healthcare professionals. In this study, we propose an explainable AI (XAI)-based approach for the diagnosis of Alzheimer's disease, leveraging the power of deep transfer learning and ensemble modeling. The proposed framework aims to enhance the interpretability of deep learning models by incorporating XAI techniques, allowing clinicians to understand the decision-making process and providing valuable insights into disease diagnosis. By leveraging popular pre-trained convolutional neural networks (CNNs) such as VGG16, VGG19, DenseNet169, and DenseNet201, we conducted extensive experiments to evaluate their individual performances on a comprehensive dataset. The proposed ensembles, Ensemble-1 (VGG16 and VGG19) and Ensemble-2 (DenseNet169 and DenseNet201), demonstrated superior accuracy, precision, recall, and F1 scores compared to individual models, reaching up to 95%. In order to enhance interpretability and transparency in Alzheimer's diagnosis, we introduced a novel model achieving an impressive accuracy of 96%. This model incorporates explainable AI techniques, including saliency maps and grad-CAM (gradient-weighted class activation mapping). The integration of these techniques not only contributes to the model's exceptional accuracy but also provides clinicians and researchers with visual insights into the neural regions influencing the diagnosis. Our findings showcase the potential of combining deep transfer learning with explainable AI in the realm of Alzheimer's disease diagnosis, paving the way for more interpretable and clinically relevant AI models in healthcare.

Transformer with convolution and graph-node co-embedding: An accurate and interpretable vision backbone for predicting gene expressions from local histopathological image

Inferring gene expressions from histopathological images has long been a fascinating yet challenging task, primarily due to the substantial disparities between the two modality. Existing strategies using local or global features of histological images are suffering model complexity, GPU consumption, low interpretability, insufficient encoding of local features, and over-smooth prediction of gene expressions among neighboring sites. In this paper, we develop TCGN (Transformer with Convolution and Graph-Node co-embedding method) for gene expression estimation from H&E-stained pathological slide images. TCGN comprises a combination of convolutional layers, transformer encoders, and graph neural networks, and is the first to integrate these blocks in a general and interpretable computer vision backbone. Notably, TCGN uniquely operates with just a single spot image as input for histopathological image analysis, simplifying the process while maintaining interpretability. We validate TCGN on three publicly available spatial transcriptomic datasets. TCGN consistently exhibited the best performance (with median PCC 0.232). TCGN offers superior accuracy while keeping parameters to a minimum (just 86.241 million), and it consumes minimal memory, allowing it to run smoothly even on personal computers. Moreover, TCGN can be extended to handle bulk RNA-seq data while providing the interpretability. Enhancing the accuracy of omics information prediction from pathological images not only establishes a connection between genotype and phenotype, enabling the prediction of costly-to-measure biomarkers from affordable histopathological images, but also lays the groundwork for future multi-modal data modeling. Our results confirm that TCGN is a powerful tool for inferring gene expressions from histopathological images in precision health applications.

Rice seed vigor detection based on near-infrared hyperspectral imaging and deep transfer learning

Vigor is one of the important factors that affects rice yield and quality. Rapid and accurate detection of rice seed vigor is of great importance for rice production. In this study, near-infrared hyperspectral imaging technique and transfer learning were combined to detect rice seed vigor. Four varieties of artificial-aged rice seeds (Yongyou12, Yongyou1540, Suxiangjing100, and Longjingyou1212) were studied. Different convolutional neural network (CNN) models were built to detect the vigor of the rice seeds. Two transfer strategies, fine-tuning and MixStyle, were used to transfer knowledge among different rice varieties for vigor detection. The experimental results showed that the convolutional neural network model of Yongyou12 classified the vigor of Yongyou1540, Suxiangjing100, and Longjingyou1212 through MixStyle transfer knowledge, and the accuracy reached 90.00%, 80.33%, and 85.00% in validation sets, respectively, which was better or close to the initial modeling performances of each variety. MixStyle statistics are based on probabilistic mixed instance-level features of cross-source domain training samples. When training instances, new domains can be synthesized, which increases the domain diversity of the source domain, thereby improving the generalization ability of the trained model. This study would help rapid and accurate detection of a large varieties of crop seeds.

Harnessing the power of AI: Advanced deep learning models optimization for accurate SARS-CoV-2 forecasting

The pandemic has significantly affected many countries including the USA, UK, Asia, the Middle East and Africa region, and many other countries. Similarly, it has substantially affected Malaysia, making it crucial to develop efficient and precise forecasting tools for guiding public health policies and approaches. Our study is based on advanced deep-learning models to predict the SARS-CoV-2 cases. We evaluate the performance of Long Short-Term Memory (LSTM), Bi-directional LSTM, Convolutional Neural Networks (CNN), CNN-LSTM, Multilayer Perceptron, Gated Recurrent Unit (GRU), and Recurrent Neural Networks (RNN). We trained these models and assessed them using a detailed dataset of confirmed cases, demographic data, and pertinent socio-economic factors. Our research aims to determine the most reliable and accurate model for forecasting SARS-CoV-2 cases in the region. We were able to test and optimize deep learning models to predict cases, with each model displaying diverse levels of accuracy and precision. A comprehensive evaluation of the models' performance discloses the most appropriate architecture for Malaysia's specific situation. This study supports ongoing efforts to combat the pandemic by offering valuable insights into the application of sophisticated deep-learning models for precise and timely SARS-CoV-2 case predictions. The findings hold considerable implications for public health decision-making, empowering authorities to create targeted and data-driven interventions to limit the virus's spread and minimize its effects on Malaysia's population.

Deep Convolutional Neural Networks for Detecting COVID-19 Using Medical Images: A Survey

Coronavirus Disease 2019 (COVID-19), which is caused by Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-COV-2), surprised the world in December 2019 and has threatened the lives of millions of people. Countries all over the world closed worship places and shops, prevented gatherings, and implemented curfews to stand against the spread of COVID-19. Deep Learning (DL) and Artificial Intelligence (AI) can have a great role in detecting and fighting this disease. Deep learning can be used to detect COVID-19 symptoms and signs from different imaging modalities, such as X-Ray, Computed Tomography (CT), and Ultrasound Images (US). This could help in identifying COVID-19 cases as a first step to curing them. In this paper, we reviewed the research studies conducted from January 2020 to September 2022 about deep learning models that were used in COVID-19 detection. This paper clarified the three most common imaging modalities (X-Ray, CT, and US) in addition to the DL approaches that are used in this detection and compared these approaches. This paper also provided the future directions of this field to fight COVID-19 disease.

Enhanced Tooth Region Detection Using Pretrained Deep Learning Models

The rapid development of artificial intelligence (AI) has led to the emergence of many new technologies in the healthcare industry. In dentistry, the patient's panoramic radiographic or cone beam computed tomography (CBCT) images are used for implant placement planning to find the correct implant position and eliminate surgical risks. This study aims to develop a deep learning-based model that detects missing teeth's position on a dataset segmented from CBCT images. Five hundred CBCT images were included in this study. After preprocessing, the datasets were randomized and divided into 70% training, 20% validation, and 10% test data. A total of six pretrained convolutional neural network (CNN) models were used in this study, which includes AlexNet, VGG16, VGG19, ResNet50, DenseNet169, and MobileNetV3. In addition, the proposed models were tested with/without applying the segmentation technique. Regarding the normal teeth class, the performance of the proposed pretrained DL models in terms of precision was above 0.90. Moreover, the experimental results showed the superiority of DenseNet169 with a precision of 0.98. In addition, other models such as MobileNetV3, VGG19, ResNet50, VGG16, and AlexNet obtained a precision of 0.95, 0.94, 0.94, 0.93, and 0.92, respectively. The DenseNet169 model performed well at the different stages of CBCT-based detection and classification with a segmentation accuracy of 93.3% and classification of missing tooth regions with an accuracy of 89%. As a result, the use of this model may represent a promising time-saving tool serving dental implantologists with a significant step toward automated dental implant planning.

Design and implementation of a New Blockchain-based digital health passport: A Moroccan case study

In the context of COVID-19 pandemic, the Moroccan Interior and Health Ministries have proposed to use the health pass with a QR code to identify vaccinated people. Additionally, the government suggested a mobile application to control the health passport authenticity. However, the key problem is the possibility of anyone scanning the QR code and figuring out citizens' private information, causing severe issues about individual privacy. In this work, the main contribution is integrating a private Blockchain-based digital health passport to ensure high protection of sensitive information, security and privacy among all the actors (Government, Ministry of Interior, Ministry of Health, verifiers) that comply with the CNDP (National Commission for the Control of Personal Data Protection) and the Moroccan Law 09–08. In our proposed architectural framework solution, we identify two types of actors: authorized and unauthorized, to limit and control access to the citizens' personal information. Besides, to preserve individuals' privacy, we adopt on-chain and off-chain storage (Interplanetary File Systems IPFS). In our case, smart contracts improve security and privacy in the health passport verification process. Our system implementation describes the proposed solution to grant individual privacy. To verify and validate our approach, we used Remix-IDE and Ethereum Blockchain to build smart contracts.

Performance evaluation of spatial fuzzy C-means clustering algorithm on GPU for image segmentation

Image processing by segmentation technique is an important phase in medical imaging such as MRI. Its objective is to analyze the different tissues in human body. In research area, Fuzzy set is one of the most successful techniques that guarantees a robust classification. Spatial FCM (SFCM); one of the fuzzy c-means variants; considers spatial information to deal with the noisy images. To reduce this iterative algorithm's execution time, a hard SIMD architecture has been planted named the Graphical Processing Unit (GPU). In this work, a great contribution has been done to diagnose, confront and implement three different parallel implementations on GPU. A parallel implementations' extensive study of SFCM entitled PSFCM using 3 × 3 window is presented, and the experiments illustrate a significant decrease in terms of running time of this algorithm known by its high complexity. The experimental results indicate that the parallel version's execution time is about 9.46 times faster than the sequential implementation on image segmentation. This gain in terms of speed-up is achieved on the Nvidia GeForce GT 740 m GPU.

Concatenation of Pre-Trained Convolutional Neural Networks for Enhanced COVID-19 Screening Using Transfer Learning Technique

Coronavirus (COVID-19) is the most prevalent coronavirus infection with respiratory symptoms such as fever, cough, dyspnea, pneumonia, and weariness being typical in the early stages. On the other hand, COVID-19 has a direct impact on the circulatory and respiratory systems as it causes a failure to some human organs or severe respiratory distress in extreme circumstances. Early diagnosis of COVID-19 is extremely important for the medical community to limit its spread. For a large number of suspected cases, manual diagnostic methods based on the analysis of chest images are insufficient. Faced with this situation, artificial intelligence (AI) techniques have shown great potential in automatic diagnostic tasks. This paper aims at proposing a fast and precise medical diagnosis support system (MDSS) that can distinguish COVID-19 precisely in chest-X-ray images. This MDSS uses a concatenation technique that aims to combine pre-trained convolutional neural networks (CNN) depend on the transfer learning (TL) technique to build a highly accurate model. The models enable storage and application of knowledge learned from a pre-trained CNN to a new task, viz., COVID-19 case detection. For this purpose, we employed the concatenation method to aggregate the performances of numerous pre-trained models to confirm the reliability of the proposed method for identifying the patients with COVID-19 disease from X-ray images. The proposed system was trialed on a dataset that included four classes: normal, viral-pneumonia, tuberculosis, and COVID-19 cases. Various general evaluation methods were used to evaluate the effectiveness of the proposed model. The first proposed model achieved an accuracy rate of 99.80% while the second model reached an accuracy of 99.71%.