Explainability Metrics of Deep Convolutional Networks for Photoplethysmography Quality Assessment

Development of a Dual-Plane MRI-Based Deep Learning Model to Assess the 1-Year Postoperative Outcomes in Lumbar Disc Herniation After Tubular Microdiscectomy

BACKGROUND

Tubular microdiscectomy (TMD) is a treatment for lumbar disc herniation (LDH). Although the combination of MRI and deep learning (DL) has shown promise, its application in evaluating postoperative outcomes in TMD has not been fully explored.

PURPOSE/HYPOTHESIS

To evaluate whether integrating preoperative dual-plane MRI-based DL features with clinical features can assess 1-year outcomes in TMD for LDH.

STUDY TYPE

Retrospective.

POPULATION/SUBJECTS

The study involved 548 patients who underwent TMD between January 2016 and January 2021. Training set (N = 305, mean age 51.85 ± 13.84 years, 56.4% male). Internal validation set (N = 131, mean age 51.85 ± 13.84 years, 54.2% male). External validation set (N = 112, mean age 51.54 ± 14.43 years, 50.9% male).

FIELD STRENGTH/SEQUENCE

3 T MRI with sagittal and transverse T2-weighted sequences (Fast Spin Echo).

ASSESSMENT

Ground truth labels were based on improvement rate in 1-year Japanese Orthopaedic Association (JOA) scores. Information on 42 preoperative clinical features was collected. The largest protrusions were identified from T2 MRI by three clinicians and were used to train deep learning models (ResNet50, ResNet101, and ResNet152) to extract DL features. After feature selection, three models were built, namely, clinical, DL, and combined models.

STATISTICAL TESTS

Chi-square or Fisher's exact tests was used for group comparisons. Quantitative differences were analyzed using the t-test or Mann-Whitney U test. P-values <0.05 were considered significant. Models were validated on internal and external datasets using metrics such as the area under the curve (AUC).

RESULTS

The AUCs of the clinical models achieved 0.806 (internal) and 0.779 (external). ResNet152 performed best in three DL models, with AUCs of 0.858 (internal) and 0.834 (external). The combined model achieved AUCs of 0.889 (internal) and 0.857 (external).

DATA CONCLUSION

A model combining preoperative dual-plane MRI DL features and clinical features can assess 1-year outcomes of TMD for LDH.

EVIDENCE LEVEL

4 TECHNICAL EFFICACY: Stage 2.

A review of evaluation approaches for explainable AI with applications in cardiology

Explainable artificial intelligence (XAI) elucidates the decision-making process of complex AI models and is important in building trust in model predictions. XAI explanations themselves require evaluation as to accuracy and reasonableness and in the context of use of the underlying AI model. This review details the evaluation of XAI in cardiac AI applications and has found that, of the studies examined, 37% evaluated XAI quality using literature results, 11% used clinicians as domain-experts, 11% used proxies or statistical analysis, with the remaining 43% not assessing the XAI used at all. We aim to inspire additional studies within healthcare, urging researchers not only to apply XAI methods but to systematically assess the resulting explanations, as a step towards developing trustworthy and safe models.

Supplementary Information

The online version contains supplementary material available at 10.1007/s10462-024-10852-w.

BCG Signal Quality Assessment Based on Time-Series Imaging Methods

This paper describes a signal quality classification method for arm ballistocardiogram (BCG), which has the potential for non-invasive and continuous blood pressure measurement. An advantage of the BCG signal for wearable devices is that it can easily be measured using accelerometers. However, the BCG signal is also susceptible to noise caused by motion artifacts. This distortion leads to errors in blood pressure estimation, thereby lowering the performance of blood pressure measurement based on BCG. In this study, to prevent such performance degradation, a binary classification model was created to distinguish between high-quality versus low-quality BCG signals. To estimate the most accurate model, four time-series imaging methods (recurrence plot, the Gramain angular summation field, the Gramain angular difference field, and the Markov transition field) were studied to convert the temporal BCG signal associated with each heartbeat into a 448 × 448 pixel image, and the image was classified using CNN models such as ResNet, SqueezeNet, DenseNet, and LeNet. A total of 9626 BCG beats were used for training, validation, and testing. The experimental results showed that the ResNet and SqueezeNet models with the Gramain angular difference field method achieved a binary classification accuracy of up to 87.5%.

Application of explainable artificial intelligence for healthcare: A systematic review of the last decade (2011-2022)

BACKGROUND AND OBJECTIVES

Artificial intelligence (AI) has branched out to various applications in healthcare, such as health services management, predictive medicine, clinical decision-making, and patient data and diagnostics. Although AI models have achieved human-like performance, their use is still limited because they are seen as a black box. This lack of trust remains the main reason for their low use in practice, especially in healthcare. Hence, explainable artificial intelligence (XAI) has been introduced as a technique that can provide confidence in the model's prediction by explaining how the prediction is derived, thereby encouraging the use of AI systems in healthcare. The primary goal of this review is to provide areas of healthcare that require more attention from the XAI research community.

METHODS

Multiple journal databases were thoroughly searched using PRISMA guidelines 2020. Studies that do not appear in Q1 journals, which are highly credible, were excluded.

RESULTS

In this review, we surveyed 99 Q1 articles covering the following XAI techniques: SHAP, LIME, GradCAM, LRP, Fuzzy classifier, EBM, CBR, rule-based systems, and others.

CONCLUSION

We discovered that detecting abnormalities in 1D biosignals and identifying key text in clinical notes are areas that require more attention from the XAI research community. We hope this is review will encourage the development of a holistic cloud system for a smart city.

Explainable AI for clinical and remote health applications: a survey on tabular and time series data

Nowadays Artificial Intelligence (AI) has become a fundamental component of healthcare applications, both clinical and remote, but the best performing AI systems are often too complex to be self-explaining. Explainable AI (XAI) techniques are defined to unveil the reasoning behind the system’s predictions and decisions, and they become even more critical when dealing with sensitive and personal health data. It is worth noting that XAI has not gathered the same attention across different research areas and data types, especially in healthcare. In particular, many clinical and remote health applications are based on tabular and time series data, respectively, and XAI is not commonly analysed on these data types, while computer vision and Natural Language Processing (NLP) are the reference applications. To provide an overview of XAI methods that are most suitable for tabular and time series data in the healthcare domain, this paper provides a review of the literature in the last 5 years, illustrating the type of generated explanations and the efforts provided to evaluate their relevance and quality. Specifically, we identify clinical validation, consistency assessment, objective and standardised quality evaluation, and human-centered quality assessment as key features to ensure effective explanations for the end users. Finally, we highlight the main research challenges in the field as well as the limitations of existing XAI methods.

The Hybrid Excess and Decay (HED) model: an automated approach to characterising changes in the photoplethysmography pulse waveform

Photoplethysmography offers a widely used, convenient and non-invasive approach to monitoring basic indices of cardiovascular function, such as heart rate and blood oxygenation. Systematic analysis of the shape of the waveform generated by photoplethysmography might be useful to extract estimates of several physiological and psychological factors influencing the waveform. Here, we developed a robust and automated method for such a systematic analysis across individuals and across different physiological and psychological contexts. We describe a psychophysiologically-relevant model, the Hybrid Excess and Decay (HED) model, which characterises pulse wave morphology in terms of three underlying pressure waves and a decay function. We present the theoretical and practical basis for the model and demonstrate its performance when applied to a pharmacological dataset of 105 participants receiving intravenous administrations of the sympathomimetic drug isoproterenol (isoprenaline). We show that these parameters capture photoplethysmography data with a high degree of precision and, moreover, are sensitive to experimentally-induced changes in interoceptive arousal within individuals. We conclude by discussing the possible value in using the HED model as a complement to standard measures of photoplethysmography signals.

Design of a Realtime Photoplethysmogram Signal Quality Checker for Wearables and Edge Computing

Photoplethysmogram (PPG) signal is extensively used for deducing health parameters of patients in order to infer about physiological conditions of heart, blood pressure, respiratory patterns, and so on. Such analysis and estimations can be done accurately only on high quality PPG signals with very minimal artifacts. PPG signals collected from fitness grade and smart phone scenarios are prone to muscle artifacts and hence there is a need to assess the signal quality before using the signal. Although there are approaches available in the realm of machine learning and deep learning, they are computationally expensive and may not be suitable for a wearable or edge computing scenario. In this paper, we propose the design of a quality checker to check the quality of the signal that can be directly implemented on edge devices like smartwatch. The algorithm is tested on PPG data collected from wearable, ICU and medical grade devices. In the wearable scenario where the noise levels are very high, our algorithm has performed significantly better with a F_score of over 0.92. Further we show that by applying the proposed quality checker, the accuracy of the computed heart rate from a smart phone PPG-application significantly improves.

Signal Quality Assessment of Photoplethysmogram Signals using Quantum Pattern Recognition Technique and lightweight CNN Module

Photoplethysmography (PPG) signal comprises physiological information related to cardiorespiratory health. High-quality PPG signals are necessary to extract cardiores-piratory information accurately. Motion artifacts can easily corrupt PPG signals due to human locomotion, leading to noise enriched, poor quality signals. Several rule-based and Machine-Learning (ML) - based approaches for PPG signal quality estimation are available, but those algorithms' efficacy is questionable. So, the authors propose a lightweight CNN architecture for signal quality assessment by employing a novel Quantum Pattern Recognition (QPR) technique. The proposed algorithm is validated on manually annotated data obtained from the University of Queensland database. A total of 28366, 5s signal segments are preprocessed and transformed into image files of 20 x 500 pixels for input to the 2D CNN architecture. The developed model classifies the PPG signal as 'good' and 'bad' with an accuracy of 98.3% with 99.3% sensitivity, 94.5% specificity and 98.9% F1-score. The experimental analysis concludes that slim module based architecture and novel Spatio-temporal pattern recognition technique improve the system's performance. The proposed approach is suitable for a resource-constrained wearable implementation.

A supervised machine learning semantic segmentation approach for detecting artifacts in plethysmography signals from wearables

Objective. Wearable devices equipped with plethysmography (PPG) sensors provided a low-cost, long-term solution to early diagnosis and continuous screening of heart conditions. However PPG signals collected from such devices often suffer from corruption caused by artifacts. The objective of this study is to develop an effective supervised algorithm to locate the regions of artifacts within PPG signals.Approach. We treat artifact detection as a 1D segmentation problem. We solve it via a novel combination of an active-contour-based loss and an adapted U-Net architecture. The proposed algorithm was trained on the PPG DaLiA training set, and further evaluated on the PPG DaLiA testing set, WESAD dataset and TROIKA dataset.Main results. We evaluated with the DICE score, a well-established metric for segmentation accuracy evaluation in the field of computer vision. The proposed method outperforms baseline methods on all three datasets by a large margin (≈7 percentage points above the next best method). On the PPG DaLiA testing set, WESAD dataset and TROIKA dataset, the proposed method achieved 0.8734 ± 0.0018, 0.9114 ± 0.0033 and 0.8050 ± 0.0116 respectively. The next best method only achieved 0.8068 ± 0.0014, 0.8446 ± 0.0013 and 0.7247 ± 0.0050.Significance. The proposed method is able to pinpoint exact locations of artifacts with high precision; in the past, we had only a binary classification of whether a PPG signal has good or poor quality. This more nuanced information will be critical to further inform the design of algorithms to detect cardiac arrhythmia.