Non-Standardized Patch-Based ECG Lead Together With Deep Learning Based Algorithm for Automatic Screening of Atrial Fibrillation

Improving deep-learning electrocardiogram classification with an effective coloring method

Cardiovascular diseases, particularly arrhythmias, remain a leading cause of mortality worldwide. Electrocardiogram (ECG) analysis plays a pivotal role in cardiovascular disease diagnosis. Although previous studies have focused on waveform analysis and model training, integrating additional clinical information, especially demographic data, remains challenging. In this study, we present an innovative approach to ECG classification by incorporating demographic information from patients' medical histories through a colorization technique. Our proposed method maps demographic features onto the (R, G, B) color space through normalized scaling. Each demographic feature corresponds to a distinct color, allowing for different ECG leads to be colored. This approach preserves the relationships between data by maintaining the color correlations in the statistical features, enhancing ECG analytics and supporting precision medicine. We conducted experiments with PTB-XL dataset and achieved 1%-6% improvements in the area under the receiving operator characteristic curve performance compared with other methods for various classification problems. Notably, our method excelled in multiclass and challenging classification tasks. The combined use of color features and the original waveform shape features enhanced prediction accuracy for various deep learning models. Our findings suggest that colorization is a promising avenue for advancing ECG classification and diagnosis, contributing to improved prediction and diagnosis of cardiovascular diseases and ultimately enhancing clinical outcomes.

Snippet Policy Network V2: Knee-Guided Neuroevolution for Multi-Lead ECG Early Classification

Early time series classification predicts the class label of a given time series before it is completely observed. In time-critical applications, such as arrhythmia monitoring in ICU, early treatment contributes to the patient's fast recovery, and early warning could even save lives. Hence, in these cases, it is worthy of trading, to some extent, classification accuracy in favor of earlier decisions when the time series data are collected over time. In this article, we propose a novel deep reinforcement learning-based framework, snippet policy network V2 (SPN-V2), for long and varied-length multi-lead electrocardiogram (ECG) early classification. The proposed SNP-V2 contains two main components: snippet representation learning (SRL) and early classification timing learning (ECTL). The SRL is proposed to encode inner-snippet spatial correlations and inter-snippet temporal correlations into the hidden representations of the subsegment (snippet) of the input ECG. ECTL aims to learn a decision agent to classify the time series early and accurately. To optimize the proposed framework, we design a novel knee-guided neuroevolution algorithm (KGNA) to solve cardiovascular diseases' early classification problem, automatically optimizing the proposed SPN-V2 regarding the tradeoff between accuracy and earliness. In addition, we conduct a series of experiments on two real-world ECG datasets. The experimental results show the superiority of the proposed algorithm over the state-of-the-art competing methods.

Deep learning-based regional ECG diagnosis platform

OBJECTIVE

To enable the intelligent diagnosis of a variety of common Electrocardiogram (ECG), we investigate the deep learning-based ECG diagnosis system.

METHODS

From January 2015 to December 2019, four consecutive years of 100,120 conventional 12-lead ECG data were collected in our hospital. Utilizing this dataset, we constructed a deep learning model designed to intelligently diagnose prevalent ECG anomalies by employing a multi-task learning framework. The system performance was evaluated using various metrics, including sensitivity, specificity, negative predictive value, positive predictive value, and so forth. Additionally, we employed an ECG intelligent diagnostic platform for clinical application to undertake real-time online analysis of 2500 conventional 12-lead ECG samples in June 2020, aiming to validate our model. At this stage, we compared the performance of our model against the traditional manual identification method.

RESULTS

The efficacy of the ECG intelligent diagnostic model was notably high for common and straightforward ECG patterns, such as sinus rhythm (F1 = 98.01%), sinus tachycardia (F1 = 96.26%), sinus bradycardia (F1 = 94.88%), and a normal electrocardiogram (F1 = 91.71%), as well as for Premature Ventricular Contractions (F1 = 91.62%). Nevertheless, when diagnosing rarer and more intricate ECG anomalies, the system requires an increased number of samples to refine the deep learning models. During the validation stage, our model exhibited better efficiency in terms of accuracy, labor time and labor cost when compared to the manual identification approach.

CONCLUSIONS

Our deep learning-driven intelligent ECG diagnostic model clearly demonstrates significant clinical utility. The integrated artificial intelligence diagnosis system not only has the potential to augment physicians in their diagnostic processes but also offers a viable avenue to reduce associated labor costs.

Applying Artificial Intelligence to Wearable Sensor Data to Diagnose and Predict Cardiovascular Disease: A Review

Cardiovascular disease (CVD) is the world's leading cause of mortality. There is significant interest in using Artificial Intelligence (AI) to analyse data from novel sensors such as wearables to provide an earlier and more accurate prediction and diagnosis of heart disease. Digital health technologies that fuse AI and sensing devices may help disease prevention and reduce the substantial morbidity and mortality caused by CVD worldwide. In this review, we identify and describe recent developments in the application of digital health for CVD, focusing on AI approaches for CVD detection, diagnosis, and prediction through AI models driven by data collected from wearables. We summarise the literature on the use of wearables and AI in cardiovascular disease diagnosis, followed by a detailed description of the dominant AI approaches applied for modelling and prediction using data acquired from sensors such as wearables. We discuss the AI algorithms and models and clinical applications and find that AI and machine-learning-based approaches are superior to traditional or conventional statistical methods for predicting cardiovascular events. However, further studies evaluating the applicability of such algorithms in the real world are needed. In addition, improvements in wearable device data accuracy and better management of their application are required. Lastly, we discuss the challenges that the introduction of such technologies into routine healthcare may face.

Atrioventricular Synchronization for Detection of Atrial Fibrillation and Flutter in One to Twelve ECG Leads Using a Dense Neural Network Classifier

This study investigates the use of atrioventricular (AV) synchronization as an important diagnostic criterion for atrial fibrillation and flutter (AF) using one to twelve ECG leads. Heart rate, lead-specific AV conduction time, and P-/f-wave amplitude were evaluated by three representative ECG metrics (mean value, standard deviation), namely RR-interval (RRi-mean, RRi-std), PQ-interval (PQi-mean, PQI-std), and PQ-amplitude (PQa-mean, PQa-std), in 71,545 standard 12-lead ECG records from the six largest PhysioNet CinC Challenge 2021 databases. Two rhythm classes were considered (AF, non-AF), randomly assigning records into training (70%), validation (20%), and test (10%) datasets. In a grid search of 19, 55, and 83 dense neural network (DenseNet) architectures and five independent training runs, we optimized models for one-lead, six-lead (chest or limb), and twelve-lead input features. Lead-set performance and SHapley Additive exPlanations (SHAP) input feature importance were evaluated on the test set. Optimal DenseNet architectures with the number of neurons in sequential [1st, 2nd, 3rd] hidden layers were assessed for sensitivity and specificity: DenseNet [16,16,0] with primary leads (I or II) had 87.9-88.3 and 90.5-91.5%; DenseNet [32,32,32] with six limb leads had 90.7 and 94.2%; DenseNet [32,32,4] with six chest leads had 92.1 and 93.2%; and DenseNet [128,8,8] with all 12 leads had 91.8 and 95.8%, indicating sensitivity and specificity values, respectively. Mean SHAP values on the entire test set highlighted the importance of RRi-mean (100%), RR-std (84%), and atrial synchronization (40-60%) for the PQa-mean (aVR, I), PQi-std (V2, aVF, II), and PQi-mean (aVL, aVR). Our focus on finding the strongest AV synchronization predictors of AF in 12-lead ECGs would lead to a comprehensive understanding of the decision-making process in advanced neural network classifiers. DenseNet self-learned to rely on a few ECG behavioral characteristics: first, characteristics usually associated with AF conduction such as rapid heart rate, enhanced heart rate variability, and large PQ-interval deviation in V2 and inferior leads (aVF, II); second, characteristics related to a typical P-wave pattern in sinus rhythm, which is best distinguished from AF by the earliest negative P-peak deflection of the right atrium in the lead (aVR) and late positive left atrial deflection in lateral leads (I, aVL). Our results on lead-selection and feature-selection practices for AF detection should be considered for one- to twelve-lead ECG signal processing settings, particularly those measuring heart rate, AV conduction times, and P-/f-wave amplitudes. Performances are limited to the AF diagnostic potential of these three metrics. SHAP value importance can be used in combination with a human expert's ECG interpretation to change the focus from a broad observation of 12-lead ECG morphology to focusing on the few AV synchronization findings strongly predictive of AF or non-AF arrhythmias. Our results are representative of AV synchronization findings across a broad taxonomy of cardiac arrhythmias in large 12-lead ECG databases.

Recent Advances in Stretchable and Wearable Capacitive Electrophysiological Sensors for Long-Term Health Monitoring

Over the past several years, wearable electrophysiological sensors with stretchability have received significant research attention because of their capability to continuously monitor electrophysiological signals from the human body with minimal body motion artifacts, long-term tracking, and comfort for real-time health monitoring. Among the four different sensors, i.e., piezoresistive, piezoelectric, iontronic, and capacitive, capacitive sensors are the most advantageous owing to their reusability, high durability, device sterilization ability, and minimum leakage currents between the electrode and the body to reduce the health risk arising from any short circuit. This review focuses on the development of wearable, flexible capacitive sensors for monitoring electrophysiological conditions, including the electrode materials and configuration, the sensing mechanisms, and the fabrication strategies. In addition, several design strategies of flexible/stretchable electrodes, body-to-electrode signal transduction, and measurements have been critically evaluated. We have also highlighted the gaps and opportunities needed for enhancing the suitability and practical applicability of wearable capacitive sensors. Finally, the potential applications, research challenges, and future research directions on stretchable and wearable capacitive sensors are outlined in this review.

Perspectives on Sex- and Gender-Specific Prediction of New-Onset Atrial Fibrillation by Leveraging Big Data

Atrial fibrillation (AF), the most common sustained cardiac arrhythmia, has a large impact on quality of life and is associated with increased risk of hospitalization, morbidity, and mortality. Over the past two decades advances regarding the clinical epidemiology and management of AF have been established. Moreover, sex differences in the prevalence, incidence, prediction, pathophysiology, and prognosis of AF have been identified. Nevertheless, AF remains to be a complex and heterogeneous disorder and a comprehensive sex- and gender-specific approach to predict new-onset AF is lacking. The exponential growth in various sources of big data such as electrocardiograms, electronic health records, and wearable devices, carries the potential to improve AF risk prediction. Leveraging these big data sources by artificial intelligence (AI)-enabled approaches, in particular in a sex- and gender-specific manner, could lead to substantial advancements in AF prediction and ultimately prevention. We highlight the current status, premise, and potential of big data to improve sex- and gender-specific prediction of new-onset AF.

Deepaware: A hybrid deep learning and context-aware heuristics-based model for atrial fibrillation detection

BACKGROUND

State-of-the-art automatic atrial fibrillation (AF) detection models trained on RR-interval (RRI) features generally produce high performance on standard benchmark electrocardiogram (ECG) AF datasets. These models, however, result in a significantly high false positive rates (FPRs) when applied on ECG data collected under free-living ambulatory conditions and in the presence of non-AF arrhythmias.

METHOD

This paper proposes DeepAware, a novel hybrid model combining deep learning (DL) and context-aware heuristics (CAH), which reduces the FPR effectively and improves the AF detection performance on participant-operated ambulatory ECG from free-living conditions. It exploits the RRI and P-wave features, as well as the contextual features from the ambulatory ECG.

RESULTS

DeepAware is shown to be very generalizable and superior to the state-of-the-art models when applied on unseen benchmark ECG AF datasets. Most importantly, the model is able to detect AF efficiently when applied on participant-operated ambulatory ECG recordings from free-living conditions and has achieved a sensitivity (Se), specificity (Sp), and accuracy (Acc) of 97.94%, 98.39%, 98.06%, respectively. Results also demonstrate the effect of atrial activity analysis (via P-waves detection) and CAH in reducing the FPR over the RRI features-based AF detection model.

CONCLUSIONS

The proposed DeepAware model can substantially reduce the physician's workload of manually reviewing the false positives (FPs) and facilitate long-term ambulatory monitoring for early detection of AF.

Semi-supervised learning for automatic atrial fibrillation detection in 24-hour Holter monitoring

Paroxysmal atrial fibrillation (AF) is generally diagnosed by long-term dynamic electrocardiogram (ECG) monitoring. Identifying AF episodes from long-term ECG data can place a heavy burden on clinicians. Many machine-learning-based automatic AF detection methods have been proposed to solve this issue. However, these methods require numerous annotated data to train the model, and the annotation of AF in long-term ECG is extremely time-consuming. Reducing the demand for labeled data can effectively improve the clinical practicability of automatic AF detection methods. In this study, we developed a novel semi-supervised learning method that generated modified low-entropy labels of unlabeled samples for training a deep learning model to automatically detect paroxysmal AF in 24 h Holter monitoring data. Our method employed a 1D CNN-LSTM neural network with RR intervals as input and used few labeled training data with numerous unlabeled data for training the neural network. This method was evaluated using a 24 h Holter monitoring dataset collected from 1000 paroxysmal AF patients. Using labeled samples from only 10 patients for model training, our method achieved a sensitivity of 97.8%, specificity of 97.9%, and accuracy of 97.9% in five-fold cross-validation. Compared to the supervised learning method with complete labeled samples, the detection accuracy of our method was only 0.5% lower, while the workload of data annotation was significantly reduced by more than 98%. In general, this is the first study to apply semi-supervised learning techniques for automatic AF detection using ECG. Our method can effectively reduce the demand for AF data annotations and can improve the clinical practicability of automatic AF detection.

State-of-the-art Deep Learning Methods on Electrocardiogram Data: A Systematic Review (Preprint)

Background

Electrocardiogram (ECG) is one of the most common noninvasive diagnostic tools that can provide useful information regarding a patient’s health status. Deep learning (DL) is an area of intense exploration that leads the way in most attempts to create powerful diagnostic models based on physiological signals.

Objective

This study aimed to provide a systematic review of DL methods applied to ECG data for various clinical applications.

Methods

The PubMed search engine was systematically searched by combining “deep learning” and keywords such as “ecg,” “ekg,” “electrocardiogram,” “electrocardiography,” and “electrocardiology.” Irrelevant articles were excluded from the study after screening titles and abstracts, and the remaining articles were further reviewed. The reasons for article exclusion were manuscripts written in any language other than English, absence of ECG data or DL methods involved in the study, and absence of a quantitative evaluation of the proposed approaches.

Results

We identified 230 relevant articles published between January 2020 and December 2021 and grouped them into 6 distinct medical applications, namely, blood pressure estimation, cardiovascular disease diagnosis, ECG analysis, biometric recognition, sleep analysis, and other clinical analyses. We provide a complete account of the state-of-the-art DL strategies per the field of application, as well as major ECG data sources. We also present open research problems, such as the lack of attempts to address the issue of blood pressure variability in training data sets, and point out potential gaps in the design and implementation of DL models.

Conclusions

We expect that this review will provide insights into state-of-the-art DL methods applied to ECG data and point to future directions for research on DL to create robust models that can assist medical experts in clinical decision-making.

Classification of De novo post-operative and persistent atrial fibrillation using multi-channel ECG recordings

Atrial fibrillation (AF) is the most sustained arrhythmia in the heart and also the most common complication developed after cardiac surgery. Due to its progressive nature, timely detection of AF is important. Currently, physicians use a surface electrocardiogram (ECG) for AF diagnosis. However, when the patient develops AF, its various development stages are not distinguishable for cardiologists based on visual inspection of the surface ECG signals. Therefore, severity detection of AF could start from differentiating between short-lasting AF and long-lasting AF. Here, de novo post-operative AF (POAF) is a good model for short-lasting AF while long-lasting AF can be represented by persistent AF. Therefore, we address in this paper a binary severity detection of AF for two specific types of AF. We focus on the differentiation of these two types as de novo POAF is the first time that a patient develops AF. Hence, comparing its development to a more severe stage of AF (e.g., persistent AF) could be beneficial in unveiling the electrical changes in the atrium. To the best of our knowledge, this is the first paper that aims to differentiate these different AF stages. We propose a method that consists of three sets of discriminative features based on fundamentally different aspects of the multi-channel ECG data, namely based on the analysis of RR intervals, a greyscale image representation of the vectorcardiogram, and the frequency domain representation of the ECG. Due to the nature of AF, these features are able to capture both morphological and rhythmic changes in the ECGs. Our classification system consists of a random forest classifier, after a feature selection stage using the ReliefF method. The detection efficiency is tested on 151 patients using 5-fold cross-validation. We achieved 89.07% accuracy in the classification of de novo POAF and persistent AF. The results show that the features are discriminative to reveal the severity of AF. Moreover, inspection of the most important features sheds light on the different characteristics of de novo post-operative and persistent AF.

Artificial Intelligence for Detection of Cardiovascular-Related Diseases from Wearable Devices: A Systematic Review and Meta-Analysis

PURPOSE

Several artificial intelligence (AI) models for the detection and prediction of cardiovascular-related diseases, including arrhythmias, diabetes, and sleep apnea, have been reported. This systematic review and meta-analysis aimed to identify AI models developed for or applicable to wearable and mobile devices for diverse cardiovascular-related diseases.

MATERIALS AND METHODS

The searched databases included Medline, Embase, and Cochrane Library. For AI models for atrial fibrillation (AF) detection, a meta-analysis of diagnostic accuracy was performed to summarize sensitivity and specificity.

RESULTS

A total of 102 studies were included in the qualitative review. There were AI models for the detection of arrythmia (n=62), followed by sleep apnea (n=11), peripheral vascular diseases (n=6), diabetes mellitus (n=5), hyper/hypotension (n=5), valvular heart disease (n=4), heart failure (n=3), myocardial infarction and cardiac arrest (n=2), and others (n=4). For quantitative analysis of 26 studies reporting AI models for AF detection, meta-analyzed sensitivity was 94.80% and specificity was 96.96%. Deep neural networks showed superior performance [meta-analyzed area under receiver operating characteristics curve (AUROC) of 0.981] compared to conventional machine learning algorithms (meta-analyzed AUROC of 0.961). However, AI models tested with proprietary dataset (meta-analyzed AUROC of 0.972) or data acquired from wearable devices (meta-analyzed AUROC of 0.977) showed inferior performance than those with public dataset (meta-analyzed AUROC of 0.986) or data from in-hospital devices (meta-analyzed AUROC of 0.983).

CONCLUSION

This review found that AI models for diverse cardiovascular-related diseases are being developed, and that they are gradually developing into a form that is suitable for wearable and mobile devices.

Review of Deep Learning-Based Atrial Fibrillation Detection Studies

Atrial fibrillation (AF) is a common arrhythmia that can lead to stroke, heart failure, and premature death. Manual screening of AF on electrocardiography (ECG) is time-consuming and prone to errors. To overcome these limitations, computer-aided diagnosis systems are developed using artificial intelligence techniques for automated detection of AF. Various machine learning and deep learning (DL) techniques have been developed for the automated detection of AF. In this review, we focused on the automated AF detection models developed using DL techniques. Twenty-four relevant articles published in international journals were reviewed. DL models based on deep neural network, convolutional neural network (CNN), recurrent neural network, long short-term memory, and hybrid structures were discussed. Our analysis showed that the majority of the studies used CNN models, which yielded the highest detection performance using ECG and heart rate variability signals. Details of the ECG databases used in the studies, performance metrics of the various models deployed, associated advantages and limitations, as well as proposed future work were summarized and discussed. This review paper serves as a useful resource for the researchers interested in developing innovative computer-assisted ECG-based DL approaches for AF detection.

How machine learning is impacting research in atrial fibrillation: implications for risk prediction and future management

There has been an exponential growth of artificial intelligence (AI) and machine learning (ML) publications aimed at advancing our understanding of atrial fibrillation (AF), which has been mainly driven by the confluence of two factors: the advances in deep neural networks (DeepNNs) and the availability of large, open access databases. It is observed that most of the attention has centred on applying ML for dvsetecting AF, particularly using electrocardiograms (ECGs) as the main data modality. Nearly a third of them used DeepNNs to minimize or eliminate the need for transforming the ECGs to extract features prior to ML modelling; however, we did not observe a significant advantage in following this approach. We also found a fraction of studies using other data modalities, and others centred in aims, such as risk prediction, AF management, and others. From the clinical perspective, AI/ML can help expand the utility of AF detection and risk prediction, especially for patients with additional comorbidities. The use of AI/ML for detection and risk prediction into applications and smart mobile health (mHealth) technology would enable ‘real time’ dynamic assessments. AI/ML could also adapt to treatment changes over time, as well as incident risk factors. Incorporation of a dynamic AI/ML model into mHealth technology would facilitate ‘real time’ assessment of stroke risk, facilitating mitigation of modifiable risk factors (e.g. blood pressure control). Overall, this would lead to an improvement in clinical care for patients with AF.

Development and Validation of an Automated Algorithm to Detect Atrial Fibrillation Within Stored Intensive Care Unit Continuous Electrocardiographic Data: Observational Study

Background

Atrial fibrillation (AF) is the most common arrhythmia during critical illness, representing a sepsis-defining cardiac dysfunction associated with adverse outcomes. Large burdens of premature beats and noisy signal during sepsis may pose unique challenges to automated AF detection.

Objective

The objective of this study is to develop and validate an automated algorithm to accurately identify AF within electronic health care data among critically ill patients with sepsis.

Methods

This is a retrospective cohort study of patients hospitalized with sepsis identified from Medical Information Mart for Intensive Care (MIMIC III) electronic health data with linked electrocardiographic (ECG) telemetry waveforms. Within 3 separate cohorts of 50 patients, we iteratively developed and validated an automated algorithm that identifies ECG signals, removes noise, and identifies irregular rhythm and premature beats in order to identify AF. We compared the automated algorithm to current methods of AF identification in large databases, including ICD-9 (International Classification of Diseases, 9th edition) codes and hourly nurse annotation of heart rhythm. Methods of AF identification were tested against gold-standard manual ECG review.

Results

AF detection algorithms that did not differentiate AF from premature atrial and ventricular beats performed modestly, with 76% (95% CI 61%-87%) accuracy. Performance improved (P=.02) with the addition of premature beat detection (validation set accuracy: 94% [95% CI 83%-99%]). Median time between automated and manual detection of AF onset was 30 minutes (25th-75th percentile 0-208 minutes). The accuracy of ICD-9 codes (68%; P=.002 vs automated algorithm) and nurse charting (80%; P=.02 vs algorithm) was lower than that of the automated algorithm.

Conclusions

An automated algorithm using telemetry ECG data can feasibly and accurately detect AF among critically ill patients with sepsis, and represents an improvement in AF detection within large databases.