1
|
Rawshani A, Rawshani A, Smith G, Boren J, Bhatt DL, Börjesson M, Engdahl J, Kelly P, Louca A, Ramunddal T, Andersson E, Omerovic E, Mandalenakis Z, Gupta V. Integrating deep learning with ECG, heart rate variability and demographic data for improved detection of atrial fibrillation. Open Heart 2025; 12:e003185. [PMID: 40164487 PMCID: PMC11962809 DOI: 10.1136/openhrt-2025-003185] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/27/2025] [Accepted: 03/15/2025] [Indexed: 04/02/2025] Open
Abstract
BACKGROUND Atrial fibrillation (AF) is a common but often undiagnosed condition, increasing the risk of stroke and heart failure. Early detection is crucial, yet traditional methods struggle with AF's transient nature. This study investigates how augmenting ECG data with heart rate variability (HRV) and demographic data (age and sex) can improve AF detection. METHODS We analysed 35 634 12-lead ECG recordings from three public databases (China Physiological Signal Challenge-Extra, PTB-XL and Georgia), each with physician-validated AF labels. A range of convolutional neural network models, including AlexNet, VGG-16, ResNet and transformers, were tested for AF prediction, enriched with HRV and demographic data to explore the effectiveness of the multimodal approach. Each data modality (ECG, HRV and demographic) was assessed for its contribution to model performance using fivefold cross-validation. Performance improvements were evaluated across key metrics, and saliency maps were generated to provide further insights into model behaviour and identify critical features in AF detection. RESULTS Integrating HRV and demographic data with ECG substantially improved performance. AlexNet and VGG-16 outperformed more complex models, achieving AUROC of 0.9617 (95% CI 0.95 to 0.97) and 0.9668 (95% CI 0.96 to 0.97), respectively. Adding HRV data showed the most significant improvement in sensitivity, with AlexNet increasing from 0.9117 to 0.9225 and VGG-16 from 0.9216 to 0.9225. Combining both HRV and demographic data led to further improvements, with AlexNet achieving a sensitivity of 0.9225 (up from 0.9192 with HRV) and VGG-16 reaching 0.9113 (up from 0.9097 with HRV). The combination of HRV and demographic data resulted in the highest gains in sensitivity and area under the receiver operating characteristic curve. Saliency maps confirmed the models identified key AF features, such as the absence of the P-wave, validating the multimodal approach. CONCLUSIONS AlexNet and VGG-16 excelled in AF detection, with HRV data improving sensitivity, and demographic data providing additional benefits. These results highlight the potential of multimodal approaches, pending further clinical validation.
Collapse
Affiliation(s)
- Araz Rawshani
- Departement of Clinical & Molecular Medicine, Institute of Medicine, Gothenburg, Sweden
| | - Aidin Rawshani
- University of Gothenburg Institute of Medicine, Goteborg, Sweden
| | - Gustav Smith
- University of Gothenburg Institute of Medicine, Goteborg, Sweden
- Department of Cardiology, Sahlgrenska University Hospital, Goteborg, Sweden
| | - Jan Boren
- University of Gothenburg Institute of Medicine, Goteborg, Sweden
| | - Deepak L Bhatt
- Icahn School of Medicine at Mount Sinai, New York, NY, USA
| | - Mats Börjesson
- University of Gothenburg Institute of Medicine, Goteborg, Sweden
| | - Johan Engdahl
- Department of Cardiology, Sahlgrenska University Hospital, Goteborg, Sweden
| | - Peter Kelly
- Department of Cardiology, Sahlgrenska University Hospital, Goteborg, Sweden
| | - Antros Louca
- University of Gothenburg Institute of Medicine, Goteborg, Sweden
- Department of Molecular and Clinical Medicine, Gothenburg University, Gothenburg, Sweden
| | - Truls Ramunddal
- Department of Cardiology, Sahlgrenska University Hospital, Goteborg, Sweden
| | - Erik Andersson
- Department of Clinical and Molecular Medicine, University of Gothenburg Institute of Medicine, Goteborg, Sweden
| | - Elmir Omerovic
- Department of Cardiology, Sahlgrenska University Hospital, Goteborg, Sweden
| | - Zacharias Mandalenakis
- Department of Cardiology, Sahlgrenska University Hospital, Goteborg, Sweden
- Department of Molecular and Clinical Medicine, Gothenburg University, Gothenburg, Sweden
| | - Vibha Gupta
- University of Gothenburg Institute of Medicine, Goteborg, Sweden
| |
Collapse
|
2
|
洪 永, 张 鑫, 林 铭, 吴 秋, 陈 超. [A lightweight classification network for single-lead atrial fibrillation based on depthwise separable convolution and attention mechanism]. NAN FANG YI KE DA XUE XUE BAO = JOURNAL OF SOUTHERN MEDICAL UNIVERSITY 2025; 45:650-660. [PMID: 40159980 PMCID: PMC11955883 DOI: 10.12122/j.issn.1673-4254.2025.03.23] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Subscribe] [Scholar Register] [Received: 12/04/2024] [Indexed: 04/02/2025]
Abstract
OBJECTIVES To design a deep learning model that balances model complexity and performance to enable its integration into wearable ECG monitoring devices for automated diagnosis of atrial fibrillation. METHODS This study was performed based on data from 84 patients with atrial fibrillation, 25 patients with atrial fibrillation, and 18 subjects without obvious arrhythmia collected from the publicly available datasets LTAFDB, AFDB, and NSRDB, respectively. A lightweight attention network based on depthwise separable convolution and fusion of channel-spatial information, namely DSC-AttNet, was proposed. Depthwise separable convolution was introduced to replace standard convolution and reduce model parameters and computational complexity to realize high efficiency and light weight of the model. The multilayer hybrid attention mechanism was embedded to compute the attentional weights of the channels and spatial information at different scales to improve the feature expression ability of the model. Ten-fold cross-validation was performed on LTAFDB, and external independent testing was conducted on AFDB and NSRDB datasets. RESULTS DSC-AttNet achieved a ten-fold average accuracy of 97.33% and a precision of 97.30% on the test set, both of which outperformed the other 4 comparison models as well as the 3 classical models. The accuracy of the model on the external test set reached 92.78%, better than those of the 3 classical models. The number of parameters of DSC-AttNet was 1.01M, and the computational volume was 27.19G, both smaller than the 3 classical models. CONCLUSIONS This proposed method has a smaller complexity, achieves better classification performance, and has a better generalization ability for atrial fibrillation classification.
Collapse
|
3
|
She WJ, Siriaraya P, Iwakoshi H, Kuwahara N, Senoo K. An Explainable AI Application (AF'fective) to Support Monitoring of Patients With Atrial Fibrillation After Catheter Ablation: Qualitative Focus Group, Design Session, and Interview Study. JMIR Hum Factors 2025; 12:e65923. [PMID: 39946707 PMCID: PMC11888073 DOI: 10.2196/65923] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2024] [Revised: 11/27/2024] [Accepted: 01/05/2025] [Indexed: 03/10/2025] Open
Abstract
BACKGROUND The opaque nature of artificial intelligence (AI) algorithms has led to distrust in medical contexts, particularly in the treatment and monitoring of atrial fibrillation. Although previous studies in explainable AI have demonstrated potential to address this issue, they often focus solely on electrocardiography graphs and lack real-world field insights. OBJECTIVE We addressed this gap by incorporating standardized clinical interpretation of electrocardiography graphs into the system and collaborating with cardiologists to co-design and evaluate this approach using real-world patient cases and data. METHODS We conducted a 3-stage iterative design process with 23 cardiologists to co-design, evaluate, and pilot an explainable AI application. In the first stage, we identified 4 physician personas and 7 explainability strategies, which were reviewed in the second stage. A total of 4 strategies were deemed highly effective and feasible for pilot deployment. On the basis of these strategies, we developed a progressive web application and tested it with cardiologists in the third stage. RESULTS The final progressive web application prototype received above-average user experience evaluations and effectively motivated physicians to adopt it owing to its ease of use, reliable information, and explainable functionality. In addition, we gathered in-depth field insights from cardiologists who used the system in clinical contexts. CONCLUSIONS Our study identified effective explainability strategies, emphasized the importance of curating actionable features and setting accurate expectations, and suggested that many of these insights could apply to other disease care contexts, paving the way for future real-world clinical evaluations.
Collapse
Affiliation(s)
- Wan Jou She
- Faculty of Information and Human Sciences, Kyoto Institute of Technology, Kyoto, Japan
| | - Panote Siriaraya
- Faculty of Information and Human Sciences, Kyoto Institute of Technology, Kyoto, Japan
| | - Hibiki Iwakoshi
- Department of Cardiovascular Medicine, Graduate School of Medical Science, Kyoto Prefectural University of Medicine, Kyoto, Japan
- Department of Cardiac Arrhythmia Research and Innovation, Graduate School of Medical Science, Kyoto Prefectural University of Medicine, Kyoto, Japan
| | - Noriaki Kuwahara
- Faculty of Information and Human Sciences, Kyoto Institute of Technology, Kyoto, Japan
- Department of Advanced Fibro-Science, Kyoto Institute of Technology, Kyoto, Japan
| | - Keitaro Senoo
- Department of Cardiovascular Medicine, Graduate School of Medical Science, Kyoto Prefectural University of Medicine, Kyoto, Japan
- Department of Cardiac Arrhythmia Research and Innovation, Graduate School of Medical Science, Kyoto Prefectural University of Medicine, Kyoto, Japan
| |
Collapse
|
4
|
Mika B, Komorowski D. Higher-Order Spectral Analysis Combined with a Convolution Neural Network for Atrial Fibrillation Detection-Preliminary Study. SENSORS (BASEL, SWITZERLAND) 2024; 24:4171. [PMID: 39000950 PMCID: PMC11243991 DOI: 10.3390/s24134171] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/28/2024] [Revised: 06/19/2024] [Accepted: 06/25/2024] [Indexed: 07/16/2024]
Abstract
The global burden of atrial fibrillation (AFIB) is constantly increasing, and its early detection is still a challenge for public health and motivates researchers to improve methods for automatic AFIB prediction and management. This work proposes higher-order spectra analysis, especially the bispectrum of electrocardiogram (ECG) signals combined with the convolution neural network (CNN) for AFIB detection. Like other biomedical signals, ECG is non-stationary, non-linear, and non-Gaussian in nature, so the spectra of higher-order cumulants, in this case, bispectra, preserve valuable features. The two-dimensional (2D) bispectrum images were applied as input for the two CNN architectures with the output AFIB vs. no-AFIB: the pre-trained modified GoogLeNet and the proposed CNN called AFIB-NET. The MIT-BIH Atrial Fibrillation Database (AFDB) was used to evaluate the performance of the proposed methodology. AFIB-NET detected atrial fibrillation with a sensitivity of 95.3%, a specificity of 93.7%, and an area under the receiver operating characteristic (ROC) of 98.3%, while for GoogLeNet results for sensitivity and specificity were equal to 96.7%, 82%, respectively, and the area under ROC was equal to 96.7%. According to preliminary studies, bispectrum images as input to 2D CNN can be successfully used for AFIB rhythm detection.
Collapse
Affiliation(s)
- Barbara Mika
- Faculty of Biomedical Engineering, Department of Medical Informatics and Artificial Intelligence, Silesian University of Technology, Roosevelt 40, 41-800 Zabrze, Poland
| | - Dariusz Komorowski
- Faculty of Biomedical Engineering, Department of Medical Informatics and Artificial Intelligence, Silesian University of Technology, Roosevelt 40, 41-800 Zabrze, Poland
| |
Collapse
|
5
|
Xia L, He S, Huang YF, Ma H. Multiscale dilated convolutional neural network for Atrial Fibrillation detection. PLoS One 2024; 19:e0301691. [PMID: 38829846 PMCID: PMC11146707 DOI: 10.1371/journal.pone.0301691] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2023] [Accepted: 03/20/2024] [Indexed: 06/05/2024] Open
Abstract
Atrial Fibrillation (AF), a type of heart arrhythmia, becomes more common with aging and is associated with an increased risk of stroke and mortality. In light of the urgent need for effective automated AF monitoring, existing methods often fall short in balancing accuracy and computational efficiency. To address this issue, we introduce a framework based on Multi-Scale Dilated Convolution (AF-MSDC), aimed at achieving precise predictions with low cost and high efficiency. By integrating Multi-Scale Dilated Convolution (MSDC) modules, our model is capable of extracting features from electrocardiogram (ECG) datasets across various scales, thus achieving an optimal balance between precision and computational savings. We have developed three MSDC modules to construct the AF-MSDC framework and assessed its performance on renowned datasets, including the MIT-BIH Atrial Fibrillation Database and Physionet Challenge 2017. Empirical results unequivocally demonstrate that our technique surpasses existing state-of-the-art (SOTA) methods in the AF detection domain. Specifically, our model, with only a quarter of the parameters of a Residual Network (ResNet), achieved an impressive sensitivity of 99.45%, specificity of 99.64% (on the MIT-BIH AFDB dataset), and an [Formula: see text] score of 85.63% (on the Physionet Challenge 2017 AFDB dataset). This high efficiency makes our model particularly suitable for integration into wearable ECG devices powered by edge computing frameworks. Moreover, this innovative approach offers new possibilities for the early diagnosis of AF in clinical applications, potentially improving patient quality of life and reducing healthcare costs.
Collapse
Affiliation(s)
- Lingnan Xia
- Henan High-speed Railway Operation and Maintenance Engineering Research Center, Zhengzhou Railway Vocational and Technical College, Zhengzhou, China
| | - Sirui He
- Department of Big Data Management and Application, Dalian Polytechnic University, Dalian, Liaoning, China
| | - Y-F Huang
- Henan High-speed Railway Operation and Maintenance Engineering Research Center, Zhengzhou Railway Vocational and Technical College, Zhengzhou, China
| | - Hua Ma
- Henan High-speed Railway Operation and Maintenance Engineering Research Center, Zhengzhou Railway Vocational and Technical College, Zhengzhou, China
| |
Collapse
|
6
|
Asfaw D, Jordanov I, Impey L, Namburete A, Lee R, Georgieva A. Multimodal Deep Learning for Predicting Adverse Birth Outcomes Based on Early Labour Data. Bioengineering (Basel) 2023; 10:730. [PMID: 37370663 PMCID: PMC10294944 DOI: 10.3390/bioengineering10060730] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2023] [Revised: 05/29/2023] [Accepted: 06/07/2023] [Indexed: 06/29/2023] Open
Abstract
Cardiotocography (CTG) is a widely used technique to monitor fetal heart rate (FHR) during labour and assess the health of the baby. However, visual interpretation of CTG signals is subjective and prone to error. Automated methods that mimic clinical guidelines have been developed, but they failed to improve detection of abnormal traces. This study aims to classify CTGs with and without severe compromise at birth using routinely collected CTGs from 51,449 births at term from the first 20 min of FHR recordings. Three 1D-CNN and LSTM based architectures are compared. We also transform the FHR signal into 2D images using time-frequency representation with a spectrogram and scalogram analysis, and subsequently, the 2D images are analysed using a 2D-CNNs. In the proposed multi-modal architecture, the 2D-CNN and the 1D-CNN-LSTM are connected in parallel. The models are evaluated in terms of partial area under the curve (PAUC) between 0-10% false-positive rate; and sensitivity at 95% specificity. The 1D-CNN-LSTM parallel architecture outperformed the other models, achieving a PAUC of 0.20 and sensitivity of 20% at 95% specificity. Our future work will focus on improving the classification performance by employing a larger dataset, analysing longer FHR traces, and incorporating clinical risk factors.
Collapse
Affiliation(s)
- Daniel Asfaw
- School of Computing, University of Portsmouth, Portsmouth PO1 3HE, UK
- Nuffield Department of Women’s & Reproductive Health, University of Oxford, Oxford OX1 2JD, UK (A.G.)
| | - Ivan Jordanov
- School of Computing, University of Portsmouth, Portsmouth PO1 3HE, UK
| | - Lawrence Impey
- Nuffield Department of Women’s & Reproductive Health, University of Oxford, Oxford OX1 2JD, UK (A.G.)
| | - Ana Namburete
- Department of Computer Science, University of Oxford, Oxford OX1 3QG, UK
| | - Raymond Lee
- Faculty of Technology, University of Portsmouth, Portsmouth PO1 2UP, UK
| | - Antoniya Georgieva
- Nuffield Department of Women’s & Reproductive Health, University of Oxford, Oxford OX1 2JD, UK (A.G.)
| |
Collapse
|
7
|
Yang X, Ji Z. Automatic Classification Method of Arrhythmias Based on 12-Lead Electrocardiogram. SENSORS (BASEL, SWITZERLAND) 2023; 23:s23094372. [PMID: 37177575 PMCID: PMC10181542 DOI: 10.3390/s23094372] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/18/2023] [Revised: 04/17/2023] [Accepted: 04/26/2023] [Indexed: 05/15/2023]
Abstract
Cardiovascular disease is one of the main causes of death worldwide. Arrhythmias are an important group of cardiovascular diseases. The standard 12-lead electrocardiogram signals are an important tool for diagnosing arrhythmias. Although 12-lead electrocardiogram signals provide more comprehensive arrhythmia information than single-lead electrocardiogram signals, it is difficult to effectively fuse information between different leads. In addition, most of the current researches working on automatic diagnosis of cardiac arrhythmias are based on modeling and analysis of single-mode features extracted from one-dimensional electrocardiogram sequences, ignoring the frequency domain features of electrocardiogram signals. Therefore, developing an automatic arrhythmia detection algorithm based on 12-lead electrocardiogram with high accuracy and strong generalization ability is still challenging. In this paper, a multimodal feature fusion model based on the mechanism is developed. This model utilizes a dual channel deep neural network to extract different dimensional features from one-dimensional and two-dimensional electrocardiogram time-frequency maps, and combines attention mechanism to effectively fuse the important features of 12-lead, thereby obtaining richer arrhythmia information and ultimately achieving accurate classification of nine types of arrhythmia signals. This study used electrocardiogram signals from a mixed dataset to train, validate, and evaluate the model, with an average of F1 score and average accuracy reached 0.85 and 0.97, respectively. Experimental results show that our algorithm has stable and reliable performance, so it is expected to have good practical application potential.
Collapse
Affiliation(s)
- Xiao Yang
- College of Bioengineering, Chongqing University, Chongqing 400030, China
| | - Zhong Ji
- College of Bioengineering, Chongqing University, Chongqing 400030, China
| |
Collapse
|
8
|
Ayano YM, Schwenker F, Dufera BD, Debelee TG. Interpretable Machine Learning Techniques in ECG-Based Heart Disease Classification: A Systematic Review. Diagnostics (Basel) 2022; 13:111. [PMID: 36611403 PMCID: PMC9818170 DOI: 10.3390/diagnostics13010111] [Citation(s) in RCA: 21] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2022] [Revised: 12/22/2022] [Accepted: 12/23/2022] [Indexed: 12/31/2022] Open
Abstract
Heart disease is one of the leading causes of mortality throughout the world. Among the different heart diagnosis techniques, an electrocardiogram (ECG) is the least expensive non-invasive procedure. However, the following are challenges: the scarcity of medical experts, the complexity of ECG interpretations, the manifestation similarities of heart disease in ECG signals, and heart disease comorbidity. Machine learning algorithms are viable alternatives to the traditional diagnoses of heart disease from ECG signals. However, the black box nature of complex machine learning algorithms and the difficulty in explaining a model's outcomes are obstacles for medical practitioners in having confidence in machine learning models. This observation paves the way for interpretable machine learning (IML) models as diagnostic tools that can build a physician's trust and provide evidence-based diagnoses. Therefore, in this systematic literature review, we studied and analyzed the research landscape in interpretable machine learning techniques by focusing on heart disease diagnosis from an ECG signal. In this regard, the contribution of our work is manifold; first, we present an elaborate discussion on interpretable machine learning techniques. In addition, we identify and characterize ECG signal recording datasets that are readily available for machine learning-based tasks. Furthermore, we identify the progress that has been achieved in ECG signal interpretation using IML techniques. Finally, we discuss the limitations and challenges of IML techniques in interpreting ECG signals.
Collapse
Affiliation(s)
| | | | - Bisrat Derebssa Dufera
- Addis Ababa Institute of Technology, Addis Ababa University, Addis Ababa 11760, Ethiopia
| | - Taye Girma Debelee
- Ethiopian Artificial Intelligence Institute, Addis Ababa 40782, Ethiopia
- College of Electrical and Computer Engineering, Addis Ababa Science and Technology University, Addis Ababa 16417, Ethiopia
| |
Collapse
|
9
|
Rohr M, Reich C, Höhl A, Lilienthal T, Dege T, Plesinger F, Bulkova V, Clifford G, Reyna M, Hoog Antink C. Exploring novel algorithms for atrial fibrillation detection by driving graduate level education in medical machine learning. Physiol Meas 2022; 43:074001. [PMID: 35697013 PMCID: PMC11409601 DOI: 10.1088/1361-6579/ac7840] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2022] [Accepted: 06/13/2022] [Indexed: 11/12/2022]
Abstract
During the lockdown of universities and the COVID-Pandemic most students were restricted to their homes. Novel and instigating teaching methods were required to improve the learning experience and so recent implementations of the annual PhysioNet/Computing in Cardiology (CinC) Challenges posed as a reference. For over 20 years, the challenges have proven repeatedly to be of immense educational value, besides leading to technological advances for specific problems. In this paper, we report results from the class 'Artificial Intelligence in Medicine Challenge', which was implemented as an online project seminar at Technical University Darmstadt, Germany, and which was heavily inspired by the PhysioNet/CinC Challenge 2017 'AF Classification from a Short Single Lead ECG Recording'. Atrial fibrillation is a common cardiac disease and often remains undetected. Therefore, we selected the two most promising models of the course and give an insight into the Transformer-based DualNet architecture as well as into the CNN-LSTM-based model and finally a detailed analysis for both. In particular, we show the model performance results of our internal scoring process for all submitted models and the near state-of-the-art model performance for the two named models on the official 2017 challenge test set. Several teams were able to achieve F1scores above/close to 90% on a hidden test-set of Holter recordings. We highlight themes commonly observed among participants, and report the results from the self-assessed student evaluation. Finally, the self-assessment of the students reported a notable increase in machine learning knowledge.
Collapse
Affiliation(s)
- Maurice Rohr
- KIS*MED - AI Systems in Medicine, Technische Universität Darmstadt, Darmstadt, Germany
| | - Christoph Reich
- KIS*MED - AI Systems in Medicine, Technische Universität Darmstadt, Darmstadt, Germany
| | - Andreas Höhl
- KIS*MED - AI Systems in Medicine, Technische Universität Darmstadt, Darmstadt, Germany
| | - Timm Lilienthal
- KIS*MED - AI Systems in Medicine, Technische Universität Darmstadt, Darmstadt, Germany
| | - Tizian Dege
- KIS*MED - AI Systems in Medicine, Technische Universität Darmstadt, Darmstadt, Germany
| | - Filip Plesinger
- Institute of Scientific Instruments of the Czech Academy of Sciences, Brno, Czech Republic
| | | | - Gari Clifford
- Department of Biomedical Informatics, Emory University, United States of America
- Department of Biomedical Engineering, Georgia Institute of Technology, United States of America
| | - Matthew Reyna
- Department of Biomedical Informatics, Emory University, United States of America
| | - Christoph Hoog Antink
- KIS*MED - AI Systems in Medicine, Technische Universität Darmstadt, Darmstadt, Germany
| |
Collapse
|
10
|
Dubatovka A, Buhmann JM. Automatic Detection of Atrial Fibrillation from Single-Lead ECG Using Deep Learning of the Cardiac Cycle. BME FRONTIERS 2022; 2022:9813062. [PMID: 37850161 PMCID: PMC10521743 DOI: 10.34133/2022/9813062] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2021] [Accepted: 03/15/2022] [Indexed: 10/19/2023] Open
Abstract
Objective and Impact Statement. Atrial fibrillation (AF) is a serious medical condition that requires effective and timely treatment to prevent stroke. We explore deep neural networks (DNNs) for learning cardiac cycles and reliably detecting AF from single-lead electrocardiogram (ECG) signals. Introduction. Electrocardiograms are widely used for diagnosis of various cardiac dysfunctions including AF. The huge amount of collected ECGs and recent algorithmic advances to process time-series data with DNNs substantially improve the accuracy of the AF diagnosis. DNNs, however, are often designed as general purpose black-box models and lack interpretability of their decisions. Methods. We design a three-step pipeline for AF detection from ECGs. First, a recording is split into a sequence of individual heartbeats based on R-peak detection. Individual heartbeats are then encoded using a DNN that extracts interpretable features of a heartbeat by disentangling the duration of a heartbeat from its shape. Second, the sequence of heartbeat codes is passed to a DNN to combine a signal-level representation capturing heart rhythm. Third, the signal representations are passed to a DNN for detecting AF. Results. Our approach demonstrates a superior performance to existing ECG analysis methods on AF detection. Additionally, the method provides interpretations of the features extracted from heartbeats by DNNs and enables cardiologists to study ECGs in terms of the shapes of individual heartbeats and rhythm of the whole signals. Conclusion. By considering ECGs on two levels and employing DNNs for modelling of cardiac cycles, this work presents a method for reliable detection of AF from single-lead ECGs.
Collapse
Affiliation(s)
- Alina Dubatovka
- Department of Computer Science, ETH Zurich, Zurich, Switzerland
| | | |
Collapse
|
11
|
Alqudah AM, Alqudah A. Deep learning for single-lead ECG beat arrhythmia-type detection using novel iris spectrogram representation. Soft comput 2022. [DOI: 10.1007/s00500-021-06555-x] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
12
|
Meeting the unmet needs of clinicians from AI systems showcased for cardiology with deep-learning-based ECG analysis. Proc Natl Acad Sci U S A 2021; 118:2020620118. [PMID: 34099565 DOI: 10.1073/pnas.2020620118] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/04/2023] Open
Abstract
Despite their great promise, artificial intelligence (AI) systems have yet to become ubiquitous in the daily practice of medicine largely due to several crucial unmet needs of healthcare practitioners. These include lack of explanations in clinically meaningful terms, handling the presence of unknown medical conditions, and transparency regarding the system's limitations, both in terms of statistical performance as well as recognizing situations for which the system's predictions are irrelevant. We articulate these unmet clinical needs as machine-learning (ML) problems and systematically address them with cutting-edge ML techniques. We focus on electrocardiogram (ECG) analysis as an example domain in which AI has great potential and tackle two challenging tasks: the detection of a heterogeneous mix of known and unknown arrhythmias from ECG and the identification of underlying cardio-pathology from segments annotated as normal sinus rhythm recorded in patients with an intermittent arrhythmia. We validate our methods by simulating a screening for arrhythmias in a large-scale population while adhering to statistical significance requirements. Specifically, our system 1) visualizes the relative importance of each part of an ECG segment for the final model decision; 2) upholds specified statistical constraints on its out-of-sample performance and provides uncertainty estimation for its predictions; 3) handles inputs containing unknown rhythm types; and 4) handles data from unseen patients while also flagging cases in which the model's outputs are not usable for a specific patient. This work represents a significant step toward overcoming the limitations currently impeding the integration of AI into clinical practice in cardiology and medicine in general.
Collapse
|
13
|
Olier I, Ortega-Martorell S, Pieroni M, Lip GYH. How machine learning is impacting research in atrial fibrillation: implications for risk prediction and future management. Cardiovasc Res 2021; 117:1700-1717. [PMID: 33982064 PMCID: PMC8477792 DOI: 10.1093/cvr/cvab169] [Citation(s) in RCA: 47] [Impact Index Per Article: 11.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/18/2021] [Accepted: 05/11/2021] [Indexed: 02/01/2023] Open
Abstract
There has been an exponential growth of artificial intelligence (AI) and machine learning (ML) publications aimed at advancing our understanding of atrial fibrillation (AF), which has been mainly driven by the confluence of two factors: the advances in deep neural networks (DeepNNs) and the availability of large, open access databases. It is observed that most of the attention has centred on applying ML for dvsetecting AF, particularly using electrocardiograms (ECGs) as the main data modality. Nearly a third of them used DeepNNs to minimize or eliminate the need for transforming the ECGs to extract features prior to ML modelling; however, we did not observe a significant advantage in following this approach. We also found a fraction of studies using other data modalities, and others centred in aims, such as risk prediction, AF management, and others. From the clinical perspective, AI/ML can help expand the utility of AF detection and risk prediction, especially for patients with additional comorbidities. The use of AI/ML for detection and risk prediction into applications and smart mobile health (mHealth) technology would enable ‘real time’ dynamic assessments. AI/ML could also adapt to treatment changes over time, as well as incident risk factors. Incorporation of a dynamic AI/ML model into mHealth technology would facilitate ‘real time’ assessment of stroke risk, facilitating mitigation of modifiable risk factors (e.g. blood pressure control). Overall, this would lead to an improvement in clinical care for patients with AF.
Collapse
Affiliation(s)
- Ivan Olier
- School of Computer Science and Mathematics, Liverpool John Moores University, 3 Byrom Street, Liverpool L3 3AF, UK.,Liverpool Centre for Cardiovascular Science, Liverpool John Moores University, Liverpool, UK
| | - Sandra Ortega-Martorell
- School of Computer Science and Mathematics, Liverpool John Moores University, 3 Byrom Street, Liverpool L3 3AF, UK.,Liverpool Centre for Cardiovascular Science, Liverpool John Moores University, Liverpool, UK
| | - Mark Pieroni
- School of Computer Science and Mathematics, Liverpool John Moores University, 3 Byrom Street, Liverpool L3 3AF, UK.,Liverpool Centre for Cardiovascular Science, Liverpool John Moores University, Liverpool, UK
| | - Gregory Y H Lip
- Liverpool Centre for Cardiovascular Science, Liverpool John Moores University, Liverpool, UK.,Liverpool Heart and Chest Hospital, Liverpool, UK
| |
Collapse
|
14
|
Chen CY, Lin YT, Lee SJ, Tsai WC, Huang TC, Liu YH, Cheng MC, Dai CY. Automated ECG classification based on 1D deep learning network. Methods 2021; 202:127-135. [PMID: 33930574 DOI: 10.1016/j.ymeth.2021.04.021] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/03/2021] [Revised: 04/02/2021] [Accepted: 04/24/2021] [Indexed: 11/15/2022] Open
Abstract
The standard 12-lead electrocardiogram (ECG) records the heart's electrical activity from electrodes on the skin, and is widely used in screening and diagnosis of the cardiac conditions due to its low price and non-invasive characteristics. Manual examination of ECGs requires professional medical skills, and is strenuous and time consuming. Recently, deep learning methodologies have been successfully applied in the analysis of medical images. In this paper, we present an automated system for the identification of normal and abnormal ECG signals. A multi-channel multi-scale deep neural network (DNN) model is proposed, which is an end-to-end structure to classify the ECG signals without any feature extraction. Convolutional layers are used to extract primary features, and long short-term memory (LSTM) and attention are incorporated to improve the performance of the DNN model. The system was developed with a 12-lead ECG dataset provided by the Kaohsiung Medical University Hospital (KMUH). Experimental results show that the proposed system can yield high recognition rates in classifying normal and abnormal ECG signals.
Collapse
Affiliation(s)
- Chun-Yen Chen
- Department of Electrical Engineering, National Sun Yat-Sen University, Kaohsiung, Taiwan
| | - Yan-Ting Lin
- Department of Electrical Engineering, National Sun Yat-Sen University, Kaohsiung, Taiwan
| | - Shie-Jue Lee
- Department of Electrical Engineering and Intelligent Electronic Commerce Research Center, National Sun Yat-Sen University, Kaohsiung, Taiwan.
| | - Wei-Chung Tsai
- Department of Internal Medicine, Faculty of Medicine, Kaohsiung Medical University, Department of Internal Medicine, Kaohsiung Medical University Hospital, Kaohsiung, Taiwan
| | - Tien-Chi Huang
- Department of Internal Medicine, Kaohsiung Medical University Hospital, Kaohsiung, Taiwan
| | - Yi-Hsueh Liu
- Department of Internal Medicine, Kaohsiung Medical University Hospital, Kaohsiung, Taiwan
| | - Mu-Chun Cheng
- Department of Internal Medicine, Kaohsiung Medical University Hospital, Kaohsiung, Taiwan
| | - Chia-Yen Dai
- Department of Internal Medicine, Faculty of Medicine, Kaohsiung Medical University, Department of Internal Medicine, Kaohsiung Medical University Hospital, Kaohsiung, Taiwan
| |
Collapse
|
15
|
Mousavi S, Afghah F, Khadem F, Acharya UR. ECG Language processing (ELP): A new technique to analyze ECG signals. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2021; 202:105959. [PMID: 33607552 PMCID: PMC8009849 DOI: 10.1016/j.cmpb.2021.105959] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/29/2020] [Accepted: 01/27/2021] [Indexed: 05/22/2023]
Abstract
BACKGROUND A language is constructed of a finite/infinite set of sentences composing of words. Similar to natural languages, the Electrocardiogram (ECG) signal, the most common noninvasive tool to study the functionality of the heart and diagnose several abnormal arrhythmias, is made up of sequences of three or four distinct waves, including the P-wave, QRS complex, T-wave, and U-wave. An ECG signal may contain several different varieties of each wave (e.g., the QRS complex can have various appearances). For this reason, the ECG signal is a sequence of heartbeats similar to sentences in natural languages) and each heartbeat is composed of a set of waves (similar to words in a sentence) of different morphologies. METHODS Analogous to natural language processing (NLP), which is used to help computers understand and interpret the human's natural language, it is possible to develop methods inspired by NLP to aid computers to gain a deeper understanding of Electrocardiogram signals. In this work, our goal is to propose a novel ECG analysis technique, ECG language processing (ELP), focusing on empowering computers to understand ECG signals in a way physicians do. RESULTS We evaluated the proposed approach on two tasks, including the classification of heartbeats and the detection of atrial fibrillation in the ECG signals. Overall, our technique resulted in better performance or comparable performance with smaller neural networks compared to other deep neural networks and existing algorithms. CONCLUSION Experimental results on three databases (i.e., PhysioNet's MIT-BIH, MIT-BIH AFIB, and PhysioNet Challenge 2017 AFIB Dataset databases) reveal that the proposed approach as a general idea can be applied to a variety of biomedical applications and can achieve remarkable performance.
Collapse
Affiliation(s)
- Sajad Mousavi
- School of Informatics, Computing, and Cyber Systems, Northern Arizona University, Flagstaff, AZ 86011, USA.
| | - Fatemeh Afghah
- School of Informatics, Computing, and Cyber Systems, Northern Arizona University, Flagstaff, AZ 86011, USA.
| | - Fatemeh Khadem
- School of Informatics, Computing, and Cyber Systems, Northern Arizona University, Flagstaff, AZ 86011, USA.
| | - U Rajendra Acharya
- School of Engineering, Ngee Ann Polytechnic, Singapore; School of Science and Technology, Singapore University of Social Sciences, 463 Clementi Road, 599494, Singapore; Department Bioinformatics and Medical Engineering, Asia University, Taiwan.
| |
Collapse
|
16
|
Weimann K, Conrad TOF. Transfer learning for ECG classification. Sci Rep 2021; 11:5251. [PMID: 33664343 PMCID: PMC7933237 DOI: 10.1038/s41598-021-84374-8] [Citation(s) in RCA: 58] [Impact Index Per Article: 14.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/19/2020] [Accepted: 02/12/2021] [Indexed: 12/05/2022] Open
Abstract
Remote monitoring devices, which can be worn or implanted, have enabled a more effective healthcare for patients with periodic heart arrhythmia due to their ability to constantly monitor heart activity. However, these devices record considerable amounts of electrocardiogram (ECG) data that needs to be interpreted by physicians. Therefore, there is a growing need to develop reliable methods for automatic ECG interpretation to assist the physicians. Here, we use deep convolutional neural networks (CNN) to classify raw ECG recordings. However, training CNNs for ECG classification often requires a large number of annotated samples, which are expensive to acquire. In this work, we tackle this problem by using transfer learning. First, we pretrain CNNs on the largest public data set of continuous raw ECG signals. Next, we finetune the networks on a small data set for classification of Atrial Fibrillation, which is the most common heart arrhythmia. We show that pretraining improves the performance of CNNs on the target task by up to \documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$6.57\%$$\end{document}6.57%, effectively reducing the number of annotations required to achieve the same performance as CNNs that are not pretrained. We investigate both supervised as well as unsupervised pretraining approaches, which we believe will increase in relevance, since they do not rely on the expensive ECG annotations. The code is available on GitHub at https://github.com/kweimann/ecg-transfer-learning.
Collapse
Affiliation(s)
- Kuba Weimann
- Department of Visual and Data-Centric Computing, Zuse Institute Berlin, Takustrasse 7, 14195, Berlin, Germany.
| | - Tim O F Conrad
- Department of Visual and Data-Centric Computing, Zuse Institute Berlin, Takustrasse 7, 14195, Berlin, Germany.,Department of Mathematics, Free University of Berlin, Arnimallee 6, 14195, Berlin, Germany
| |
Collapse
|
17
|
HAN-ECG: An interpretable atrial fibrillation detection model using hierarchical attention networks. Comput Biol Med 2020; 127:104057. [PMID: 33126126 DOI: 10.1016/j.compbiomed.2020.104057] [Citation(s) in RCA: 35] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2020] [Revised: 10/10/2020] [Accepted: 10/11/2020] [Indexed: 11/22/2022]
Abstract
Atrial fibrillation (AF) is one of the most prevalent cardiac arrhythmias that affects the lives of many people around the world and is associated with a five-fold increased risk of stroke and mortality. Like other problems in the healthcare domain, artificial intelligence (AI)-based models have been used to detect AF from patients' ECG signals. The cardiologist level performance in detecting this arrhythmia is often achieved by deep learning-based methods, however, they suffer from the lack of interpretability. In other words, these approaches are unable to explain the reasons behind their decisions. The lack of interpretability is a common challenge toward a wide application of machine learning (ML)-based approaches in the healthcare which limits the trust of clinicians in such methods. To address this challenge, we propose HAN-ECG, an interpretable bidirectional-recurrent-neural-network-based approach for the AF detection task. The HAN-ECG employs three attention mechanism levels to provide a multi-resolution analysis of the patterns in ECG leading to AF. The detected patterns by this hierarchical attention model facilitate the interpretation of the neural network decision process in identifying the patterns in the signal which contributed the most to the final detection. Experimental results on two AF databases demonstrate that our proposed model performs better than the existing algorithms. Visualization of these attention layers illustrates that our proposed model decides upon the important waves and heartbeats which are clinically meaningful in the detection task (e.g., absence of P-waves, and irregular R-R intervals for the AF detection task).
Collapse
|
18
|
Ahmedt-Aristizabal D, Armin MA, Denman S, Fookes C, Petersson L. Attention Networks for Multi-Task Signal Analysis. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2020; 2020:184-187. [PMID: 33017960 DOI: 10.1109/embc44109.2020.9175730] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Recent advances in deep learning have enabled the development of automated frameworks for analysing medical images and signals. For analysis of physiological recordings, models based on temporal convolutional networks and recurrent neural networks have demonstrated encouraging results and an ability to capture complex patterns and dependencies in the data. However, representations that capture the entirety of the raw signal are suboptimal as not all portions of the signal are equally important. As such, attention mechanisms are proposed to divert focus to regions of interest, reducing computational cost and enhancing accuracy. Here, we evaluate attention-based frameworks for the classification of physiological signals in different clinical domains. We evaluated our methodology on three classification scenarios: neurogenerative disorders, neurological status and seizure type. We demonstrate that attention networks can outperform traditional deep learning models for sequence modelling by identifying the most relevant attributes of an input signal for decision making. This work highlights the benefits of attention-based models for analysing raw data in the field of biomedical research.
Collapse
|
19
|
Mousavi S, Fotoohinasab A, Afghah F. Single-modal and multi-modal false arrhythmia alarm reduction using attention-based convolutional and recurrent neural networks. PLoS One 2020; 15:e0226990. [PMID: 31923226 PMCID: PMC6953791 DOI: 10.1371/journal.pone.0226990] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/09/2019] [Accepted: 12/09/2019] [Indexed: 11/19/2022] Open
Abstract
This study proposes a deep learning model that effectively suppresses the false alarms in the intensive care units (ICUs) without ignoring the true alarms using single- and multi- modal biosignals. Most of the current work in the literature are either rule-based methods, requiring prior knowledge of arrhythmia analysis to build rules, or classical machine learning approaches, depending on hand-engineered features. In this work, we apply convolutional neural networks to automatically extract time-invariant features, an attention mechanism to put more emphasis on the important regions of the segmented input signal(s) that are more likely to contribute to an alarm, and long short-term memory units to capture the temporal information presented in the signal segments. We trained our method efficiently using a two-step training algorithm (i.e., pre-training and fine-tuning the proposed network) on the dataset provided by the PhysioNet computing in cardiology challenge 2015. The evaluation results demonstrate that the proposed method obtains better results compared to other existing algorithms for the false alarm reduction task in ICUs. The proposed method achieves a sensitivity of 93.88% and a specificity of 92.05% for the alarm classification, considering three different signals. In addition, our experiments for 5 separate alarm types leads significant results, where we just consider a single-lead ECG (e.g., a sensitivity of 90.71%, a specificity of 88.30%, an AUC of 89.51 for alarm type of Ventricular Tachycardia arrhythmia).
Collapse
Affiliation(s)
- Sajad Mousavi
- School of Informatics, Computing and Cyber Systems, Northern Arizona University, Flagstaff, Arizona, United States of America
| | - Atiyeh Fotoohinasab
- School of Informatics, Computing and Cyber Systems, Northern Arizona University, Flagstaff, Arizona, United States of America
| | - Fatemeh Afghah
- School of Informatics, Computing and Cyber Systems, Northern Arizona University, Flagstaff, Arizona, United States of America
| |
Collapse
|
20
|
Deep Learning-Based Approach for Atrial Fibrillation Detection. LECTURE NOTES IN COMPUTER SCIENCE 2020. [PMCID: PMC7313287 DOI: 10.1007/978-3-030-51517-1_9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Atrial Fibrillation (AF) is a health-threatening condition, which is a violation of the heart rhythm that can lead to heart-related complications. Remarkable interest has been given to ECG signals analysis for AF detection in an early stage. In this context, we propose an artificial neural network ANN application to classify ECG signals into three classes, the first presents Normal Sinus Rhythm NSR, the second depicts abnormal signal with Atrial Fibrillation (AF) and the third shows noisy ECG signals. Accordingly, we achieve 93.1% accuracy classification results, 95.1% of sensitivity, 90.5% of specificity and 98%. Furthermore, we yield a value of zero error and a low value of cross entropy, which prove the robustness of the proposed ANN model architecture. Thus, we outperform the state of the art by achieving high accuracy classification without pre-processing step and without high level of feature extraction, and then we enable clinicians to determine automatically the class of each patient ECG signal.
Collapse
|