A transformer-based deep neural network for arrhythmia detection using continuous ECG signals

Profiling electric signals of electrogenic probiotic bacteria using self-attention analysis

We fabricated a self-assembled electric circuit to detect the electrical signals produced by two electrogenic probiotic bacteria [Leuconostoc mesenteroides (L. mesenteroides) and Lactococcus lactis (L. lactis)] on chicken egg chorioallantoic membranes as well as in the intestine lumen of mice. Inoculation of L. mesenteroides or L. lactis plus glucose onto a ferrozine assay triggered the reduction of ferric ions to ferrous ions and the formation of ferrozine complexes, indicating the bacterial electron production. In the presence of glucose, L. lactis yielded higher electricity, measured by voltage changes, than L. mesenteroides in vitro. The spectra of the electrical signals generated by these two probiotic bacteria were highly distinguishable. We evaluated the importance of these differences with the application of a self-attention mechanism, a deep learning-based module, revealing several unique signals in the electrical spectra of L. mesenteroides as well as L. lactis bacteria. The specific electrical spectrum for each probiotic bacterium provided a dynamic signature for evaluation of the efficacy of various therapies using probiotics, antibiotics, and fecal microbiota transplantation in the future. KEY POINTS: • The electrical signals produced by probiotic bacteria L. mesenteroides and L. lactis on chicken egg chorioallantoic membranes and in the mouse intestine lumen were detectable. • In the presence of glucose, L. lactis yielded higher electricity than L. mesenteroides in vitro. Furthermore, the electrical spectra generated by these two bacteria were different. • The importance of these differences with the application of a self-attention mechanism revealed several unique signals in the electrical spectra.

TinyML and edge intelligence applications in cardiovascular disease: A survey

Tiny machine learning (TinyML) and edge intelligence have emerged as pivotal paradigms for enabling machine learning on resource-constrained devices situated at the extreme edge of networks. In this paper, we explore the transformative potential of TinyML in facilitating pervasive, low-power cardiovascular monitoring and real-time analytics for patients with cardiac anomalies, leveraging wearable devices as the primary interface. To begin with, we provide an overview of TinyML software and hardware enablers, accompanied by an examination of networking solutions such as Low-power Wide area network (LPWAN) that facilitate the seamless deployment of TinyML frameworks. Following this, we delve into the methodologies of knowledge distillation, quantization, and pruning, which represent the cornerstone strategies for optimizing machine learning models to operate efficiently within resource-constrained environments. Furthermore, our discussion extends to the role of efficient deep neural networks tailored specifically for cardiovascular monitoring on wearable devices with limited computational resources. Through a comprehensive review, we analyze the applications of prominent artificial neural network architectures including Convolutional Neural Networks (CNNs), Autoencoders, Deep Belief Networks (DBNs), and Transformers in the domain of Electrocardiogram (ECG) analytics, shedding light on their efficacy and potential in advancing healthcare technology.

A Tiny Transformer for Low-Power Arrhythmia Classification on Microcontrollers

Wearable systems for the continuous and real-time monitoring of cardiovascular diseases are becoming widespread and valuable assets in diagnosis and therapy. A promising approach for real-time analysis of the electrocardiographic (ECG) signal and the detection of heart conditions, such as arrhythmia, is represented by the transformer machine learning model. Transformers are powerful models for the classification of time series, although efficient implementation in the wearable domain raises significant design challenges, to combine adequate accuracy and a suitable complexity. In this work, we present a tiny transformer model for the analysis of the ECG signal, requiring only 6k parameters and reaching 98.97% accuracy in the recognition of the 5 most common arrhythmia classes from the MIT-BIH Arrhythmia database, assessed considering 8-bit integer inference as required for efficient execution on low-power microcontroller-based devices. We explored an augmentation-based training approach for improving the robustness against electrode motion artifacts noise, resulting in a worst-case post-deployment performance assessment of 98.36% accuracy. Suitability for wearable monitoring solutions is finally demonstrated through efficient deployment on the parallel ultra-low-power GAP9 processor, where inference execution requires 4.28ms and 0.09mJ.

A novel deep learning model based on transformer and cross modality attention for classification of sleep stages

The classification of sleep stages is crucial for gaining insights into an individual's sleep patterns and identifying potential health issues. Employing several important physiological channels in different views, each providing a distinct perspective on sleep patterns, can have a great impact on the efficiency of the classification models. In the context of neural networks and deep learning models, transformers are very effective, especially when dealing with time series data, and have shown remarkable compatibility with sequential data analysis as physiological channels. On the other hand, cross-modality attention by integrating information from multiple views of the data enables to capture relationships among different modalities, allowing models to selectively focus on relevant information from each modality. In this paper, we introduce a novel deep-learning model based on transformer encoder-decoder and cross-modal attention for sleep stage classification. The proposed model processes information from various physiological channels with different modalities using the Sleep Heart Health Study Dataset (SHHS) data and leverages transformer encoders for feature extraction and cross-modal attention for effective integration to feed into the transformer decoder. The combination of these elements increased the accuracy of the model up to 91.33% in classifying five classes of sleep stages. Empirical evaluations demonstrated the model's superior performance compared to standalone approaches and other state-of-the-art techniques, showcasing the potential of combining transformer and cross-modal attention for improved sleep stage classification.

LDCNN: A new arrhythmia detection technique with ECG signals using a linear deep convolutional neural network

The electrocardiogram (ECG) is a fundamental and widely used tool for diagnosing cardiovascular diseases. It involves recording cardiac electrical signals using electrodes, which illustrate the functioning of cardiac muscles during contraction and relaxation phases. ECG is instrumental in identifying abnormal cardiac activity, heart attacks, and various cardiac conditions. Arrhythmia detection, a critical aspect of ECG analysis, entails accurately classifying heartbeats. However, ECG signal analysis demands a high level of expertise, introducing the possibility of human errors in interpretation. Hence, there is a clear need for robust automated detection techniques. Recently, numerous methods have emerged for arrhythmia detection from ECG signals. In our research, we developed a novel one-dimensional deep neural network technique called linear deep convolutional neural network (LDCNN) to identify arrhythmias from ECG signals. We compare our suggested method with several state-of-the-art algorithms for arrhythmia detection. We evaluate our methodology using benchmark datasets, including the PTB Diagnostic ECG and MIT-BIH Arrhythmia databases. Our proposed method achieves high accuracy rates of 99.24% on the PTB Diagnostic ECG dataset and 99.38% on the MIT-BIH Arrhythmia dataset.

Review on spiking neural network-based ECG classification methods for low-power environments

This paper reviews arrhythmia classification studies using electrocardiogram (ECG) signals. Research on automatically diagnosing arrhythmia in daily life has been actively underway for early detection and treatment of heart disease. Development of automatic arrhythmia classification using ECG signal began based on handcrafted morphological feature extraction and machine learning-based classification methods. As deep neural networks (DNN) show excellent performance in the signal processing field, studies using various types of DNN are also being conducted in ECG classification. However, these DNN-based studies have extremely high computational complexity, making it challenging to perform real-time classification, and are unsuitable for low-power environments such as wearable devices due to high power consumption. Currently, research based on spiking neural network (SNN), which mimics the low-power operation of the human nervous system, is attracting attention as a method that can dramatically reduce complexity and power consumption. The classification accuracy of the SNN-based ECG classification studies is close to that of the DNN-based studies. When combined with neuromorphic hardware, it shows ultra-low-power performance, suggesting the possibility of use in lightweight devices. In this paper, the SNN-based ECG classification studies for low-power environments are mainly reviewed, and prior to this, conventional and DNN-based ECG classification studies are also reviewed. We hope that this review will be helpful to researchers and engineers interested in the field of ECG classification.

Automatic detection of cardiac conditions from photos of electrocardiogram captured by smartphones

BACKGROUND

Researchers have developed machine learning-based ECG diagnostic algorithms that match or even surpass cardiologist level of performance. However, most of them cannot be used in real-world, as older generation ECG machines do not permit installation of new algorithms.

OBJECTIVE

To develop a smartphone application that automatically extract ECG waveforms from photos and to convert them to voltage-time series for downstream analysis by a variety of diagnostic algorithms built by researchers.

METHODS

A novel approach of using objective detection and image segmentation models to automatically extract ECG waveforms from photos taken by clinicians was devised. Modular machine learning models were developed to sequentially perform waveform identification, gridline removal, and scale calibration. The extracted data were then analysed using a machine learning-based cardiac rhythm classifier.

RESULTS

Waveforms from 40 516 scanned and 444 photographed ECGs were automatically extracted. 12 828 of 13 258 (96.8%) scanned and 5399 of 5743 (94.0%) photographed waveforms were correctly cropped and labelled. 11 604 of 12 735 (91.1%) scanned and 5062 of 5752 (88.0%) photographed waveforms achieved successful voltage-time signal extraction after automatic gridline and background noise removal. In a proof-of-concept demonstration, an atrial fibrillation diagnostic algorithm achieved 91.3% sensitivity, 94.2% specificity, 95.6% positive predictive value, 88.6% negative predictive value and 93.4% F1 score, using photos of ECGs as input.

CONCLUSION

Object detection and image segmentation models allow automatic extraction of ECG signals from photos for downstream diagnostics. This novel pipeline circumvents the need for costly ECG hardware upgrades, thereby paving the way for large-scale implementation of machine learning-based diagnostic algorithms.

A High-Performance Anti-Noise Algorithm for Arrhythmia Recognition

In recent years, the incidence of cardiac arrhythmias has been on the rise because of changes in lifestyle and the aging population. Electrocardiograms (ECGs) are widely used for the automated diagnosis of cardiac arrhythmias. However, existing models possess poor noise robustness and complex structures, limiting their effectiveness. To solve these problems, this paper proposes an arrhythmia recognition system with excellent anti-noise performance: a convolutionally optimized broad learning system (COBLS). In the proposed COBLS method, the signal is convolved with blind source separation using a signal analysis method based on high-order-statistic independent component analysis (ICA). The constructed feature matrix is further feature-extracted and dimensionally reduced using principal component analysis (PCA), which reveals the essence of the signal. The linear feature correlation between the data can be effectively reduced, and redundant attributes can be eliminated to obtain a low-dimensional feature matrix that retains the essential features of the classification model. Then, arrhythmia recognition is realized by combining this matrix with the broad learning system (BLS). Subsequently, the model was evaluated using the MIT-BIH arrhythmia database and the MIT-BIH noise stress test database. The outcomes of the experiments demonstrate exceptional performance, with impressive achievements in terms of the overall accuracy, overall precision, overall sensitivity, and overall F1-score. Specifically, the results indicate outstanding performance, with figures reaching 99.11% for the overall accuracy, 96.95% for the overall precision, 89.71% for the overall sensitivity, and 93.01% for the overall F1-score across all four classification experiments. The model proposed in this paper shows excellent performance, with 24 dB, 18 dB, and 12 dB signal-to-noise ratios.

A novel method of swin transformer with time-frequency characteristics for ECG-based arrhythmia detection

Introduction

Arrhythmia is an important indication of underlying cardiovascular diseases (CVD) and is prevalent worldwide. Accurate diagnosis of arrhythmia is crucial for timely and effective treatment. Electrocardiogram (ECG) plays a key role in the diagnosis of arrhythmia. With the continuous development of deep learning and machine learning processes in the clinical field, ECG processing algorithms have significantly advanced the field with timely and accurate diagnosis of arrhythmia.

Methods

In this study, we combined the wavelet time-frequency maps with the novel Swin Transformer deep learning model for the automatic detection of cardiac arrhythmias. In specific practice, we used the MIT-BIH arrhythmia dataset, and to improve the signal quality, we removed the high-frequency noise, artifacts, electromyographic noise and respiratory motion effects in the ECG signals by the wavelet thresholding method; we used the complex Morlet wavelet for the feature extraction, and plotted wavelet time-frequency maps to visualise the time-frequency information of the ECG; we introduced the Swin Transformer model for classification and achieve high classification accuracy of ECG signals through hierarchical construction and self attention mechanism, and combines windowed multi-head self-attention (W-MSA) and shifted window-based multi-head self-attention (SW-MSA) to comprehensively utilise the local and global information.

Results

To enhance the confidence of the experimental results, we evaluated the performance using intra-patient and inter-patient paradigm analyses, and the model classification accuracies reached 99.34% and 98.37%, respectively, which are better than the currently available detection methods.

Discussion

The results reveal that our proposed method is superior to currently available methods for detecting arrhythmia ECG. This provides a new idea for ECG based arrhythmia diagnosis.

Cardiac Arrhythmia Classification Using Advanced Deep Learning Techniques on Digitized ECG Datasets

ECG classification or heartbeat classification is an extremely valuable tool in cardiology. Deep learning-based techniques for the analysis of ECG signals assist human experts in the timely diagnosis of cardiac diseases and help save precious lives. This research aims at digitizing a dataset of images of ECG records into time series signals and then applying deep learning (DL) techniques on the digitized dataset. State-of-the-art DL techniques are proposed for the classification of the ECG signals into different cardiac classes. Multiple DL models, including a convolutional neural network (CNN), a long short-term memory (LSTM) network, and a self-supervised learning (SSL)-based model using autoencoders are explored and compared in this study. The models are trained on the dataset generated from ECG plots of patients from various healthcare institutes in Pakistan. First, the ECG images are digitized, segmenting the lead II heartbeats, and then the digitized signals are passed to the proposed deep learning models for classification. Among the different DL models used in this study, the proposed CNN model achieves the highest accuracy of ∼92%. The proposed model is highly accurate and provides fast inference for real-time and direct monitoring of ECG signals that are captured from the electrodes (sensors) placed on different parts of the body. Using the digitized form of ECG signals instead of images for the classification of cardiac arrhythmia allows cardiologists to utilize DL models directly on ECG signals from an ECG machine for the real-time and accurate monitoring of ECGs.

Non-Invasive Biosensing for Healthcare Using Artificial Intelligence: A Semi-Systematic Review

The rapid development of biosensing technologies together with the advent of deep learning has marked an era in healthcare and biomedical research where widespread devices like smartphones, smartwatches, and health-specific technologies have the potential to facilitate remote and accessible diagnosis, monitoring, and adaptive therapy in a naturalistic environment. This systematic review focuses on the impact of combining multiple biosensing techniques with deep learning algorithms and the application of these models to healthcare. We explore the key areas that researchers and engineers must consider when developing a deep learning model for biosensing: the data modality, the model architecture, and the real-world use case for the model. We also discuss key ongoing challenges and potential future directions for research in this field. We aim to provide useful insights for researchers who seek to use intelligent biosensing to advance precision healthcare.

Automated cardiac arrhythmia detection techniques: a comprehensive review for prospective approach

Abnormal cardiac functionality produces irregular heart rhythms which are commonly known as arrhythmias. In some conditions, arrhythmias are treated as very dangerous which may lead to sudden cardiac arrest. The incidence and prevalence of cardiac anomalies seeks early detection of arrhythmias using automated classification techniques. In the past, numerous automated arrhythmia detection techniques have been developed that are based on electrocardiogram (ECG) signal analysis. Focusing on the prospective research in this field, this article reports a comprehensive review of existing techniques that are obtained using search engines such as IEEE explore, Google scholar and science direct. Based on the review, the existing techniques are broadly categorized into two types: machine-learning and deep-learning-based techniques. In this study, it is noticed that the performance of the machine-learning-based arrhythmia detection techniques depend on pre-processing of ECG signal, R-peaks detection, features extraction and classification tools while the deep-learning-based techniques do not require the features extraction step. Generally, the existing techniques utilize Massachusetts Institute of Technology-Beth Israel Hospital arrhythmia database to evaluate the classification performance. The classification performance of automated techniques also depends on ECG data used for training and testing of the classifier. It is expected that the performance should be evaluated using a variety of ECG signals including the cases of inter-patient and intra-patient paradigm. The existing techniques also require to deal with the class-imbalance problem. In addition to this, a specific partition-ratio between training and testing datasets should be maintained for fair comparison of performance of different techniques.

Identification of Congenital Valvular Murmurs in Young Patients Using Deep Learning-Based Attention Transformers and Phonocardiograms

One in every four newborns suffers from congenital heart disease (CHD) that causes defects in the heart structure. The current gold-standard assessment technique, echocardiography, causes delays in the diagnosis owing to the need for experts who vary markedly in their ability to detect and interpret pathological patterns. Moreover, echo is still causing cost difficulties for low- and middle-income countries. Here, we developed a deep learning-based attention transformer model to automate the detection of heart murmurs caused by CHD at an early stage of life using cost-effective and widely available phonocardiography (PCG). PCG recordings were obtained from 942 young patients at four major auscultation locations, including the aortic valve (AV), mitral valve (MV), pulmonary valve (PV), and tricuspid valve (TV), and they were annotated by experts as absent, present, or unknown murmurs. A transformation to wavelet features was performed to reduce the dimensionality before the deep learning stage for inferring the medical condition. The performance was validated through 10-fold cross-validation and yielded an average accuracy and sensitivity of 90.23 % and 72.41 %, respectively. The accuracy of discriminating between murmurs' absence and presence reached 76.10 % when evaluated on unseen data. The model had accuracies of 70 %, 88 %, and 86 % in predicting murmur presence in infants, children, and adolescents, respectively. The interpretation of the model revealed proper discrimination between the learned attributes, and AV channel was found important (score 0.75) for the murmur absence predictions while MV and TV were more important for murmur presence predictions. The findings potentiate deep learning as a powerful front-line tool for inferring CHD status in PCG recordings leveraging early detection of heart anomalies in young people. It is suggested as a tool that can be used independently from high-cost machinery or expert assessment.

Enhancing ECG classification with continuous wavelet transform and multi-branch transformer

Background

Accurate classification of electrocardiogram (ECG) signals is crucial for automatic diagnosis of heart diseases. However, existing ECG classification methods often require complex preprocessing and denoising operations, and traditional convolutional neural network (CNN)-based methods struggle to capture complex relationships and high-level time-series features.

Method

In this study, we propose an ECG classification method based on continuous wavelet transform and multi-branch transformer. The method utilizes continuous wavelet transform (CWT) to convert the ECG signal into time-series feature map, eliminating the need for complicated preprocessing. Additionally, the multi-branch transformer is introduced to enhance feature extraction during model training and improve classification performance by removing redundant information while preserving important features.

Results

The proposed method was evaluated on the CPSC 2018 (6877 cases) and MIT-BIH (47 cases) ECG public datasets, achieving an accuracy of 98.53% and 99.38%, respectively, with F1 scores of 97.57% and 98.65%. These results outperformed most existing methods, demonstrating the excellent performance of the proposed method.

Conclusion

The proposed method accurately classifies the ECG time-series feature map, which holds promise for the diagnosis of cardiac arrhythmias. The findings of this study are valuable for advancing the field of automatic ECG diagnosis.

Pre-Processing techniques and artificial intelligence algorithms for electrocardiogram (ECG) signals analysis: A comprehensive review

Electrocardiogram (ECG) are the physiological signals and a standard test to measure the heart's electrical activity that depicts the movement of cardiac muscles. A review study has been conducted on ECG signals analysis with the help of artificial intelligence (AI) methods over the last ten years i.e., 2012-22. Primarily, the method of ECG analysis by software systems was divided into classical signal processing (e.g. spectrograms or filters), machine learning (ML) and deep learning (DL), including recursive models, transformers and hybrid. Secondly, the data sources and benchmark datasets were depicted. Authors grouped resources by ECG acquisition methods into hospital-based portable machines and wearable devices. Authors also included new trends like advanced pre-processing, data augmentation, simulations and agent-based modeling. The study found improvement in ECG examination perfection made each year through ML, DL, hybrid models, and transformers. Convolutional neural networks and hybrid models were more targeted and proved efficient. The transformer model extended the accuracy from 90% to 98%. The Physio-Net library helps acquire ECG signals, including the popular benchmark databases such as MIT-BIH, PTB, and challenging datasets. Similarly, wearable devices have been established as a appropriate option for monitoring patient health without the time and place limitations and are also helpful for AI model calibration with so far accuracy of 82%-83% on Samsung smartwatch. In the pre-processing signals, spectrogram generation through Fourier and wavelet transformations are erected leading approaches promoting on average accuracy of 90%-95%. Likewise, data enhancement using geometrical techniques is well-considered; however, extraction and concatenation-based methods need attention. As the what-if analysis in healthcare or cardiac issues can be performed using a complex simulation, the study reviews agent-based modeling and simulation approaches for cardiovascular risk event assessment.

Enhanced multi-label cardiology diagnosis with channel-wise recurrent fusion

The timely detection of abnormal electrocardiogram (ECG) signals is vital for preventing heart disease. However, traditional automated cardiology diagnostic methods have the limitation of being unable to simultaneously identify multiple diseases in a segment of ECG signals, and do not consider the potential correlations between the 12-lead ECG signals. To address these issues, this paper presents a novel network architecture, denoted as Branched Convolution and Channel Fusion Network (BCCF-Net), designed for the multi-label diagnosis of ECG cardiology to achieve simultaneous identification of multiple diseases. Among them, the BCCF-Net incorporates the Channel-wise Recurrent Fusion (CRF) network, which is designed to enhance the ability to explore potential correlation information between 12 leads. Furthermore, the utilization of the squeeze and excitation (SE) attention mechanism maximizes the potential of the convolutional neural network (CNN). In order to efficiently capture complex patterns in space and time across various scales, the multi branch convolution (MBC) module has been developed. Through extensive experiments on two public datasets with seven subtasks, the efficacy and robustness of the proposed ECG multi-label classification framework have been comprehensively evaluated. The results demonstrate the superior performance of the BCCF-Net compared to other state-of-the-art algorithms. The developed framework holds practical application in clinical settings, allowing for the refined diagnosis of cardiac arrhythmias through ECG signal analysis.

Convolutional transformer-driven robust electrocardiogram signal denoising framework with adaptive parametric ReLU

The electrocardiogram (ECG) is a widely used diagnostic tool for cardiovascular diseases. However, ECG recording is often subject to various noises, which can limit its clinical evaluation. To address this issue, we propose a novel Transformer-based convolutional neural network framework with adaptively parametric ReLU (APtrans-CNN) for ECG signal denoising. The proposed APtrans-CNN architecture combines the strengths of transformers in global feature learning and CNNs in local feature learning to address the inadequacy of learning with long sequence time-series features. By fully exploiting the global features of ECG signals, our framework can effectively extract critical information that is necessary for signal denoising. We also introduce an adaptively parametric ReLU that can assign a value to the negative information contained in the ECG signal, thereby overcoming the limitation of ReLU to retain negative information. Additionally, we introduce a dynamic feature aggregation module that enables automatic learning and retention of valuable features while discarding useless noise information. Results obtained from two datasets demonstrate that our proposed APtrans-CNN can accurately extract pure ECG signals from noisy datasets and is adaptable to various applications. Specifically, when the input consists of ECG signals with a signal-to-noise ratio (SNR) of -4 dB, APtrans-CNN successfully increases the SNR to more than 6 dB, resulting in the diagnostic model's accuracy exceeding 96%.

Echo state networks for the recognition of type 1 Brugada syndrome from conventional 12-LEAD ECG

Artificial Intelligence (AI) applications and Machine Learning (ML) methods have gained much attention in recent years for their ability to automatically detect patterns in data without being explicitly taught rules. Specific features characterise the ECGs of patients with Brugada Syndrome (BrS); however, there is still ambiguity regarding the correct diagnosis of BrS and its differentiation from other pathologies. This work presents an application of Echo State Networks (ESN) in the Recurrent Neural Networks (RNN) class for diagnosing BrS from the ECG time series. 12-lead ECGs were obtained from patients with a definite clinical diagnosis of spontaneous BrS Type 1 pattern (Group A), patients who underwent provocative pharmacological testing to induce BrS type 1 pattern, which resulted in positive (Group B) or negative (Group C), and control subjects (Group D). One extracted beat in the V2 lead was used as input, and the dataset was used to train and evaluate the ESN model using a double cross-validation approach. ESN performance was compared with that of 4 cardiologists trained in electrophysiology. The model performance was assessed in the dataset, with a correct global diagnosis observed in 91.5 % of cases compared to clinicians (88.0 %). High specificity (94.5 %), sensitivity (87.0 %) and AUC (94.7 %) for BrS recognition by ESN were observed in Groups A + B vs. C + D. Our results show that this ML model can discriminate Type 1 BrS ECGs with high accuracy comparable to expert clinicians. Future availability of larger datasets may improve the model performance and increase the potential of the ESN as a clinical support system tool for daily clinical practice.

Automatic segmentation of atrial fibrillation and flutter in single-lead electrocardiograms by self-supervised learning and Transformer architecture

OBJECTIVES

Automatic detection of atrial fibrillation and flutter (AF/AFL) is a significant concern in preventing stroke and mitigating hemodynamic instability. Herein, we developed a Transformer-based deep learning model for AF/AFL segmentation in single-lead electrocardiograms (ECGs) by self-supervised learning with masked signal modeling (MSM).

MATERIALS AND METHODS

We retrieved data from 11 open-source databases on PhysioNet; 7 of these databases included labeled ECGs, while the other 4 were without labels. Each database contained ECG recordings with durations of ≥30 s. A total of 24 intradialytic ECGs with paroxysmal AF/AFL during 4 h of hemodialysis sessions at Seoul National University Hospital were used for external validation. The model was pretrained by predicting masked areas of ECG signals and fine-tuned by predicting AF/AFL areas. Cross-database validation was used for evaluation, and the intersection over union (IOU) was used as a main performance metric in external database validation.

RESULTS

In the 7 labeled databases, the areas marked as AF/AFL constituted 41.1% of the total ECG signals, ranging from 0.19% to 51.31%. In the evaluation per ECG segment, the model achieved IOU values of 0.9254 and 0.9477 for AF/AFL segmentation and other segmentation tasks, respectively. When applied to intradialytic ECGs with paroxysmal AF/AFL, the IOUs for the segmentation of AF/AFL and non-AF/AFL were 0.9896 and 0.9650, respectively. Model performance by different training procedure indicated that pretraining with MSM and the application of an appropriate masking ratio both contributed to the model performance. It also showed higher IOUs of AF/AFL labels than in previous studies when training and test databases were matched.

CONCLUSION

The present model with self-supervised learning by MSM performs robustly in segmenting AF/AFL.

Inter-patient ECG heartbeat classification for arrhythmia classification: a new approach of multi-layer perceptron with weight capsule and sequence-to-sequence combination

Objective: The objective of this research is to construct a method to alleviate the problem of sample imbalance in classification, especially for arrhythmia classification. This approach can improve the performance of the model without using data enhancement. Methods: In this study, we have developed a new Multi-layer Perceptron (MLP) block and have used a Weight Capsule (WCapsule) network with MLP combined with sequence-to-sequence (Seq2Seq) network to classify arrhythmias. Our work is based on the MIT-BIH arrhythmia database, the original electrocardiogram (ECG) data is classified according to the criteria recommended by the American Association for Medical Instrumentation (AAMI). Also, our method's performance is further evaluated. Results: The proposed model is evaluated using the inter-patient paradigm. Our proposed method shows an accuracy (ACC) of 99.88% under sample imbalance. For Class N, sensitivity (SEN) is 99.79%, positive predictive value (PPV) is 99.90%, and specificity (SPEC) is 99.19%. For Class S, SEN is 97.66%, PPV is 96.14%, and SPEC is 99.85%. For Class V, SEN is 99.97%, PPV is 99.07%, and SPEC is 99.94%. For Class F, SEN is 97.94%, PPV is 98.70%, and SPEC is 99.99%. When using only half of the training sample, our method shows that the SEN of Class N and V is 0.97% and 5.27% higher than the traditional machine learning algorithm. Conclusion: The proposed method combines MLP, weight capsule network with Seq2seq network, effectively addresses the problem of sample imbalance in arrhythmia classification, and produces good performance. Our method also shows promising potential in less samples.

Deep learning for ECG Arrhythmia detection and classification: an overview of progress for period 2017-2023

Cardiovascular diseases are a leading cause of mortality globally. Electrocardiography (ECG) still represents the benchmark approach for identifying cardiac irregularities. Automatic detection of abnormalities from the ECG can aid in the early detection, diagnosis, and prevention of cardiovascular diseases. Deep Learning (DL) architectures have been successfully employed for arrhythmia detection and classification and offered superior performance to traditional shallow Machine Learning (ML) approaches. This survey categorizes and compares the DL architectures used in ECG arrhythmia detection from 2017-2023 that have exhibited superior performance. Different DL models such as Convolutional Neural Networks (CNNs), Multilayer Perceptrons (MLPs), Transformers, and Recurrent Neural Networks (RNNs) are reviewed, and a summary of their effectiveness is provided. This survey provides a comprehensive roadmap to expedite the acclimation process for emerging researchers willing to develop efficient algorithms for detecting ECG anomalies using DL models. Our tailored guidelines bridge the knowledge gap allowing newcomers to align smoothly with the prevailing research trends in ECG arrhythmia detection. We shed light on potential areas for future research and refinement in model development and optimization, intending to stimulate advancement in ECG arrhythmia detection and classification.

A novel transformer-based ECG dimensionality reduction stacked auto-encoders for arrhythmia beat detection

BACKGROUND

Electrocardiogram (ECG) is a powerful tool for studying cardiac activity and diagnosing various cardiovascular diseases, including arrhythmia. While machine learning and deep learning algorithms have been applied to ECG interpretation, there is still room for improvement. For instance, the commonly used Recurrent Neural Networks (RNNs), reply on its previous state to update and is therefore ineffective for parallel computing. RNN also struggles to efficiently address the issue of long-distance reliance.

PURPOSE

To reduce computational complexity by dimensionality reduction of ECG signals we constructed a Stacked Auto-encoders model using Transformer for ECG-based arrhythmia detection. And overcome the challenges of long-term dependencies and limited parallelizability in traditional RNNs when applied to ECG signal processing.

METHODS

In this paper, a Transformer-Based ECG Dimensionality Reduction Stacked Auto-encoders model is proposed for ECG-based arrhythmia detection. The transformer is used to encode ECG signals into a feature matrix, which is then dimensionally reduced using unsupervised greedy training through the four linear layers. This resulted in a low-dimensional representation of ECG features, which are subsequently classified using support vector machines (SVM) to minimize overfitting.

RESULTS

The proposed method is benchmarked on the MIT-BIH Arrhythmia database. In the 10-fold cross validation of beat-based arrhythmia detection, the average accuracy, sensitivity, specificity and F1 score of the proposed method are 99.83%, 98.84%, 99.84% and 99.13%, respectively, for the record-based arrhythmia detection which refers to the approach where the training and testing sets use ECG data from independent recorded patients are 88.10%, 49.79%, 91.56% and 39.95%, respectively.

CONCLUSIONS

Compared to other existing ECG-based arrhythmia detection methods, our proposed approach exhibits improved detection accuracy and stronger generalization for arrhythmia beats. Additionally, the use of the record-based data division method makes our approach more suitable for clinical practice.

An end-end arrhythmia diagnosis model based on deep learning neural network with multi-scale feature extraction

This study presents an innovative end-to-end deep learning arrhythmia diagnosis model that aims to address the problems in arrhythmia diagnosis. The model performs pre-processing of the heartbeat signal by automatically and efficiently extracting time-domain, time-frequency-domain and multi-scale features at different scales. These features are imported into an adaptive online convolutional network-based classification inference module for arrhythmia diagnosis. Experimental results show that the AOCT-based deep learning neural network diagnostic module has excellent parallel computing and classification inference capabilities, and the overall performance of the model improves with increasing scales. In particular, when multi-scale features are used as inputs, the model is able to learn both time-frequency domain information and other rich information, thus significantly improving the performance of the end-to-end diagnostic model. The final results show that the AOCT-based deep learning neural network model has an average accuracy of 99.72%, a recall of 99.62%, and an F1 score of 99.3% in diagnosing four common heart diseases.

Ensemble classifier fostered detection of arrhythmia using ECG data

Electrocardiogram (ECG) is a non-invasive medical tool that divulges the rhythm and function of the human heart. This is broadly employed in heart disease detection including arrhythmia. Arrhythmia is a general term for abnormal heart rhythms that can be identified and classified into many categories. Automatic ECG analysis is provided by arrhythmia categorization in cardiac patient monitoring systems. It aids cardiologists to diagnose the ECG signal. In this work, an Ensemble classifier is proposed for accurate arrhythmia detection using ECG Signal. Input data are taken from the MIT-BIH arrhythmia dataset. Then the input data was pre-processed using Python in Jupyter Notebook which run the code in an isolated manner and was able to keep code, formula, comments, and images. Then, Residual Exemplars Local Binary Pattern is applied for extracting statistical features. The extracted features are given to ensemble classifiers, like Support vector machines (SVM), Naive Bayes (NB), and random forest (RF) for classifying the arrhythmia as normal (N), supraventricular ectopic beat (S), ventricular ectopic beat (V), fusion beat (F), and unknown beat (Q). The proposed AD-Ensemble SVM-NB-RF method is implemented in Python. The proposed AD-Ensemble SVM-NB-RF method is 44.57%, 52.41%, and 29.49% higher accuracy; 2.01%, 3.33%, and 3.19% higher area under the curve (AUC); and 21.52%, 23.05%, and 12.68% better F-Measure compared with existing models, like multi-model depending on the ensemble of deep learning for ECG heartbeats arrhythmia categorization (AD-Ensemble CNN-LSTM-RRHOS), ECG signal categorization utilizing VGGNet: a neural network based classification method (AD-Ensemble CNN-LSTM) and higher performance arrhythmic heartbeat categorization utilizing ensemble learning along PSD based feature extraction method (AD-Ensemble MLP-NB-RF).

A Residual-Dense-Based Convolutional Neural Network Architecture for Recognition of Cardiac Health Based on ECG Signals

Cardiovascular disorders are often diagnosed using an electrocardiogram (ECG). It is a painless method that mimics the cyclical contraction and relaxation of the heart's muscles. By monitoring the heart's electrical activity, an ECG can be used to identify irregular heartbeats, heart attacks, cardiac illnesses, or enlarged hearts. Numerous studies and analyses of ECG signals to identify cardiac problems have been conducted during the past few years. Although ECG heartbeat classification methods have been presented in the literature, especially for unbalanced datasets, they have not proven to be successful in recognizing some heartbeat categories with high performance. This study uses a convolutional neural network (CNN) model to combine the benefits of dense and residual blocks. The objective is to leverage the benefits of residual and dense connections to enhance information flow, gradient propagation, and feature reuse, ultimately improving the model's performance. This proposed model consists of a series of residual-dense blocks interleaved with optional pooling layers for downsampling. A linear support vector machine (LSVM) classified heartbeats into five classes. This makes it easier to learn and represent features from ECG signals. We first denoised the gathered ECG data to correct issues such as baseline drift, power line interference, and motion noise. The impacts of the class imbalance are then offset by resampling techniques that denoise ECG signals. An RD-CNN algorithm is then used to categorize the ECG data for the various cardiac illnesses using the retrieved characteristics. On two benchmarked datasets, we conducted extensive simulations and assessed several performance measures. On average, we have achieved an accuracy of 98.5%, a sensitivity of 97.6%, a specificity of 96.8%, and an area under the receiver operating curve (AUC) of 0.99. The effectiveness of our suggested method for detecting heart disease from ECG data was compared with several recently presented algorithms. The results demonstrate that our method is lightweight and practical, qualifying it for continuous monitoring applications in clinical settings for automated ECG interpretation to support cardiologists.

Artificial Intelligence in Cardiology: An Australian Perspective

Significant advances have been made in artificial intelligence technology in recent years. Many health care applications have been investigated to assist clinicians and the technology is close to being integrated into routine clinical practice. The high prevalence of cardiac disease in Australia places overwhelming demands on the existing health care system, challenging its capacity to provide quality patient care. Artificial intelligence has emerged as a promising solution. This discussion paper provides an Australian perspective on the current state of artificial intelligence in cardiology, including the benefits and challenges of implementation. This paper highlights some current artificial intelligence applications in cardiology, while also detailing challenges such as data privacy, ethical considerations, and integration within existing health infrastructures. Overall, this paper aims to provide insights into the potential benefits of artificial intelligence in cardiology, while also acknowledging the barriers that need to be addressed to ensure safe and effective implementation into an Australian health system.

Accurate detection of paroxysmal atrial fibrillation with certified-GAN and neural architecture search

This paper presents a novel machine learning framework for detecting PxAF, a pathological characteristic of electrocardiogram (ECG) that can lead to fatal conditions such as heart attack. To enhance the learning process, the framework involves a generative adversarial network (GAN) along with a neural architecture search (NAS) in the data preparation and classifier optimization phases. The GAN is innovatively invoked to overcome the class imbalance of the training data by producing the synthetic ECG for PxAF class in a certified manner. The effect of the certified GAN is statistically validated. Instead of using a general-purpose classifier, the NAS automatically designs a highly accurate convolutional neural network architecture customized for the PxAF classification task. Experimental results show that the accuracy of the proposed framework exhibits a high value of 99.0% which not only enhances state-of-the-art by up to 5.1%, but also improves the classification performance of the two widely-accepted baseline methods, ResNet-18, and Auto-Sklearn, by [Formula: see text] and [Formula: see text].

A Dual-Scale Lead-Separated Transformer for ECG Classification

This work proposes a novel dual-scale lead-separated transformer for the auxiliary diagnosis of 12-lead electrocardiograms (ECGs). We added a new structure design on the basis of traditional ECG signal processing, which led to our model with only 2.6M parameters. The output of the system is the classification results. The fixed 0.5 second ECG segments of each lead are interpreted as independent patches. Together with the reduced dimension signal, patches form a dual-scale representation. As a method to reduce interference from segments with low correlation, a lead-orthogonal attention module is proposed. Experimental results show the effectiveness and scalability of our model.Clinical relevance- Our method improves the scores of clinical 12-lead ECG classification and shows generalization ability. Our model is suitable for single-label and multi-label classification tasks on clinical 12-lead ECG and is compatible with single lead classification. The integration of clinical information can further improve the effectiveness of the model.

Practical intelligent diagnostic algorithm for wearable 12-lead ECG via self-supervised learning on large-scale dataset

Cardiovascular disease is a major global public health problem, and intelligent diagnostic approaches play an increasingly important role in the analysis of electrocardiograms (ECGs). Convenient wearable ECG devices enable the detection of transient arrhythmias and improve patient health by making it possible to seek intervention during continuous monitoring. We collected 658,486 wearable 12-lead ECGs, among which 164,538 were annotated, and the remaining 493,948 were without diagnostic. We present four data augmentation operations and a self-supervised learning classification framework that can recognize 60 ECG diagnostic terms. Our model achieves an average area under the receiver-operating characteristic curve (AUROC) and average F1 score on the offline test of 0.975 and 0.575. The average sensitivity, specificity and F1-score during the 2-month online test are 0.736, 0.954 and 0.468, respectively. This approach offers real-time intelligent diagnosis, and detects abnormal segments in long-term ECG monitoring in the clinical setting for further diagnosis by cardiologists.

An Arrhythmia Classification Model Based on Vision Transformer with Deformable Attention

The electrocardiogram (ECG) is a highly effective non-invasive tool for monitoring heart activity and diagnosing cardiovascular diseases (CVDs). Automatic detection of arrhythmia based on ECG plays a critical role in the early prevention and diagnosis of CVDs. In recent years, numerous studies have focused on using deep learning methods to address arrhythmia classification problems. However, the transformer-based neural network in current research still has a limited performance in detecting arrhythmias for the multi-lead ECG. In this study, we propose an end-to-end multi-label arrhythmia classification model for the 12-lead ECG with varied-length recordings. Our model, called CNN-DVIT, is based on a combination of convolutional neural networks (CNNs) with depthwise separable convolution, and a vision transformer structure with deformable attention. Specifically, we introduce the spatial pyramid pooling layer to accept varied-length ECG signals. Experimental results show that our model achieved an F1 score of 82.9% in CPSC-2018. Notably, our CNN-DVIT outperforms the latest transformer-based ECG classification algorithms. Furthermore, ablation experiments reveal that the deformable multi-head attention and depthwise separable convolution are both efficient in extracting features from multi-lead ECG signals for diagnosis. The CNN-DVIT achieved good performance for the automatic arrhythmia detection of ECG signals. This indicates that our research can assist doctors in clinical ECG analysis, providing important support for the diagnosis of arrhythmia and contributing to the development of computer-aided diagnosis technology.

Detection of Paroxysmal Atrial Fibrillation from Dynamic ECG Recordings Based on a Deep Learning Model

BACKGROUND AND OBJECTIVES

Atrial fibrillation (AF) is one of the most common arrhythmias clinically. Aging tends to increase the risk of AF, which also increases the burden of other comorbidities, including coronary artery disease (CAD), and even heart failure (HF). The precise detection of AF is a challenge due to its intermittence and unpredictability. A method for the accurate detection of AF is still needed.

METHODS

A deep learning model was used to detect atrial fibrillation. Here, a distinction was not made between AF and atrial flutter (AFL), both of which manifest as a similar pattern on an electrocardiogram (ECG). This method not only discriminated AF from normal rhythm of the heart, but also detected its onset and offset. The proposed model involved residual blocks and a Transformer encoder.

RESULTS AND CONCLUSIONS

The data used for training were obtained from the CPSC2021 Challenge, and were collected using dynamic ECG devices. Tests on four public datasets validated the availability of the proposed method. The best performance for AF rhythm testing attained an accuracy of 98.67%, a sensitivity of 87.69%, and a specificity of 98.56%. In onset and offset detection, it obtained a sensitivity of 95.90% and 87.70%, respectively. The algorithm with a low FPR of 0.46% was able to reduce troubling false alarms. The model had a great capability to discriminate AF from normal rhythm and to detect its onset and offset. Noise stress tests were conducted after mixing three types of noise. We visualized the model's features using a heatmap and illustrated its interpretability. The model focused directly on the crucial ECG waveform where showed obvious characteristics of AF.

Electrocardiogram Heartbeat Classification for Arrhythmias and Myocardial Infarction

An electrocardiogram (ECG) is a basic and quick test for evaluating cardiac disorders and is crucial for remote patient monitoring equipment. An accurate ECG signal classification is critical for real-time measurement, analysis, archiving, and transmission of clinical data. Numerous studies have focused on accurate heartbeat classification, and deep neural networks have been suggested for better accuracy and simplicity. We investigated a new model for ECG heartbeat classification and found that it surpasses state-of-the-art models, achieving remarkable accuracy scores of 98.5% on the Physionet MIT-BIH dataset and 98.28% on the PTB database. Furthermore, our model achieves an impressive F1-score of approximately 86.71%, outperforming other models, such as MINA, CRNN, and EXpertRF on the PhysioNet Challenge 2017 dataset.

An intelligent health monitoring and diagnosis system based on the internet of things and fuzzy logic for cardiac arrhythmia COVID-19 patients

BACKGROUND

During the COVID-19 pandemic, there is a global demand for intelligent health surveillance and diagnosis systems for patients with critical conditions, particularly those with severe heart diseases. Sophisticated measurement tools are used in hospitals worldwide to identify serious heart conditions. However, these tools need the face-to-face involvement of healthcare experts to identify cardiac problems.

OBJECTIVE

To design and implement an intelligent health monitoring and diagnosis system for critical cardiac arrhythmia COVID-19 patients.

METHODOLOGY

We use artificial intelligence tools divided into two parts: (i) IoT-based health monitoring; and (ii) fuzzy logic-based medical diagnosis. The intelligent diagnosis of heart conditions and IoT-based health surveillance by doctors is offered to critical COVID-19 patients or isolated in remote locations. Sensors, cloud storage, as well as a global system for mobile texts and emails for communication with doctors in case of emergency are employed in our proposal.

RESULTS

Our implemented system favors remote areas and isolated critical patients. This system utilizes an intelligent algorithm that employs an ECG signal pre-processed by moving through six digital filters. Then, based on the processed results, features are computed and assessed. The intelligent fuzzy system can make an autonomous diagnosis and has enough information to avoid human intervention. The algorithm is trained using ECG data from the MIT-BIH database and achieves high accuracy. In real-time validation, the fuzzy algorithm obtained almost 100% accuracy for all experiments.

CONCLUSION

Our intelligent system can be helpful in many situations, but it is particularly beneficial for isolated COVID-19 patients who have critical heart arrhythmia and must receive intensive care.

Multi-Step Structure Image Inpainting Model with Attention Mechanism

The proliferation of deep learning has propelled image inpainting to an important research field. Although the current image inpainting model has made remarkable achievements, the two-stage image inpainting method is easy to produce structural errors in the rough stage because of insufficient treatment of the rough inpainting stage. To address this problem, we propose a multi-step structured image inpainting model combining attention mechanisms. Different from the previous two-stage inpainting model, we divide the damaged area into four sub-areas, calculate the priority of each area according to the priority, specify the inpainting order, and complete the rough inpainting stage several times. The stability of the model is enhanced by the multi-step method. The structural attention mechanism strengthens the expression of structural features and improves the quality of structure and contour reconstruction. Experimental evaluation of benchmark data sets shows that our method effectively reduces structural errors and improves the effect of image inpainting.

A Literature Review: ECG-Based Models for Arrhythmia Diagnosis Using Artificial Intelligence Techniques

In the health care and medical domain, it has been proven challenging to diagnose correctly many diseases with complicated and interferential symptoms, including arrhythmia. However, with the evolution of artificial intelligence (AI) techniques, the diagnosis and prognosis of arrhythmia became easier for the physicians and practitioners using only an electrocardiogram (ECG) examination. This review presents a synthesis of the studies conducted in the last 12 years to predict arrhythmia's occurrence by classifying automatically different heartbeat rhythms. From a variety of research academic databases, 40 studies were selected to analyze, among which 29 of them applied deep learning methods (72.5%), 9 of them addressed the problem with machine learning methods (22.5%), and 2 of them combined both deep learning and machine learning to predict arrhythmia (5%). Indeed, the use of AI for arrhythmia diagnosis is emerging in literature, although there are some challenging issues, such as the explicability of the Deep Learning methods and the computational resources needed to achieve high performance. However, with the continuous development of cloud platforms and quantum calculation for AI, we can achieve a breakthrough in arrhythmia diagnosis.

Diagnosis of arrhythmias with few abnormal ECG samples using metric-based meta learning

A major challenge in artificial intelligence based ECG diagnosis lies that it is difficult to obtain sufficient annotated training samples for each rhythm type, especially for rare diseases, which makes many approaches fail to achieve the desired performance with limited ECG records. In this paper, we propose a Meta Siamese Network (MSN) based on metric learning to achieve high accuracy for automatic ECG arrhythmias diagnosis with limited ECG records. First, the ECG signals from three different ECG datasets are preprocessed through resampling, wavelet denoising, R-wave localization, heartbeat segmentation and Z-score normalization. Then, an ECG dataset with limited records is constructed to verify the performance of the proposed model and explore variation of model performance with the sample size. Second, a metric-based meta-learning framework is proposed to address the challenge of few-shot learning for automatic ECG diagnosis of cardiac arrhythmia, and siamese network is employed to achieve arrhythmia diagnosis based on similarity metric. Finally, the N-way K-shot meta-testing strategy is proposed based on the siamese network with double inputs, and the experimental results demonstrate that the proposed strategy can effectively improve the robustness of the proposed model.

Fuzz-ClustNet: Coupled fuzzy clustering and deep neural networks for Arrhythmia detection from ECG signals

Electrocardiogram (ECG) is a widely used technique to diagnose cardiovascular diseases. It is a non-invasive technique that represents the cyclic contraction and relaxation of heart muscles. ECG can be used to detect abnormal heart motions, heart attacks, heart diseases, or enlarged hearts by measuring the heart's electrical activity. Over the past few years, various works have been done in the field of studying and analyzing the ECG signals to detect heart diseases. In this work, we propose a deep learning and fuzzy clustering (Fuzz-ClustNet) based approach for Arrhythmia detection from ECG signals. We started by denoising the collected ECG signals to remove errors like baseline drift, power line interference, motion noise, etc. The denoised ECG signals are then segmented to have an increased focus on the ECG signals. We then perform data augmentation on the segmented images to counter the effects of the class imbalance. The augmented images are then passed through a CNN feature extractor. The extracted features are then passed to a fuzzy clustering algorithm to classify the ECG signals for their respective cardio diseases. We ran intensive simulations on two benchmarked datasets and evaluated various performance metrics. The performance of our proposed algorithm was compared with several recently proposed algorithms for heart disease detection from ECG signals. The obtained results demonstrate the efficacy of our proposed approach as compared to other contemporary algorithms.

ECG classification using 1-D convolutional deep residual neural network

An electrocardiograph (ECG) is widely used in diagnosis and prediction of cardiovascular diseases (CVDs). The traditional ECG classification methods have complex signal processing phases that leads to expensive designs. This paper provides a deep learning (DL) based system that employs the convolutional neural networks (CNNs) for classification of ECG signals present in PhysioNet MIT-BIH Arrhythmia database. The proposed system implements 1-D convolutional deep residual neural network (ResNet) model that performs feature extraction by directly using the input heartbeats. We have used synthetic minority oversampling technique (SMOTE) that process class-imbalance problem in the training dataset and effectively classifies the five heartbeat types in the test dataset. The classifier's performance is evaluated with ten-fold cross validation (CV) using accuracy, precision, sensitivity, F1-score, and kappa. We have obtained an average accuracy of 98.63%, precision of 92.86%, sensitivity of 92.41%, and specificity of 99.06%. The average F1-score and Kappa obtained were 92.63% and 95.5% respectively. The study shows that proposed ResNet performs well with deep layers compared to other 1-D CNNs.

TC-Net: A Transformer Capsule Network for EEG-based emotion recognition

Deep learning has recently achieved remarkable success in emotion recognition based on Electroencephalogram (EEG), in which convolutional neural networks (CNNs) are the mostly used models. However, due to the local feature learning mechanism, CNNs have difficulty in capturing the global contextual information involving temporal domain, frequency domain, intra-channel and inter-channel. In this paper, we propose a Transformer Capsule Network (TC-Net), which mainly contains an EEG Transformer module to extract EEG features and an Emotion Capsule module to refine the features and classify the emotion states. In the EEG Transformer module, EEG signals are partitioned into non-overlapping windows. A Transformer block is adopted to capture global features among different windows, and we propose a novel patch merging strategy named EEG-PatchMerging (EEG-PM) to better extract local features. In the Emotion Capsule module, each channel of the EEG feature maps is encoded into a capsule to better characterize the spatial relationships among multiple features. Experimental results on two popular datasets (i.e., DEAP and DREAMER) demonstrate that the proposed method achieves the state-of-the-art performance in the subject-dependent scenario. Specifically, on DEAP (DREAMER), our TC-Net achieves the average accuracies of 98.76% (98.59%), 98.81% (98.61%) and 98.82% (98.67%) at valence, arousal and dominance dimensions, respectively. Moreover, the proposed TC-Net also shows high effectiveness in multi-state emotion recognition tasks using the popular VA and VAD models. The main limitation of the proposed model is that it tends to obtain relatively low performance in the cross-subject recognition task, which is worthy of further study in the future.

Identification of Heart Arrhythmias by Utilizing a Deep Learning Approach of the ECG Signals on Edge Devices

Accurate and timely detection of cardiac arrhythmias is crucial in reducing treatment times and, ultimately, preventing serious life-threatening complications, such as the incidence of a stroke. This becomes of major importance, especially during the diagnostic process, where there is limited access to cardiologists, such as in hospital emergency departments. The proposed lightweight solution uses a novel classifier, consistently designed and implemented, based on a 2D convolutional neural network (CNN) and properly optimized in terms of storage and computational complexity, thus making it suitable for deployment on edge devices capable of operating in hospital emergency departments, providing privacy, portability, and constant operation. The experiments on the MIT-BIH arrhythmia database, show that the proposed 2D-CNN obtains an overall accuracy of 95.3%, mean sensitivity of 95.27%, mean specificity of 98.82%, and a One-vs-Rest ROC-AUC score of 0.9934. Moreover, the results and metrics based on the NVIDIA® Jetson Nano™ platform show that the proposed method achieved excellent performance and speed, and would be particularly useful in the clinical practice for continuous real-time (RT) monitoring scenarios.

TranGRU: focusing on both the local and global information of molecules for molecular property prediction

Molecular property prediction is an essential but challenging task in drug discovery. The recurrent neural network (RNN) and Transformer are the mainstream methods for sequence modeling, and both have been successfully applied independently for molecular property prediction. As the local information and global information of molecules are very important for molecular properties, we aim to integrate the bi-directional gated recurrent unit (BiGRU) into the original Transformer encoder, together with self-attention to better capture local and global molecular information simultaneously. To this end, we propose the TranGRU approach, which encodes the local and global information of molecules by using the BiGRU and self-attention, respectively. Then, we use a gate mechanism to reasonably fuse the two molecular representations. In this way, we enhance the ability of the proposed model to encode both local and global molecular information. Compared to the baselines and state-of-the-art methods when treating each task as a single-task classification on Tox21, the proposed approach outperforms the baselines on 9 out of 12 tasks and state-of-the-art methods on 5 out of 12 tasks. TranGRU also obtains the best ROC-AUC scores on BBBP, FDA, LogP, and Tox21 (multitask classification) and has a comparable performance on ToxCast, BACE, and ecoli. On the whole, TranGRU achieves better performance for molecular property prediction. The source code is available in GitHub: https://github.com/Jiangjing0122/TranGRU.

Investigation of Applying Machine Learning and Hyperparameter Tuned Deep Learning Approaches for Arrhythmia Detection in ECG Images

The level of patient's illness is determined by diagnosing the problem through different methods like physically examining patients, lab test data, and history of patient and by experience. To treat the patient, proper diagnosis is very much important. Arrhythmias are irregular variations in normal heart rhythm, and detecting them manually takes a long time and relies on clinical skill. Currently machine learning and deep learning models are used to automate the diagnosis by capturing unseen patterns from datasets. This research work concentrates on data expansion using augmentation technique which increases the dataset size by generating different images. The proposed system develops a medical diagnosis system which can be used to classify arrhythmia into different categories. Initially, machine learning techniques like Support Vector Machine (SVM), Naïve Bayes (NB), and Logistic Regression (LR) are used for diagnosis. In general deep learning models are used to extract high level features and to provide improved performance over machine learning algorithms. In order to achieve this, the proposed system utilizes a deep learning algorithm known as Convolutional Neural Network-baseline model for arrhythmia detection. The proposed system also adopts a novel hyperparameter tuned CNN model to acquire optimal combination of parameters that minimizes loss function and produces better result. The result shows that the hyper-tuned model outperforms other machine learning models and CNN baseline model for accurate classification of normal and other five different arrhythmia types.

A Review on Deep Learning Techniques for IoT Data

Continuous growth in software, hardware and internet technology has enabled the growth of internet-based sensor tools that provide physical world observations and data measurement. The Internet of Things(IoT) is made up of billions of smart things that communicate, extending the boundaries of physical and virtual entities of the world further. These intelligent things produce or collect massive data daily with a broad range of applications and fields. Analytics on these huge data is a critical tool for discovering new knowledge, foreseeing future knowledge and making control decisions that make IoT a worthy business paradigm and enhancing technology. Deep learning has been used in a variety of projects involving IoT and mobile apps, with encouraging early results. With its data-driven, anomaly-based methodology and capacity to detect developing, unexpected attacks, deep learning may deliver cutting-edge solutions for IoT intrusion detection. In this paper, the increased amount of information gathered or produced is being used to further develop intelligence and application capabilities through Deep Learning (DL) techniques. Many researchers have been attracted to the various fields of IoT, and both DL and IoT techniques have been approached. Different studies suggested DL as a feasible solution to manage data produced by IoT because it was intended to handle a variety of data in large amounts, requiring almost real-time processing. We start by discussing the introduction to IoT, data generation and data processing. We also discuss the various DL approaches with their procedures. We surveyed and summarized major reporting efforts for DL in the IoT region on various datasets. The features, application and challenges that DL uses to empower IoT applications, which are also discussed in this promising field, can motivate and inspire further developments.