1
|
Mustaqeem, El Saddik A, Alotaibi FS, Pham NT. AAD-Net: Advanced end-to-end speech signal system for human emotion detection & recognition using attention-based deep echo state network. Knowl Based Syst 2023. [DOI: 10.1016/j.knosys.2023.110525] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/03/2023]
|
2
|
Daneshfar F, Jamshidi MB. An octonion-based nonlinear echo state network for speech emotion recognition in Metaverse. Neural Netw 2023; 163:108-121. [PMID: 37030275 DOI: 10.1016/j.neunet.2023.03.026] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2022] [Revised: 01/18/2023] [Accepted: 03/19/2023] [Indexed: 03/29/2023]
Abstract
While the Metaverse is becoming a popular trend and drawing much attention from academia, society, and businesses, processing cores used in its infrastructures need to be improved, particularly in terms of signal processing and pattern recognition. Accordingly, the speech emotion recognition (SER) method plays a crucial role in creating the Metaverse platforms more usable and enjoyable for its users. However, existing SER methods continue to be plagued by two significant problems in the online environment. The shortage of adequate engagement and customization between avatars and users is recognized as the first issue and the second problem is related to the complexity of SER problems in the Metaverse as we face people and their digital twins or avatars. This is why developing efficient machine learning (ML) techniques specified for hypercomplex signal processing is essential to enhance the impressiveness and tangibility of the Metaverse platforms. As a solution, echo state networks (ESNs), which are an ML powerful tool for SER, can be an appropriate technique to enhance the Metaverse's foundations in this area. Nevertheless, ESNs have some technical issues restricting them from a precise and reliable analysis, especially in the aspect of high-dimensional data. The most significant limitation of these networks is the high memory consumption caused by their reservoir structure in face of high-dimensional signals. To solve all problems associated with ESNs and their application in the Metaverse, we have come up with a novel structure for ESNs empowered by octonion algebra called NO2GESNet. Octonion numbers have eight dimensions, compactly display high-dimensional data, and improve the network precision and performance in comparison to conventional ESNs. The proposed network also solves the weaknesses of the ESNs in the presentation of the higher-order statistics to the output layer by equipping it with a multidimensional bilinear filter. Three comprehensive scenarios to use the proposed network in the Metaverse have been designed and analyzed, not only do they show the accuracy and performance of the proposed approach, but also the ways how SER can be employed in the Metaverse platforms.
Collapse
Affiliation(s)
- Fatemeh Daneshfar
- Department of Computer Engineering, University of Kurdistan, Sanandaj, Iran.
| | | |
Collapse
|
3
|
Interpretable Machine Learning Techniques in ECG-Based Heart Disease Classification: A Systematic Review. Diagnostics (Basel) 2022; 13:diagnostics13010111. [PMID: 36611403 PMCID: PMC9818170 DOI: 10.3390/diagnostics13010111] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2022] [Revised: 12/22/2022] [Accepted: 12/23/2022] [Indexed: 12/31/2022] Open
Abstract
Heart disease is one of the leading causes of mortality throughout the world. Among the different heart diagnosis techniques, an electrocardiogram (ECG) is the least expensive non-invasive procedure. However, the following are challenges: the scarcity of medical experts, the complexity of ECG interpretations, the manifestation similarities of heart disease in ECG signals, and heart disease comorbidity. Machine learning algorithms are viable alternatives to the traditional diagnoses of heart disease from ECG signals. However, the black box nature of complex machine learning algorithms and the difficulty in explaining a model's outcomes are obstacles for medical practitioners in having confidence in machine learning models. This observation paves the way for interpretable machine learning (IML) models as diagnostic tools that can build a physician's trust and provide evidence-based diagnoses. Therefore, in this systematic literature review, we studied and analyzed the research landscape in interpretable machine learning techniques by focusing on heart disease diagnosis from an ECG signal. In this regard, the contribution of our work is manifold; first, we present an elaborate discussion on interpretable machine learning techniques. In addition, we identify and characterize ECG signal recording datasets that are readily available for machine learning-based tasks. Furthermore, we identify the progress that has been achieved in ECG signal interpretation using IML techniques. Finally, we discuss the limitations and challenges of IML techniques in interpreting ECG signals.
Collapse
|
4
|
Liang X, Li H, Vuckovic A, Mercer J, Heidari H. A Neuromorphic Model With Delay-Based Reservoir for Continuous Ventricular Heartbeat Detection. IEEE Trans Biomed Eng 2022; 69:1837-1849. [PMID: 34797760 DOI: 10.1109/tbme.2021.3129306] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
There is a growing interest in neuromorphic hardware since it offers a more intuitive way to achieve bio-inspired algorithms. This paper presents a neuromorphic model for intelligently processing continuous electrocardiogram (ECG) signal. This model aims to develop a hardware-based signal processing model and avoid employing digitally intensive operations, such as signal segmentation and feature extraction, which are not desired in an analogue neuromorphic system. We apply delay-based reservoir computing as the information processing core, along with a novel training and labelling method. Different from the conventional ECG classification techniques, this computation model is a end-to-end dynamic system that mimics the real-time signal flow in neuromorphic hardware. The input is the raw ECG stream, while the amplitude of the output represents the risk factor of a ventricular ectopic heartbeat. The intrinsic memristive property of the reservoir empowers the system to retain the historical ECG information for high-dimensional mapping. This model was evaluated with the MIT-BIH database under the inter-patient paradigm and yields 81% sensitivity and 98% accuracy. Under this architecture, the minimum size of memory required in the inference process can be as low as 3.1 MegaByte(MB) because the majority of the computation takes place in the analogue domain. Such computational modelling boosts memory efficiency by simplifying the computing procedure and minimizing the required memory for future wearable devices.
Collapse
Affiliation(s)
- Xiangpeng Liang
- James Watt School of Engineering, University of Glasgow, U.K
| | - Haobo Li
- James Watt School of Engineering, University of Glasgow, U.K
| | | | - John Mercer
- BHF Cardiovascular Research Centre, University of Glasgow, U.K
| | - Hadi Heidari
- James Watt School of Engineering, University of Glasgow, Glasgow, U.K
| |
Collapse
|
5
|
XU WANSONG, DU FANYU. A ROBUST QRS COMPLEX DETECTION METHOD BASED ON SHANNON ENERGY ENVELOPE AND HILBERT TRANSFORM. J MECH MED BIOL 2022. [DOI: 10.1142/s0219519422400139] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
QRS complex detection plays an important role in electrocardiogram (ECG) automatic analysis. The accuracy and robustness of the detection algorithm greatly affect its practicability. However, the existing detection algorithms are greatly affected by ECG signal quality, and some detection algorithms cannot even work properly due to the poor signal quality. In this paper, a robust QRS complex detection algorithm is proposed based on Shannon energy envelope and Hilbert transform. The detection algorithm extracts the Shannon energy envelope of the preprocessed ECG signal, performs Hilbert transform on the envelope signal, then detects the suspected [Formula: see text]-peaks on the envelope by detecting the position of zero pass and screens the real [Formula: see text]-peaks by using a combination of ECG refractory period and backtracking mechanism. The proposed detection algorithm is validated using MIT-BIH Arrhythmia Database, and achieves the average detection accuracy of 99.69%, sensitivity of 99.81% and positive predictivity of 99.88%. Experimental results show that the proposed detection algorithm can still detect QRS complex correctly under complex interference, and the performance of the algorithm is hardly affected.
Collapse
Affiliation(s)
- WANSONG XU
- Medical Imaging Department, North Sichuan Medical College, Nanchong, Sichuan 637000, P. R. China
| | - FANYU DU
- Medical Imaging Department, North Sichuan Medical College, Nanchong, Sichuan 637000, P. R. China
| |
Collapse
|
6
|
Petryshak B, Kachko I, Maksymenko M, Dobosevych O. Robust deep learning pipeline for PVC beats localization. Technol Health Care 2021; 29:475-486. [PMID: 33682784 PMCID: PMC8150659 DOI: 10.3233/thc-218045] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
Abstract
BACKGROUND: Premature ventricular contraction (PVC) is among the most frequently occurring types of arrhythmias. Existing approaches for automated PVC identification suffer from a range of disadvantages related to hand-crafted features and benchmarking on datasets with a tiny sample of PVC beats. OBJECTIVE: The main objective is to address the drawbacks described above in the proposed framework, which takes a raw ECG signal as an input and localizes R peaks of the PVC beats. METHODS: Our method consists of two neural networks. First, an encoder-decoder architecture trained on PVC-rich dataset localizes the R peak of both Normal and anomalous heartbeats. Provided R peaks positions, our CardioIncNet model does the delineation of healthy versus PVC beats. RESULTS: We have performed an extensive evaluation of our pipeline with both single- and cross-dataset paradigms on three public datasets. Our approach results in over 0.99 and 0.979 F1-measure on both single- and cross-dataset paradigms for R peaks localization task and above 0.96 and 0.85 F1 score for the PVC beats classification task. CONCLUSIONS: We have shown a method that provides robust performance beyond the beats of Normal nature and clearly outperforms classical algorithms both in the case of a single and cross-dataset evaluation. We provide a Github1 repository for the reproduction of the results.
Collapse
Affiliation(s)
- Bohdan Petryshak
- The Machine Learning Laboratory, Ukrainian Catholic University Lviv, Ukraine
| | - Illia Kachko
- The Machine Learning Laboratory, Ukrainian Catholic University Lviv, Ukraine
| | | | - Oles Dobosevych
- The Machine Learning Laboratory, Ukrainian Catholic University Lviv, Ukraine
| |
Collapse
|
7
|
Deep learning-based multidimensional feature fusion for classification of ECG arrhythmia. Neural Comput Appl 2021. [DOI: 10.1007/s00521-021-06487-5] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/29/2022]
|
8
|
S. A, S. V. Machine learning based pervasive analytics for ECG signal analysis. INTERNATIONAL JOURNAL OF PERVASIVE COMPUTING AND COMMUNICATIONS 2021. [DOI: 10.1108/ijpcc-03-2021-0080] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Purpose
Pervasive analytics act as a prominent role in computer-aided prediction of non-communicating diseases. In the early stage, arrhythmia diagnosis detection helps prevent the cause of death suddenly owing to heart failure or heart stroke. The arrhythmia scope can be identified by electrocardiogram (ECG) report.
Design/methodology/approach
The ECG report has been used extensively by several clinical experts. However, diagnosis accuracy has been dependent on clinical experience. For the prediction methods of computer-aided heart disease, both accuracy and sensitivity metrics play a remarkable part. Hence, the existing research contributions have optimized the machine-learning approaches to have a great significance in computer-aided methods, which perform predictive analysis of arrhythmia detection.
Findings
In reference to this, this paper determined a regression heuristics by tridimensional optimum features of ECG reports to perform pervasive analytics for computer-aided arrhythmia prediction. The intent of these reports is arrhythmia detection. From an empirical outcome, it has been envisioned that the project model of this contribution is more optimal and added a more advantage when compared to existing or contemporary approaches.
Originality/value
In reference to this, this paper determined a regression heuristics by tridimensional optimum features of ECG reports to perform pervasive analytics for computer-aided arrhythmia prediction. The intent of these reports is arrhythmia detection. From an empirical outcome, it has been envisioned that the project model of this contribution is more optimal and added a more advantage when compared to existing or contemporary approaches.
Collapse
|
9
|
Huang Y, Li H, Yu X. A multiview feature fusion model for heartbeat classification. Physiol Meas 2021; 42. [PMID: 33984841 DOI: 10.1088/1361-6579/ac010f] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/29/2021] [Accepted: 05/13/2021] [Indexed: 11/11/2022]
Abstract
Objective.An electrocardiogram (ECG) is one of the most common means to diagnose arrhythmia according to different waveforms clinically. Although there are advanced classification methods such as deep learning, the single view feature cannot meet the demand of classification accuracy for new individuals. To this end, a classification model based on multiview fusion was proposed.Approach.First, handcrafted view features were extracted from heartbeats and then deep view features were obtained from the deep learning model. The features of two different perspectives were fused in the fully connected layer, and the random forest classifier was used instead of the Softmax classifier for classification. Notably, Bayesian optimization was utilized in the hyper-parameter tuning of the classifier. The proposed method employed the MIT-BIH database to classify five classes: normal heartbeat (N), left bundle branch block heartbeat (LB), right bundle branch block heartbeat (RB), atrial premature contraction (APC) and premature ventricular contraction (PVC).Main results.The experimental results achieved a higher average accuracy of 98.93%, average precision of 96.92%, average sensitivity of 96.46%, and average specificity of 99.33% in five types of heartbeat classification for inter-patient.Significance.The proposed framework improves the performance of ECG detection for new individuals. And it provides an feasible algorithmic model for single-lead wearable devices with multiview fusion.
Collapse
Affiliation(s)
- Youhe Huang
- College of Information Sciences and Engineering, Northeastern University, Shenyang, People's Republic of China
| | - Hongru Li
- College of Information Sciences and Engineering, Northeastern University, Shenyang, People's Republic of China
| | - Xia Yu
- College of Information Sciences and Engineering, Northeastern University, Shenyang, People's Republic of China
| |
Collapse
|
10
|
Covi E, Donati E, Liang X, Kappel D, Heidari H, Payvand M, Wang W. Adaptive Extreme Edge Computing for Wearable Devices. Front Neurosci 2021; 15:611300. [PMID: 34045939 PMCID: PMC8144334 DOI: 10.3389/fnins.2021.611300] [Citation(s) in RCA: 23] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2020] [Accepted: 03/24/2021] [Indexed: 11/13/2022] Open
Abstract
Wearable devices are a fast-growing technology with impact on personal healthcare for both society and economy. Due to the widespread of sensors in pervasive and distributed networks, power consumption, processing speed, and system adaptation are vital in future smart wearable devices. The visioning and forecasting of how to bring computation to the edge in smart sensors have already begun, with an aspiration to provide adaptive extreme edge computing. Here, we provide a holistic view of hardware and theoretical solutions toward smart wearable devices that can provide guidance to research in this pervasive computing era. We propose various solutions for biologically plausible models for continual learning in neuromorphic computing technologies for wearable sensors. To envision this concept, we provide a systematic outline in which prospective low power and low latency scenarios of wearable sensors in neuromorphic platforms are expected. We successively describe vital potential landscapes of neuromorphic processors exploiting complementary metal-oxide semiconductors (CMOS) and emerging memory technologies (e.g., memristive devices). Furthermore, we evaluate the requirements for edge computing within wearable devices in terms of footprint, power consumption, latency, and data size. We additionally investigate the challenges beyond neuromorphic computing hardware, algorithms and devices that could impede enhancement of adaptive edge computing in smart wearable devices.
Collapse
Affiliation(s)
| | - Elisa Donati
- Institute of Neuroinformatics, University of Zurich, Eidgenössische Technische Hochschule Zürich (ETHZ), Zurich, Switzerland
| | - Xiangpeng Liang
- Microelectronics Lab, James Watt School of Engineering, University of Glasgow, Glasgow, United Kingdom
| | - David Kappel
- Bernstein Center for Computational Neuroscience, III Physikalisches Institut–Biophysik, Georg-August Universität, Göttingen, Germany
| | - Hadi Heidari
- Microelectronics Lab, James Watt School of Engineering, University of Glasgow, Glasgow, United Kingdom
| | - Melika Payvand
- Institute of Neuroinformatics, University of Zurich, Eidgenössische Technische Hochschule Zürich (ETHZ), Zurich, Switzerland
| | - Wei Wang
- The Andrew and Erna Viterbi Department of Electrical Engineering, Technion–Israel Institute of Technology, Haifa, Israel
| |
Collapse
|
11
|
Malik J, Loring Z, Piccini JP, Wu HT. Interpretable morphological features for efficient single-lead automatic ventricular ectopy detection. J Electrocardiol 2021; 65:55-63. [PMID: 33516949 PMCID: PMC11115193 DOI: 10.1016/j.jelectrocard.2020.11.014] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2020] [Revised: 11/12/2020] [Accepted: 11/29/2020] [Indexed: 12/25/2022]
Abstract
OBJECTIVE We designed an automatic, computationally efficient, and interpretable algorithm for detecting ventricular ectopic beats in long-term, single-lead electrocardiogram recordings. METHODS We built five simple, interpretable, and computationally efficient features from each cardiac cycle, including a novel morphological feature which described the distance to the median beat in the recording. After an unsupervised subject-specific normalization procedure, we trained an ensemble binary classifier using the AdaBoost algorithm RESULTS: After our classifier was trained on subset DS1 of the Massachusetts Institute of Technology-Beth Israel Hospital (MIT-BIH) Arrhythmia database, our classifier obtained an F1 score of 94.35% on subset DS2 of the same database. The same classifier achieved F1 scores of 92.06% on the St. Petersburg Institute of Cardiological Technics (INCART) 12-lead Arrhythmia database and 91.40% on the MIT-BIH Long-term database. A phenotype-specific analysis of model performance was afforded by the annotations included in the St. Petersburg INCART Arrhythmia database CONCLUSION: The five features this novel algorithm employed allowed our ventricular ectopy detector to obtain high precision on previously unseen subjects and databases SIGNIFICANCE: Our ventricular ectopy detector will be used to study the relationship between premature ventricular contractions and adverse patient outcomes such as congestive heart failure and death.
Collapse
Affiliation(s)
- John Malik
- Department of Mathematics, Duke University, Durham, NC 27708, USA
| | - Zak Loring
- Division of Cardiology, Duke University Medical Center, Durham, NC 27710, USA; Duke Clinical Research Institute, Durham, NC 27701, USA
| | - Jonathan P Piccini
- Division of Cardiology, Duke University Medical Center, Durham, NC 27710, USA; Duke Clinical Research Institute, Durham, NC 27701, USA
| | - Hau-Tieng Wu
- Department of Mathematics, Duke University, Durham, NC 27708, USA; Department of Statistical Science, Duke University, Durham, NC 27708, USA; Mathematics Division, National Center for Theoretical Sciences, Taipei, Taiwan.
| |
Collapse
|
12
|
Sevakula RK, Au-Yeung WTM, Singh JP, Heist EK, Isselbacher EM, Armoundas AA. State-of-the-Art Machine Learning Techniques Aiming to Improve Patient Outcomes Pertaining to the Cardiovascular System. J Am Heart Assoc 2020; 9:e013924. [PMID: 32067584 PMCID: PMC7070211 DOI: 10.1161/jaha.119.013924] [Citation(s) in RCA: 47] [Impact Index Per Article: 11.8] [Reference Citation Analysis] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
Affiliation(s)
| | | | - Jagmeet P Singh
- The Cardiac Arrhythmia Service Massachusetts General Hospital Boston MA
| | - E Kevin Heist
- The Cardiac Arrhythmia Service Massachusetts General Hospital Boston MA
| | | | - Antonis A Armoundas
- Cardiovascular Research Center Massachusetts General Hospital Boston MA.,Institute for Medical Engineering and Science Massachusetts Institute of Technology Cambridge MA
| |
Collapse
|