1
|
Zhang R, Zhou R, Zhong Z, Qi H, Wang Y. A Multi-Class ECG Signal Classifier Using a Binarized Depthwise Separable CNN with the Merged Convolution-Pooling Method. SENSORS (BASEL, SWITZERLAND) 2024; 24:7207. [PMID: 39598983 PMCID: PMC11598813 DOI: 10.3390/s24227207] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/23/2024] [Revised: 10/28/2024] [Accepted: 11/08/2024] [Indexed: 11/29/2024]
Abstract
Binarized convolutional neural networks (bCNNs) are favored for the design of low-storage, low-power cardiac arrhythmia classifiers owing to their high weight compression rate. However, multi-class classification of ECG signals based on bCNNs is challenging due to the accuracy loss introduced by the binarization operation. In this paper, an effective multi-classifier system is proposed for electrocardiogram (ECG) signals using a binarized depthwise separable convolutional neural network (bDSCNN) with the merged convolution-pooling (MCP) method. The binarized depthwise separable convolution layer is adopted to reduce the increased number of parameters in multi-classification systems. Instead of operating convolution and pooling sequentially as in a traditional convolutional neural network (CNN), the MCP method merges pooling together with convolution layers to reduce the number of computations. To further reduce hardware resources, this work employs blockwise incremental calculation to eliminate redundant storage with computations. In addition, the R peak interval data are integrated with P-QRS-T features to improve the classification accuracy. The proposed bDSCNN model is evaluated on an Intel DE1-SoC field-programmable gate array (FPGA), and the experimental results demonstrate that the proposed system achieves a five-class classification accuracy of 96.61% and a macro-F1 score of 89.08%, along with a dynamic power dissipation of 20 μW for five-category ECG signal classification. The hardware resource usage of BRAM and LUTs plus REGs is reduced by at least 2.94 and 1.74 times, respectively, compared with existing ECG classifiers using bCNN methods.
Collapse
Affiliation(s)
| | - Ranran Zhou
- School of Integrated Circuits, Shandong University, Jinan 250101, China; (R.Z.); (Z.Z.); (H.Q.)
| | | | | | - Yong Wang
- School of Integrated Circuits, Shandong University, Jinan 250101, China; (R.Z.); (Z.Z.); (H.Q.)
| |
Collapse
|
2
|
Wang R, Veera SCM, Asan O, Liao T. A Systematic Review on the Use of Consumer-Based ECG Wearables on Cardiac Health Monitoring. IEEE J Biomed Health Inform 2024; 28:6525-6537. [PMID: 39240746 DOI: 10.1109/jbhi.2024.3456028] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/08/2024]
Abstract
This systematic review aims to summarize the consumer wearable devices used for collecting ECG signals, explore the models or algorithms employed in diagnosing and preventing heart-related diseases through ECG analysis, and discuss the challenges and future work related to adopting health monitoring using consumer wearable devices. Following the PRISMA method, we identified and reviewed 102 relevant papers from PubMed, IEEE, and Web of Science databases, covering the period from May 2013 to May 2023. This review comprehensively summarizes consumer wearable devices with ECG functions, available ECG datasets, and various algorithms for detecting cardiac diseases and monitoring long-term health. It also discusses the integration challenges and future directions in cardiac health monitoring. The results highlight a preference for deep learning algorithms, such as Convolutional Neural Networks (CNNs) and their variations, in analyzing ECG data due to the ability to automate feature extraction and reduce memory requirements. The review also discusses potential limitations of the current literature, including lack of reasoning and comparison of algorithms and limited data generalizability. By analyzing the current literature, this review provides an overview of state-of-the-art technologies, identifies key findings, and suggests potential avenues for future research and implementation.
Collapse
|
3
|
Sui X, Lv Q, Ke C, Li M, Zhuang M, Yu H, Tan Z. Adaptive Global Power-of-Two Ternary Quantization Algorithm Based on Unfixed Boundary Thresholds. SENSORS (BASEL, SWITZERLAND) 2023; 24:181. [PMID: 38203043 PMCID: PMC10781396 DOI: 10.3390/s24010181] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/20/2023] [Revised: 12/16/2023] [Accepted: 12/25/2023] [Indexed: 01/12/2024]
Abstract
In the field of edge computing, quantizing convolutional neural networks (CNNs) using extremely low bit widths can significantly alleviate the associated storage and computational burdens in embedded hardware, thereby improving computational efficiency. However, such quantization also presents a challenge related to substantial decreases in detection accuracy. This paper proposes an innovative method, called Adaptive Global Power-of-Two Ternary Quantization Based on Unfixed Boundary Thresholds (APTQ). APTQ achieves adaptive quantization by quantizing each filter into two binary subfilters represented as power-of-two values, thereby addressing the accuracy degradation caused by a lack of expression ability of low-bit-width weight values and the contradiction between fixed quantization boundaries and the uneven actual weight distribution. It effectively reduces the accuracy loss while at the same time presenting strong hardware-friendly characteristics because of the power-of-two quantization. This paper extends the APTQ algorithm to propose the APQ quantization algorithm, which can adapt to arbitrary quantization bit widths. Furthermore, this paper designs dedicated edge deployment convolutional computation modules for the obtained quantized models. Through quantization comparison experiments with multiple commonly used CNN models utilized on the CIFAR10, CIFAR100, and Mini-ImageNet data sets, it is verified that the APTQ and APQ algorithms possess better accuracy performance than most state-of-the-art quantization algorithms and can achieve results with very low accuracy loss in certain CNNs (e.g., the accuracy loss of the APTQ ternary ResNet-56 model on CIFAR10 is 0.13%). The dedicated convolutional computation modules enable the corresponding quantized models to occupy fewer on-chip hardware resources in edge chips, thereby effectively improving computational efficiency. This adaptive CNN quantization method, combined with the power-of-two quantization results, strikes a balance between the quantization accuracy performance and deployment efficiency in embedded hardware. As such, valuable insights for the industrial edge computing domain can be gained.
Collapse
Affiliation(s)
- Xuefu Sui
- Aerospace Information Research Institute, Chinese Academy of Sciences, No. 9 Dengzhuang South Road, Haidian District, Beijing 100094, China; (X.S.); (Q.L.); (C.K.); (M.L.); (M.Z.); (H.Y.)
| | - Qunbo Lv
- Aerospace Information Research Institute, Chinese Academy of Sciences, No. 9 Dengzhuang South Road, Haidian District, Beijing 100094, China; (X.S.); (Q.L.); (C.K.); (M.L.); (M.Z.); (H.Y.)
- Department of Key Laboratory of Computational Optical Imagine Technology, Chinese Academy of Sciences, No. 9 Dengzhuang South Road, Haidian District, Beijing 100094, China
| | - Changjun Ke
- Aerospace Information Research Institute, Chinese Academy of Sciences, No. 9 Dengzhuang South Road, Haidian District, Beijing 100094, China; (X.S.); (Q.L.); (C.K.); (M.L.); (M.Z.); (H.Y.)
| | - Mingshan Li
- Aerospace Information Research Institute, Chinese Academy of Sciences, No. 9 Dengzhuang South Road, Haidian District, Beijing 100094, China; (X.S.); (Q.L.); (C.K.); (M.L.); (M.Z.); (H.Y.)
| | - Mingjin Zhuang
- Aerospace Information Research Institute, Chinese Academy of Sciences, No. 9 Dengzhuang South Road, Haidian District, Beijing 100094, China; (X.S.); (Q.L.); (C.K.); (M.L.); (M.Z.); (H.Y.)
| | - Haiyang Yu
- Aerospace Information Research Institute, Chinese Academy of Sciences, No. 9 Dengzhuang South Road, Haidian District, Beijing 100094, China; (X.S.); (Q.L.); (C.K.); (M.L.); (M.Z.); (H.Y.)
| | - Zheng Tan
- Aerospace Information Research Institute, Chinese Academy of Sciences, No. 9 Dengzhuang South Road, Haidian District, Beijing 100094, China; (X.S.); (Q.L.); (C.K.); (M.L.); (M.Z.); (H.Y.)
- Department of Key Laboratory of Computational Optical Imagine Technology, Chinese Academy of Sciences, No. 9 Dengzhuang South Road, Haidian District, Beijing 100094, China
| |
Collapse
|
4
|
Chen C, da Silva B, Yang C, Ma C, Li J, Liu C. AutoMLP: A Framework for the Acceleration of Multi-Layer Perceptron Models on FPGAs for Real-Time Atrial Fibrillation Disease Detection. IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS 2023; 17:1371-1386. [PMID: 37494158 DOI: 10.1109/tbcas.2023.3299084] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/28/2023]
Abstract
Cardiovascular diseases are a leading cause of death globally, and atrial fibrillation (AF) is a common arrhythmia that affects many people. Detecting AF in real-time using hardware acceleration can prompt timely medical intervention. Multi-layer perceptron (MLP) has demonstrated the ability to detect AF accurately. However, implementing MLP on Field-Programmable Gate Array (FPGA) for real-time detection poses challenges due to the complex hardware design requirements. This study presents a novel framework for generating hardware accelerators to detect AF in real-time using MLP on FPGA. The framework automates evaluating MLP model topology, data type, and bit-widths to generate parallel acceleration. The generated solutions are evaluated using two AF datasets, PhysioNet MIT-BIH atrial fibrillation (AFDB) and China Physiological Signal Challenge 2018 (CPSC2018), regarding execution time, resource utilization, and accuracy. The evaluation results demonstrate that the hardware MLP can achieve a speedup higher than 1500× and around 25000× lower energy consumption than an embedded CPU. These satisfactory results prove the framework's suitability and convenience for the online detection of AF in an accelerated and automatic way through FPGA hardware implementation.
Collapse
|
5
|
Shumba AT, Montanaro T, Sergi I, Bramanti A, Ciccarelli M, Rispoli A, Carrizzo A, De Vittorio M, Patrono L. Wearable Technologies and AI at the Far Edge for Chronic Heart Failure Prevention and Management: A Systematic Review and Prospects. SENSORS (BASEL, SWITZERLAND) 2023; 23:6896. [PMID: 37571678 PMCID: PMC10422393 DOI: 10.3390/s23156896] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/19/2023] [Revised: 07/31/2023] [Accepted: 08/01/2023] [Indexed: 08/13/2023]
Abstract
Smart wearable devices enable personalized at-home healthcare by unobtrusively collecting patient health data and facilitating the development of intelligent platforms to support patient care and management. The accurate analysis of data obtained from wearable devices is crucial for interpreting and contextualizing health data and facilitating the reliable diagnosis and management of critical and chronic diseases. The combination of edge computing and artificial intelligence has provided real-time, time-critical, and privacy-preserving data analysis solutions. However, based on the envisioned service, evaluating the additive value of edge intelligence to the overall architecture is essential before implementation. This article aims to comprehensively analyze the current state of the art on smart health infrastructures implementing wearable and AI technologies at the far edge to support patients with chronic heart failure (CHF). In particular, we highlight the contribution of edge intelligence in supporting the integration of wearable devices into IoT-aware technology infrastructures that provide services for patient diagnosis and management. We also offer an in-depth analysis of open challenges and provide potential solutions to facilitate the integration of wearable devices with edge AI solutions to provide innovative technological infrastructures and interactive services for patients and doctors.
Collapse
Affiliation(s)
- Angela-Tafadzwa Shumba
- Department of Engineering for Innovation, University of Salento, 73100 Lecce, Italy; (A.-T.S.); (T.M.); (I.S.); (M.D.V.)
- Istituto Italiano di Tecnologia, Centre for Biomolecular Nanotechnologies, 73010 Arnesano, Italy
| | - Teodoro Montanaro
- Department of Engineering for Innovation, University of Salento, 73100 Lecce, Italy; (A.-T.S.); (T.M.); (I.S.); (M.D.V.)
| | - Ilaria Sergi
- Department of Engineering for Innovation, University of Salento, 73100 Lecce, Italy; (A.-T.S.); (T.M.); (I.S.); (M.D.V.)
| | - Alessia Bramanti
- Dipartimento di Medicina, Chirurgia e Odontoiatria “Scuola Medica Salernitana” (DIPMED), University of Salerno, 84081 Baronissi, Italy; (A.B.); (M.C.); (A.R.); (A.C.)
| | - Michele Ciccarelli
- Dipartimento di Medicina, Chirurgia e Odontoiatria “Scuola Medica Salernitana” (DIPMED), University of Salerno, 84081 Baronissi, Italy; (A.B.); (M.C.); (A.R.); (A.C.)
| | - Antonella Rispoli
- Dipartimento di Medicina, Chirurgia e Odontoiatria “Scuola Medica Salernitana” (DIPMED), University of Salerno, 84081 Baronissi, Italy; (A.B.); (M.C.); (A.R.); (A.C.)
| | - Albino Carrizzo
- Dipartimento di Medicina, Chirurgia e Odontoiatria “Scuola Medica Salernitana” (DIPMED), University of Salerno, 84081 Baronissi, Italy; (A.B.); (M.C.); (A.R.); (A.C.)
| | - Massimo De Vittorio
- Department of Engineering for Innovation, University of Salento, 73100 Lecce, Italy; (A.-T.S.); (T.M.); (I.S.); (M.D.V.)
- Istituto Italiano di Tecnologia, Centre for Biomolecular Nanotechnologies, 73010 Arnesano, Italy
| | - Luigi Patrono
- Department of Engineering for Innovation, University of Salento, 73100 Lecce, Italy; (A.-T.S.); (T.M.); (I.S.); (M.D.V.)
| |
Collapse
|
6
|
Peng P, Jiang K, You M, Xie J, Zhou H, Xu W, Lu J, Li X, Xu Y. Design of an Efficient CNN-Based Cough Detection System on Lightweight FPGA. IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS 2023; 17:116-128. [PMID: 37018680 DOI: 10.1109/tbcas.2023.3236976] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/19/2023]
Abstract
Precisely and automatically detecting the cough sound is of vital clinical importance. Nevertheless, due to privacy protection considerations, transmitting the raw audio data to the cloud is not permitted, and therefore there is a great demand for an efficient, accurate, and low-cost solution at the edge device. To address this challenge, we propose a semi-custom software-hardware co-design methodology to help build the cough detection system. Specifically, we first design a scalable and compact convolutional neural network (CNN) structure that generates many network instances. Second, we develop a dedicated hardware accelerator to perform the inference computation efficiently, and then we find the optimal network instance by applying network design space exploration. Finally, we compile the optimal network and let it run on the hardware accelerator. The experimental results demonstrate that our model achieves 88.8% classification accuracy, 91.2% sensitivity, 86.5% specificity, and 86.5% precision, while the computation complexity is only 1.09 M multiply-accumulation (MAC). Additionally, when implemented on a lightweight field programmable gate array (FPGA), the complete cough detection system only occupies 7.9 K lookup tables (LUTs), 12.9 K flip-flops (FFs), and 41 digital signal processing (DSP) slices, providing 8.3 GOP/s actual inference throughput and total power dissipation of 0.93 W. This framework meets the needs of partial application and can be easily extended or integrated into other healthcare applications.
Collapse
|
7
|
Wong DLT, Li Y, John D, Ho WK, Heng CH. Low Complexity Binarized 2D-CNN Classifier for Wearable Edge AI Devices. IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS 2022; 16:822-831. [PMID: 35921347 DOI: 10.1109/tbcas.2022.3196165] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Wearable Artificial Intelligence-of-Things (AIoT) devices exhibit the need to be resource and energy-efficient. In this paper, we introduced a quantized multilayer perceptron (qMLP) for converting ECG signals to binary image, which can be combined with binary convolutional neural network (bCNN) for classification. We deploy our model into a low-power and low-resource field programmable gate array (FPGA) fabric. The model requires 5.8× lesser multiply and accumulate (MAC) operations than known wearable CNN models. Our model also achieves a classification accuracy of 98.5%, sensitivity of 85.4%, specificity of 99.5%, precision of 93.3%, and F1-score of 89.2%, along with dynamic power dissipation of 34.9 μW.
Collapse
|
8
|
Abubakar SM, Yin Y, Tan S, Jiang H, Wang Z. A 746 nW ECG Processor ASIC Based on Ternary Neural Network. IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS 2022; 16:703-713. [PMID: 35921346 DOI: 10.1109/tbcas.2022.3196059] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
This paper presents an ultra-low power electrocardiography (ECG) processor application-specific integrated circuit (ASIC) for the real-time detection of abnormal cardiac rhythms (ACRs). The proposed ECG processor can support wearable or implantable ECG devices for long-term health monitoring. It adopts a derivative-based patient adaptive threshold approach to detect the R peaks in the PQRST complex of ECG signals. Two tiny machine learning classifiers are used for the accurate classification of ACRs. A 3-layer feed-forward ternary neural network (TNN) is designed, which classifies the QRS complex's shape, followed by the adaptive decision logics (DL). The proposed processor requires only 1 KB on-chip memory to store the parameters and ECG data required by the classifiers. The ECG processor has been implemented based on fully-customized near-threshold logic cells using thick-gate transistors in 65-nm CMOS technology. The ASIC core occupies a die area of 1.08 mm2. The measured total power consumption is 746 nW, with 0.8 V power supply at 2.5 kHz real-time operating clock. It can detect 13 abnormal cardiac rhythms with a sensitivity and specificity of 99.10% and 99.5%. The number of detectable ACR types far exceeds the other low power designs in the literature.
Collapse
|