Segmentation of heart sound recordings by a duration-dependent hidden Markov model

Multiple instance learning framework can facilitate explainability in murmur detection

OBJECTIVE

Cardiovascular diseases (CVDs) account for a high fatality rate worldwide. Heart murmurs can be detected from phonocardiograms (PCGs) and may indicate CVDs. Still, they are often overlooked as their detection and correct clinical interpretation require expert skills. In this work, we aim to predict the presence of murmurs and clinical outcomes from multiple PCG recordings employing an explainable multitask model.

APPROACH

Our approach consists of a two-stage multitask model. In the first stage, we predict the murmur presence in single PCGs using a multiple instance learning (MIL) framework. MIL also allows us to derive sample-wise classifications (i.e. murmur locations) while only needing one annotation per recording ("weak label") during training. In the second stage, we fuse explainable hand-crafted features with features from a pooling-based artificial neural network (PANN) derived from the MIL framework. Finally, we predict the presence of murmurs and the clinical outcome for a single patient based on multiple recordings using a simple feed-forward neural network.

MAIN RESULTS

We show qualitatively and quantitatively that the MIL approach yields useful features and can be used to detect murmurs on multiple time instances and may thus guide a practitioner through PCGs. We analyze the second stage of the model in terms of murmur classification and clinical outcome. We achieved a weighted accuracy of 0.714 and an outcome cost of 13612 when using the PANN model and demographic features on the CirCor dataset (hidden test set of the George B. Moody PhysioNet challenge 2022, team "Heart2Beat", rank 12 / 40).

SIGNIFICANCE

To the best of our knowledge, we are the first to demonstrate the usefulness of MIL in PCG classification. Also, we showcase how the explainability of the model can be analyzed quantitatively, thus avoiding confirmation bias inherent to many post-hoc methods. Finally, our overall results demonstrate the merit of employing MIL combined with handcrafted features for the generation of explainable features as well as for a competitive classification performance.

Algorithm for predicting valvular heart disease from heart sounds in an unselected cohort

Objective

This study aims to assess the ability of state-of-the-art machine learning algorithms to detect valvular heart disease (VHD) from digital heart sound recordings in a general population that includes asymptomatic cases and intermediate stages of disease progression.

Methods

We trained a recurrent neural network to predict murmurs from heart sound audio using annotated recordings collected with digital stethoscopes from four auscultation positions in 2,124 participants from the Tromsø7 study. The predicted murmurs were used to predict VHD as determined by echocardiography.

Results

The presence of aortic stenosis (AS) was detected with a sensitivity of 90.9%, a specificity of 94.5%, and an area under the curve (AUC) of 0.979 (CI: 0.963-0.995). At least moderate AS was detected with an AUC of 0.993 (CI: 0.989-0.997). Moderate or greater aortic and mitral regurgitation (AR and MR) were predicted with AUC values of 0.634 (CI: 0.565-703) and 0.549 (CI: 0.506-0.593), respectively, which increased to 0.766 and 0.677 when clinical variables were added as predictors. The AUC for predicting symptomatic cases was higher for AR and MR, 0.756 and 0.711, respectively. Screening jointly for symptomatic regurgitation or presence of stenosis resulted in an AUC of 0.86, with 97.7% of AS cases (n = 44) and all 12 MS cases detected.

Conclusions

The algorithm demonstrated excellent performance in detecting AS in a general cohort, surpassing observations from similar studies on selected cohorts. The detection of AR and MR based on HS audio was poor, but accuracy was considerably higher for symptomatic cases, and the inclusion of clinical variables improved the performance of the model significantly.

An edge-device-compatible algorithm for valvular heart diseases screening using phonocardiogram signals with a lightweight convolutional neural network and self-supervised learning

BACKGROUND AND OBJECTIVES

Detection and classification of heart murmur using mobile-phone-collected sound is an emerging approach to the scale-up screening of valvular heart disease at a population level. Nonetheless, the widespread adoption of artificial intelligence (AI) methods for this type of mobile health (mHealth) application requires highly accurate and lightweight AI models that can be deployed in consumer-grade mobile devices. This study presents a lightweight deep learning model and a self-supervised learning (SSL) method to utilise unlabelled data to improve the accuracy of valvular heart disease classification using phonocardiogram data.

METHODS

This study proposes a lightweight convolutional neural network (CNN) that consists of ten times fewer parameters than other deep learning models to classify phonocardiogram data. SSL is applied to harness a large collection of unlabelled data as pre-training to enhance the accuracy and robustness of the model and reduce the number of epochs required to converge. A mobile application prototype that encapsulates the model is developed to perform in-device inference and fine-turning.

RESULTS

The proposed lightweight model achieves an average accuracy of 98.65% in 10-fold cross-validation. When coupled with SSL using unlabelled data, the pre-trained model can reach an average accuracy higher than 99.4% in 10-fold cross-validation. Furthermore, SSL-trained models have a 4-20% improvement in classification accuracy over non-SSL-trained models when tested with perturbed or noisy data, suggesting that SSL improves robustness of the model. When deployed on common smartphones, in-device fine-tuning and inference of the model can be completed within 0.03-0.37 s, which is considerably faster than 0.22-5.7 s by a standard CNN model that have ten times the number of parameters. Our lightweight model also consumes only a third of the power compared to the larger standard model.

CONCLUSION

This work presents a lightweight and accurate phonocardiogram classifier that supports near real-time performance on standard mobile devices.

Markov-Based Neural Networks for Heart Sound Segmentation: Using Domain Knowledge in a Principled Way

This work considers the problem of segmenting heart sounds into their fundamental components. We unify statistical and data-driven solutions by introducing Markov-based Neural Networks (MNNs), a hybrid end-to-end framework that exploits Markov models as statistical inductive biases for an Artificial Neural Network (ANN) discriminator. We show that an MNN leveraging a simple one-dimensional Convolutional ANN significantly outperforms two recent purely data-driven solutions for this task in two publicly available datasets: PhysioNet 2016 (Sensitivity: 0.947 ±0.02; Positive Predictive Value : 0.937 ±0.025) and the CirCor DigiScope 2022 (Sensitivity: 0.950 ±0.008; Positive Predictive Value: 0.943 ±0.012). We also propose a novel gradient-based unsupervised learning algorithm that effectively makes the MNN adaptive to unseen datum sampled from unknown distributions. We perform a cross dataset analysis and show that an MNN pre-trained in the CirCor DigiScope 2022 can benefit from an average improvement of 3.90% Positive Predictive Value on unseen observations from the PhysioNet 2016 dataset using this method.

Novel phonocardiography system for heartbeat detection from various locations

The paper presents evaluation of the proposed phonocardiography (PCG) measurement system designed primarily for heartbeat detection to estimate heart rate (HR). Typically, HR estimation is performed using electrocardiography (ECG) or pulse wave as one of the fundamental diagnostic methodologies for assessing cardiac function. The system includes novel both sensory part and data processing procedure, which is based on signal preprocessing using Wavelet Transform (WT) and Shannon energy computation and heart sounds classification using K-means. Due to the lack of standardization in the placement of PCG sensors, the study focuses on evaluating the signal quality obtained from 7 different sensor locations on the subject's chest and investigates which locations are most suitable for recording heart sounds. The suitability of sensor localization was examined in 27 subjects by detecting the first two heart sounds (S1, S2). The HR detection sensitivity related to reference ECG from all sensor positions reached values over 88.9 and 77.4% in detection of S1 and S2, respectively. The placement in the middle of sternum showed the higher signal quality with median of the proper S1 and S2 detection sensitivity of 98.5 and 97.5%, respectively.

Cutting Weights of Deep Learning Models for Heart Sound Classification: Introducing a Knowledge Distillation Approach

Cardiovascular diseases (CVDs) are the number one cause of death worldwide. In recent years, intelligent auxiliary diagnosis of CVDs based on computer audition has become a popular research field, and intelligent diagnosis technology is increasingly mature. Neural networks used to monitor CVDs are becoming more complex, requiring more computing power and memory, and are difficult to deploy in wearable devices. This paper proposes a lightweight model for classifying heart sounds based on knowledge distillation, which can be deployed in wearable devices to monitor the heart sounds of wearers. The network model is designed based on Convolutional Neural Networks (CNNs). Model performance is evaluated by extracting Mel Frequency Cepstral Coefficients (MFCCs) features from the PhysioNet/CinC Challenge 2016 dataset. The experimental results show that knowledge distillation can improve a lightweight network's accuracy, and our model performs well on the test set. Especially, when the knowledge distillation temperature is 7 and the weight α is 0.1, the accuracy is 88.5 %, the recall is 83.8 %, and the specificity is 93.6 %.Clinical relevance- A lightweight model of heart sound classification based on knowledge distillation can be deployed on various hardware devices for timely monitoring and feedback of the physical condition of patients with CVDs for timely provision of medical advice. When the model is deployed on the medical instruments of the hospital, the condition of severe and hospitalised patients can be timely fed back and clinical treatment advice can be provided to the clinicians.

On the Impact of Synchronous Electrocardiogram Signals for Heart Sounds Segmentation

In this paper we study the heart sound segmentation problem using Deep Neural Networks. The impact of available electrocardiogram (ECG) signals in addition to phonocardiogram (PCG) signals is evaluated. To incorporate ECG, two different models considered, which are built upon a 1D U-net - an early fusion one that fuses ECG in an early processing stage, and a late fusion one that averages the probabilities obtained by two networks applied independently on PCG and ECG data. Results show that, in contrast with traditional uses of ECG for PCG gating, early fusion of PCG and ECG information can provide more robust heart sound segmentation. As a proof of concept, we use the publicly available PhysioNet dataset. Validation results provide, on average, a sensitivity of 97.2%, 94.5%, and 95.6% and a Positive Predictive Value of 97.5%, 96.2%, and 96.1% for Early-fusion, Late-fusion, and unimodal (PCG only) models, respectively, showing the advantages of combining both signals at early stages to segment heart sounds.Clinical relevance- Cardiac auscultation is the first line of screening for cardiovascular diseases. Its low cost and simplicity are especially suitable for screening large populations in underprivileged countries. The proposed analysis and algorithm show the potential of effectively including electrocardiogram information to improve heart sound segmentation performance, thus enhancing the capacity of extracting useful information from heart sound recordings.

Impact of Biological Sex on Radar-Measured Heart Sound Quality

Radar based contact-free technology has number of potential applications for monitoring the cardiopulmonary functions of patients. However, no study has evaluated the effect of gender on the quality of the recordings. This study makes an attempt to distinguish radar based recording of male and female subjects. The study analysed a publicly available dataset of radar-recorded heart sound signals from both male and female subjects. Here, we exploit the reference signal-to-noise ratio (RSNR) to quantify the signal's quality. The results indicate that there is a significant difference in the signal quality between males and females, with males having a higher RSNR value compared to females. This could be a limitation in the widespread use of the current radar based cardiopulmonary recording techniques and overcoming this should be considered for future research.Clinical relevance- This work has highlighted the gender based difference. By considering this, the radar based cardiopulmonary device has the potential for being used for patients requiring long-term monitoring.

A New Method for Heart Disease Detection: Long Short-Term Feature Extraction from Heart Sound Data

Heart sounds have been extensively studied for heart disease diagnosis for several decades. Traditional machine learning algorithms applied in the literature have typically partitioned heart sounds into small windows and employed feature extraction methods to classify samples. However, as there is no optimal window length that can effectively represent the entire signal, windows may not provide a sufficient representation of the underlying data. To address this issue, this study proposes a novel approach that integrates window-based features with features extracted from the entire signal, thereby improving the overall accuracy of traditional machine learning algorithms. Specifically, feature extraction is carried out using two different time scales. Short-term features are computed from five-second fragments of heart sound instances, whereas long-term features are extracted from the entire signal. The long-term features are combined with the short-term features to create a feature pool known as long short-term features, which is then employed for classification. To evaluate the performance of the proposed method, various traditional machine learning algorithms with various models are applied to the PhysioNet/CinC Challenge 2016 dataset, which is a collection of diverse heart sound data. The experimental results demonstrate that the proposed feature extraction approach increases the accuracy of heart disease diagnosis by nearly 10%.

A Hardware-Software System for Accurate Segmentation of Phonocardiogram Signal

Background

Phonocardiogram (PCG) signal provides valuable information for diagnosing heart diseases. However, its applications in quantitative analyses of heart function are limited because the interpretation of this signal is difficult. A key step in quantitative PCG is the identification of the first and second sounds (S1 and S2) in this signal.

Objective

This study aims to develop a hardware-software system for synchronized acquisition of two signals electrocardiogram (ECG) and PCG and to segment the recorded PCG signal via the information provided in the acquired ECG signal.

Material and Methods

In this analytical study, we developed a hardware-software system for real-time identification of the first and second heart sounds in the PCG signal. A portable device to capture synchronized ECG and PCG signals was developed. Wavelet de-noising technique was used to remove noise from the signal. Finally, by fusing the information provided by the ECG signal (R-peaks and T-end) into a hidden Markov model (HMM), the first and second heart sounds were identified in the PCG signal.

Results

ECG and PCG signals from 15 healthy adults were acquired and analyzed using the developed system. The average accuracy of the system in correctly detecting the heart sounds was 95.6% for S1 and 93.4% for S2.

Conclusion

The presented system is cost-effective, user-friendly, and accurate in identifying S1 and S2 in PCG signals. Therefore, it might be effective in quantitative PCG and diagnosing heart diseases.

Heart sounds: Past, present, and future from a technological and clinical perspective - a systematic review

The high prevalence of cardiac diseases around the world has created a need for quick, easy and cost effective approaches to diagnose heart disease. The auscultation and interpretation of heart sounds using the stethoscope is relatively inexpensive, requires minimal to advanced training, and is widely available and easily carried by healthcare providers working in urban environments or medically underserved rural areas. Since René-Théophile-Hyacinthe Laennec's simple, monoaural design, the capabilities of modern-day, commercially available stethoscopes and stethoscope systems have radically advanced with the integration of electronic hardware and software tools, however these systems are largely confined to the metropolitan medical centers. The purpose of this paper is to review the history of stethoscopes, compare commercially available stethoscope products and analytical software, and discuss future directions. Our review includes a description of heart sounds and how modern software enables the measurement and analysis of time intervals, teaching auscultation, remote cardiac examination (telemedicine) and, more recently, spectrographic evaluation and electronic storage. The basic methodologies behind modern software algorithms and techniques for heart sound preprocessing, segmentation and classification are described to provide awareness.

Review on the Advancements of Stethoscope Types in Chest Auscultation

Stethoscopes were originally designed for the auscultation of a patient's chest for the purpose of listening to lung and heart sounds. These aid medical professionals in their evaluation of the cardiovascular and respiratory systems, as well as in other applications, such as listening to bowel sounds in the gastrointestinal system or assessing for vascular bruits. Listening to internal sounds during chest auscultation aids healthcare professionals in their diagnosis of a patient's illness. We performed an extensive literature review on the currently available stethoscopes specifically for use in chest auscultation. By understanding the specificities of the different stethoscopes available, healthcare professionals can capitalize on their beneficial features, to serve both clinical and educational purposes. Additionally, the ongoing COVID-19 pandemic has also highlighted the unique application of digital stethoscopes for telemedicine. Thus, the advantages and limitations of digital stethoscopes are reviewed. Lastly, to determine the best available stethoscopes in the healthcare industry, this literature review explored various benchmarking methods that can be used to identify areas of improvement for existing stethoscopes, as well as to serve as a standard for the general comparison of stethoscope quality. The potential use of digital stethoscopes for telemedicine amidst ongoing technological advancements in wearable sensors and modern communication facilities such as 5G are also discussed. Based on the ongoing trend in advancements in wearable technology, telemedicine, and smart hospitals, understanding the benefits and limitations of the digital stethoscope is an essential consideration for potential equipment deployment, especially during the height of the current COVID-19 pandemic and, more importantly, for future healthcare crises when human and resource mobility is restricted.

A novel heart sound segmentation algorithm via multi-feature input and neural network with attention mechanism

Objective. Heart sound segmentation (HSS), which aims to identify the exact positions of the first heart sound(S1), second heart sound(S2), the duration of S1, systole, S2, and diastole within a cardiac cycle of phonocardiogram (PCG), is an indispensable step to find out heart health. Recently, some neural network-based methods for heart sound segmentation have shown good performance.Approach. In this paper, a novel method was proposed for HSS exactly using One-Dimensional Convolution and Bidirectional Long-Short Term Memory neural network with Attention mechanism (C-LSTM-A) by incorporating the 0.5-order smooth Shannon entropy envelope and its instantaneous phase waveform (IPW), and third intrinsic mode function (IMF-3) of PCG signal to reduce the difficulty of neural network learning features.Main results. An average F1-score of 96.85 was achieved in the clinical research dataset (Fuwai Yunnan Cardiovascular Hospital heart sound dataset) and an average F1-score of 95.68 was achieved in 2016 PhysioNet/CinC Challenge dataset using the novel method.Significance. The experimental results show that this method has advantages for normal PCG signals and common pathological PCG signals, and the segmented fundamental heart sound(S1, S2), systole, and diastole signal components are beneficial to the study of subsequent heart sound classification.

ECG segmentation algorithm based on bidirectional hidden semi-Markov model

Accurate segmentation of electrocardiogram (ECG) waves is crucial for cardiovascular diseases (CVDs). In this study, a bidirectional hidden semi-Markov model (BI-HSMM) based on the probability distributions of ECG waveform duration was proposed for ECG wave segmentation. Four feature-vectors of ECG signals were extracted as the observation sequence of the hidden Markov model (HMM), and the statistical probability distribution of each waveform duration was counted. Logistic regression (LR) was used to train model parameters. The starting and ending positions of the QRS wave were first detected, and thereafter, bidirectional prediction was employed for the other waves. Forwardly, ST segment, T wave, and TP segment were predicted. Backwardly, P wave and PQ segments were detected. The Viterbi algorithm was improved by integrating the recursive formula of the forward prediction and backward backtracking algorithms. In the QT database, the proposed method demonstrated excellent performance (Acc = 97.98%, F1 score of P wave = 98.37%, F1 score of QRS wave = 97.60%, F1 score of T wave = 97.79%). For the wearable dynamic electrocardiography (DCG) signals collected by the Shandong Provincial Hospital (SPH), the detection accuracy was 99.71% and the F1 of each waveform was above 99%. The experimental results and real DCG signal validation confirmed that the proposed new BI-HSMM method exhibits significant ability to segment the resting and DCG signals; this is conducive to the detection and monitoring of CVDs.

Correlation between diastolic seismocardiography variables and echocardiography variables. EUROPEAN HEART JOURNAL. DIGITAL HEALTH 2022;3:465-472. [PMID: 36712165 PMCID: PMC9707922 DOI: 10.1093/ehjdh/ztac043] [Citation(s) in RCA: 0] [Impact Index Per Article: 0]

Aims

Echocardiography is a key diagnostic tool for assessment of myocardial performance and haemodynamics. Seismocardiography (SCG) can potentially provide fast and reliable assessments of key components related to myocardial performance. The aims of this study were to investigate the correlation between SCG and echocardiographic measures, and a decrease in preload by raising the subjects to a 30° head-up tilt position would be detected by both echocardiography and SCG.

Methods and results

A total of 45 subjects were included in the study. SCG and electrocardiogram were recorded simultaneously and afterwards echocardiography was recorded. The SCG signals were divided into individual heart beats using a duration-dependent Markov model. Using a fiducial point detection algorithm, the diastolic fiducial points were identified. The amplitudes from the SCG showed a high correlation, especially with the variable e' from the echocardiography. The peak-to-peak amplitude of the diastolic SCG complex and e' had a high correlation of 0.713 (P < 0.001). The second minimum in diastolic occurring after the closing of the aortic valve was the only amplitude showing a high correlation when comparing supine with head-up tilt in the SCG. All the echocardiography variables but E/e' showed a high correlation when comparing supine with head-up tilt.

Conclusion

The results found in this study showed a high correlation between the amplitudes from the diastolic SCG and the diastolic variable e' from the echocardiography, thus indicating that the SCG could potentially be utilized to evaluate the diastolic function.

Design of Abnormal Heart Sound Recognition System Based on HSMM and Deep Neural Network

Introduction

Heart sound signal is an important physiological signal of human body, and the identification and research of heart sound signal is of great significance.

Methods

For abnormal heart sound signal recognition, an abnormal heart sound recognition system, combining hidden semi-Markov models (HSMM) with deep neural networks, is proposed. Firstly, HSMM is used to build a heart sound segmentation model to accurately segment the heart sound signal, and then the segmented heart sound signal is subjected to feature extraction. Finally, the trained deep neural network model is used for recognition.

Results

Compared with other methods, this method has a relatively small amount of input feature data and high accuracy, fast recognition speed.

Discussion

HSMM combined with deep neural network is expected to be deployed on smart mobile devices for telemedicine detection.

Heart Sound Classification based on Residual Shrinkage Networks

Heart sound classification is one of the non-invasive methods for early detection of the cardiovascular diseases (CVDs), the leading cause for deaths. In recent years, Computer Audition (CA) technology has become increasingly sophisticated, auxiliary diagnosis technology of heart disease based on CA has become a popular research area. This paper proposes a deep Convolutional Neural Network (CNN) model for heart sound classification. To improve the classification accuracy of heart sound, we design a classification algorithm combining classical Residual Network (ResNet) and Long Short-Term Memory (LSTM). The model performance is evaluated in the PhysioNet/CinC Challenges 2016 datasets using a 2D time-frequency feature. We extract the four features from different filter-bank coefficients, including Filterbank (Fbank), Mel-Frequency Spectral Coefficients (MFSCs), and Mel-Frequency Cepstral Coefficients (MFCCs). The experimental results show the MFSCs feature outperforms the other features in the proposed CNN model. The proposed model performs well on the test set, particularly the F1 score of 84.3 % - the accuracy of 84.4 %, the sensitivity of 84.3 %, and the specificity of 85.6 %. Compared with the classical ResNet model, an accuracy of 4.9 % improvement is observed in the proposed model.

Heart rate estimation and validation algorithm for fetal phonocardiography

Fetal heart rate (FHR) is an important parameter for assessing fetal well-being and is usually measured by doppler ultrasound. Fetal phonocardiography can provide non-invasive, easy-to-use and passive alternative for fetal monitoring method if reliable FHR measurements can be made even in noisy clinical environments. In this work we present an automatic algorithm to determine fetal heart rate from the fetal heart sound recordings in a noisy clinical environment. Using an electronic stethoscope fetal heart sounds were recorded from the expecting mother's abdomen, during weeks 30-40 of their pregnancy. Of these, 60 recordings were analyzed manually by two observers to obtain reference heart rate measurement. An algorithm was developed to determine FHR using envelope detection and autocorrelation of the signals. Algorithm performance was improved by implementing peak validation algorithm utilizing knowledge of valid FHR from prior windows and power spectral density function. The improvements in accuracy and reliability of algorithm were measured by mean absolute error and positive precent agreement. By including the validation step, the mean absolute error reduced from 11.50 to 7.54 beats per minute and positive percent agreement improved from 81% to 87%. The proposed algorithms provide good accuracy overall but are sensitive to the noises in recording environment that influence the quality of the signals.

Hybrid Convolutional Networks for End-to-End Event Detection in Concurrent PPG and PCG Signals Affected by Motion Artifacts

The accurate detection of physiologically-related events in photopletismographic (PPG) and phocardiographic (PCG) signals, recorded by wearable sensors, is mandatory to perform the estimation of relevant cardiovascular parameters like the heart rate and the blood pressure. However, the measurement performed in uncontrolled conditions without clinical supervision leaves the detection quality particularly susceptible to noise and motion artifacts. The performed work proposed a new fully-automatic computational framework, based on convolutional networks, to identify and localize fiducial points in time as the foot, maximum slope and peak in PPG signal and the S1 sound in the PCG signal, both acquired by a custom chest sensor, described recently in the literature by our group. The novelty entailing a custom neural architecture to process sequentially the PPG and PCG signals. Tests were performed analysing four different acquisition conditions (rest, cycling, rest recovery and walking). Cross-validation results for the three PPG fiducial points showed identification accuracy greater than 93 % and localization error (RMSE) less than 10 ms. As expected, cycling and walking conditions provided worse results than rest and recovery, however reaching an accuracy greater than 90 % and a localization error lower than 15 ms. Likewise, the identification and localization error for S1 sound were greater than 90 % and lower than 25 ms. Overall, this study showcased the ability of the proposed technique to detect events with high accuracy not only for steady acquisitions but also during subject movements. We also showed that the proposed network outperformed traditional Shannon-energy-envelope method in the detection of S1 sound. Therefore, we argue that coupling chest sensors and deep learning processing techniques may disclose wearable devices to unobtrusively acquire health information, being less affected by noise and motion artifacts.

A novel multi-branch architecture for state of the art robust detection of pathological phonocardiograms

Heart auscultation is an inexpensive and fundamental technique to effectively diagnose cardiovascular disease. However, due to relatively high human error rates even when auscultation is performed by an experienced physician, and due to the not universal availability of qualified personnel, e.g. in developing countries, many efforts are made worldwide to propose computational tools for detecting abnormalities in heart sounds. The large heterogeneity of achievable data quality and devices, the variety of possible heart pathologies, and a generally poor signal-to-noise ratio make this problem very challenging. We present an accurate classification strategy for diagnosing heart sounds based on (1) automatic heart phase segmentation, (2) state-of-the art filters drawn from the field of speech synthesis (mel-frequency cepstral representation) and (3) an ad hoc multi-branch, multi-instance artificial neural network based on convolutional layers and fully connected neuronal ensembles which separately learns from each heart phase hence implicitly leveraging their different physiological significance. We demonstrate that it is possible to train our architecture to reach very high performances, e.g. an area under the curve of 0.87 or a sensitivity of 0.97. Our machine-learning-based tool could be employed for heartsound classification, especially as a screening tool in a variety of situations including telemedicine applications. This article is part of the theme issue 'Advanced computation in cardiovascular physiology: new challenges and opportunities'.

Analysis of Cardiac Vibration Signals Acquired From a Novel Implant Placed on the Gastric Fundus

The analysis of cardiac vibration signals has been shown as an interesting tool for the follow-up of chronic pathologies involving the cardiovascular system, such as heart failure (HF). However, methods to obtain high-quality, real-world and longitudinal data, that do not require the involvement of the patient to correctly and regularly acquire these signals, remain to be developed. Implantable systems may be a solution to this observability challenge. In this paper, we evaluate the feasibility of acquiring useful electrocardiographic (ECG) and accelerometry (ACC) data from an innovative implant located in the gastric fundus. In a first phase, we compare data acquired from the gastric fundus with gold standard data acquired from surface sensors on 2 pigs. A second phase investigates the feasibility of deriving useful hemodynamic markers from these gastric signals using data from 4 healthy pigs and 3 pigs with induced HF with longitudinal recordings. The following data processing chain was applied to the recordings: (1) ECG and ACC data denoising, (2) noise-robust real-time QRS detection from ECG signals and cardiac cycle segmentation, (3) Correlation analysis of the cardiac cycles and computation of coherent mean from aligned ECG and ACC, (4) cardiac vibration components segmentation (S1 and S2) from the coherent mean ACC data, and (5) estimation of signal context and a signal-to-noise ratio (SNR) on both signals. Results show a high correlation between the markers acquired from the gastric and thoracic sites, as well as pre-clinical evidence on the feasibility of chronic cardiovascular monitoring from an implantable cardiac device located at the gastric fundus, the main challenge remains on the optimization of the signal-to-noise ratio, in particular for the handling of some sources of noise that are specific to the gastric acquisition site.

Spectral analysis of heart sounds associated with coronary artery disease

Objective. The aim of this study was to find spectral differences of diagnostic interest in heart sound recordings of patients with coronary artery disease (CAD) and healthy subjects.Approach. Heart sound recordings from three studies were pooled, and patients with clear diagnostic outcomes (positive: CAD and negative: Non-CAD) were selected for further analysis. Recordings from 1146 patients (191 CAD and 955 Non-CAD) were analyzed for spectral differences between the two groups using Welch's spectral density estimate. Frequency spectra were estimated for systole and diastole segments, and time-frequency spectra were estimated for first (S1) and second (S2) heart sound segments. An ANCOVA model with terms for diagnosis, age, gender, and body mass index was used to evaluate statistical significance of the diagnosis term for each time-frequency component.Main results. Diastole and systole segments of CAD patients showed increased energy at frequencies 20-120 Hz; furthermore, this difference was statistically significant for the diastole. CAD patients showed decreased energy for the mid-S1 and mid-S2 segments and conversely increased energy before and after the valve sounds. Both S1 and S2 segments showed regions of statistically significant difference in the time-frequency spectra.Significance. Results from analysis of the diastole support findings of increased low-frequency energy from previous studies. Time-frequency components of S1 and S2 sounds showed that these two segments likely contain heretofore untapped information for risk assessment of CAD using phonocardiography; this should be considered in future works. Further development of features that build on these findings could lead to improved acoustic detection of CAD.

Classification of real-world pathological phonocardiograms through multi-instance learning

Heart auscultation is an inexpensive and fundamental technique to effectively to diagnose cardiovascular disease. However, due to relatively high human error rates even when auscultation is performed by an experienced physician, and due to the not universal availability of qualified personnel e.g. in developing countries, a large body of research is attempting to develop automated, computational tools for detecting abnormalities in heart sounds. The large heterogeneity of achievable data quality and devices, the variety o possible heart pathologies, and a generally poor signal-to-noise ratio make this problem extremely challenging. We present an accurate classification strategy for diagnosing heart sounds based on 1) automatic heart phase segmentation, 2) state-of-the art filters drawn from the filed of speech synthesis (mel-frequency cepstral representation), and 3) an ad-hoc multi-branch, multi-instance artificial neural network based on convolutional layers and fully connected neuronal ensembles which separately learns from each heart phase, hence leveraging their different physiological significance. We demonstrate that it is possible to train our architecture to reach very high performances, e.g. an AUC of 0.87 or a sensitivity of 0.97. Our machine-learning-based tool could be employed for heart sound classification, especially as a screening tool in a variety of situations including telemedicine applications.

Automatic segmentation for neonatal phonocardiogram

This work addresses the automatic segmentation of neonatal phonocardiogram (PCG) to be used in the artificial intelligence-assisted diagnosis of abnormal heart sounds. The proposed novel algorithm has a single free parameter - the maximum heart rate. The algorithm is compared with the baseline algorithm, which was developed for adult PCG segmentation. When evaluated on a large clinical dataset of neonatal PCG with a total duration of over 7h, an F1 score of 0.94 is achieved. The main features relevant for the segmentation of neonatal PCG are identified and discussed. The algorithm is able to increase the number of cardiac cycles by a factor of 5 compared to manual segmentation, potentially allowing to improve the performance of heart abnormality detection algorithms.

Unsupervised Heart Sound Decomposition and State Estimation with Generative Oscillation Models

This paper proposes a new generative probabilistic model for phonocardiograms (PCGs) that can simultaneously capture oscillatory factors and state transitions in cardiac cycles. Conventionally, PCGs have been modeled in two main aspects. One is a state space model that represents recurrent and frequently appearing state transitions. Another is a factor model that expresses the PCG as a non-stationary signal consisting of multiple oscillations. To model these perspectives in a unified framework, we combine an oscillation decomposition with a state space model. The proposed model can decompose the PCG into cardiac state dependent oscillations by reflecting the mechanism of cardiac sounds generation in an unsupervised manner. In the experiments, our model achieved better accuracy in the state estimation task compared to the empirical mode decomposition method. In addition, our model detected S2 onsets more accurately than the supervised segmentation method when distributions among PCG signals were different.

Classification of heart sounds based on quality assessment and wavelet scattering transform

Automatic classification of heart sound plays an important role in the diagnosis of cardiovascular diseases. In this study, a heart sound sample classification method based on quality assessment and wavelet scattering transform was proposed. First, the ratio of zero crossings (RZC) and the root mean square of successive differences (RMSSD) were used for assessing the quality of heart sound signal. The first signal segment conforming to the threshold standard was selected as the current sample for the continuous heart sound signal. Using the wavelet scattering transform, the wavelet scattering coefficients were expanded according to the wavelet scale dimension, to obtain the features. Support vector machine (SVM) was used for classification, and the classification results for the samples were obtained using the wavelet scale dimension voting approach. The effects of RZC and RMSSD on the results are discussed in detail. On the database of PhysioNet Computing in Cardiology Challenge 2016 (CinC 2016), the proposed method yields 92.23% accuracy (Acc), 96.62% sensitivity (Se), 90.65% specificity (Sp), and 93.64% measure of accuracy (Macc). The results show that the proposed method can effectively classify normal and abnormal heart sound samples with high accuracy.

Detection of Junctional Ectopic Tachycardia by Central Venous Pressure

Central venous pressure (CVP) is the blood pressure in the venae cavae, near the right atrium of the heart. This signal waveform is commonly collected in clinical settings, and yet there has been limited discussion of using this data for detecting arrhythmia and other cardiac events. In this paper, we develop a signal processing and feature engineering pipeline for CVP waveform analysis. Through a case study on pediatric junctional ectopic tachycardia (JET), we show that our extracted CVP features reliably detect JET with comparable results to the more commonly used electrocardiogram (ECG) features. This machine learning pipeline can thus improve the clinical diagnosis and ICU monitoring of arrhythmia. It also corroborates and complements the ECG-based diagnosis, especially when the ECG measurements are unavailable or corrupted.

Cross-Domain Transfer Learning for PCG Diagnosis Algorithm

Cardiechema is a way to reflect cardiovascular disease where the doctor uses a stethoscope to help determine the heart condition with a sound map. In this paper, phonocardiogram (PCG) is used as a diagnostic signal, and a deep learning diagnostic framework is proposed. By improving the architecture and modules, a new transfer learning and boosting architecture is mainly employed. In addition, a segmentation method is designed to improve on the existing signal segmentation methods, such as R wave to R wave interval segmentation and fixed segmentation. For the evaluation, the final diagnostic architecture achieved a sustainable performance with a public PCG database.

End-to-end heart sound segmentation using deep convolutional recurrent network

Heart sound segmentation (HSS) aims to detect the four stages (first sound, systole, second heart sound and diastole) from a heart cycle in a phonocardiogram (PCG), which is an essential step in automatic auscultation analysis. Traditional HSS methods need to manually extract the features before dealing with HSS tasks. These artificial features highly rely on extraction algorithms, which often result in poor performance due to the different operating environments. In addition, the high-dimension and frequency characteristics of audio also challenge the traditional methods in effectively addressing HSS tasks. This paper presents a novel end-to-end method based on convolutional long short-term memory (CLSTM), which directly uses audio recording as input to address HSS tasks. Particularly, the convolutional layers are designed to extract the meaningful features and perform the downsampling, and the LSTM layers are developed to conduct the sequence recognition. Both components collectively improve the robustness and adaptability in processing the HSS tasks. Furthermore, the proposed CLSTM algorithm is easily extended to other complex heart sound annotation tasks, as it does not need to extract the characteristics of corresponding tasks in advance. In addition, the proposed algorithm can also be regarded as a powerful feature extraction tool, which can be integrated into the existing models for HSS. Experimental results on real-world PCG datasets, through comparisons to peer competitors, demonstrate the outstanding performance of the proposed algorithm.

An innovative method for cardiovascular disease detection based on nonlinear geometric features and feature reduction combination

Cardiovascular is arguably the most dominant death cause in the world. Heart functionality can be measured in various ways. Heart sounds are usually inspected in these experiments as they can unveil a variety of heart related diseases. This study tackles the lack of reliable models and high training times on a publicly available dataset. The heart sound set is provided by Physionet consisting of 3153 recordings, from which five seconds were fixed to evaluate to the developed method. In this work, we propose a novel method based on feature reduction combination, using Genetic Algorithm (GA) and Principal Component Analysis (PCA). The authors present eight dominant features in heart sound classification: mean duration of systole interval, the standard deviation of diastole interval, the absolute amplitude ratio of diastole to S2, S1 to systole and S1 to diastole, zero crossings, Centroid to Centroid distance (CCdis) and mean power in the 95–295 Hz range. These reduced features are then optimized respectively with two straightforward classification algorithms weighted k-NN with a lower-dimensional feature space and Linear SVM that uses a linear combination of all features to create a robust model, acquiring up to 98.15% accuracy, holding the best stats in the heart sound classification on a largely used dataset. According to the experiments done in this study, the developed method can be further explored for real world heart sound assessments.

Prospective validation of an acoustic-based system for the detection of obstructive coronary artery disease in a high-prevalence population

Recent guidelines recommend a risk-adjusted, non-invasive work-up in patients presenting with chest discomfort to exclude coronary artery disease (CAD). However, a risk-adjusted diagnostic approach remains challenging in clinical practice. An acoustic detection device for analyzing micro-bruits induced by stenosis-generated turbulence in the coronary circulation has shown potential for ruling out CAD in patients with low-to-intermediate likelihood. We examined the diagnostic value of this acoustic detection system in a high-prevalence cohort. In total, 226 patients scheduled for clinically indicated invasive coronary angiography (ICA) were prospectively enrolled at two centers and examined using a portable, acoustic detection system. The acoustic analysis was performed in double-blinded fashion prior to quantitative ICA and following percutaneous coronary intervention (PCI). An acoustic detection result (CAD score) was obtained in 94% of all patients. The mean baseline CAD score was 41.2 ± 11.9 in patients with obstructive CAD and 33.8 ± 13.4 in patients without obstructive CAD (p < 0.001). ROC analysis revealed an AUC of 0.661 (95% CI 0.584-0.737). Sensitivity was 97.6% (95% confidence interval (CI) 91.5-99.7%), specificity was 14.5% (CI 9.0-21.7%), negative predictive value was 90.5% (CI 69.6-98.8%), and positive predictive value was 41.7% (CI 34.6-49.0%). Following PCI, the mean CAD score decreased from 40.5 ± 11.2 to 38.3 ± 13.7 (p = 0.039). Using an acoustic detection device identified individuals with CAD in a high-prevalence cohort with high sensitivity but relatively low specificity. The negative predictive value was within the predicted range and may be of value for a fast rule-out of obstructive CAD even in a high-prevalence population.

Research on Segmentation and Classification of Heart Sound Signals Based on Deep Learning

The heart sound signal is one of the signals that reflect the health of the heart. Research on the heart sound signal contributes to the early diagnosis and prevention of cardiovascular diseases. As a commonly used deep learning network, convolutional neural network (CNN) has been widely used in images. In this paper, the method of analyzing heart sound through using CNN has been studied. Firstly, the original data set was preprocessed, and then the heart sounds were segmented on U-net, based on the deep CNN. Finally, the classification of heart sounds was completed through CNN. The data from 2016 PhysioNet/CinC Challenge was utilized for algorithm validation, and the following results were obtained. When the heart sound segmented, the overall accuracy rate was 0.991, the accuracy of the first heart sound was 0.991, the accuracy of the systolic period was 0.996, the accuracy of the second heart sound was 0.996, and the accuracy of the diastolic period was 0.997, and the average accuracy rate was 0.995; While in classification, the accuracy was 0.964, the sensitivity was 0.781, and the specificity was 0.873. These results show that deep learning based on CNN shows good performance in the segmentation and classification of the heart sound signal.

Neonatal Heart and Lung Sound Quality Assessment for Robust Heart and Breathing Rate Estimation for Telehealth Applications

With advances in digital stethoscopes, internet of things, signal processing and machine learning, chest sounds can be easily collected and transmitted to the cloud for remote monitoring and diagnosis. However, low quality of recordings complicates remote monitoring and diagnosis, particularly for neonatal care. This paper proposes a new method to objectively and automatically assess the signal quality to improve the accuracy and reliability of heart rate (HR) and breathing rate (BR) estimation from noisy neonatal chest sounds. A total of 88 10-second long chest sounds were taken from 76 preterm and full-term babies. Six annotators independently assessed the signal quality, number of detectable beats, and breathing periods from these recordings. For quality classification, 187 and 182 features were extracted from heart and lung sounds, respectively. After feature selection, class balancing, and hyperparameter optimization, a dynamic binary classification model was trained. Then HR and BR were automatically estimated from the chest sound and several approaches were compared.The results of subject-wise leave-one-out cross-validation, showed that the model distinguished high and low quality recordings in the test set with 96% specificity, 81% sensitivity and 93% accuracy for heart sounds, and 86% specificity, 69% sensitivity and 82% accuracy for lung sounds. The HR and BR estimated from high quality sounds resulted in significantly less median absolute error (4 bpm and 12 bpm difference, respectively) compared to those from low quality sounds. The methods presented in this work, facilitates automated neonatal chest sound auscultation for future telehealth applications.

Temporal Convolutional Network Connected with an Anti-Arrhythmia Hidden Semi-Markov Model for Heart Sound Segmentation

Heart sound segmentation (HSS) is a critical step in heart sound processing, where it improves the interpretability of heart sound disease classification algorithms. In this study, we aimed to develop a real-time algorithm for HSS by combining the temporal convolutional network (TCN) and the hidden semi-Markov model (HSMM), and improve the performance of HSMM for heart sounds with arrhythmias. We experimented with TCN and determined the best parameters based on spectral features, envelopes, and one-dimensional CNN. However, the TCN results could contradict the natural fixed order of S1-systolic-S2-diastolic of heart sound, and thereby the Viterbi algorithm based on HSMM was connected to correct the order errors. On this basis, we improved the performance of the Viterbi algorithm when detecting heart sounds with cardiac arrhythmias by changing the distribution and weights of the state duration probabilities. The public PhysioNet Computing in Cardiology Challenge 2016 data set was employed to evaluate the performance of the proposed algorithm. The proposed algorithm achieved an F1 score of 97.02%, and this result was comparable with the current state-of-the-art segmentation algorithms. In addition, the proposed enhanced Viterbi algorithm for HSMM corrected 30 out of 30 arrhythmia errors after checking one by one in the dataset.

Unsupervised hidden semi-Markov model for automatic beat onset detection in 1D Doppler ultrasound

OBJECTIVE

One dimensional (1D) Doppler ultrasound (DUS) is commonly used for fetal health assessment, during both regular prenatal visits and labor. It is used in preference to ECG and other modalities because of its simplicity and cost. To date, all analysis of such data has been confined to a smoothed, windowed heart rate estimation derived from the 1D DUS signal, reducing the potential of short-term variability information. A first step in improving the assessment of short-term variability of the fetal heart rate (FHR) is through implementing an accurate beat detector for 1D DUS signals.

APPROACH

This work presents an unsupervised probabilistic segmentation method enabled by a hidden semi-Markov model (HSMM). The proposed method employs envelope and spectral features for an online segmentation of fetal 1D DUS signal. The beat onsets and fetal cardiac beat-to-beat intervals are then estimated from the segmentations. For this work, two data sets were used, including 1D DUS recordings from five fetuses recorded in Germany, comprising 6521 beats and 45.06 minutes of data (dataset 1). Simultaneous fetal ECG (fECG) was used as the reference for beat timing. Dataset 2, comprising 4044 beats captured from 17 subjects in the UK was hand scored for beat location and was used as an independent held-out test set. Leave-one-out subject cross-validation was used for parameter tuning on dataset 1. No retraining was performed for dataset 2. To assess the performance of the beat onset detection, the root mean square error (RMSE), F1 score, sensitivity, positive predictivity (PPV) and the error in several standard common heart rate variability metrics were used. These metrics were evaluated on three fiducial points: (1) beat onset, (2) beat offset, and (3) middle of beat interval.

MAIN RESULTS

In dataset 1, the proposed method provided an RMSE of 20 ms, F1 score of 97.5 %, a Se of 97.6%, and a PPV of 97.3%. In dataset 2, the proposed method achieved an RMSE of 26 ms, an F1 score of 98.5 %, a Se of 98.0 % and a PPV of 98.9 %. It was also determined that the best beat-to-beat interval was derived from the onset of each beat. For the dataset 2, significant correlations were found in all short term heart rate variability metrics tested, both in the time and frequency domain. Only the proportion of successive normal-to-normal interval differences greater than 20 ms (pNN20) exhibited a significant absolute difference.

SIGNIFICANCE

This work presents the first-ever description of an algorithm to identify cardiac beats with 1D DUS, closely matching the fetal ECG-derived beats, to enable short-term heart rate variability analysis. The novel algorithm proposed requires no human labeling of data, and could have applicability beyond 1D DUS to other similar highly variable time series.

Temporal-Framing Adaptive Network for Heart Sound Segmentation Without Prior Knowledge of State Duration

OBJECTIVE

This paper presents a novel heart sound segmentation algorithm based on Temporal-Framing Adaptive Network (TFAN), including state transition loss and dynamic inference.

METHODS

In contrast to previous state-of-the-art approaches, TFAN does not require any prior knowledge of the state duration of heart sounds and is therefore likely to generalize to non sinus rhythm. TFAN was trained on 50 recordings randomly chosen from Training set A of the 2016 PhysioNet/Computer in Cardiology Challenge and tested on the other 12 independent databases (2,099 recordings and 52,180 beats). And further testing of performance was conducted on databases with three levels of increasing difficulty (LEVEL-I, -II and -III).

RESULTS

TFAN achieved a superior F₁ score for all 12 databases except for 'Test-B,' with an average of 96.72%, compared to 94.56% for logistic regression hidden semi-Markov model (LR-HSMM) and 94.18% for bidirectional gated recurrent neural network (BiGRNN). Moreover, TFAN achieved an overall F₁ score of 99.21%, 94.17%, 91.31% on LEVEL-I, -II and -III databases respectively, compared to 98.37%, 87.56%, 78.46% for LR-HSMM and 99.01%, 92.63%, 88.45% for BiGRNN.

CONCLUSION

TFAN therefore provides a substantial improvement on heart sound segmentation while using less parameters compared to BiGRNN.

SIGNIFICANCE

The proposed method is highly flexible and likely to apply to other non-stationary time series. Further work is required to understand to what extent this approach will provide improved diagnostic performance, although it is logical to assume superior segmentation will lead to improved diagnostics.

Automatic Segmentation and Classification of Heart Sounds Using Modified Empirical Wavelet Transform and Power Features

A system for the automatic classification of cardiac sounds can be of great help for doctors in the diagnosis of cardiac diseases. Generally speaking, the main stages of such systems are (i) the pre-processing of the heart sound signal, (ii) the segmentation of the cardiac cycles, (iii) feature extraction and (iv) classification. In this paper, we propose methods for each of these stages. The modified empirical wavelet transform (EWT) and the normalized Shannon average energy are used in pre-processing and automatic segmentation to identify the systolic and diastolic intervals in a heart sound recording; then, six power characteristics are extracted (three for the systole and three for the diastole)—the motivation behind using power features is to achieve a low computational cost to facilitate eventual real-time implementations. Finally, different models of machine learning (support vector machine (SVM), k-nearest neighbor (KNN), random forest and multilayer perceptron) are used to determine the classifier with the best performance. The automatic segmentation method was tested with the heart sounds from the Pascal Challenge database. The results indicated an error (computed as the sum of the differences between manual segmentation labels from the database and the segmentation labels obtained by the proposed algorithm) of 843,440.8 for dataset A and 17,074.1 for dataset B, which are better values than those reported with the state-of-the-art methods. For automatic classification, 805 sample recordings from different databases were used. The best accuracy result was 99.26% using the KNN classifier, with a specificity of 100% and a sensitivity of 98.57%. These results compare favorably with similar works using the state-of-the-art methods.

Artificial intelligence and automation in valvular heart diseases

Artificial intelligence (AI) is gradually changing every aspect of social life, and healthcare is no exception. The clinical procedures that were supposed to, and could previously only be handled by human experts can now be carried out by machines in a more accurate and efficient way. The coming era of big data and the advent of supercomputers provides great opportunities to the development of AI technology for the enhancement of diagnosis and clinical decision-making. This review provides an introduction to AI and highlights its applications in the clinical flow of diagnosing and treating valvular heart diseases (VHDs). More specifically, this review first introduces some key concepts and subareas in AI. Secondly, it discusses the application of AI in heart sound auscultation and medical image analysis for assistance in diagnosing VHDs. Thirdly, it introduces using AI algorithms to identify risk factors and predict mortality of cardiac surgery. This review also describes the state-of-the-art autonomous surgical robots and their roles in cardiac surgery and intervention.

Classification of Heart Sounds Using Convolutional Neural Network

Heart sounds play an important role in the diagnosis of cardiac conditions. Due to the low signal-to-noise ratio (SNR), it is problematic and time-consuming for experts to discriminate different kinds of heart sounds. Thus, objective classification of heart sounds is essential. In this study, we combined a conventional feature engineering method with deep learning algorithms to automatically classify normal and abnormal heart sounds. First, 497 features were extracted from eight domains. Then, we fed these features into the designed convolutional neural network (CNN), in which the fully connected layers that are usually used before the classification layer were replaced with a global average pooling layer to obtain global information about the feature maps and avoid overfitting. Considering the class imbalance, the class weights were set in the loss function during the training process to improve the classification algorithm’s performance. Stratified five-fold cross-validation was used to evaluate the performance of the proposed method. The mean accuracy, sensitivity, specificity and Matthews correlation coefficient observed on the PhysioNet/CinC Challenge 2016 dataset were 86.8%, 87%, 86.6% and 72.1% respectively. The proposed algorithm’s performance achieves an appropriate trade-off between sensitivity and specificity.

Automatic heart sound classification from segmented/unsegmented phonocardiogram signals using time and frequency features

OBJECTIVE

Heart abnormality detection using heart sound signals (phonocardiogram (PCG)) has been an active research area for the last few decades. In this paper, automatic heart sound classification using segmented and unsegmented PCG signals is presented.

APPROACH

In this paper: (i) we perform an in-depth analysis of various time and frequency domain features, followed by experimental determination of effective feature subsets for improved classification performance; (ii) both segmented and unsegmented PCG signals are studied and important results concerning the respective feature subsets and their classification performances are reported; and (iii) different classification algorithms, including the support vector machine, kth nearest neighbor, decision tree, ensemble classifier, artificial neural network and long short-term memory network (LSTMs), are employed to evaluate the performance of the proposed feature subsets and their comparison with other established features and methods is presented.

MAIN RESULTS

It is observed that LSTM performs better on mel-frequency cepstral coefficient (MFCC) features extracted from unsegmented PCG data, with an area under curve (AUC) score of 91.39%, however, the MFCC features do not show a consistent performance with other classifiers (the second highest AUC score is 62.08% with the decision tree classifier). In contrast, in the case of time-frequency features from segmented data, the performance of all the classifiers is appreciable with AUC scores over 70%. In particular, the conventional machine learning techniques shows consistency in achieving over 80% in AUC scores. Significanc e: The results of this study highlight the importance of time and frequency domain features. Thus it is necessary to employ both the time and frequency features of segmented PCG signals to achieve improved classification.

Enhancement of the heart sound envelope using the logistic function amplitude moderation method

This paper presents a new method to extract the envelope of the fundamental heart sound (S1 and S2) using the logistic function. The sigmoid characteristic of the logistic function is incorporated to segregate S1, and S2 signal intensities from silent or noise interfered systolic and diastolic intervals in a heart sound cycle. This signal intensity transformation brings uniformity to the envelope peak of S1 and S2 sound by inclining the transform intensity distribution towards the upper asymptote of the sigmoid curve. The proposed logistic function based amplitude moderation (LFAM) envelogram method involves finding the critical upper amplitude (x_uc) above which the signals will be categorized as loud sound and the critical lower amplitude (x_lc) below which the signal will be considered as noise. These critical values are regressively obtained from the signal itself by histogram analysis of intensity distribution. The performance is evaluated on noisy PCG dataset taken from PhysioNet/Computing in Cardiology Challenge 2016. The LFAM envelope yields better hill-valley discrimination of heart sounds from its silent/noisy signal intervals. The enhance heart sound envelope peaks are better than conventional methods. The proposed envelope feature is evaluated for heart sound segmentation using HSMM. There is a significant improvement in segmentation accuracy, especially at a low signal-to-noise ratio. The best average F1 score is 97.73%.

A Robust and Real-Time Capable Envelope-Based Algorithm for Heart Sound Classification: Validation under Different Physiological Conditions

This paper proposes a robust and real-time capable algorithm for classification of the firstand second heart sounds. The classification algorithm is based on the evaluation of the envelope curveof the phonocardiogram. For the evaluation, in contrast to other studies, measurements on twelveprobands were conducted in different physiological conditions. Moreover, for each measurement theauscultation point, posture and physical stress were varied. The proposed envelope-based algorithmis tested with two different methods for envelope curve extraction: the Hilbert transform andthe short-time Fourier transform. The performance of the classification of the first heart soundsis evaluated by using a reference electrocardiogram. Overall, by using the Hilbert transform,the algorithm has a better performance regarding the F1-score and computational effort. Theproposed algorithm achieves for the S1 classification an F1-score up to 95.7% and in average 90.5 %.The algorithm is robust against the age, BMI, posture, heart rate and auscultation point (exceptmeasurements on the back) of the subjects. The ECG and PCG records are available from the authors.

Is there an Optimal Localization of Cardio-microphone Sensors for Phonocardiogram Analysis?

Heart auscultation is one of the most useful medical diagnostic tools for getting valuable information of heart valves and heart hemodynamics functions. However, the information acquired by a traditional stethoscope can be inaccurate and insufficient. Phonocardiogram (PCG) was developed to improve accuracy through visual inspection and analysis. Digitally processed, PCG can then be analyzed by automated heart sound analysis systems. But there is no standardization for PCG data acquisition unlike electrocardiogram (ECG). This study aims at analyzing the influence of cardiomicrophone localization on the chest for the study of cardiac sounds S1 and S2. For that purpose, simultaneous acquisitions of 12 PCG signals with one ECG signal were realized and a comparative analysis of delays between R waves of ECG and detected S1 and S2 sounds was conducted. Results show that there are significant differences between R-S1 (or R-S2) intervals obtained from different areas of sensor placement on the chest. For future works on PCG, studies dealing with the analysis of heart sounds or proposing new heart sounds detection algorithms may pay attention to the location and attachment of PCG sensors.

Machine Listening for Heart Status Monitoring: Introducing and Benchmarking HSS - the Heart Sounds Shenzhen Corpus

Auscultation of the heart is a widely studied technique, which requires precise hearing from practitioners as a means of distinguishing subtle differences in heart-beat rhythm. This technique is popular due to its non-invasive nature, and can be an early diagnosis aid for a range of cardiac conditions. Machine listening approaches can support this process, monitoring continuously and allowing for a representation of both mild and chronic heart conditions. Despite this potential, relevant databases and benchmark studies are scarce. In this paper, we introduce our publicly accessible database, the Heart Sounds Shenzhen Corpus (HSS), which was first released during the recent INTERSPEECH 2018 ComParE Heart Sound sub-challenge. Additionally, we provide a survey of machine learning work in the area of heart sound recognition, as well as a benchmark for HSS utilising standard acoustic features and machine learning models. At best our support vector machine with Log Mel features achieves 49.7% unweighted average recall on a three category task (normal, mild, moderate/severe).