Voice Signal Characteristics Are Independently Associated With Coronary Artery Disease

Machine Learning-based Voice Assessment for the Detection of Positive and Recovered COVID-19 Patients

Many virological tests have been implemented during the Coronavirus Disease 2019 (COVID-19) pandemic for diagnostic purposes, but they appear unsuitable for screening purposes. Furthermore, current screening strategies are not accurate enough to effectively curb the spread of the disease. Therefore, the present study was conducted within a controlled clinical environment to determine eventual detectable variations in the voice of COVID-19 patients, recovered and healthy subjects, and also to determine whether machine learning-based voice assessment (MLVA) can accurately discriminate between them, thus potentially serving as a more effective mass-screening tool. Three different subpopulations were consecutively recruited: positive COVID-19 patients, recovered COVID-19 patients and healthy individuals as controls. Positive patients were recruited within 10 days from nasal swab positivity. Recovery from COVID-19 was established clinically, virologically and radiologically. Healthy individuals reported no COVID-19 symptoms and yielded negative results at serological testing. All study participants provided three trials for multiple vocal tasks (sustained vowel phonation, speech, cough). All recordings were initially divided into three different binary classifications with a feature selection, ranking and cross-validated RBF-SVM pipeline. This brough a mean accuracy of 90.24%, a mean sensitivity of 91.15%, a mean specificity of 89.13% and a mean AUC of 0.94 across all tasks and all comparisons, and outlined the sustained vowel as the most effective vocal task for COVID discrimination. Moreover, a three-way classification was carried out on an external test set comprised of 30 subjects, 10 per class, with a mean accuracy of 80% and an accuracy of 100% for the detection of positive subjects. Within this assessment, recovered individuals proved to be the most difficult class to identify, and all the misclassified subjects were declared positive; this might be related to mid and short-term vocal traces of COVID-19, even after the clinical resolution of the infection. In conclusion, MLVA may accurately discriminate between positive COVID-19 patients, recovered COVID-19 patients and healthy individuals. Further studies should test MLVA among larger populations and asymptomatic positive COVID-19 patients to validate this novel screening technology and test its potential application as a potentially more effective surveillance strategy for COVID-19.

Promises and Perils of Consumer Mobile Technologies in Cardiovascular Care: JACC Scientific Statement

Direct-to-consumer (D2C) wearables are becoming increasingly popular in cardiovascular health management because of their affordability and capability to capture diverse health data. Wearables may enable continuous health care provider-patient partnerships and reduce the volume of episodic clinic-based care (thereby reducing health care costs). However, challenges arise from the unregulated use of these devices, including questionable data reliability, potential misinterpretation of information, unintended psychological impacts, and an influx of clinically nonactionable data that may overburden the health care system. Further, these technologies could exacerbate, rather than mitigate, health disparities. Experience with wearables in atrial fibrillation underscores these challenges. The prevalent use of D2C wearables necessitates a collaborative approach among stakeholders to ensure effective integration into cardiovascular care. Wearables are heralding innovative disease screening, diagnosis, and management paradigms, expanding therapeutic avenues, and anchoring personalized medicine.

Guess What We Can Hear-Novel Voice Biomarkers for the Remote Detection of Disease

The advancement of digital biomarkers and the provision of remote health care greatly progressed during the coronavirus disease 2019 global pandemic. Combining voice/speech data with artificial intelligence and machine-based learning offers a novel solution to the growing demand for telemedicine. Voice biomarkers, obtained from the extraction of characteristic acoustic and linguistic features, are associated with a variety of diseases and even coronavirus disease 2019. In the current review, we (1) describe the basis on which digital voice biomarkers could facilitate "telemedicine," (2) discuss potential mechanisms that may explain the association between voice biomarkers and disease, (3) offer a novel classification system to conceptualize voice biomarkers depending on different methods for recording and analyzing voice/speech samples, (4) outline evidence revealing an association between voice biomarkers and a number of disease states, and (5) describe the process of developing a voice biomarker from recording, storing voice samples, and extracting acoustic and linguistic features relevant to training and testing deep and machine-based learning algorithms to detect disease. We further explore several important future considerations in this area of research, including the necessity for clinical trials and the importance of safeguarding data and individual privacy. To this end, we searched PubMed and Google Scholar to identify studies evaluating the relationship between voice/speech features and biomarkers and various diseases. Search terms included digital biomarker, telemedicine, voice features, voice biomarker, speech features, speech biomarkers, acoustics, linguistics, cardiovascular disease, neurologic disease, psychiatric disease, and infectious disease. The search was limited to studies published in English in peer-reviewed journals between 1980 and the present. To identify potential studies not captured by our database search strategy, we also searched studies listed in the bibliography of relevant publications and reviews.

Artificial intelligence in cardiovascular prevention: new ways will open new doors

Prevention and effective treatment of cardiovascular disease are progressive issues that grow in tandem with the average age of the world population. Over recent decades, the potential role of artificial intelligence in cardiovascular medicine has been increasingly recognized because of the incredible amount of real-world data (RWD) regarding patient health status and healthcare delivery that can be collated from a variety of sources wherein patient information is routinely collected, including patient registries, clinical case reports, reimbursement claims and billing reports, medical devices, and electronic health records. Like any other (health) data, RWD can be analysed in accordance with high-quality research methods, and its analysis can deliver valuable patient-centric insights complementing the information obtained from conventional clinical trials. Artificial intelligence application on RWD has the potential to detect a patient's health trajectory leading to personalized medicine and tailored treatment. This article reviews the benefits of artificial intelligence in cardiovascular prevention and management, focusing on diagnostic and therapeutic improvements without neglecting the limitations of this new scientific approach.

Acoustic Voice and Speech Biomarkers of Treatment Status during Hospitalization for Acute Decompensated Heart Failure

This study investigates acoustic voice and speech features as biomarkers for acute decompensated heart failure (ADHF), a serious escalation of heart failure symptoms including breathlessness and fatigue. ADHF-related systemic fluid accumulation in the lungs and laryngeal tissues is hypothesized to affect phonation and respiration for speech. A set of daily spoken recordings from 52 patients undergoing inpatient ADHF treatment was analyzed to identify voice and speech biomarkers for ADHF and to examine the trajectory of biomarkers during treatment. Results indicated that speakers produce more stable phonation, a more creaky voice, faster speech rates, and longer phrases after ADHF treatment compared to their pre-treatment voices. This project builds on work to develop a method of monitoring ADHF using speech biomarkers and presents a more detailed understanding of relevant voice and speech features.

Speech biomarkers of risk factors for vascular dementia in people with mild cognitive impairment

Introduction

In this study we intend to use speech analysis to analyze the cognitive impairments caused by pathologies of vascular origin such as diabetes, hypertension, hypercholesterolemia and heart disease, predictors of the development of vascular dementia.

Methods

In this study, 40 participants with mild cognitive impairment were asked to read while being recorded and they were inquired about their history of the aforementioned conditions. Their speech was then analyzed.

Results

We found that some speech parameters of frequencies and syllabic rhythm vary due to these pathologies. In addition, we conducted a discriminant analysis in which we found that diabetes and hypertension can be predicted with an accuracy over 95% with few speech parameters, and hypercholesterolemia and heart disease with an accuracy over 80%.

Discussion

The predictor parameters found are heterogeneous, including voice quality, amplitude, frequency, and rhythm parameters. This result may lead to investigate why such important qualitative changes occur in the voice of older adults with these pathologies. Rather than trying to find a diagnostic procedure already existing in classical medicine, we expect this finding to contribute to explore the causes and concomitant pathologies of these diseases. We discuss the implications of behavioral traits, such as speech, as digital biomarkers.

Discovery and Analytical Validation of a Vocal Biomarker to Monitor Anosmia and Ageusia in Patients With COVID-19: Cross-sectional Study

Background

The COVID-19 disease has multiple symptoms, with anosmia and ageusia being the most prevalent, varying from 75% to 95% and from 50% to 80% of infected patients, respectively. An automatic assessment tool for these symptoms will help monitor the disease in a fast and noninvasive manner.

Objective

We hypothesized that people with COVID-19 experiencing anosmia and ageusia had different voice features than those without such symptoms. Our objective was to develop an artificial intelligence pipeline to identify and internally validate a vocal biomarker of these symptoms for remotely monitoring them.

Methods

This study used population-based data. Participants were assessed daily through a web-based questionnaire and asked to register 2 different types of voice recordings. They were adults (aged >18 years) who were confirmed by a polymerase chain reaction test to be positive for COVID-19 in Luxembourg and met the inclusion criteria. Statistical methods such as recursive feature elimination for dimensionality reduction, multiple statistical learning methods, and hypothesis tests were used throughout this study. The TRIPOD (Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis) Prediction Model Development checklist was used to structure the research.

Results

This study included 259 participants. Younger (aged <35 years) and female participants showed higher rates of ageusia and anosmia. Participants were aged 41 (SD 13) years on average, and the data set was balanced for sex (female: 134/259, 51.7%; male: 125/259, 48.3%). The analyzed symptom was present in 94 (36.3%) out of 259 participants and in 450 (27.5%) out of 1636 audio recordings. In all, 2 machine learning models were built, one for Android and one for iOS devices, and both had high accuracy—88% for Android and 85% for iOS. The final biomarker was then calculated using these models and internally validated.

Conclusions

This study demonstrates that people with COVID-19 who have anosmia and ageusia have different voice features from those without these symptoms. Upon further validation, these vocal biomarkers could be nested in digital devices to improve symptom assessment in clinical practice and enhance the telemonitoring of COVID-19–related symptoms.

Trial Registration

Clinicaltrials.gov NCT04380987; https://clinicaltrials.gov/ct2/show/NCT04380987

Evaluation of Speech and Pause Alterations in Patients With Acute and Chronic Heart Failure

Background

Acute heart failure is the most frequent cause of unplanned hospital admission in elderly patients. Various biomarkers have been evaluated to better assess the status of these patients and prevent decompensation. Recently, voice has been suggested as a cost‐effective and noninvasive way to monitor disease progression. This study evaluates speech and pause alterations in patients with acute decompensated and stable heart failure. Specifically, we aim to identify a vocal biomarker that could be used to monitor patients with heart failure and to prevent decompensation.

Methods and Results

Speech and pause patterns were evaluated in 68 patients with acute and 36 patients with stable heart failure. Voice recordings were performed using a web‐browser based application that consisted of 5 tasks. Speech and pause patterns were automatically extracted and compared between acute and stable patients and with clinical markers. Compared with stable patients, pause ratio was up to 14.9% increased in patients with acute heart failure. This increase was largely independent of sex, age, and ejection fraction and persisted in patients with lower degrees of edema or dyspnea. Furthermore, pause ratio was positively correlated with NT‐proBNP (N‐terminal pro‐B‐type natriuretic peptide) after controlling for acute versus stable heart failure. Collectively, our findings indicate that the pause ratio could be useful in identifying acute heart failure, particularly in patients who do not display traditional indicators of decompensation.

Conclusions

Speech and pause patterns are altered in patients with acute heart failure. Particularly, we identified pause ratio as an easily interpretable vocal biomarker to support the monitoring of heart failure decompensation.

Computerized analysis of speech and voice for Parkinson's disease: A systematic review

BACKGROUND AND OBJECTIVE

Speech impairment is an early symptom of Parkinson's disease (PD). This study has summarized the literature related to speech and voice in detecting PD and assessing its severity.

METHODS

A systematic review of the literature from 2010 to 2021 to investigate analysis methods and signal features. The keywords "Automatic analysis" in conjunction with "PD speech" or "PD voice" were used, and the PubMed and ScienceDirect databases were searched. A total of 838 papers were found on the first run, of which 189 were selected. One hundred and forty-seven were found to be suitable for the review. The different datasets, recording protocols, signal analysis methods and features that were reported are listed. Values of the features that separate PD patients from healthy controls were tabulated. Finally, the barriers that limit the wide use of computerized speech analysis are discussed.

RESULTS

Speech and voice may be valuable markers for PD. However, large differences between the datasets make it difficult to compare different studies. In addition, speech analytic methods that are not informed by physiological understanding may alienate clinicians.

CONCLUSIONS

The potential usefulness of speech and voice for the detection and assessment of PD is confirmed by evidence from the classification and correlation results.

Post-stroke respiratory complications using machine learning with voice features from mobile devices

Abnormal voice may identify those at risk of post-stroke aspiration. This study was aimed to determine whether machine learning algorithms with voice recorded via a mobile device can accurately classify those with dysphagia at risk of tube feeding and post-stroke aspiration pneumonia and be used as digital biomarkers. Voice samples from patients referred for swallowing disturbance in a university-affiliated hospital were collected prospectively using a mobile device. Subjects that required tube feeding were further classified to high risk of respiratory complication, based on the voluntary cough strength and abnormal chest x-ray images. A total of 449 samples were obtained, with 234 requiring tube feeding and 113 showing high risk of respiratory complications. The eXtreme gradient boosting multimodal models that included abnormal acoustic features and clinical variables showed high sensitivity levels of 88.7% (95% CI 82.6–94.7) and 84.5% (95% CI 76.9–92.1) in the classification of those at risk of tube feeding and at high risk of respiratory complications; respectively. In both cases, voice features proved to be the strongest contributing factors in these models. Voice features may be considered as viable digital biomarkers in those at risk of respiratory complications related to post-stroke dysphagia.

COVID-19: respiratory disease diagnosis with regularized deep convolutional neural network using human respiratory sounds

Human respiratory sound auscultation (HRSA) parameters have been the real choice for detecting human respiratory diseases in the last few years. It is a challenging task to extract the respiratory sound features from the breath, voice, and cough sounds. The existing methods failed to extract the sound features to diagnose respiratory diseases. We proposed and evaluated a new regularized deep convolutional neural network (RDCNN) architecture to accept COVID-19 sound data and essential sound features. The proposed architecture is trained with the COVID-19 sound data sets and gives a better learning curve than any other state-of-the-art model. We examine the performance of RDCNN with Max-Pooling (Model-1) and without Max-Pooling (Model-2) functions. In this work, we observed that RDCNN model performance with three sound feature extraction methods [Soft-Mel frequency channel, Log-Mel frequency spectrum, and Modified Mel-frequency Cepstral Coefficient (MMFCC) spectrum] for COVID-19 sound data sets (KDD-data, ComParE2021-CCS-CSS-Data, and NeurlPs2021-data). To amplify the models' performance, we applied the augmentation technique along with regularization. We have also carried out this work to estimate the mutation of SARS-CoV-2 in the five waves using prognostic models (fractal-based). The proposed model achieves state-of-the-art performance on the COVID-19 sound data set to identify COVID-19 disease symptoms. The model's learnable parameter gradients have vanished in the intermediate layers while optimizing the prediction error which is addressed with our proposed RDCNN model. Our experiments suggested that 3 × 3 kernel size for regularized deep CNN (without max-pooling) shows 2-3% better classification accuracy compared to RDCNN with max-pooling. The experimental results suggest that this new approach may achieve the finest results on respiratory diseases.

Automated detection of atrial fibrillation based on vocal features analysis

INTRODUCTION

Early detection of atrial fibrillation (AF) is desirable but challenging due to the often-asymptomatic nature of AF. Known screening methods are limited and most of them depend of electrocardiography or other techniques with direct contact with the skin. Analysis of voice signals from natural speech has been reported for several applications in medicine. The study goal was to evaluate the usefulness of vocal features analysis for the detection of AF.

METHODS

This prospective study was performed in two medical centers. Patients with persistent AF admitted for cardioversion were enrolled. The patients pronounced the vowels "Ahh" and "Ohh" were recorded synchronously with an ECG tracing. An algorithm was developed to provide an "AF indicator" for detection of AF from the speech signal.

RESULTS

A total of 158 patients were recruited. The final analysis of "Ahh" and "Ohh" syllables was performed on 143 and 142 patients, respectively. The mean age was 71.4 ± 9.3 and 43% of patients were females. The developed AF indicator was reliable. Its numerical value decreased significantly in sinus rhythm (SR) after the cardioversion ("Ahh": from 13.98 ± 3.10 to 7.49 ± 1.58; "Ohh": from 11.39 ± 2.99 to 2.99 ± 1.61). The values at SR were significantly more homogenous compared to AF as indicated by a lower standard deviation. The area under the receiver operating characteristic curve was >0.98 and >0.89 ("Ahh" and "Ohh," respectively, p < .001). The AF indicator sensitivity is 95% with 82% specificity.

CONCLUSION

This study is the first report to demonstrate feasibility and reliability of the identification of AF episodes using voice analysis with acceptable accuracy, within the identified limitations of our study methods. The developed AF indicator has higher accuracy using the "Ahh" syllable versus "Ohh."

Noninvasive Voice Biomarker Is Associated With Incident Coronary Artery Disease Events at Follow-up

OBJECTIVE

To evaluate the association between a preidentified voice biomarker and incident coronary artery disease (CAD) events.

METHODS

Patients referred for clinically indicated coronary angiography underwent a total of three 30-second voice recordings using the Vocalis Health smartphone application between January 1, 2015, and February 28, 2017. A pre-established voice biomarker was derived from each individual recording, and the mean biomarker value was calculated for each patient. Individuals were clinically observed through December 31, 2019. The prespecified primary outcome was a composite of presenting to the emergency department with chest pain, being admitted to the hospital with chest pain, or having an acute coronary syndrome; the prespecified secondary outcome was a composite of a positive stress test result at follow-up or the presence of CAD at follow-up coronary angiography.

RESULTS

In the final analysis, 108 patients were included (mean age, 59.47±11.44 years; male, 59 [54.6%]). The median follow-up time was 24 months (range, 1 to 60 months). In multivariable Cox proportional hazards models adjusting for CAD grade on baseline angiography, a high baseline mean voice biomarker was significantly associated with both the primary (hazard ratio, 2.61; 95% CI, 1.42 to 4.80; P=.002) and secondary (hazard ratio, 3.13; 95% CI, 1.13 to 8.68; P=.03) composite outcomes.

CONCLUSION

This study found a significant association between a noninvasive voice biomarker and incident CAD events at follow-up. These results may have important clinical implications for the remote and noninvasive screening of patients to identify those at risk of coronary disease and its complications.

QUCoughScope: An Intelligent Application to Detect COVID-19 Patients Using Cough and Breath Sounds

Problem-Since the outbreak of the COVID-19 pandemic, mass testing has become essential to reduce the spread of the virus. Several recent studies suggest that a significant number of COVID-19 patients display no physical symptoms whatsoever. Therefore, it is unlikely that these patients will undergo COVID-19 testing, which increases their chances of unintentionally spreading the virus. Currently, the primary diagnostic tool to detect COVID-19 is a reverse-transcription polymerase chain reaction (RT-PCR) test from the respiratory specimens of the suspected patient, which is invasive and a resource-dependent technique. It is evident from recent researches that asymptomatic COVID-19 patients cough and breathe in a different way than healthy people. Aim-This paper aims to use a novel machine learning approach to detect COVID-19 (symptomatic and asymptomatic) patients from the convenience of their homes so that they do not overburden the healthcare system and also do not spread the virus unknowingly by continuously monitoring themselves. Method-A Cambridge University research group shared such a dataset of cough and breath sound samples from 582 healthy and 141 COVID-19 patients. Among the COVID-19 patients, 87 were asymptomatic while 54 were symptomatic (had a dry or wet cough). In addition to the available dataset, the proposed work deployed a real-time deep learning-based backend server with a web application to crowdsource cough and breath datasets and also screen for COVID-19 infection from the comfort of the user's home. The collected dataset includes data from 245 healthy individuals and 78 asymptomatic and 18 symptomatic COVID-19 patients. Users can simply use the application from any web browser without installation and enter their symptoms, record audio clips of their cough and breath sounds, and upload the data anonymously. Two different pipelines for screening were developed based on the symptoms reported by the users: asymptomatic and symptomatic. An innovative and novel stacking CNN model was developed using three base learners from of eight state-of-the-art deep learning CNN algorithms. The stacking CNN model is based on a logistic regression classifier meta-learner that uses the spectrograms generated from the breath and cough sounds of symptomatic and asymptomatic patients as input using the combined (Cambridge and collected) dataset. Results-The stacking model outperformed the other eight CNN networks with the best classification performance for binary classification using cough sound spectrogram images. The accuracy, sensitivity, and specificity for symptomatic and asymptomatic patients were 96.5%, 96.42%, and 95.47% and 98.85%, 97.01%, and 99.6%, respectively. For breath sound spectrogram images, the metrics for binary classification of symptomatic and asymptomatic patients were 91.03%, 88.9%, and 91.5% and 80.01%, 72.04%, and 82.67%, respectively. Conclusion-The web-application QUCoughScope records coughing and breathing sounds, converts them to a spectrogram, and applies the best-performing machine learning model to classify the COVID-19 patients and healthy subjects. The result is then reported back to the test user in the application interface. Therefore, this novel system can be used by patients in their premises as a pre-screening method to aid COVID-19 diagnosis by prioritizing the patients for RT-PCR testing and thereby reducing the risk of spreading of the disease.

Noninvasive Vocal Biomarker is Associated With Severe Acute Respiratory Syndrome Coronavirus 2 Infection

Objective

To investigate the association of voice analysis with severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection.

Patients and Methods

A vocal biomarker, a unitless scalar with a value between 0 and 1, was developed based on 434 voice samples. The biomarker training was followed by a prospective, multicenter, observational study. All subjects were tested for SARS-CoV-2, had their voice recorded to a smartphone application, and gave their informed consent to participate in the study. The association of SARS-CoV-2 infection with the vocal biomarker was evaluated.

Results

The final study population included 80 subjects with a median age of 29 [range, 23 to 36] years, of whom 68% were men. Forty patients were positive for SARS-CoV-2. Infected patients were 12 times more likely to report at least one symptom (odds ratio, 11.8; P<.001). The vocal biomarker was significantly higher among infected patients (OR, 0.11; 95% CI, 0.06 to 0.17 vs OR, 0.19; 95% CI, 0.12 to 0.3; P=.001). The area under the receiver operating characteristic curve evaluating the association of the vocal biomarker with SARS-CoV-2 status was 72%. With a biomarker threshold of 0.115, the results translated to a sensitivity and specificity of 85% (95% CI, 70% to 94%) and 53% (95% CI, 36% to 69%), respectively. When added to a self-reported symptom classifier, the area under the curve significantly improved from 0.775 to 0.85.

Conclusion

Voice analysis is associated with SARS-CoV-2 status and holds the potential to improve the accuracy of self-reported symptom-based screening tools. This pilot study suggests a possible role for vocal biomarkers in screening for SARS-CoV-2-infected subjects.

Feasibility of remote speech analysis in evaluation of dynamic fluid overload in heart failure patients undergoing haemodialysis treatment

Aims

This study aimed to assess the ability of a voice analysis application to discriminate between wet and dry states in chronic heart failure (CHF) patients undergoing regular scheduled haemodialysis treatment due to volume overload as a result of their chronic renal failure.

Methods and results

In this single‐centre, observational study, five patients with CHF, peripheral oedema of ≥2, and pulmonary congestion‐related dyspnoea, undergoing haemodialysis three times per week, recorded five sentences into a standard smartphone/tablet before and after haemodialysis. Recordings were provided that same noon/early evening and the next morning and evening. Patient weight was measured at the hospital before and after each haemodialysis session. Recordings were analysed by a smartphone application (app) algorithm, to compare speech measures (SMs) of utterances collected over time. On average, patients provided recordings throughout 25.8 ± 3.9 dialysis treatment cycles, resulting in a total of 472 recordings. Weight changes of 1.95 ± 0.64 kg were documented during cycles. Median baseline SM prior to dialysis was 0.87 ± 0.17, and rose to 1.07 ± 0.15 following the end of the dialysis session, at noon (P = 0.0355), and remained at a similar level until the following morning (P = 0.007). By the evening of the day following dialysis, SMs returned to baseline levels (0.88 ± 0.19). Changes in patient weight immediately after dialysis positively correlated with SM changes, with the strongest correlation measured the evening of the dialysis day [slope: −0.40 ± 0.15 (95% confidence interval: −0.71 to −0.10), P = 0.0096].

Conclusions

The fluid‐controlled haemodialysis model demonstrated the ability of the app algorithm to identify cyclic changes in SMs, which reflected bodily fluid levels. The voice analysis platform bears considerable potential as a harbinger of impending fluid overload in a range of clinical scenarios, which will enhance monitoring and triage efforts, ultimately optimizing remote CHF management.

Voice for Health: The Use of Vocal Biomarkers from Research to Clinical Practice

Diseases can affect organs such as the heart, lungs, brain, muscles, or vocal folds, which can then alter an individual's voice. Therefore, voice analysis using artificial intelligence opens new opportunities for healthcare. From using vocal biomarkers for diagnosis, risk prediction, and remote monitoring of various clinical outcomes and symptoms, we offer in this review an overview of the various applications of voice for health-related purposes. We discuss the potential of this rapidly evolving environment from a research, patient, and clinical perspective. We also discuss the key challenges to overcome in the near future for a substantial and efficient use of voice in healthcare.

Digital Health in Cardiac Rehabilitation and Secondary Prevention: A Search for the Ideal Tool

Digital health is becoming more integrated in daily medical practice. In cardiology, patient care is already moving from the hospital to the patients' homes, with large trials showing positive results in the field of telemonitoring via cardiac implantable electronic devices (CIEDs), monitoring of pulmonary artery pressure via implantable devices, telemonitoring via home-based non-invasive sensors, and screening for atrial fibrillation via smartphone and smartwatch technology. Cardiac rehabilitation and secondary prevention are modalities that could greatly benefit from digital health integration, as current compliance and cardiac rehabilitation participation rates are low and optimisation is urgently required. This viewpoint offers a perspective on current use of digital health technologies in cardiac rehabilitation, heart failure and secondary prevention. Important barriers which need to be addressed for implementation in medical practice are discussed. To conclude, a future ideal digital tool and integrated healthcare system are envisioned. To overcome personal, technological, and legal barriers, technological development should happen in dialog with patients and caregivers. Aided by digital technology, a future could be realised in which we are able to offer high-quality, affordable, personalised healthcare in a patient-centred way.

Wearable Activity Trackers in the Management of Rheumatic Diseases: Where Are We in 2020?

In healthcare, physical activity can be monitored in two ways: self-monitoring by the patient himself or external monitoring by health professionals. Regarding self-monitoring, wearable activity trackers allow automated passive data collection that educate and motivate patients. Wearing an activity tracker can improve walking time by around 1500 steps per day. However, there are concerns about measurement accuracy (e.g., lack of a common validation protocol or measurement discrepancies between different devices). For external monitoring, many innovative electronic tools are currently used in rheumatology to help support physician time management, to reduce the burden on clinic time, and to prioritize patients who may need further attention. In inflammatory arthritis, such as rheumatoid arthritis, regular monitoring of patients to detect disease flares improves outcomes. In a pilot study applying machine learning to activity tracker steps, we showed that physical activity was strongly linked to disease flares and that patterns of physical activity could be used to predict flares with great accuracy, with a sensitivity and specificity above 95%. Thus, automatic monitoring of steps may lead to improved disease control through potential early identification of disease flares. However, activity trackers have some limitations when applied to rheumatic patients, such as tracker adherence, lack of clarity on long-term effectiveness, or the potential multiplicity of trackers.

[eHealth-smart devices revolutionizing cardiology]

Hintergrund

Der Nutzen von Smart Devices wie Handys und Smartwatches in der Kardiologie nimmt deutlich zu. Der gehäufte Einsatz wird vor allem auch von Patienten und der Industrie vorangetrieben.

Fragestellung

Welche Möglichkeiten bieten Smart Devices in der Kardiologie?

Material und Methode

Es wurde eine selektive Literaturrecherche durchgeführt. Naturwissenschaftliche und klinische Studien über die verschiedenen Einsatzmöglichkeiten der technischen Mittel wurden interpretiert.

Ergebnisse

Der Besitz und Gebrauch von Smartphones in Deutschland ist im weltweiten Vergleich sehr hoch. Dies ermöglicht einen sehr breiten Einsatz dieser Technologie auch im medizinischen Bereich. Die Anwendungsmöglichkeiten sind vielfältig und reichen von der Nutzung als Nachschlagewerk über einen „clinical decision support“ bis hin zur Erfassung von Biosignalen. Gerade die Kombination aus Biosignalmessung und Weiterverarbeitung der Information durch künstliche Intelligenz (KI) ermöglicht eine deutliche Verbesserung der bisherigen Diagnosemethoden und erlaubt extrem genaue Vorhersagen verschiedener kardiovaskulärer Krankheitsverläufe.

Schlussfolgerung

Smart Devices werden in der Kardiologie zunehmend im klinischen Alltag genutzt. Aufgrund der technischen Möglichkeiten wird der Einsatz sehr wahrscheinlich weiter steigen und einige Bereiche der Kardiologie deutlich verändern.

Artificial Intelligence in Cardiology: Present and Future

Artificial intelligence (AI) is a nontechnical, popular term that refers to machine learning of various types but most often to deep neural networks. Cardiology is at the forefront of AI in medicine. For this review, we searched PubMed and MEDLINE databases with no date restriction using search terms related to AI and cardiology. Articles were selected for inclusion on the basis of relevance. We highlight the major achievements in recent years in nearly all areas of cardiology and underscore the mounting evidence suggesting how AI will take center stage in the field. Artificial intelligence requires a close collaboration among computer scientists, clinical investigators, clinicians, and other users in order to identify the most relevant problems to be solved. Best practices in the generation and implementation of AI include the selection of ideal data sources, taking into account common challenges during the interpretation, validation, and generalizability of findings, and addressing safety and ethical concerns before final implementation. The future of AI in cardiology and in medicine in general is bright as the collaboration between investigators and clinicians continues to excel.

Non-invasive vocal biomarker is associated with pulmonary hypertension

Emerging data suggest that noninvasive voice biomarker analysis is associated with coronary artery disease. We recently showed that a vocal biomarker was associated with hospitalization and heart failure in patients with heart failure. We evaluate the association between a vocal biomarker and invasively measured indices of pulmonary hypertension (PH). Patients were referred for an invasive cardiac hemodynamic study between January 2017 and December 2018, and had their voices recorded on three separate occasions to their smartphone prior to each study. A pre-established vocal biomarker was determined based on each individual recording. The intra-class correlation co-efficient between the separate voice recording biomarker values for each individual participant was 0.829 (95% CI 0.740-0.889) implying very good agreement between values. Thus, the mean biomarker was calculated for each patient. Patients were divided into two groups: high pulmonary arterial pressure (PAP) defined as ≥ 35 mmHg (moderate or greater PH), versus lower PAP. Eighty three patients, mean age 61.6 ± 15.1 years, 37 (44.6%) male, were included. Patients with a high mean PAP (≥ 35 mmHg) had on average significantly higher values of the mean voice biomarker compared to those with a lower mean PAP (0.74 ± 0.85 vs. 0.40 ± 0.88 p = 0.046). Multivariate logistic regression showed that an increase in the mean voice biomarker by 1 unit was associated with a high PAP, odds ratio 2.31, 95% CI 1.05-5.07, p = 0.038. This study shows a relationship between a noninvasive vocal biomarker and an invasively derived hemodynamic index related to PH obtained during clinically indicated cardiac catheterization. These results may have important practical clinical implications for telemedicine and remote monitoring of patients with heart failure and PH.

Vocal Biomarker Is Associated With Hospitalization and Mortality Among Heart Failure Patients

Background The purpose of this article is to evaluate the association of voice signal analysis with adverse outcome among patients with congestive heart failure (CHF). Methods and Results The study cohort included 10 583 patients who were registered to a call center of patients who had chronic conditions including CHF in Israel between 2013 and 2018. A total of 223 acoustic features were extracted from 20 s of speech for each patient. A biomarker was developed based on a training cohort of non-CHF patients (N=8316). The biomarker was tested on a mutually exclusive CHF study cohort (N=2267) and was evaluated as a continuous and ordinal (4 quartiles) variable. Median age of the CHF study population was 77 (interquartile range 68-83) and 63% were men. During a median follow-up of 20 months (interquartile range 9-34), 824 (36%) patients died. Kaplan-Meier survival analysis showed higher cumulative probability of death with increasing quartiles (23%, 29%, 38%, and 54%; P<0.001). Survival analysis with adjustment to known predictors of poor survival demonstrated that each SD increase in the biomarker was associated with a significant 32% increased risk of death during follow-up (95% CI, 1.24-1.41, P<0.001) and that compared with the lowest quartile, patients in the highest quartile were 96% more likely to die (95% CI, 1.59-2.42, P<0.001). The model consistently demonstrated an independent association of the biomarker with hospitalizations during follow-up (P<0.001). Conclusions Noninvasive vocal biomarker is associated with adverse outcome among CHF patients, suggesting a possible role for voice analysis in telemedicine and CHF patient care.

Artificial intelligence in clinical and genomic diagnostics

Artificial intelligence (AI) is the development of computer systems that are able to perform tasks that normally require human intelligence. Advances in AI software and hardware, especially deep learning algorithms and the graphics processing units (GPUs) that power their training, have led to a recent and rapidly increasing interest in medical AI applications. In clinical diagnostics, AI-based computer vision approaches are poised to revolutionize image-based diagnostics, while other AI subtypes have begun to show similar promise in various diagnostic modalities. In some areas, such as clinical genomics, a specific type of AI algorithm known as deep learning is used to process large and complex genomic datasets. In this review, we first summarize the main classes of problems that AI systems are well suited to solve and describe the clinical diagnostic tasks that benefit from these solutions. Next, we focus on emerging methods for specific tasks in clinical genomics, including variant calling, genome annotation and variant classification, and phenotype-to-genotype correspondence. Finally, we end with a discussion on the future potential of AI in individualized medicine applications, especially for risk prediction in common complex diseases, and the challenges, limitations, and biases that must be carefully addressed for the successful deployment of AI in medical applications, particularly those utilizing human genetics and genomics data.

High-Definition Medicine

The foundation for a new era of data-driven medicine has been set by recent technological advances that enable the assessment and management of human health at an unprecedented level of resolution-what we refer to as high-definition medicine. Our ability to assess human health in high definition is enabled, in part, by advances in DNA sequencing, physiological and environmental monitoring, advanced imaging, and behavioral tracking. Our ability to understand and act upon these observations at equally high precision is driven by advances in genome editing, cellular reprogramming, tissue engineering, and information technologies, especially artificial intelligence. In this review, we will examine the core disciplines that enable high-definition medicine and project how these technologies will alter the future of medicine.