Multi-center retrospective cohort study applying deep learning to electrocardiograms to identify left heart valvular dysfunction

BACKGROUND

Aortic Stenosis and Mitral Regurgitation are common valvular conditions representing a hidden burden of disease within the population. The aim of this study was to develop and validate deep learning-based screening and diagnostic tools that can help guide clinical decision making.

METHODS

In this multi-center retrospective cohort study, we acquired Transthoracic Echocardiogram reports from five Mount Sinai hospitals within New York City representing a demographically diverse cohort of patients. We developed a Natural Language Processing pipeline to extract ground-truth labels about valvular status and paired these to Electrocardiograms (ECGs). We developed and externally validated deep learning models capable of detecting valvular disease, in addition to considering scenarios of clinical deployment.

RESULTS

We use 617,338 ECGs paired to transthoracic echocardiograms from 123,096 patients to develop a deep learning model for detection of Mitral Regurgitation. Area Under Receiver Operating Characteristic curve (AUROC) is 0.88 (95% CI:0.88-0.89) in internal testing, and 0.81 (95% CI:0.80-0.82) in external validation. To develop a model for detection of Aortic Stenosis, we use 617,338 Echo-ECG pairs for 128,628 patients. AUROC is 0.89 (95% CI: 0.88-0.89) in internal testing, going to 0.86 (95% CI: 0.85-0.87) in external validation. The model's performance increases leading up to the time of the diagnostic echo, and it performs well in validation against requirement of Transcatheter Aortic Valve Replacement procedures.

CONCLUSIONS

Deep learning based tools can increase the amount of information extracted from ubiquitous investigations such as the ECG. Such tools are inexpensive, can help in earlier disease detection, and potentially improve prognosis.

Electrocardiogram screening for aortic valve stenosis using artificial intelligence

AIMS

Early detection of aortic stenosis (AS) is becoming increasingly important with a better outcome after aortic valve replacement in asymptomatic severe AS patients and a poor outcome in moderate AS. We aimed to develop artificial intelligence-enabled electrocardiogram (AI-ECG) using a convolutional neural network to identify patients with moderate to severe AS.

METHODS AND RESULTS

Between 1989 and 2019, 258 607 adults [mean age 63 ± 16.3 years; women 122 790 (48%)] with an echocardiography and an ECG performed within 180 days were identified from the Mayo Clinic database. Moderate to severe AS by echocardiography was present in 9723 (3.7%) patients. Artificial intelligence training was performed in 129 788 (50%), validation in 25 893 (10%), and testing in 102 926 (40%) randomly selected subjects. In the test group, the AI-ECG labelled 3833 (3.7%) patients as positive with the area under the curve (AUC) of 0.85. The sensitivity, specificity, and accuracy were 78%, 74%, and 74%, respectively. The sensitivity increased and the specificity decreased as age increased. Women had lower sensitivity but higher specificity compared with men at any age groups. The model performance increased when age and sex were added to the model (AUC 0.87), which further increased to 0.90 in patients without hypertension. Patients with false-positive AI-ECGs had twice the risk for developing moderate or severe AS in 15 years compared with true negative AI-ECGs (hazard ratio 2.18, 95% confidence interval 1.90-2.50).

CONCLUSION

An AI-ECG can identify patients with moderate or severe AS and may serve as a powerful screening tool for AS in the community.