Systematic Quantification of Sources of Variation in Ejection Fraction Calculation Using Deep Learning

Artificial Intelligence for Cardiovascular Care-Part 1: Advances: JACC Review Topic of the Week

Recent artificial intelligence (AI) advancements in cardiovascular care offer potential enhancements in diagnosis, treatment, and outcomes. Innovations to date focus on automating measurements, enhancing image quality, and detecting diseases using novel methods. Applications span wearables, electrocardiograms, echocardiography, angiography, genetics, and more. AI models detect diseases from electrocardiograms at accuracy not previously achieved by technology or human experts, including reduced ejection fraction, valvular heart disease, and other cardiomyopathies. However, AI's unique characteristics necessitate rigorous validation by addressing training methods, real-world efficacy, equity concerns, and long-term reliability. Despite an exponentially growing number of studies in cardiovascular AI, trials showing improvement in outcomes remain lacking. A number are currently underway. Embracing this rapidly evolving technology while setting a high evaluation benchmark will be crucial for cardiology to leverage AI to enhance patient care and the provider experience.

Agreement of ejection fraction measured by coronary computed tomography (CT) and cardiac ultrasound in evaluating patients with chronic heart failure: an observational comparative study

Background

Cardiac ultrasound is one of the most important examinations in cardiovascular medicine, but the technical requirements for the operator are relatively high, which to some extent affects the scope of its use. This study was dedicated to investigating the agreement of ejection fraction between coronary computed tomography (CT) and cardiac ultrasound and diagnostic performance in evaluating the clinical diagnosis of patients with chronic heart failure.

Methods

We conducted a single-center-based retrospective study including 343 consecutive patients enrolled between January 2019 to April 2020, all of whom presented with suspected symptoms of heart failure within one month. All enrolled cases performed cardiac ultrasound and coronary CT scans. The CT images were analyzed using accurate left ventricle (AccuLV) artificial intelligence (AI) software to calculate the ejection fraction-computed tomography (EF-CT) and it was compared with the ejection fraction (EF) obtained based on ultrasound. Cardiac insufficiency was determined if the EF measured by ultrasound was below 50%. Diagnostic performance analysis, correlation analysis and Bland-Altman plot were used to compare agreement between EF-CT and CT.

Results

Of the 319 successfully performed patients, 220 (69%) were identified as cardiac insufficiency. Quantitative consistency analysis showed a good correlation between EF-CT and EF values in all cases (R square =0.704, r=0.837). Bland-Altman analysis showed mean bias of 6.6%, mean percentage error of 27.5% and 95% limit of agreement of -17% to 30% between EF and EF-CT. The results of the qualitative diagnostic study showed that the sensitivity and specificity of EF measured by coronary CT reached a high level of 91% [95% confidence interval (CI): 86-94%], and the positive diagnostic value was up to 96% (95% CI: 92-98%).

Conclusions

The EF-CT and EF have excellent agreement, and AccuLV-based AI left ventricular function analysis software perhaps can be used as a clinical diagnostic reference.

Vision-language foundation model for echocardiogram interpretation

The development of robust artificial intelligence models for echocardiography has been limited by the availability of annotated clinical data. Here, to address this challenge and improve the performance of cardiac imaging models, we developed EchoCLIP, a vision-language foundation model for echocardiography, that learns the relationship between cardiac ultrasound images and the interpretations of expert cardiologists across a wide range of patients and indications for imaging. After training on 1,032,975 cardiac ultrasound videos and corresponding expert text, EchoCLIP performs well on a diverse range of benchmarks for cardiac image interpretation, despite not having been explicitly trained for individual interpretation tasks. EchoCLIP can assess cardiac function (mean absolute error of 7.1% when predicting left ventricular ejection fraction in an external validation dataset) and identify implanted intracardiac devices (area under the curve (AUC) of 0.84, 0.92 and 0.97 for pacemakers, percutaneous mitral valve repair and artificial aortic valves, respectively). We also developed a long-context variant (EchoCLIP-R) using a custom tokenizer based on common echocardiography concepts. EchoCLIP-R accurately identified unique patients across multiple videos (AUC of 0.86), identified clinical transitions such as heart transplants (AUC of 0.79) and cardiac surgery (AUC 0.77) and enabled robust image-to-text search (mean cross-modal retrieval rank in the top 1% of candidate text reports). These capabilities represent a substantial step toward understanding and applying foundation models in cardiovascular imaging for preliminary interpretation of echocardiographic findings.

Deep learning from latent spatiotemporal information of the heart: Identifying advanced bioimaging markers from echocardiograms

A key strength of echocardiography lies in its integration of comprehensive spatiotemporal cardiac imaging data in real-time, to aid frontline or bedside patient risk stratification and management. Nonetheless, its acquisition, processing, and interpretation are known to all be subject to heterogeneity from its reliance on manual and subjective human tracings, which challenges workflow and protocol standardization and final interpretation accuracy. In the era of advanced computational power, utilization of machine learning algorithms for big data analytics in echocardiography promises reduction in cost, cognitive errors, and intra- and inter-observer variability. Novel spatiotemporal deep learning (DL) models allow the integration of temporal arm information based on unlabeled pixel echocardiographic data for convolution of an adaptive semantic spatiotemporal calibration to construct personalized 4D heart meshes, assess global and regional cardiac function, detect early valve pathology, and differentiate uncommon cardiovascular disorders. Meanwhile, data visualization on spatiotemporal DL prediction models helps extract latent temporal imaging features to develop advanced imaging biomarkers in early disease stages and advance our understanding of pathophysiology to support the development of personalized prevention or treatment strategies. Since portable echocardiograms have been increasingly used as point-of-care imaging tools to aid rural care delivery, the application of these new spatiotemporal DL techniques show the potentials in streamlining echocardiographic acquisition, processing, and data analysis to improve workflow standardization and efficiencies, and provide risk stratification and decision supporting tools in real-time, to prompt the building of new imaging diagnostic networks to enhance rural healthcare engagement.

Cyclical Self-Supervision for Semi-Supervised Ejection Fraction Prediction From Echocardiogram Videos

Left-ventricular ejection fraction (LVEF) is an important indicator of heart failure. Existing methods for LVEF estimation from video require large amounts of annotated data to achieve high performance, e.g. using 10,030 labeled echocardiogram videos to achieve mean absolute error (MAE) of 4.10. Labeling these videos is time-consuming however and limits potential downstream applications to other heart diseases. This paper presents the first semi-supervised approach for LVEF prediction. Unlike general video prediction tasks, LVEF prediction is specifically related to changes in the left ventricle (LV) in echocardiogram videos. By incorporating knowledge learned from predicting LV segmentations into LVEF regression, we can provide additional context to the model for better predictions. To this end, we propose a novel Cyclical Self-Supervision (CSS) method for learning video-based LV segmentation, which is motivated by the observation that the heartbeat is a cyclical process with temporal repetition. Prediction masks from our segmentation model can then be used as additional input for LVEF regression to provide spatial context for the LV region. We also introduce teacher-student distillation to distill the information from LV segmentation masks into an end-to-end LVEF regression model that only requires video inputs. Results show our method outperforms alternative semi-supervised methods and can achieve MAE of 4.17, which is competitive with state-of-the-art supervised performance, using half the number of labels. Validation on an external dataset also shows improved generalization ability from using our method.

Blinded, randomized trial of sonographer versus AI cardiac function assessment

Artificial intelligence (AI) has been developed for echocardiography1-3, although it has not yet been tested with blinding and randomization. Here we designed a blinded, randomized non-inferiority clinical trial (ClinicalTrials.gov ID: NCT05140642; no outside funding) of AI versus sonographer initial assessment of left ventricular ejection fraction (LVEF) to evaluate the impact of AI in the interpretation workflow. The primary end point was the change in the LVEF between initial AI or sonographer assessment and final cardiologist assessment, evaluated by the proportion of studies with substantial change (more than 5% change). From 3,769 echocardiographic studies screened, 274 studies were excluded owing to poor image quality. The proportion of studies substantially changed was 16.8% in the AI group and 27.2% in the sonographer group (difference of -10.4%, 95% confidence interval: -13.2% to -7.7%, P < 0.001 for non-inferiority, P < 0.001 for superiority). The mean absolute difference between final cardiologist assessment and independent previous cardiologist assessment was 6.29% in the AI group and 7.23% in the sonographer group (difference of -0.96%, 95% confidence interval: -1.34% to -0.54%, P < 0.001 for superiority). The AI-guided workflow saved time for both sonographers and cardiologists, and cardiologists were not able to distinguish between the initial assessments by AI versus the sonographer (blinding index of 0.088). For patients undergoing echocardiographic quantification of cardiac function, initial assessment of LVEF by AI was non-inferior to assessment by sonographers.

Single-Site Experience with an Automated Artificial Intelligence Application for Left Ventricular Ejection Fraction Measurement in Echocardiography

Left ventricular ejection fraction (LVEF) is a key parameter in evaluating left ventricular (LV) function using echocardiography (Echo), but its manual measurement by the modified biplane Simpson (MBS) method is time consuming and operator dependent. We investigated the feasibility of a server-based, commercially available and ready-to use-artificial intelligence (AI) application based on convolutional neural network methods that integrate fully automatic view selection and measurement of LVEF from an entire Echo exam into a single workflow. We prospectively enrolled 1083 consecutive patients who had been referred to Echo for diagnostic or therapeutic purposes. LVEF was measured independently using MBS and AI. Test–retest variability was assessed in 40 patients. The reliability, repeatability, and time efficiency of LVEF measurements were compared between the two methods. Overall, 889 Echos were analyzed by cardiologists with the MBS method and by the AI. Over the study period of 10 weeks, the feasibility of both automatic view classification and seamlessly measured LVEF rose to 81% without user involvement. LVEF, LV end-diastolic and end-systolic volumes correlated strongly between MBS and AI (R = 0.87, 0.89 and 0.93, p < 0.001 for all) with a mean bias of +4.5% EF, −12 mL and −11 mL, respectively, due to impaired image quality and the extent of LV function. Repeatability and reliability of LVEF measurement (n = 40, test–retest) by AI was excellent compared to MBS (coefficient of variation: 3.2% vs. 5.9%), although the median analysis time of the AI was longer than that of the operator-dependent MBS method (258 s vs. 171 s). This AI has succeeded in identifying apical LV views and measuring EF in one workflow with comparable results to the MBS method and shows excellent reproducibility. It offers realistic perspectives for fully automated AI-based measurement of LVEF in routine clinical settings.

Impact of Measurement Imprecision on Genetic Association Studies of Cardiac Function

Background

Recent studies have leveraged quantitative traits from imaging to amplify the power of genome-wide association studies (GWAS) to gain further insights into the biology of diseases and traits. However, measurement imprecision is intrinsic to phenotyping and can impact downstream genetic analyses.

Methods

Left ventricular ejection fraction (LVEF), an important but imprecise quantitative imaging measurement, was examined to assess the impact of precision of phenotype measurement on genetic studies. Multiple approaches to obtain LVEF, as well as simulated measurement noise, were evaluated with their impact on downstream genetic analyses.

Results

Even within the same population, small changes in the measurement of LVEF drastically impacted downstream genetic analyses. Introducing measurement noise as little as 7.9% can eliminate all significant genetic associations in an GWAS with almost forty thousand individuals. An increase of 1% in mean absolute error (MAE) in LVEF had an equivalent impact on GWAS power as a decrease of 10% in the cohort sample size, suggesting optimizing phenotyping precision is a cost-effective way to improve power of genetic studies.

Conclusions

Improving the precision of phenotyping is important for maximizing the yield of genome-wide association studies.

Three-Dimensional Automated, Machine-Learning-Based Left Heart Chamber Metrics: Associations with Prevalent Vascular Risk Factors and Cardiovascular Diseases

Background. Three-dimensional transthoracic echocardiography (3DE) powered by artificial intelligence provides accurate left chamber quantification in good accordance with cardiac magnetic resonance and has the potential to revolutionize our clinical practice. Aims. To evaluate the association and the independent value of dynamic heart model (DHM)-derived left atrial (LA) and left ventricular (LV) metrics with prevalent vascular risk factors (VRFs) and cardiovascular diseases (CVDs) in a large, unselected population. Materials and Methods. We estimated the association of DHM metrics with VRFs (hypertension, diabetes) and CVDs (atrial fibrillation, stroke, ischemic heart disease, cardiomyopathies, >moderate valvular heart disease/prosthesis), stratified by prevalent disease status: participants without VRFs or CVDs (healthy), with at least one VRFs but without CVDs, and with at least one CVDs. Results. We retrospectively included 1069 subjects (median age 62 [IQR 49−74]; 50.6% women). When comparing VRFs with the healthy, significant difference in maximum and minimum indexed atrial volume (LAVi max and LAVi min), left atrial ejection fraction (LAEF), left ventricular mass/left ventricular end-diastolic volume ratio, and left ventricular global function index (LVGFI) were recorded (p < 0.05). In the adjusted logistic regression, LAVi min, LAEF, LV ejection fraction, and LVGFI showed the most robust association (OR 3.03 [95% CI 2.48−3.70], 0.45 [95% CI 0.39−0.51], 0.28 [95% CI 0.22−0.35], and 0.22 [95% CI 0.16−0.28], respectively, with CVDs. Conclusions. The present data suggested that novel 3DE left heart chamber metrics by DHM such as LAEF, LAVi min, and LVGFI can refine our echocardiographic disease discrimination capacity.

Artificial intelligence applications in cardio-oncology: Leveraging high dimensional cardiovascular data

Growing evidence suggests a wide spectrum of potential cardiovascular complications following cancer therapies, leading to an urgent need for better risk-stratifying and disease screening in patients undergoing oncological treatment. As many cancer patients undergo frequent surveillance through imaging as well as other diagnostic testing, there is a wealth of information that can be utilized to assess one's risk for cardiovascular complications of cancer therapies. Over the past decade, there have been remarkable advances in applying artificial intelligence (AI) to analyze cardiovascular data obtained from electrocardiograms, echocardiograms, computed tomography, and cardiac magnetic resonance imaging to detect early signs or future risk of cardiovascular diseases. Studies have shown AI-guided cardiovascular image analysis can accurately, reliably and inexpensively identify and quantify cardiovascular risk, leading to better detection of at-risk or disease features, which may open preventive and therapeutic opportunities in cardio-oncology. In this perspective, we discuss the potential for the use of AI in analyzing cardiovascular data to identify cancer patients at risk for cardiovascular complications early in treatment which would allow for rapid intervention to prevent adverse cardiovascular outcomes.