Assessment of Artificial Intelligence in Echocardiography Diagnostics in Differentiating Takotsubo Syndrome From Myocardial Infarction

Interpretation of SPECT wall motion with deep learning

OBJECTIVES

We sought to develop a novel deep learning (DL) workflow to interpret single-photon emission computed tomography (SPECT) wall motion.

BACKGROUND

Wall motion assessment with SPECT is limited by image temporal and spatial resolution. Visual interpretation of wall motion can be subjective and prone to error. Artificial intelligence (AI) may improve accuracy of wall motion assessment.

METHODS

A total of 1038 patients undergoing rest electrocardiogram (ECG)-gated SPECT and echocardiography were included. Using echocardiography as truth, a DL-model (DL-model 1) was trained to predict the probability of abnormal wall motion. Of the 1038 patients, 317 were used to train a DL-model (DL-model 2) to assess regional wall motion. A 10-fold cross-validation was adopted. Diagnostic performance of DL was compared with human readers and quantitative parameters.

RESULTS

The area under the receiver operating characteristic curve (AUC) and accuracy (ACC) of DL model (AUC: .82 [95% CI: .79-.85]; ACC: .88) were higher than human (AUC: .77 [95% CI: .73-.81]; ACC: .82; P < .001) and quantitative parameter (AUC: .74 [95% CI: .66-.81]; ACC: .78; P < .05). The net reclassification index (NRI) was 7.7%. The AUC and accuracy of DL model for per-segment and per-vessel territory diagnosis were also higher than human reader. The DL model generated results within 30 seconds with operable guided user interface (GUI) and therefore could provide preliminary interpretation.

CONCLUSIONS

DL can be used to improve interpretation of rest SPECT wall motion as compared with current human readers and quantitative parameter diagnosis.

Left Ventricular Segmentation, Warping, and Myocardial Registration for Automated Strain Measurement

The left ventricular global longitudinal strain (LVGLS) is a crucial prognostic indicator. However, inconsistencies in measurements due to the speckle tracking algorithm and manual adjustments have hindered its standardization and democratization. To solve this issue, we proposed a fully automated strain measurement by artificial intelligence-assisted LV segmentation contours. The LV segmentation model was trained from echocardiograms of 368 adults (11,125 frames). We compared the registration-like effects of dynamic time warping (DTW) with speckle tracking on a synthetic echocardiographic dataset in experiment-1. In experiment-2, we enrolled 80 patients to compare the DTW method with commercially available software. In experiment-3, we combined the segmentation model and DTW method to create the artificial intelligence (AI)-DTW method, which was then tested on 40 patients with general LV morphology, 20 with dilated cardiomyopathy (DCMP), and 20 with transthyretin-associated cardiac amyloidosis (ATTR-CA), 20 with severe aortic stenosis (AS), and 20 with severe mitral regurgitation (MR). Experiments-1 and -2 revealed that the DTW method is consistent with dedicated software. In experiment-3, the AI-DTW strain method showed comparable results for general LV morphology (bias - 0.137 ± 0.398%), DCMP (- 0.397 ± 0.607%), ATTR-CA (0.095 ± 0.581%), AS (0.334 ± 0.358%), and MR (0.237 ± 0.490%). Moreover, the strain curves showed a high correlation in their characteristics, with R-squared values of 0.8879-0.9452 for those LV morphology in experiment-3. Measuring LVGLS through dynamic warping of segmentation contour is a feasible method compared to traditional tracking techniques. This approach has the potential to decrease the need for manual demarcation and make LVGLS measurements more efficient and user-friendly for daily practice.

Deep learning from latent spatiotemporal information of the heart: Identifying advanced bioimaging markers from echocardiograms

A key strength of echocardiography lies in its integration of comprehensive spatiotemporal cardiac imaging data in real-time, to aid frontline or bedside patient risk stratification and management. Nonetheless, its acquisition, processing, and interpretation are known to all be subject to heterogeneity from its reliance on manual and subjective human tracings, which challenges workflow and protocol standardization and final interpretation accuracy. In the era of advanced computational power, utilization of machine learning algorithms for big data analytics in echocardiography promises reduction in cost, cognitive errors, and intra- and inter-observer variability. Novel spatiotemporal deep learning (DL) models allow the integration of temporal arm information based on unlabeled pixel echocardiographic data for convolution of an adaptive semantic spatiotemporal calibration to construct personalized 4D heart meshes, assess global and regional cardiac function, detect early valve pathology, and differentiate uncommon cardiovascular disorders. Meanwhile, data visualization on spatiotemporal DL prediction models helps extract latent temporal imaging features to develop advanced imaging biomarkers in early disease stages and advance our understanding of pathophysiology to support the development of personalized prevention or treatment strategies. Since portable echocardiograms have been increasingly used as point-of-care imaging tools to aid rural care delivery, the application of these new spatiotemporal DL techniques show the potentials in streamlining echocardiographic acquisition, processing, and data analysis to improve workflow standardization and efficiencies, and provide risk stratification and decision supporting tools in real-time, to prompt the building of new imaging diagnostic networks to enhance rural healthcare engagement.

Deep learning from atrioventricular plane displacement in patients with Takotsubo syndrome: lighting up the black-box

Aims

The spatiotemporal deep convolutional neural network (DCNN) helps reduce echocardiographic readers' erroneous 'judgement calls' on Takotsubo syndrome (TTS). The aim of this study was to improve the interpretability of the spatiotemporal DCNN to discover latent imaging features associated with causative TTS pathophysiology.

Methods and results

We applied gradient-weighted class activation mapping analysis to visualize an established spatiotemporal DCNN based on the echocardiographic videos to differentiate TTS (150 patients) from anterior wall ST-segment elevation myocardial infarction (STEMI, 150 patients). Forty-eight human expert readers interpreted the same echocardiographic videos and prioritized the regions of interest on myocardium for the differentiation. Based on visualization results, we completed optical flow measurement, myocardial strain, and Doppler/tissue Doppler echocardiography studies to investigate regional myocardial temporal dynamics and diastology. While human readers' visualization predominantly focused on the apex of the heart in TTS patients, the DCNN temporal arm's saliency visualization was attentive on the base of the heart, particularly at the atrioventricular (AV) plane. Compared with STEMI patients, TTS patients consistently showed weaker peak longitudinal displacement (in pixels) in the basal inferoseptal (systolic: 2.15 ± 1.41 vs. 3.10 ± 1.66, P < 0.001; diastolic: 2.36 ± 1.71 vs. 2.97 ± 1.69, P = 0.004) and basal anterolateral (systolic: 2.70 ± 1.96 vs. 3.44 ± 2.13, P = 0.003; diastolic: 2.73 ± 1.70 vs. 3.45 ± 2.20, P = 0.002) segments, and worse longitudinal myocardial strain in the basal inferoseptal (-8.5 ± 3.8% vs. -9.9 ± 4.1%, P = 0.013) and basal anterolateral (-8.6 ± 4.2% vs. -10.4 ± 4.1%, P = 0.006) segments. Meanwhile, TTS patients showed worse diastolic mechanics than STEMI patients (E'/septal: 5.1 ± 1.2 cm/s vs. 6.3 ± 1.5 cm/s, P < 0.001; S'/septal: 5.8 ± 1.3 cm/s vs. 6.8 ± 1.4 cm/s, P < 0.001; E'/lateral: 6.0 ± 1.4 cm/s vs. 7.9 ± 1.6 cm/s, P < 0.001; S'/lateral: 6.3 ± 1.4 cm/s vs. 7.3 ± 1.5 cm/s, P < 0.001; E/E': 15.5 ± 5.6 vs. 12.5 ± 3.5, P < 0.001).

Conclusion

The spatiotemporal DCNN saliency visualization helps identify the pattern of myocardial temporal dynamics and navigates the quantification of regional myocardial mechanics. Reduced AV plane displacement in TTS patients likely correlates with impaired diastolic mechanics.

Adopting artificial intelligence in cardiovascular medicine: a scoping review

Recent years have witnessed significant transformations in cardiovascular medicine, driven by the rapid evolution of artificial intelligence (AI). This scoping review was conducted to capture the breadth of AI applications within cardiovascular science. Employing a structured approach, we sourced relevant articles from PubMed, with an emphasis on journals encompassing general cardiology and digital medicine. We applied filters to highlight cardiovascular articles published in journals focusing on general internal medicine, cardiology and digital medicine, thereby identifying the prevailing trends in the field. Following a comprehensive full-text screening, a total of 140 studies were identified. Over the preceding 5 years, cardiovascular medicine's interplay with AI has seen an over tenfold augmentation. This expansive growth encompasses multiple cardiovascular subspecialties, including but not limited to, general cardiology, ischemic heart disease, heart failure, and arrhythmia. Deep learning emerged as the predominant methodology. The majority of AI endeavors in this domain have been channeled toward enhancing diagnostic and prognostic capabilities, utilizing resources such as hospital datasets, electrocardiograms, and echocardiography. A significant uptrend was observed in AI's application for omics data analysis. However, a clear gap persists in AI's full-scale integration into the clinical decision-making framework. AI, particularly deep learning, has demonstrated robust applications across cardiovascular subspecialties, indicating its transformative potential in this field. As we continue on this trajectory, ensuring the alignment of technological progress with medical ethics becomes crucial. The abundant digital health data today further accentuates the need for meticulous systematic reviews, tailoring them to each cardiovascular subspecialty.

An Automated Heart Shunt Recognition Pipeline Using Deep Neural Networks

Automated recognition of heart shunts using saline contrast transthoracic echocardiography (SC-TTE) has the potential to transform clinical practice, enabling non-experts to assess heart shunt lesions. This study aims to develop a fully automated and scalable analysis pipeline for distinguishing heart shunts, utilizing a deep neural network-based framework. The pipeline consists of three steps: (1) chamber segmentation, (2) ultrasound microbubble localization, and (3) disease classification model establishment. The study's normal control group included 91 patients with intracardiac shunts, 61 patients with extracardiac shunts, and 84 asymptomatic individuals. Participants' SC-TTE images were segmented using the U-Net model to obtain cardiac chambers. The segmentation results were combined with ultrasound microbubble localization to generate multivariate time series data on microbubble counts in each chamber. A classification model was then trained using this data to distinguish between intracardiac and extracardiac shunts. The proposed framework accurately segmented heart chambers (dice coefficient = 0.92 ± 0.1) and localized microbubbles. The disease classification model achieved high accuracy, sensitivity, specificity, F1 score, kappa value, and AUC value for both intracardiac and extracardiac shunts. For intracardiac shunts, accuracy was 0.875 ± 0.008, sensitivity was 0.891 ± 0.002, specificity was 0.865 ± 0.012, F1 score was 0.836 ± 0.011, kappa value was 0.735 ± 0.017, and AUC value was 0.942 ± 0.014. For extracardiac shunts, accuracy was 0.902 ± 0.007, sensitivity was 0.763 ± 0.014, specificity was 0.966 ± 0.008, F1 score was 0.830 ± 0.012, kappa value was 0.762 ± 0.017, and AUC value was 0.916 ± 0.006. The proposed framework utilizing deep neural networks offers a fast, convenient, and accurate method for identifying intracardiac and extracardiac shunts. It aids in shunt recognition and generates valuable quantitative indices, assisting clinicians in diagnosing these conditions.

Deep Learning for Cardiovascular Imaging: A Review

Importance

Artificial intelligence (AI), driven by advances in deep learning (DL), has the potential to reshape the field of cardiovascular imaging (CVI). While DL for CVI is still in its infancy, research is accelerating to aid in the acquisition, processing, and/or interpretation of CVI across various modalities, with several commercial products already in clinical use. It is imperative that cardiovascular imagers are familiar with DL systems, including a basic understanding of how they work, their relative strengths compared with other automated systems, and possible pitfalls in their implementation. The goal of this article is to review the methodology and application of DL to CVI in a simple, digestible fashion toward demystifying this emerging technology.

Observations

At its core, DL is simply the application of a series of tunable mathematical operations that translate input data into a desired output. Based on artificial neural networks that are inspired by the human nervous system, there are several types of DL architectures suited to different tasks; convolutional neural networks are particularly adept at extracting valuable information from CVI data. We survey some of the notable applications of DL to tasks across the spectrum of CVI modalities. We also discuss challenges in the development and implementation of DL systems, including avoiding overfitting, preventing systematic bias, improving explainability, and fostering a human-machine partnership. Finally, we conclude with a vision of the future of DL for CVI.

Conclusions and Relevance

Deep learning has the potential to meaningfully affect the field of CVI. Rather than a threat, DL could be seen as a partner to cardiovascular imagers in reducing technical burden and improving efficiency and quality of care. High-quality prospective evidence is still needed to demonstrate how the benefits of DL CVI systems may outweigh the risks.

Using Deep Learning to Detect the Presence and Location of Hemoperitoneum on the Focused Assessment with Sonography in Trauma (FAST) Examination in Adults

Abdominal ultrasonography has become an integral component of the evaluation of trauma patients. Internal hemorrhage can be rapidly diagnosed by finding free fluid with point-of-care ultrasound (POCUS) and expedite decisions to perform lifesaving interventions. However, the widespread clinical application of ultrasound is limited by the expertise required for image interpretation. This study aimed to develop a deep learning algorithm to identify the presence and location of hemoperitoneum on POCUS to assist novice clinicians in accurate interpretation of the Focused Assessment with Sonography in Trauma (FAST) exam. We analyzed right upper quadrant (RUQ) FAST exams obtained from 94 adult patients (44 confirmed hemoperitoneum) using the YoloV3 object detection algorithm. Exams were partitioned via fivefold stratified sampling for training, validation, and hold-out testing. We assessed each exam image-by-image using YoloV3 and determined hemoperitoneum presence for the exam using the detection with highest confidence score. We determined the detection threshold as the score that maximizes the geometric mean of sensitivity and specificity over the validation set. The algorithm had 95% sensitivity, 94% specificity, 95% accuracy, and 97% AUC over the test set, significantly outperforming three recent methods. The algorithm also exhibited strength in localization, while the detected box sizes varied with a 56% IOU averaged over positive cases. Image processing demonstrated only 57-ms latency, which is adequate for real-time use at the bedside. These results suggest that a deep learning algorithm can rapidly and accurately identify the presence and location of free fluid in the RUQ of the FAST exam in adult patients with hemoperitoneum.

Automated detection and localization of pericardial effusion from point-of-care cardiac ultrasound examination

Focused Assessment with Sonography in Trauma (FAST) exam is the standard of care for pericardial and abdominal free fluid detection in emergency medicine. Despite its life saving potential, FAST is underutilized due to requiring clinicians with appropriate training and practice. To aid ultrasound interpretation, the role of artificial intelligence has been studied, while leaving room for improvement in localization information and computation time. The purpose of this study was to develop and test a deep learning approach to rapidly and accurately identify both the presence and location of pericardial effusion on point-of-care ultrasound (POCUS) exams. Each cardiac POCUS exam is analyzed image-by-image via the state-of-the-art YoloV3 algorithm and pericardial effusion presence is determined from the most confident detection. We evaluate our approach over a dataset of POCUS exams (cardiac component of FAST and ultrasound), comprising 37 cases with pericardial effusion and 39 negative controls. Our algorithm attains 92% specificity and 89% sensitivity in pericardial effusion identification, outperforming existing deep learning approaches, and localizes pericardial effusion by 51% Intersection Over Union with ground-truth annotations. Moreover, image processing demonstrates only 57 ms latency. Experimental results demonstrate the feasibility of rapid and accurate pericardial effusion detection from POCUS exams for physician overread.

The Role of Artificial Intelligence in Echocardiography

Echocardiography is an integral part of the diagnosis and management of cardiovascular disease. The use and application of artificial intelligence (AI) is a rapidly expanding field in medicine to improve consistency and reduce interobserver variability. AI can be successfully applied to echocardiography in addressing variance during image acquisition and interpretation. Furthermore, AI and machine learning can aid in the diagnosis and management of cardiovascular disease. In the realm of echocardiography, accurate interpretation is largely dependent on the subjective knowledge of the operator. Echocardiography is burdened by the high dependence on the level of experience of the operator, to a greater extent than other imaging modalities like computed tomography, nuclear imaging, and magnetic resonance imaging. AI technologies offer new opportunities for echocardiography to produce accurate, automated, and more consistent interpretations. This review discusses machine learning as a subfield within AI in relation to image interpretation and how machine learning can improve the diagnostic performance of echocardiography. This review also explores the published literature outlining the value of AI and its potential to improve patient care.

Weakly supervised inference of personalized heart meshes based on echocardiography videos

Echocardiography provides recordings of the heart chamber size and function and is a central tool for non-invasive diagnosis of heart diseases. It produces high-dimensional video data with substantial stochasticity in the measurements, which frequently prove difficult to interpret. To address this challenge, we propose an automated framework to enable the inference of a high resolution personalized 4D (3D plus time) surface mesh of the cardiac structures from 2D echocardiography video data. Inferring such shape models arises as a key step towards accurate personalized simulation that enables an automated assessment of the cardiac chamber morphology and function. The proposed method is trained using only unpaired echocardiography and heart mesh videos to find a mapping between these distinct visual domains in a self-supervised manner. The resulting model produces personalized 4D heart meshes, which exhibit a high correspondence with the input echocardiography videos. Furthermore, the 4D heart meshes enable the automatic extraction of echocardiographic variables, such as ejection fraction, myocardial muscle mass, and volumetric changes of chamber volumes over time with high temporal resolution.

Advancing cardiovascular medicine with machine learning: Progress, potential, and perspective

Recent advances in machine learning (ML) have made it possible to analyze high-dimensional and complex data-such as free text, images, waveforms, videos, and sound-in an automated manner by successfully learning complex associations within these data. Cardiovascular medicine is particularly well poised to take advantage of these ML advances, due to the widespread digitization of medical data and the large number of diagnostic tests used to evaluate cardiovascular disease. Various ML approaches have successfully been applied to cardiovascular tests and diseases to automate interpretation, accurately perform measurements, and, in some cases, predict novel diagnoses from less invasive tests, effectively expanding the utility of more widely accessible diagnostic tests. Here, we present examples of some impactful advances in cardiovascular medicine using ML across a variety of modalities, with a focus on deep learning applications.

Artificial intelligence applied to cardiovascular imaging, a critical focus on echocardiography: The point-of-view from "the other side of the coin"

Cardiovascular imaging has achieved a crucial role in the management of cardiovascular diseases. In this field, echocardiography advantages include wide availability, portability, and affordability, at a relatively low cost. However, echocardiographic assessment requires highly trained operators, and implies high observer variability, as compared with the other cardiac imaging modalities. Hence, artificial intelligence might be extremely helpful. From the point-of-view of the peripheral "Spoke" Hospital potential user ("the other side of the coin"), artificial intelligence development appears very slow in the clinical arena. Many limitations are still present, and require full involvement, cooperation, and coordination of professional operators into Hub-and-Spoke network.

Gender Differences in Takotsubo Syndrome

Simple Summary

The manifestation of Takotsubo Syndrome (TTS) may be different in males and females based on past reports and our clinical research. However, the gender differences in TTS are unknown because patients with TTS are predominantly female. TTS is common in females; however, approximately 10–20% of males have TTS and it has been reported that in-hospital complications mostly occur in males. TTS in males is often caused by physical stress and often develops in the hospital or during hospitalization. TTS in males is associated with severe cardiac complications, which may require careful observations and interventions. Regarding the pathogenic mechanism of TTS, it has been reported that decreased estrogen levels, common in postmenopausal females, are involved in the pathogenic mechanism. Moreover, the pathological findings and gene expression were different in males and females. From these results, it can be considered that the mechanism of the onset of TTS may be different between males and females.

Abstract

Most patients with Takotsubo Syndrome (TTS) are postmenopausal females. TTS in males is rare and gender differences have not been sufficiently investigated. Therefore, we investigated gender differences in TTS. TTS in males and females is often triggered by physical and emotional stress, respectively. Heart failure, a severe in-hospital complication, requires greater mechanical respiratory support in males. Fatal arrhythmias such as ventricular tachycardia and ventricular fibrillation and in-hospital mortality rates are higher in males. The white blood cell (WBC) count has been shown to be higher in males than in females with cardiovascular death compared with non-cardiovascular death. Therefore, the WBC count, a simple marker, may reflect severe TTS. Decreased estrogen levels, common in postmenopausal females, are a pathogenic mechanism of TTS. Females have a more significant increase in the extracellular matrix-receptor interaction than males. Moreover, the pathological findings after hematoxylin–eosin staining were different in males and females. Males had more severe complications than females in the acute phase of TTS; thus, more careful observations and interventions are likely required. From these results, it can be considered that the mechanism of the onset of TTS may be different between males and females. Therefore, it is necessary to fully understand the gender differences in order to more effectively manage TTS.

Machines that save lives in the intensive care unit: the ultrasonography machine

This article highlights the ultrasonography machine as a machine that saves lives in the intensive care unit. We review its utility in the limited resource intensive care unit and some elements of machine design that are relevant to both the constrained operating environment and the well-resourced intensive care unit. As the ultrasonography machine can only save lives, if is operated by a competent intensivist; we discuss the challenges of training the frontline clinician to become competent in critical care ultrasonography followed by a review of research that supports its use.