Realtime Automatic Assessment of Cardiac Function in Echocardiography

Automatic Detection and Tracking of Anatomical Landmarks in Transesophageal Echocardiography for Quantification of Left Ventricular Function

OBJECTIVE

Evaluation of left ventricular (LV) function in critical care patients is useful for guidance of therapy and early detection of LV dysfunction, but the tools currently available are too time-consuming. To resolve this issue, we previously proposed a method for the continuous and automatic quantification of global LV function in critical care patients based on the detection and tracking of anatomical landmarks on transesophageal heart ultrasound. In the present study, our aim was to improve the performance of mitral annulus detection in transesophageal echocardiography (TEE).

METHODS

We investigated several state-of-the-art networks for both the detection and tracking of the mitral annulus in TEE. We integrated the networks into a pipeline for automatic assessment of LV function through estimation of the mitral annular plane systolic excursion (MAPSE), called autoMAPSE. TEE recordings from a total of 245 patients were collected from St. Olav's University Hospital and used to train and test the respective networks. We evaluated the agreement between autoMAPSE estimates and manual references annotated by expert echocardiographers in 30 Echolab patients and 50 critical care patients. Furthermore, we proposed a prototype of autoMAPSE for clinical integration and tested it in critical care patients in the intensive care unit.

RESULTS

Compared with manual references, we achieved a mean difference of 0.8 (95% limits of agreement: -2.9 to 4.7) mm in Echolab patients, with a feasibility of 85.7%. In critical care patients, we reached a mean difference of 0.6 (95% limits of agreement: -2.3 to 3.5) mm and a feasibility of 88.1%. The clinical prototype of autoMAPSE achieved real-time performance.

CONCLUSION

Automatic quantification of LV function had high feasibility in clinical settings. The agreement with manual references was comparable to inter-observer variability of clinical experts.

Automated estimation of mitral annular plane systolic excursion by artificial intelligence from 3D ultrasound recordings

Perioperative monitoring of cardiac function is beneficial for early detection of cardiovascular complications. The standard of care for cardiac monitoring performed by trained cardiologists and anesthesiologists involves a manual and qualitative evaluation of ultrasound imaging, which is a time-demanding and resource-intensive process with intraobserver- and interobserver variability. In practice, such measures can only be performed a limited number of times during the intervention. To overcome these difficulties, this study presents a robust method for automatic and quantitative monitoring of cardiac function based on 3D transesophageal echocardiography (TEE) B-mode ultrasound recordings of the left ventricle (LV). Such an assessment obtains consistent measurements and can produce a near real-time evaluation of ultrasound imagery. Hence, the presented method is time-saving and results in increased accessibility. The mitral annular plane systolic excursion (MAPSE), characterizing global LV function, is estimated by landmark detection and cardiac view classification of two-dimensional images extracted along the long-axis of the ultrasound volume. MAPSE estimation directly from 3D TEE recordings is beneficial since it removes the need for manual acquisition of cardiac views, hence decreasing the need for interference by physicians. Two convolutional neural networks (CNNs) were trained and tested on acquired ultrasound data of 107 patients, and MAPSE estimates were compared to clinically obtained references in a blinded study including 31 patients. The proposed method for automatic MAPSE estimation had low bias and low variability in comparison to clinical reference measures. The method accomplished a mean difference for MAPSE estimates of (-0.16±1.06) mm. Thus, the results did not show significant systematic errors. The obtained bias and variance of the method were comparable to inter-observer variability of clinically obtained MAPSE measures on 2D TTE echocardiography. The novel pipeline proposed in this study has the potential to enhance cardiac monitoring in perioperative- and intensive care settings.

Retrospective Ultrasound Doppler Quantification Using a Single Acquisition in Healthy Adults

OBJECTIVE

Using an experimental tool for retrospective ultrasound Doppler quantification-with high temporal resolution and large spatial coverage-simultaneous flow and tissue measurements were obtained. We compared and validated these experimental values against conventional measurements to determine if the experimental acquisition produced trustworthy tissue and flow velocities.

METHODS

We included 21 healthy volunteers. The only exclusion criterion was the presence of an irregular heartbeat. Two ultrasound examinations were performed for each participant, one using conventional and one using experimental acquisition. The experimental acquisition used multiple plane wave emissions combined with electrocardiography stitching to obtain continuous data with over 3500 frames per second. With two recordings covering a biplane apical view of the left ventricle, we retrospectively extracted selected flow and tissue velocities.

RESULTS

Flow and tissue velocities were compared between the two acquisitions. Statistical testing showed a small but significant difference. We also exemplified the possibility of extracting spectral tissue Doppler from different sample volumes in the myocardium within the imaging sector, showing a decrease in the velocities from the base to the apex.

CONCLUSION

This study demonstrates the feasibility of simultaneous, retrospective spectral and color Doppler of both tissue and flow from an experimental acquisition covering a full sector width. The measurements were significantly different between the two acquisitions but were still comparable, as the biases were small compared to clinical practice, and the two acquisitions were not done simultaneously. The experimental acquisition also enabled the study of deformation by simultaneous spectral velocity traces from all regions of the image sector.

Clinical Influence of Handheld Ultrasound, Supported by Automatic Quantification and Telemedicine, in Suspected Heart Failure

Early and correct heart failure (HF) diagnosis is essential to improvement of patient care. We aimed to evaluate the clinical influence of handheld ultrasound device (HUD) examinations by general practitioners (GPs) in patients with suspected HF with or without the use of automatic measurement of left ventricular (LV) ejection fraction (autoEF), mitral annular plane systolic excursion (autoMAPSE) and telemedical support. Five GPs with limited ultrasound experience examined 166 patients with suspected HF (median interquartile range = 70 (63-78) y; mean ± SD EF = 53 ± 10%). They first performed a clinical examination. Second, they added an examination with HUD, automatic quantification tools and, finally, telemedical support by an external cardiologist. At all stages, the GPs considered whether the patients had HF. The final diagnosis was made by one of five cardiologists using medical history and clinical evaluation including a standard echocardiography. Compared with the cardiologists' decision, the GPs correctly classified 54% by clinical evaluation. The proportion increased to 71% after adding HUDs, and to 74 % after telemedical evaluation. Net reclassification improvement was highest for HUD with telemedicine. There was no significant benefit of the automatic tools (p ≥ 0.58). Addition of HUD and telemedicine improved the GPs' diagnostic precision in suspected HF. Automatic LV quantification added no benefit. Refined algorithms and more training may be needed before inexperienced users benefit from automatic quantification of cardiac function by HUDs.

Real-time automatic quantification of left ventricular function by hand-held ultrasound devices in patients with suspected heart failure: a feasibility study of a diagnostic test with data from general practitioners, nurses and cardiologists

OBJECTIVES

To evaluate the feasibility and reliability of hand-held ultrasound (HUD) examinations with real-time automatic decision-making software for ejection fraction (autoEF) and mitral annular plane systolic excursion (autoMAPSE) by novices (general practitioners), intermediate users (registered cardiac nurses) and expert users (cardiologists), respectively, compared to reference echocardiography by cardiologists in an outpatient cohort with suspected heart failure (HF).

DESIGN

Feasibility study of a diagnostic test.

SETTING AND PARTICIPANTS

166 patients with suspected HF underwent HUD examinations with autoEF and autoMAPSE measurements by five novices, three intermediate-skilled users and five experts. HUD results were compared with a reference echocardiography by experts. A blinded cardiologist scored all HUD recordings with automatic measurements as (1) discard, (2) accept, but adjust the measurement or (3) accept the measurement as it is.

PRIMARY OUTCOME MEASURE

The feasibility of automatic decision-making software for quantification of left ventricular function.

RESULTS

The users were able to run autoEF and autoMAPSE in most patients. The feasibility for obtaining accepted images (score of ≥2) with automatic measurements ranged from 50% to 91%. The feasibility was lowest for novices and highest for experts for both autoEF and autoMAPSE (p≤0.001). Large coefficients of variation and wide coefficients of repeatability indicate moderate agreement. The corresponding intraclass correlations (ICC) were moderate to good (ICC 0.51-0.85) for intra-rater and poor (ICC 0.35-0.51) for inter-rater analyses. The findings of modest to poor agreement and reliability were not explained by the experience of the users alone.

CONCLUSION

Novices, intermediate and expert users were able to record four-chamber views for automatic assessment of autoEF and autoMAPSE using HUD devices. The modest feasibility, agreement and reliability suggest this should not be implemented into clinical practice without further refinement and clinical evaluation.

TRIAL REGISTRATION NUMBER

NCT03547076.

Feasibility and Reliability of Automatic Quantitative Analyses of Mitral Annular Plane Systolic Excursion by Handheld Ultrasound Devices: A Pilot Study

OBJECTIVES

Handheld ultrasound devices (HUDs) have previously been limited to grayscale imaging without options for left ventricle (LV) quantification. We aimed to study the feasibility and reliability of automatic measurements of mitral annular plane systolic excursion (MAPSE) by HUDs.

METHODS

An algorithm that automatically measured MAPSE from live grayscale recordings was implemented in a HUD. Twenty patients at a university hospital were examined by either a cardiologist or a sonographer. Standard echocardiography using a high-end scanner was performed. The apical 4-chamber view was recorded 4 times by both echocardiography and the HUD. MAPSE was measured by M-mode and color tissue Doppler (cTD) during echocardiography and automatically by the HUD.

RESULTS

The automatic method underestimated mean MAPSE ± SD versus M-mode (9.6 ± 2.2 versus 10.9 ± 2.6 mm; difference, 1.2 ± 1.4 mm, P < .005). The difference between the automatic and cTD measurements was not significant (0.8 ± 1.8 mm; P = .073). The intraclass correlation coefficients (ICCs) between automatic and M-mode measurements was 0.85, and 0.81 for cTD measurements. There was good agreement between the methods, and the intra- and inter-rater ICCs were excellent for all methods (≥0.86).

CONCLUSIONS

In this novel study evaluating automatic quantification of LV longitudinal function by HUD, we showed the high feasibility and reliability of the method. Compared to M-mode imaging, the automatic method underestimated MAPSE by 8% to 10%, but the difference with cTD imaging was nonsignificant. We conclude that this study's method for automatic quantitative assessment of LV function can be integrated in HUDs.

Influences of different dose of tirofiban for acute ST elevation myocardial infarction patients underwent percutaneous coronary intervention

Tirofiban is widely used in patients with acute ST elevation myocardial infarction (STEMI) underwent percutaneous coronary intervention (PCI). This drug can efficiently improve myocardial perfusion and cardiac function, but its dose still remains controversial. We here investigated the effects of different dose of tirofiban on myocardial reperfusion and heart function in patients with STEMI. A total of 312 STEMI patients who underwent PCI in our hospital from March 2017 to March 2018 were enrolled and randomly divided into control group (75 cases, 0 μg/kg), low-dose group (79 cases, 5 μg/kg), medium-dose group (81 cases, 10 μg/kg) and high-dose group (77 cases, 20 μg/kg). The infarction-targeted artery flow grade evaluated by thrombolysis in myocardial infarction (TIMI), corrected TIMI frame count (CTFC) and sum-ST-segment resolution were recorded. At Day 7 and Day 30 after PCI, the left ventricular ejection fraction (LVEF), left ventricular end diastolic diameter, left ventricular end systolic diameter, major adverse cardiovascular events and the hemorrhage and thrombocytopenia were also evaluated. After PCI, the rate of TIMI grade 3, CTFC and incidence of sum-ST-segment resolution > 50% of high-dose group were significantly higher than those of control group, low-dose group and medium-dose group (P < .05), and the CTFC of medium -dose group were significantly higher than that of control group, low-dose group (P < .05). Moreover, the LVEF, left ventricular end diastolic diameter and left ventricular end systolic diameter of high-dose group were significantly improved than those of other groups, and the LVEF of medium-dose group was significantly superior to that of low-dose group (P < .05). However, the incidence of major adverse cardiac events in high-dose group was significantly decreased, while the hemorrhage and incidence of thrombocytopenia of high-dose group were significantly higher than those of other 3 groups (P < .05). The tirofiban can effectively alleviate the myocardial ischemia-reperfusion injury and promote the recovery of cardiac function in STEMI patients underwent PCI. Although the high-dose can enhance the clinical effects, it also increased the hemorrhagic risk. Therefore, the rational dosage application of tirofiban become much indispensable in view of patient's conditions and hemorrhagic risk, and a medium dose of 10 μg/kg may be appropriate for patients without high hemorrhagic risk.

Automatic quantification of left ventricular function by medical students using ultrasound

BACKGROUND

Automatic analyses of echocardiograms may support inexperienced users in quantifying left ventricular (LV) function. We have developed an algorithm for fully automatic measurements of mitral annular plane systolic excursion (MAPSE) and mitral annular systolic (S') and early diastolic (e') peak velocities. We aimed to study the influence of user experience of automatic measurements of these indices in echocardiographic recordings acquired by medical students and clinicians.

METHODS

We included 75 consecutive patients referred for echocardiography at a university hospital. The patients underwent echocardiography by clinicians (cardiologists, cardiology residents and sonographers), who obtained manual reference measurements of MAPSE by M-mode and of S' and e' by colour tissue Doppler imaging (cTDI). Immediately after, each patient was examined by 1 of 39 medical students who were instructed in image acquisition on the day of participation. Each student acquired cTDI recordings from 1 to 4 patients. All cTDI recordings by students and clinicians were analysed for MAPSE, S' and e' using a fully automatic algorithm. The automatic measurements were compared to the manual reference measurements.

RESULTS

Correct tracking of the mitral annulus was feasible in 50 (67%) and 63 (84%) of the students' and clinicians' recordings, respectively (p = 0.007). Image quality was highest in the clinicians' recordings. Mean difference ± standard deviation of the automatic measurements of the students' recordings compared to the manual reference was - 0.0 ± 2.0 mm for MAPSE, 0.3 ± 1.1 cm/s for S' and 0.6 ± 1.4 cm/s for e'. The corresponding intraclass correlation coefficients for MAPSE, S' and e' were 0.85 (good), 0.89 (good) and 0.92 (excellent), respectively. Automatic measurements from the students' and clinicians' recordings were in similar agreement with the reference when mitral annular tracking was correct.

CONCLUSIONS

In case of correct tracking of the mitral annulus, the agreement with reference for the automatic measurements was overall good. Low image quality reduced feasibility. Adequate image acquisition is essential for automatic analyses of LV function indices, and thus, appropriate education of the operators is mandatory. Automatic measurements may help inexperienced users of ultrasound, but do not remove the need for dedicated education and training.

Normal ranges for automatic measurements of tissue Doppler indices of mitral annular motion by echocardiography. Data from the HUNT3 Study

BACKGROUND

Automatic quantification of left ventricular (LV) function could enhance workflow for cardiologists and assist inexperienced clinicians who perform focused cardiac ultrasound. We have developed an algorithm for automatic measurements of the mitral annular plane systolic excursion (MAPSE) and peak velocities in systole (S') and early (e') and late (a') diastole. We aimed to establish normal reference values for the automatic measurements and to compare them with manual measurements.

METHODS AND RESULTS

Healthy participants (n = 1157, 52.5% women) from the HUNT3 cross-sectional population study in Norway were included. The mean age ± standard deviation (SD) was 49 ± 14 (range: 19-89) years. The algorithm measured MAPSE, S', e', and a' from apical 4-chamber color tissue Doppler imaging (cTDI) recordings. The manual measurements were obtained by two echocardiographers, who measured MAPSE by M-mode and the velocities by cTDI. For men and women, age-specific reference values were created for groups (mean ± 1.96SD) and by linear regression (mean, 95% prediction interval). Age was negatively correlated with MAPSE, S', and e' and positively correlated with a'. There were small differences between genders. Normal reference ranges were created. The coefficients of variation between automatic and manual measurements ranged from 5.5% (S') to 11.7% (MAPSE).

CONCLUSION

Normal reference values for automatic measurements of LV function indices are provided. The automatic measurements were in line with the manual measurements. Implementing automatic measurements and comparison with normal ranges in ultrasound scanners can allow for quick and precise interpretation of LV function.

Automatic Measurements of Mitral Annular Plane Systolic Excursion and Velocities to Detect Left Ventricular Dysfunction

The purpose of the study described here was to evaluate an automatic algorithm for detection of left ventricular dysfunction, based on measurements of mitral annular motion indices from color tissue Doppler apical four-chamber recordings. Two hundred twenty-one patients, among whom 49 had systolic and 11 had diastolic dysfunction, were included. Echocardiographic evaluation by cardiologists was the reference. Twenty patients were also examined by medical students. The ability of the indices to detect systolic and diastolic dysfunction were compared in receiver operating characteristic analyses, and the agreement between automatic and reference measurements was evaluated. Mitral annular plane systolic excursion ≤10 mm detected left ventricular dysfunction with 82% specificity, 76% specificity, 56% positive predictive value and 92% negative predictive value. The automatic measurements acquired from expert recordings better agreed better with the reference than those acquired from student recordings. We conclude that automatic measurements of systolic mitral annular motion indices can be helpful in detection of left ventricular dysfunction.

Segmentation of Fetal Left Ventricle in Echocardiographic Sequences Based on Dynamic Convolutional Neural Networks

Segmentation of fetal left ventricle (LV) in echocardiographic sequences is important for further quantitative analysis of fetal cardiac function. However, image gross inhomogeneities and fetal random movements make the segmentation a challenging problem. In this paper, a dynamic convolutional neural networks (CNN) based on multiscale information and fine-tuning is proposed for fetal LV segmentation. The CNN is pretrained by amount of labeled training data. In the segmentation, the first frame of each echocardiographic sequence is delineated manually. The dynamic CNN is fine-tuned by deep tuning with the first frame and shallow tuning with the rest of frames, respectively, to adapt to the individual fetus. Additionally, to separate the connection region between LV and left atrium (LA), a matching approach, which consists of block matching and line matching, is used for mitral valve (MV) base points tracking. Advantages of our proposed method are compared with an active contour model (ACM), a dynamical appearance model (DAM), and a fixed multiscale CNN method. Experimental results in 51 echocardiographic sequences show that the segmentation results agree well with the ground truth, especially in the cases with leakage, blurry boundaries, and subject-to-subject variations. The CNN architecture can be simple, and the dynamic fine-tuning is efficient.