Real-Time Automatic Ejection Fraction and Foreshortening Detection Using Deep Learning

Deep Learning in Echocardiography for Enhanced Detection of Left Ventricular Function and Wall Motion Abnormalities

Cardiovascular diseases (CVDs) remain a leading cause of mortality worldwide, underscoring the need for advancements in diagnostic methodologies to improve early detection and treatment outcomes. This systematic review examines the integration of advanced deep learning (DL) techniques in echocardiography for detecting cardiovascular abnormalities, adhering to PRISMA 2020 guidelines. Through a comprehensive search across databases like IEEE Xplore, PubMed, and Web of Science, 29 studies were identified and analyzed, focusing on deep convolutional neural networks (DCNNs) and their role in enhancing the diagnostic precision of echocardiographic assessments. The findings highlight DL's capability to improve the accuracy and reproducibility of detecting and classifying echocardiographic data, particularly in measuring left ventricular function and identifying wall motion abnormalities. Despite these advancements, challenges such as data diversity, image quality, and the computational demands of DL models hinder their broader clinical adoption. In conclusion, DL offers significant potential to enhance the diagnostic capabilities of echocardiography. However, successful clinical implementation requires addressing issues related to data quality, computational demands, and system integration.

Regional Image Quality Scoring for 2-D Echocardiography Using Deep Learning

OBJECTIVE

To develop and compare methods to automatically estimate regional ultrasound image quality for echocardiography separate from view correctness.

METHODS

Three methods for estimating image quality were developed: (i) classic pixel-based metric: the generalized contrast-to-noise ratio (gCNR), computed on myocardial segments (region of interest) and left ventricle lumen (background), extracted by a U-Net segmentation model; (ii) local image coherence: the average local coherence as predicted by a U-Net model that predicts image coherence from B-mode ultrasound images at the pixel level; (iii) deep convolutional network: an end-to-end deep-learning model that predicts the quality of each region in the image directly. These methods were evaluated against manual regional quality annotations provided by three experienced cardiologists.

RESULTS

The results indicated poor performance of the gCNR metric, with Spearman correlation to annotations of ρ = 0.24. The end-to-end learning model obtained the best result, ρ = 0.69, comparable to the inter-observer correlation, ρ = 0.63. Finally, the coherence-based method, with ρ = 0.58, out-performed the classical metrics and was more generic than the end-to-end approach.

CONCLUSION

The deep convolutional network provided the most accurate regional quality prediction, while the coherence-based method offered a more generalizable solution. gCNR showed limited effectiveness in this study. The image quality prediction tool is available as an open-source Python library at https://github.com/GillesVanDeVyver/arqee.

A Semi-supervised Four-Chamber Echocardiographic Video Segmentation Algorithm Based on Multilevel Edge Perception and Calibration Fusion

OBJECTIVE

Echocardiographic videos are commonly used for automatic semantic segmentation of endocardium, which is crucial in evaluating cardiac function and assisting doctors to make accurate diagnoses of heart disease. However, this task faces two distinct challenges: one is the edge blurring, which is caused by the presence of speckle noise or excessive de-noising operation, and the other is the lack of an effective feature fusion approach for multilevel features for obtaining accurate endocardium.

METHODS

In this study, a deep learning model, based on multilevel edge perception and calibration fusion is proposed to improve the segmentation performance. First, a multilevel edge perception module is proposed to comprehensively extract edge features through both a detail branch and a semantic branch to alleviate the adverse impact of noise. Second, a calibration fusion module is proposed that calibrates and integrates various features, including semantic and detailed information, to maximize segmentation performance. Furthermore, the features obtained from the calibration fusion module are stored by using a memory architecture to achieve semi-supervised segmentation through both labeled and unlabeled data.

RESULTS

Our method is evaluated on two public echocardiography video data sets, achieving average Dice coefficients of 93.05% and 93.93%, respectively. Additionally, we validated our method on a local hospital clinical data set, achieving a Pearson correlation of 0.765 for predicting left ventricular ejection fraction.

CONCLUSION

The proposed model effectively solves the challenges encountered in echocardiography by using semi-supervised networks, thereby improving the segmentation accuracy of the ventricles. This indicates that the proposed model can assist cardiologists in obtaining accurate and effective research and diagnostic results.

EFNet: A multitask deep learning network for simultaneous quantification of left ventricle structure and function

PURPOSE

The purpose of this study is to develop an automated method using deep learning for the reliable and precise quantification of left ventricle structure and function from echocardiogram videos, eliminating the need to identify end-systolic and end-diastolic frames. This addresses the variability and potential inaccuracies associated with manual quantification, aiming to improve the diagnosis and management of cardiovascular conditions.

METHODS

A single, fully automated multitask network, the EchoFused Network (EFNet) is introduced that simultaneously addresses both left ventricle segmentation and ejection fraction estimation tasks through cross-module fusion. Our proposed approach utilizes semi-supervised learning to estimate the ejection fraction from the entire cardiac cycle, yielding more dependable estimations and obviating the need to identify specific frames. To facilitate joint optimization, the losses from task-specific modules are combined using a normalization technique, ensuring commensurability on a comparable scale.

RESULTS

The assessment of the proposed model on a publicly available dataset, EchoNet-Dynamic, shows significant performance improvement, achieving an MAE of 4.35% for ejection fraction estimation and DSC values of 0.9309 (end-diastolic) and 0.9135 (end-systolic) for left ventricle segmentation.

CONCLUSIONS

The study demonstrates the efficacy of EFNet, a multitask deep learning network, in simultaneously quantifying left ventricle structure and function through cross-module fusion on echocardiogram data.

Automatic Detection and Tracking of Anatomical Landmarks in Transesophageal Echocardiography for Quantification of Left Ventricular Function

OBJECTIVE

Evaluation of left ventricular (LV) function in critical care patients is useful for guidance of therapy and early detection of LV dysfunction, but the tools currently available are too time-consuming. To resolve this issue, we previously proposed a method for the continuous and automatic quantification of global LV function in critical care patients based on the detection and tracking of anatomical landmarks on transesophageal heart ultrasound. In the present study, our aim was to improve the performance of mitral annulus detection in transesophageal echocardiography (TEE).

METHODS

We investigated several state-of-the-art networks for both the detection and tracking of the mitral annulus in TEE. We integrated the networks into a pipeline for automatic assessment of LV function through estimation of the mitral annular plane systolic excursion (MAPSE), called autoMAPSE. TEE recordings from a total of 245 patients were collected from St. Olav's University Hospital and used to train and test the respective networks. We evaluated the agreement between autoMAPSE estimates and manual references annotated by expert echocardiographers in 30 Echolab patients and 50 critical care patients. Furthermore, we proposed a prototype of autoMAPSE for clinical integration and tested it in critical care patients in the intensive care unit.

RESULTS

Compared with manual references, we achieved a mean difference of 0.8 (95% limits of agreement: -2.9 to 4.7) mm in Echolab patients, with a feasibility of 85.7%. In critical care patients, we reached a mean difference of 0.6 (95% limits of agreement: -2.3 to 3.5) mm and a feasibility of 88.1%. The clinical prototype of autoMAPSE achieved real-time performance.

CONCLUSION

Automatic quantification of LV function had high feasibility in clinical settings. The agreement with manual references was comparable to inter-observer variability of clinical experts.

Cardiac Valve Event Timing in Echocardiography Using Deep Learning and Triplane Recordings

Cardiac valve event timing plays a crucial role when conducting clinical measurements using echocardiography. However, established automated approaches are limited by the need of external electrocardiogram sensors, and manual measurements often rely on timing from different cardiac cycles. Recent methods have applied deep learning to cardiac timing, but they have mainly been restricted to only detecting two key time points, namely end-diastole (ED) and end-systole (ES). In this work, we propose a deep learning approach that leverages triplane recordings to enhance detection of valve events in echocardiography. Our method demonstrates improved performance detecting six different events, including valve events conventionally associated with ED and ES. Of all events, we achieve an average absolute frame difference (aFD) of maximum 1.4 frames (29 ms) for start of diastasis, down to 0.6 frames (12 ms) for mitral valve opening when performing a ten-fold cross-validation with test splits on triplane data from 240 patients. On an external independent test consisting of apical long-axis data from 180 other patients, the worst performing event detection had an aFD of 1.8 (30 ms). The proposed approach has the potential to significantly impact clinical practice by enabling more accurate, rapid and comprehensive event detection, leading to improved clinical measurements.

Development of automated neural network prediction for echocardiographic left ventricular ejection fraction

Introduction

The echocardiographic measurement of left ventricular ejection fraction (LVEF) is fundamental to the diagnosis and classification of patients with heart failure (HF).

Methods

This paper aimed to quantify LVEF automatically and accurately with the proposed pipeline method based on deep neural networks and ensemble learning. Within the pipeline, an Atrous Convolutional Neural Network (ACNN) was first trained to segment the left ventricle (LV), before employing the area-length formulation based on the ellipsoid single-plane model to calculate LVEF values. This formulation required inputs of LV area, derived from segmentation using an improved Jeffrey's method, as well as LV length, derived from a novel ensemble learning model. To further improve the pipeline's accuracy, an automated peak detection algorithm was used to identify end-diastolic and end-systolic frames, avoiding issues with human error. Subsequently, single-beat LVEF values were averaged across all cardiac cycles to obtain the final LVEF.

Results

This method was developed and internally validated in an open-source dataset containing 10,030 echocardiograms. The Pearson's correlation coefficient was 0.83 for LVEF prediction compared to expert human analysis (p < 0.001), with a subsequent area under the receiver operator curve (AUROC) of 0.98 (95% confidence interval 0.97 to 0.99) for categorisation of HF with reduced ejection (HFrEF; LVEF<40%). In an external dataset with 200 echocardiograms, this method achieved an AUC of 0.90 (95% confidence interval 0.88 to 0.91) for HFrEF assessment.

Conclusion

The automated neural network-based calculation of LVEF is comparable to expert clinicians performing time-consuming, frame-by-frame manual evaluations of cardiac systolic function.

Automatic measurements of left ventricular volumes and ejection fraction by artificial intelligence: clinical validation in real time and large databases

AIMS

Echocardiography is a cornerstone in cardiac imaging, and left ventricular (LV) ejection fraction (EF) is a key parameter for patient management. Recent advances in artificial intelligence (AI) have enabled fully automatic measurements of LV volumes and EF both during scanning and in stored recordings. The aim of this study was to evaluate the impact of implementing AI measurements on acquisition and processing time and test-retest reproducibility compared with standard clinical workflow, as well as to study the agreement with reference in large internal and external databases.

METHODS AND RESULTS

Fully automatic measurements of LV volumes and EF by a novel AI software were compared with manual measurements in the following clinical scenarios: (i) in real time use during scanning of 50 consecutive patients, (ii) in 40 subjects with repeated echocardiographic examinations and manual measurements by 4 readers, and (iii) in large internal and external research databases of 1881 and 849 subjects, respectively. Real-time AI measurements significantly reduced the total acquisition and processing time by 77% (median 5.3 min, P < 0.001) compared with standard clinical workflow. Test-retest reproducibility of AI measurements was superior in inter-observer scenarios and non-inferior in intra-observer scenarios. AI measurements showed good agreement with reference measurements both in real time and in large research databases.

CONCLUSION

The software reduced the time taken to perform and volumetrically analyse routine echocardiograms without a decrease in accuracy compared with experts.

A deep multi-stream model for robust prediction of left ventricular ejection fraction in 2D echocardiography

We propose a deep multi-stream model for left ventricular ejection fraction (LVEF) prediction in 2D echocardiographic (2DE) examinations. We use four standard 2DE views as model input, which are automatically selected from the full 2DE examination. The LVEF prediction model processes eight streams of data (images + optical flow) and consists of convolutional neural networks terminated with transformer layers. The model is made robust to missing, misclassified and duplicate views via pre-training, sampling strategies and parameter sharing. The model is trained and evaluated on an existing clinical dataset (12,648 unique examinations) with varying properties in terms of quality, examining physician, and ultrasound system. We report [Formula: see text] and mean absolute error = 4.0% points for the test set. When evaluated on two public benchmarks, the model performs on par or better than all previous attempts on fully automatic LVEF prediction. Code and trained models are available on a public project repository .

Automated 2-D and 3-D Left Atrial Volume Measurements Using Deep Learning

OBJECTIVE

Echocardiography, a critical tool for assessing left atrial (LA) volume, often relies on manual or semi-automated measurements. This study introduces a fully automated, real-time method for measuring LA volume in both 2-D and 3-D imaging, in the aim of offering accuracy comparable to that of expert assessments while saving time and reducing operator variability.

METHODS

We developed an automated pipeline comprising a network to identify the end-systole (ES) time point and robust 2-D and 3-D U-Nets for segmentation. We employed data sets of 789 2-D images and 286 3-D recordings and explored various training regimes, including recurrent networks and pseudo-labeling, to estimate volume curves.

RESULTS

Our baseline results revealed an average volume difference of 2.9 mL for 2-D and 7.8 mL for 3-D, respectively, compared with manual methods. The application of pseudo-labeling to all frames in the cine loop generally led to more robust volume curves and notably improved ES measurement in cases with limited data.

CONCLUSION

Our results highlight the potential of automated LA volume estimation in clinical practice. The proposed prototype application, capable of processing real-time data from a clinical ultrasound scanner, provides valuable temporal volume curve information in the echo lab.

Improved assessment of left ventricular ejection fraction using artificial intelligence in echocardiography: A comparative analysis with cardiac magnetic resonance imaging

BACKGROUND

Left ventricular ejection fraction (LVEF) measurement in echocardiography (Echo) using the recommended modified biplane Simpson (MBS) method is operator-dependent and exhibits variability. We aimed to assess the accuracy of a novel fully automated (Auto) artificial intelligence (AI) in view selection and biplane LVEF calculation compared to MBS-Echo, with cardiac magnetic resonance imaging (CMR) as reference.

METHODS

Each of the 301 consecutive patients underwent CMR and Echo on the same day. LVEF was measured independently by Auto-Echo, MBS-Echo and CMR. Interobserver (n = 40) and test-retest (n = 14) analysis followed.

RESULTS

A total of 229 patients (76%) underwent complete analysis. Auto-Echo and MBS-Echo showed high correlations with CMR (R = 0.89 and 0.89) and with each other (R = 0.93). Auto underestimated LVEF (bias: 2.2%; limits of agreement [LOA]: -13.5 to 17.9%), while MBS overestimated it (bias: -2.2%; LOA: 18.6 to 14.1%). Despite comparable areas under the curves of Auto- and MBS-Echo (0.93 and 0.92), 46% (n = 70) of MBS-Echo misclassified LVEF by ≥5% units in patients with a reduced CMR-LVEF <51%. Although LVEF bias variability across different LV function ranges was significant (p < 0.001), Auto-Echo was closer to CMR for patients with reduced LVEF, wall motion abnormalities, and poor image quality than MBS-Echo. The interobserver correlation coefficient of Auto-Echo was excellent compared to MBS-Echo (1.00 vs. <0.91) for different readers. True test-retest variability was higher for MBS-Echo than for Auto-Echo (7.9% vs. 2.5%).

CONCLUSION

The tested AI has the potential to improve the clinical utility of Echo by reducing user-related variability, providing more accurate and reliable results than MBS.

Insights Into the Standard Echocardiographic Views From Multimodality Imaging: Ventricles, Pericardium, Valves, and Atria

The widespread use of cardiac computed tomography and cardiac magnetic resonance imaging in patients undergoing echocardiography presents an opportunity to correlate the images side by side. Accordingly, the aim of this report is to review aspects of the standard echocardiographic examination alongside similarly oriented images from the two tomographic imaging modalities. It is hoped that this exercise will enhance understanding of the structures depicted by echocardiography as they relate to other structures in the thorax. In addition to reviewing basic cardiac anatomy, the authors take advantage of these correlations with computed tomography and cardiac magnetic resonance imaging to better understand the issue of foreshortening, a common pitfall in transthoracic echocardiography. The authors also highlight an important role that three-dimensional echocardiography can potentially play in the future, especially as advances in image processing permit higher fidelity multiplanar reconstruction images.

Reference Values for Inward Displacement in the Normal Left Ventricle: A Novel Method of Regional Left Ventricular Function Assessment

BACKGROUND

Regional functional left ventricular (LV) assessment using current imaging techniques remains limited. Inward displacement (InD) has been developed as a novel technique to assess regional LV function via measurement of the regional displacement of the LV endocardial border across each of the 17 LV segments. Currently, normal ranges for InD are not available for clinical use. The aim of this study was to validate the normal reference limits of InD in healthy adults across all LV segments.

METHODS

InD was analyzed in 120 healthy subjects with a normal LV ejection fraction, using the three standard long-axis views obtained during cardiac MRI that quantified the degree of inward endocardial wall motion towards the true LV center of contraction. For all LV segments, InD was measured in mm and expressed as a percentage of the theoretical degree of maximal segment contraction towards the true LV centerline. The arithmetic average InD was obtained for each of the 17 segments. The LV was divided into three regions, obtaining average InD at the LV base (segments 1-6), mid-cavity (segments 7-12) and apex (segments 13-17).

RESULTS

Average InD was 33.4 ± 4.3%. InD was higher in basal and mid-cavity LV segments (32.8 ± 4.1% and 38.1 ± 5.8%) compared to apical LV segments (28.6 ± 7.7%). Interobserver variability correlations for InD were strong (R = 0.80, p < 0.0001).

CONCLUSIONS

We provide clinically meaningful reference ranges for InD in subjects with normal LV function, which will emerge as an important screening and assessment imaging tool for a range of HFrEF therapies.

Real-time guidance by deep learning of experienced operators to improve the standardization of echocardiographic acquisitions

Aims

Impaired standardization of echocardiograms may increase inter-operator variability. This study aimed to determine whether the real-time guidance of experienced sonographers by deep learning (DL) could improve the standardization of apical recordings.

Methods and results

Patients (n = 88) in sinus rhythm referred for echocardiography were included. All participants underwent three examinations, whereof two were performed by sonographers and the third by cardiologists. In the first study period (Period 1), the sonographers were instructed to provide echocardiograms for the analyses of the left ventricular function. Subsequently, after brief training, the DL guidance was used in Period 2 by the sonographer performing the second examination. View standardization was quantified retrospectively by a human expert as the primary endpoint and the DL algorithm as the secondary endpoint. All recordings were scored in rotation and tilt both separately and combined and were categorized as standardized or non-standardized. Sonographers using DL guidance had more standardized acquisitions for the combination of rotation and tilt than sonographers without guidance in both periods (all P ≤ 0.05) when evaluated by the human expert and DL [except for the apical two-chamber (A2C) view by DL evaluation]. When rotation and tilt were analysed individually, A2C and apical long-axis rotation and A2C tilt were significantly improved, and the others were numerically improved when evaluated by the echocardiography expert. Furthermore, all, except for A2C rotation, were significantly improved when evaluated by DL (P < 0.01).

Conclusion

Real-time guidance by DL improved the standardization of echocardiographic acquisitions by experienced sonographers. Future studies should evaluate the impact with respect to variability of measurements and when used by less-experienced operators.

ClinicalTrialsgov Identifier

NCT04580095.

Automated Detection of Apical Foreshortening in Echocardiography Using Statistical Shape Modelling

OBJECTIVE

Automated detection of foreshortening, a common challenge in routine 2-D echocardiography, has the potential to improve quality of acquisitions and reduce the variability of left ventricular measurements. Acquiring and labelling the required training data is challenging due to the time-intensive and highly subjective nature of foreshortened apical views. We aimed to develop an automatic pipeline for the detection of foreshortening. To this end, we propose a method to generate synthetic apical-four-chamber (A4C) views with matching ground truth foreshortening labels.

METHODS

A statistical shape model of the four chambers of the heart was used to synthesise idealised A4C views with varying degrees of foreshortening. Contours of the left ventricular endocardium were segmented in the images, and a partial least squares (PLS) model was trained to learn the morphological traits of foreshortening. The predictive capability of the learned synthetic features was evaluated on an independent set of manually labelled and automatically curated real echocardiographic A4C images.

RESULTS

Acceptable classification accuracy for identification of foreshortened views in the testing set was achieved using logistic regression based on 11 PLS shape modes, with a sensitivity, specificity and area under the receiver operating characteristic curve of 0.84, 0.82 and 0.84, respectively. Both synthetic and real cohorts showed interpretable traits of foreshortening within the first two PLS shape modes, reflected as a shortening in the long-axis length and apical rounding.

CONCLUSION

A contour shape model trained only on synthesized A4C views allowed accurate prediction of foreshortening in real echocardiographic images.

Retrospective Ultrasound Doppler Quantification Using a Single Acquisition in Healthy Adults

OBJECTIVE

Using an experimental tool for retrospective ultrasound Doppler quantification-with high temporal resolution and large spatial coverage-simultaneous flow and tissue measurements were obtained. We compared and validated these experimental values against conventional measurements to determine if the experimental acquisition produced trustworthy tissue and flow velocities.

METHODS

We included 21 healthy volunteers. The only exclusion criterion was the presence of an irregular heartbeat. Two ultrasound examinations were performed for each participant, one using conventional and one using experimental acquisition. The experimental acquisition used multiple plane wave emissions combined with electrocardiography stitching to obtain continuous data with over 3500 frames per second. With two recordings covering a biplane apical view of the left ventricle, we retrospectively extracted selected flow and tissue velocities.

RESULTS

Flow and tissue velocities were compared between the two acquisitions. Statistical testing showed a small but significant difference. We also exemplified the possibility of extracting spectral tissue Doppler from different sample volumes in the myocardium within the imaging sector, showing a decrease in the velocities from the base to the apex.

CONCLUSION

This study demonstrates the feasibility of simultaneous, retrospective spectral and color Doppler of both tissue and flow from an experimental acquisition covering a full sector width. The measurements were significantly different between the two acquisitions but were still comparable, as the biases were small compared to clinical practice, and the two acquisitions were not done simultaneously. The experimental acquisition also enabled the study of deformation by simultaneous spectral velocity traces from all regions of the image sector.

Cardiac phase detection in echocardiography using convolutional neural networks

Echocardiography is a commonly used and cost-effective test to assess heart conditions. During the test, cardiologists and technicians observe two cardiac phases-end-systolic (ES) and end-diastolic (ED)-which are critical for calculating heart chamber size and ejection fraction. However, non-essential frames called Non-ESED frames may appear between these phases. Currently, technicians or cardiologists manually detect these phases, which is time-consuming and prone to errors. To address this, an automated and efficient technique is needed to accurately detect cardiac phases and minimize diagnostic errors. In this paper, we propose a deep learning model called DeepPhase to assist cardiology personnel. Our convolutional neural network (CNN) learns from echocardiography images to identify the ES, ED, and Non-ESED phases without the need for left ventricle segmentation or electrocardiograms. We evaluate our model on three echocardiography image datasets, including the CAMUS dataset, the EchoNet Dynamic dataset, and a new dataset we collected from a cardiac hospital (CardiacPhase). Our model outperforms existing techniques, achieving 0.96 and 0.82 area under the curve (AUC) on the CAMUS and CardiacPhase datasets, respectively. We also propose a novel cropping technique to enhance the model's performance and ensure its relevance to real-world scenarios for ES, ED, and Non ES-ED classification.

Real-time guiding by deep learning during echocardiography to reduce left ventricular foreshortening and measurement variability

Aims

Apical foreshortening leads to an underestimation of left ventricular (LV) volumes and an overestimation of LV ejection fraction and global longitudinal strain. Real-time guiding using deep learning (DL) during echocardiography to reduce foreshortening could improve standardization and reduce variability. We aimed to study the effect of real-time DL guiding during echocardiography on measures of LV foreshortening and inter-observer variability.

Methods and results

Patients (n = 88) in sinus rhythm referred for echocardiography without indication for contrast were included. All participants underwent three echocardiograms. The first two examinations were performed by sonographers, and the third by cardiologists. In Period 1, the sonographers were instructed to provide high-quality echocardiograms. In Period 2, the DL guiding was used by the second sonographer. One blinded expert measured LV length in all recordings. Tri-plane recordings by cardiologists were used as reference. Apical foreshortening was calculated at the end-diastole. Both sonographer groups significantly foreshortened the LV in Period 1 (mean foreshortening: Sonographer 1: 4 mm; Sonographer 2: 3 mm, both P < 0.001 vs. reference) and reduced foreshortening in Period 2 (2 and 0 mm, respectively. Period 1 vs. Period 2, P < 0.05). Sonographers using DL guiding did not foreshorten more than cardiologists (P ≥ 0.409). Real-time guiding did not improve intra-class correlation (ICC) [LV end-diastolic volume ICC, (95% confidence interval): DL guiding 0.87 (0.77-0.93) vs. no guiding 0.92 (0.88-0.95)].

Conclusion

Real-time guiding reduced foreshortening among experienced operators and has the potential to improve image standardization. Even though the effect on inter-operator variability was minimal among experienced users, real-time guiding may improve test-retest variability among less experienced users.

Clinical trial registration

ClinicalTrials.gov, Identifier: NCT04580095.

Inward Displacement: A Novel Method of Regional Left Ventricular Functional Assessment for Left Ventriculoplasty Interventions in Heart Failure with Reduced Ejection Fraction (HFrEF)

BACKGROUND

Hybrid minimally invasive left ventricular reconstruction is used to treat patients with ischemic heart failure with reduced ejection fraction (HFrEF) and antero-apical scar. Pre- and post-procedural regional functional left ventricular assessment with current imaging techniques remains limited. We evaluated 'inward displacement' as a novel technique of assessing regional left ventricular function in an ischemic HFrEF population who underwent left ventricular reconstruction with the Revivent System.

METHODS

Inward displacement adopts three standard long-axis views obtained during cardiac MRI or CT and assesses the degree of inward endocardial wall motion towards the true left ventricular center of contraction. For each of the standard 17 left ventricular segments, regional inward displacement is measured in mm and expressed as a percentage of the maximal theoretical distance each segment can contract towards the centerline. The left ventricle was divided into three regions, obtaining the arithmetic average of inward displacement or speckle tracking echocardiographic strain at the left ventricular base (segments 1-6), mid-cavity (segments 7-12) and apex (segments 13-17). Inward displacement was measured using computed tomography or cardiac magnetic resonance imaging and compared pre- and post-procedurally in ischemic HFrEF patients who underwent left ventricular reconstruction with the Revivent System (n = 36). In a subset of patients who underwent baseline speckle tracking echocardiography, pre-procedural inward displacement was compared with left ventricular regional echocardiographic strain (n = 15).

RESULTS

Inward displacement of basal and mid-cavity left ventricular segments increased by 27% (p < 0.001) and 37% (p < 0.001), respectively, following left ventricular reconstruction. A significant overall decrease in both the left ventricular end systolic volume index and end diastolic volume index of 31% (p < 0.001) and 26% (p < 0.001), respectively, was detected, along with a 20% increase in left ventricular ejection fraction (p = 0.005). A significant correlation between inward displacement and speckle tracking echocardiographic strain was noted within the basal (R = -0.77, p < 0.001) and mid-cavity left ventricular segments (R = -0.65, p = 0.004), respectively. Inward displacement resulted in relatively larger measurement values compared to speckle tracking echocardiography, with a mean difference of absolute values of -3.33 and -7.41 for the left ventricular base and mid-cavity, respectively.

CONCLUSIONS

Obviating the limitations of echocardiography, inward displacement was found to highly correlate with speckle tracking echocardiographic strain to evaluate regional segmental left ventricular function. Significant improvements in basal and mid-cavity left ventricular contractility were demonstrated in ischemic HFrEF patients following left ventricular reconstruction of large antero-apical scars, consistent with the concept of reverse left ventricular remodeling at a distance. Inward displacement holds significant promise in the HFrEF population being evaluated pre- and post-left ventriculoplasty procedures.

A graphical analysis of aspects contributing to the spreading of measurements of left ventricular function

The Simpson's method is the standard technique to determine left ventricular (LV) ejection fraction (EF) on echocardiography. The large inter-observer variability of measuring LVEF is well documented but not fully understood. A graphical analysis was used to elaborate what contributes to the inter-observer difference. Forty-two cardiologists (32 male, 39 ± 7 years) evaluated the LVEF using the Simpson's method on 15 different echocardiograms (2 and 4 chamber view (2CH/4CH)); the program did not show the result of EF to prevent a bias. End-diastolic (ED) and end-systolic (ES) frames were predefined ensuring measurement at the same time point of the cardiac cycles. After standardization of the LV contour, the differences of the individual contours compared to a reference contour were measured. Also, the spreading of lateral/medial mitral annulus contours and the apex were depicted. A significant spreading of LV-contours was seen with larger contours leading to higher EFs (p < 0.001). Experience did not influence the determination of LVEF. ED-volumes showed more spreading than ES-volumes ((3.6 mm (IQR: 2.6-4.0) vs. 3.4 mm (IQR: 2.8-3.8), p < 0.001). Also, the differences were larger for the 2CH compared to the 4CH (p < 0.001). Variability was significantly larger for lateral than septal wall (p < 0.001) as well as the anterior compared to the inferior wall (p < 0.001). There was a relevant scattering of the apex and medial/ lateral mitral annulus ring. There was a large variability of LV-volumes and LVEF as well as position of mitral valve ring and apex. There were global differences (apical 2CH or 4CH), regional aspects (LV walls) and temporal factors (ED vs. ES). Thus, multiple factors contributed to the large variability.Trial registration: The study was registered at "Netherlands Trial Register" ( www.trialregister.nl ; study number: NL5131).

Assisted probe guidance in cardiac ultrasound: A review

Echocardiography is the most frequently used imaging modality in cardiology. However, its acquisition is affected by inter-observer variability and largely dependent on the operator's experience. In this context, artificial intelligence techniques could reduce these variabilities and provide a user independent system. In recent years, machine learning (ML) algorithms have been used in echocardiography to automate echocardiographic acquisition. This review focuses on the state-of-the-art studies that use ML to automate tasks regarding the acquisition of echocardiograms, including quality assessment (QA), recognition of cardiac views and assisted probe guidance during the scanning process. The results indicate that performance of automated acquisition was overall good, but most studies lack variability in their datasets. From our comprehensive review, we believe automated acquisition has the potential not only to improve accuracy of diagnosis, but also help novice operators build expertise and facilitate point of care healthcare in medically underserved areas.

Real-Time Echocardiography Guidance for Optimized Apical Standard Views

Measurements of cardiac function such as left ventricular ejection fraction and myocardial strain are typically based on 2-D ultrasound imaging. The reliability of these measurements depends on the correct pose of the transducer such that the 2-D imaging plane properly aligns with the heart for standard measurement views and is thus dependent on the operator's skills. We propose a deep learning tool that suggests transducer movements to help users navigate toward the required standard views while scanning. The tool can simplify echocardiography for less experienced users and improve image standardization for more experienced users. Training data were generated by slicing 3-D ultrasound volumes, which permits simulation of the movements of a 2-D transducer. Neural networks were further trained to calculate the transducer position in a regression fashion. The method was validated and tested on 2-D images from several data sets representative of a prospective clinical setting. The method proposed the adequate transducer movement 75% of the time when averaging over all degrees of freedom and 95% of the time when considering transducer rotation solely. Real-time application examples illustrate the direct relation between the transducer movements, the ultrasound image and the provided feedback.

Automatic view classification of contrast and non-contrast echocardiography

Background

Contrast and non-contrast echocardiography are crucial for cardiovascular diagnoses and treatments. Correct view classification is a foundational step for the analysis of cardiac structure and function. View classification from all sequences of a patient is laborious and depends heavily on the sonographer's experience. In addition, the intra-view variability and the inter-view similarity increase the difficulty in identifying critical views in contrast and non-contrast echocardiography. This study aims to develop a deep residual convolutional neural network (CNN) to automatically identify multiple views of contrast and non-contrast echocardiography, including parasternal left ventricular short axis, apical two, three, and four-chamber views.

Methods

The study retrospectively analyzed a cohort of 855 patients who had undergone left ventricular opacification at the Department of Ultrasound Medicine, Wuhan Union Medical College Hospital from 2013 to 2021, including 70.3% men and 29.7% women aged from 41 to 62 (median age, 53). All datasets were preprocessed to remove sensitive information and 10 frames with equivalent intervals were sampled from each of the original videos. The number of frames in the training, validation, and test datasets were, respectively, 19,370, 2,370, and 2,620 from 9 views, corresponding to 688, 84, and 83 patients. We presented the CNN model to classify echocardiographic views with an initial learning rate of 0.001, and a batch size of 4 for 30 epochs. The learning rate was decayed by a factor of 0.9 per epoch.

Results

On the test dataset, the overall classification accuracy is 99.1 and 99.5% for contrast and non-contrast echocardiographic views. The average precision, recall, specificity, and F1 score are 96.9, 96.9, 100, and 96.9% for the 9 echocardiographic views.

Conclusions

This study highlights the potential of CNN in the view classification of echocardiograms with and without contrast. It shows promise in improving the workflow of clinical analysis of echocardiography.

Real-time echocardiography image analysis and quantification of cardiac indices

Deep learning has a huge potential to transform echocardiography in clinical practice and point of care ultrasound testing by providing real-time analysis of cardiac structure and function. Automated echocardiography analysis is benefited through use of machine learning for tasks such as image quality assessment, view classification, cardiac region segmentation, and quantification of diagnostic indices. By taking advantage of high-performing deep neural networks, we propose a novel and eicient real-time system for echocardiography analysis and quantification. Our system uses a self-supervised modality-specific representation trained using a publicly available large-scale dataset. The trained representation is used to enhance the learning of target echo tasks with relatively small datasets. We also present a novel Trilateral Attention Network (TaNet) for real-time cardiac region segmentation. The proposed network uses a module for region localization and three lightweight pathways for encoding rich low-level, textural, and high-level features. Feature embeddings from these individual pathways are then aggregated for cardiac region segmentation. This network is fine-tuned using a joint loss function and training strategy. We extensively evaluate the proposed system and its components, which are echo view retrieval, cardiac segmentation, and quantification, using four echocardiography datasets. Our experimental results show a consistent improvement in the performance of echocardiography analysis tasks with enhanced computational eiciency that charts a path toward its adoption in clinical practice. Specifically, our results show superior real-time performance in retrieving good quality echo from individual cardiac view, segmenting cardiac chambers with complex overlaps, and extracting cardiac indices that highly agree with the experts' values. The source code of our implementation can be found in the project's GitHub page.

Explicit and automatic ejection fraction assessment on 2D cardiac ultrasound with a deep learning-based approach

BACKGROUND

Ejection fraction (EF) is a key parameter for assessing cardiovascular functions in cardiac ultrasound, but its manual assessment is time-consuming and subject to high inter and intra-observer variability. Deep learning-based methods have the potential to perform accurate fully automatic EF predictions but suffer from a lack of explainability and interpretability. This study proposes a fully automatic method to reliably and explicitly evaluate the biplane left ventricular EF on 2D echocardiography following the recommended modified Simpson's rule.

METHODS

A deep learning model was trained on apical 4 and 2-chamber echocardiography to segment the left ventricle and locate the mitral valve. Predicted segmentations are then validated with a statistical shape model, which detects potential failures that could impact the EF evaluation. Finally, the end-diastolic and end-systolic frames are identified based on the remaining LV segmentations' areas and EF is estimated on all available cardiac cycles.

RESULTS

Our approach was trained on a dataset of 783 patients. Its performances were evaluated on an internal and external dataset of respectively 200 and 450 patients. On the internal dataset, EF assessment achieved a mean absolute error of 6.10% and a bias of 1.56 ± 7.58% using multiple cardiac cycles. The approach evaluated EF with a mean absolute error of 5.39% and a bias of -0.74 ± 7.12% on the external dataset.

CONCLUSION

Following the recommended guidelines, we proposed an end-to-end fully automatic approach that achieves state-of-the-art performance in biplane EF evaluation while giving explicit details to clinicians.

Using deep learning method to identify left ventricular hypertrophy on echocardiography

BACKGROUND

Left ventricular hypertrophy (LVH) is an independent prognostic factor for cardiovascular events and it can be detected by echocardiography in the early stage. In this study, we aim to develop a semi-automatic diagnostic network based on deep learning algorithms to detect LVH.

METHODS

We retrospectively collected 1610 transthoracic echocardiograms, included 724 patients [189 hypertensive heart disease (HHD), 218 hypertrophic cardiomyopathy (HCM), and 58 cardiac amyloidosis (CA), along with 259 controls]. The diagnosis of LVH was defined by two experienced clinicians. For the deep learning architecture, we introduced ResNet and U-net++ to complete classification and segmentation tasks respectively. The models were trained and validated independently. Then, we connected the best-performing models to form the final framework and tested its capabilities.

RESULTS

In terms of individual networks, the view classification model produced AUC = 1.0. The AUC of the LVH detection model was 0.98 (95% CI 0.94-0.99), with corresponding sensitivity and specificity of 94.0% (95% CI 85.3-98.7%) and 91.6% (95% CI 84.6-96.1%) respectively. For etiology identification, the independent model yielded good results with AUC = 0.90 (95% CI 0.82-0.95) for HCM, AUC = 0.94 (95% CI 0.88-0.98) for CA, and AUC = 0.88 (95% CI 0.80-0.93) for HHD. Finally, our final integrated framework automatically classified four conditions (Normal, HCM, CA, and HHD), which achieved an average of AUC 0.91, with an average sensitivity and specificity of 83.7% and 90.0%.

CONCLUSION

Deep learning architecture has the ability to detect LVH and even distinguish the latent etiology of LVH.

Automatic morphological classification of mitral valve diseases in echocardiographic images based on explainable deep learning methods

PURPOSE

Carpentier's functional classification is a guide to explain the types of mitral valve regurgitation based on morphological features. There are four types of pathological morphologies, regardless of the presence or absence of mitral regurgitation: Type I, normal; Type II, mitral valve prolapse; Type IIIa, mitral valve stenosis; and Type IIIb, restricted mitral leaflet motion. The aim of this study was to automatically classify mitral valves using echocardiographic images.

METHODS

In our procedure, after the classification of apical 4-chamber (A4C) and parasternal long-axis (PLA) views, we extracted the systolic/diastolic phase of the cardiac cycle by calculating the left ventricular area. Six typical pre-trained models were fine-tuned with a 4-class model for the PLA and a 3-class model for the A4C views. As an additional contribution, to provide explainability, we applied the Gradient-weighted Class Activation Mapping (Grad-CAM) algorithm to visualize areas of echocardiographic images where the different models generated a prediction.

RESULTS

This approach conferred a proper understanding of where various networks "look" into echocardiographic images to predict the four types of pathological mitral valve morphologies. Considering the accuracy metric and Grad-CAM maps and by applying the Inception-ResNet-v2 architecture to classify Type II in the PLA view and ResNeXt50 architecture to classify the other three classes in the A4C view, we achieved an 80% rate of model accuracy in the test data set.

CONCLUSIONS

We suggest an explainable, fully automated, and rule-based procedure to classify the four types of mitral valve morphologies based on Carpentier's functional classification using deep learning on transthoracic echocardiographic images. Our study results infer the feasibility of the use of deep learning models to prepare quick and precise assessments of mitral valve morphologies in echocardiograms. According to our knowledge, our study is the first one that provides a public data set regarding the Carpentier classification of MV pathologies.

A machine learning framework for the evaluation of myocardial rotation in patients with noncompaction cardiomyopathy

Aims

Noncompaction cardiomyopathy (NCC) is considered a genetic cardiomyopathy with unknown pathophysiological mechanisms. We propose to evaluate echocardiographic predictors for rigid body rotation (RBR) in NCC using a machine learning (ML) based model.

Methods and results

Forty-nine outpatients with NCC diagnosis by echocardiography and magnetic resonance imaging (21 men, 42.8±14.8 years) were included. A comprehensive echocardiogram was performed. The layer-specific strain was analyzed from the apical two-, three, four-chamber views, short axis, and focused right ventricle views using 2D echocardiography (2DE) software. RBR was present in 44.9% of patients, and this group presented increased LV mass indexed (118±43.4 vs. 94.1±27.1g/m², P = 0.034), LV end-diastolic and end-systolic volumes (P< 0.001), E/e’ (12.2±8.68 vs. 7.69±3.13, P = 0.034), and decreased LV ejection fraction (40.7±8.71 vs. 58.9±8.76%, P < 0.001) when compared to patients without RBR. Also, patients with RBR presented a significant decrease of global longitudinal, radial, and circumferential strain. When ML model based on a random forest algorithm and a neural network model was applied, it found that twist, NC/C, torsion, LV ejection fraction, and diastolic dysfunction are the strongest predictors to RBR with accuracy, sensitivity, specificity, area under the curve of 0.93, 0.99, 0.80, and 0.88, respectively.

Conclusion

In this study, a random forest algorithm was capable of selecting the best echocardiographic predictors to RBR pattern in NCC patients, which was consistent with worse systolic, diastolic, and myocardium deformation indices. Prospective studies are warranted to evaluate the role of this tool for NCC risk stratification.

Artificial intelligence applied to support medical decisions for the automatic analysis of echocardiogram images: A systematic review

The echocardiogram is a test that is widely used in Heart Disease Diagnoses. However, its analysis is largely dependent on the physician's experience. In this regard, artificial intelligence has become an essential technology to assist physicians. This study is a Systematic Literature Review (SLR) of primary state-of-the-art studies that used Artificial Intelligence (AI) techniques to automate echocardiogram analyses. Searches on the leading scientific article indexing platforms using a search string returned approximately 1400 articles. After applying the inclusion and exclusion criteria, 118 articles were selected to compose the detailed SLR. This SLR presents a thorough investigation of AI applied to support medical decisions for the main types of echocardiogram (Transthoracic, Transesophageal, Doppler, Stress, and Fetal). The article's data extraction indicated that the primary research interest of the studies comprised four groups: 1) Improvement of image quality; 2) identification of the cardiac window vision plane; 3) quantification and analysis of cardiac functions, and; 4) detection and classification of cardiac diseases. The articles were categorized and grouped to show the main contributions of the literature to each type of ECHO. The results indicate that the Deep Learning (DL) methods presented the best results for the detection and segmentation of the heart walls, right and left atrium and ventricles, and classification of heart diseases using images/videos obtained by echocardiography. The models that used Convolutional Neural Network (CNN) and its variations showed the best results for all groups. The evidence produced by the results presented in the tabulation of the studies indicates that the DL contributed significantly to advances in echocardiogram automated analysis processes. Although several solutions were presented regarding the automated analysis of ECHO, this area of research still has great potential for further studies to improve the accuracy of results already known in the literature.

Artificial intelligence-enhanced echocardiography in the emergency department

A focused cardiac ultrasound performed by an emergency physician is becoming part of the standard assessment of patients in a variety of clinical situations. The development of inexpensive, portable handheld devices promises to make point-of-care ultrasound even more accessible over the coming decades. Many of these handheld devices are beginning to integrate artificial intelligence (AI) for image analysis. The integration of AI into focused cardiac ultrasound will have a number of implications for emergency physicians. This perspective presents an overview of the current state of AI research in echocardiography relevant to the emergency physician, as well as the future possibilities, challenges and risks of this technology.

Deep learning-based automated left ventricular ejection fraction assessment using 2-D echocardiography

Deep learning (DL) has been applied for automatic left ventricle (LV) ejection fraction (EF) measurement, but the diagnostic performance was rarely evaluated for various phenotypes of heart disease. This study aims to evaluate a new DL algorithm for automated LVEF measurement using two-dimensional echocardiography (2DE) images collected from three centers. The impact of three ultrasound machines and three phenotypes of heart diseases on the automatic LVEF measurement was evaluated. Using 36890 frames of 2DE from 340 patients, we developed a DL algorithm based on U-Net (DPS-Net) and the biplane Simpson's method was applied for LVEF calculation. Results showed a high performance in LV segmentation and LVEF measurement across phenotypes and echo systems by using DPS-Net. Good performance was obtained for LV segmentation when DPS-Net was tested on the CAMUS data set (Dice coefficient of 0.932 and 0.928 for ED and ES). Better performance of LV segmentation in study-wise evaluation was observed by comparing the DPS-Net v2 to the EchoNet-dynamic algorithm (P = 0.008). DPS-Net was associated with high correlations and good agreements for the LVEF measurement. High diagnostic performance was obtained that the area under receiver operator characteristic curve was 0.974, 0.948, 0.968, and 0.972 for normal hearts and disease phenotypes including atrial fibrillation, hypertrophic cardiomyopathy, dilated cardiomyopathy, respectively. High performance was obtained by using DPS-Net in LV detection and LVEF measurement for heart failure with several phenotypes. High performance was observed in a large-scale dataset, suggesting that the DPS-Net was highly adaptive across different echocardiographic systems.NEW & NOTEWORTHY A new strategy of feature extraction and fusion could enhance the accuracy of automatic LVEF assessment based on multiview 2-D echocardiographic sequences. High diagnostic performance for the determination of heart failure was obtained by using DPS-Net in cases with different phenotypes of heart diseases. High performance for left ventricle segmentation was obtained by using DPS-Net, suggesting the potential for a wider range of application in the interpretation of 2DE images.

Myocardial Function Imaging in Echocardiography Using Deep Learning

Deformation imaging in echocardiography has been shown to have better diagnostic and prognostic value than conventional anatomical measures such as ejection fraction. However, despite clinical availability and demonstrated efficacy, everyday clinical use remains limited at many hospitals. The reasons are complex, but practical robustness has been questioned, and a large inter-vendor variability has been demonstrated. In this work, we propose a novel deep learning based framework for motion estimation in echocardiography, and use this to fully automate myocardial function imaging. A motion estimator was developed based on a PWC-Net architecture, which achieved an average end point error of (0.06±0.04) mm per frame using simulated data from an open access database, on par or better compared to previously reported state of the art. We further demonstrate unique adaptability to image artifacts such as signal dropouts, made possible using trained models that incorporate relevant image augmentations. Further, a fully automatic pipeline consisting of cardiac view classification, event detection, myocardial segmentation and motion estimation was developed and used to estimate left ventricular longitudinal strain in vivo. The method showed promise by achieving a mean deviation of (-0.7±1.6)% compared to a semi-automatic commercial solution for N=30 patients with relevant disease, within the expected limits of agreement. We thus believe that learning-based motion estimation can facilitate extended use of strain imaging in clinical practice.

A deep learning approach for the automatic recognition of prosthetic mitral valve in echocardiographic images

The first step in the automatic evaluation of the cardiac prosthetic valve is the recognition of such valves in echocardiographic images. This research surveyed whether a deep convolutional neural network (DCNN) could improve the recognition of prosthetic mitral valve in conventional 2D echocardiographic images. An efficient intervention to decrease the misreading rate of the prosthetic mitral valve is required for non-expert cardiologists. This intervention could serve as a section of a fully-automated analysis chain, alleviate the cardiologist's workload, and improve precision and time management, especially in an emergent situation. Additionally, it might be suitable for pre-labeling large databases of unclassified images. We, therefore, introduce a large publicly-available annotated dataset for the purpose of prosthetic mitral valve recognition. We utilized 2044 comprehensive non-stress transthoracic echocardiographic studies. Totally, 1597 patients had natural mitral valves and 447 patients had prosthetic valves. Each case contained 1 cycle of echocardiographic images from the apical 4-chamber (A4C) and the parasternal long-axis (PLA) views. Thirteen versions of the state-of-the-art models were independently trained, and the ensemble predictions were performed using those versions. For the recognition of prosthetic mitral valves from natural mitral valves, the area under the receiver-operating characteristic curve (AUC) made by the deep learning algorithm was similar to that made by cardiologists (0.99). In this research, EfficientNetB3 architecture in the A4C view and the EfficientNetB4 architecture in the PLA view were the best models among the other pre-trained DCNN models.

LU-Net: A Multistage Attention Network to Improve the Robustness of Segmentation of Left Ventricular Structures in 2-D Echocardiography

Segmentation of cardiac structures is one of the fundamental steps to estimate volumetric indices of the heart. This step is still performed semiautomatically in clinical routine and is, thus, prone to interobserver and intraobserver variabilities. Recent studies have shown that deep learning has the potential to perform fully automatic segmentation. However, the current best solutions still suffer from a lack of robustness in terms of accuracy and number of outliers. The goal of this work is to introduce a novel network designed to improve the overall segmentation accuracy of left ventricular structures (endocardial and epicardial borders) while enhancing the estimation of the corresponding clinical indices and reducing the number of outliers. This network is based on a multistage framework where both the localization and segmentation steps are optimized jointly through an end-to-end scheme. Results obtained on a large open access data set show that our method outperforms the current best-performing deep learning solution with a lighter architecture and achieved an overall segmentation accuracy lower than the intraobserver variability for the epicardial border (i.e., on average a mean absolute error of 1.5 mm and a Hausdorff distance of 5.1mm) with 11% of outliers. Moreover, we demonstrate that our method can closely reproduce the expert analysis for the end-diastolic and end-systolic left ventricular volumes, with a mean correlation of 0.96 and a mean absolute error of 7.6 ml. Concerning the ejection fraction of the left ventricle, results are more contrasted with a mean correlation coefficient of 0.83 and an absolute mean error of 5.0%, producing scores that are slightly below the intraobserver margin. Based on this observation, areas for improvement are suggested.

Technology trends and applications of deep learning in ultrasonography: image quality enhancement, diagnostic support, and improving workflow efficiency

In this review of the most recent applications of deep learning to ultrasound imaging, the architectures of deep learning networks are briefly explained for the medical imaging applications of classification, detection, segmentation, and generation. Ultrasonography applications for image processing and diagnosis are then reviewed and summarized, along with some representative imaging studies of the breast, thyroid, heart, kidney, liver, and fetal head. Efforts towards workflow enhancement are also reviewed, with an emphasis on view recognition, scanning guide, image quality assessment, and quantification and measurement. Finally some future prospects are presented regarding image quality enhancement, diagnostic support, and improvements in workflow efficiency, along with remarks on hurdles, benefits, and necessary collaborations.