Robust Optical Flow Estimation in Cardiac Ultrasound Images Using a Sparse Representation

A deep learning phase-based solution in 2D echocardiography motion estimation

In this paper, we propose a new deep learning method based on Quaternion Wavelet Transform (QWT) phases of 2D echocardiographic sequences to estimate the motion and strain of myocardium. The proposed method considers intensity and phases gained from QWT as the inputs of customized PWC-Net structure, a high-performance deep network in motion estimation. We have trained and tested our proposed method performance using two realistic simulated B-mode echocardiographic sequences. We have evaluated our proposed method in terms of both geometrical and clinical indices. Our method achieved an average endpoint error of 0.06 mm per frame and 0.59 mm between End Diastole and End Systole on a simulated dataset. Correlation analysis between ground truth and the computed strain shows a correlation coefficient of 0.89, much better than the most efficient methods in the state-of-the-art 2D echocardiography motion estimation. The results show the superiority of our proposed method in both geometrical and clinical indices.

Coordinate-Independent 3-D Ultrasound Principal Stretch and Direction Imaging

OBJECTIVE

In clinical ultrasound, current 2-D strain imaging faces challenges in quantifying three orthogonal normal strain components. This requires separate image acquisitions based on the pixel-dependent cardiac coordinate system, leading to additional computations and estimation discrepancies due to probe orientation. Most systems lack shear strain information, as displaying all components is challenging to interpret.

METHODS

This paper presents a 3-D high-spatial-resolution, coordinate-independent strain imaging approach based on principal stretch and axis estimation. All strain components are transformed into three principal stretches along three normal principal axes, enabling direct visualization of the primary deformation. We devised an efficient 3-D speckle tracking method with tilt filtering, incorporating randomized searching in a two-pass tracking framework and rotating the phase of the 3-D correlation function for robust filtering. The proposed speckle tracking approach significantly improves estimates of displacement gradients related to the axial displacement component. Non-axial displacement gradient estimates are enhanced using a correlation-weighted least-squares method constrained by tissue incompressibility.

RESULTS

Simulated and in vivo canine cardiac datasets were evaluated to estimate Lagrangian strains from end-diastole to end-systole. The proposed speckle tracking method improves displacement estimation by a factor of 4.3 to 10.5 over conventional 1-pass processing. Maximum principal axis/direction imaging enables better detection of local disease regions than conventional strain imaging.

CONCLUSION

Coordinate-independent tracking can identify myocardial abnormalities with high accuracy.

SIGNIFICANCE

This study offers enhanced accuracy and robustness in strain imaging compared to current methods.

BEAS-Net: A Shape-Prior-Based Deep Convolutional Neural Network for Robust Left Ventricular Segmentation in 2-D Echocardiography

Left ventricle (LV) segmentation of 2-D echocardiography images is an essential step in the analysis of cardiac morphology and function and-more generally-diagnosis of cardiovascular diseases (CVD). Several deep learning (DL) algorithms have recently been proposed for the automatic segmentation of the LV, showing significant performance improvement over the traditional segmentation algorithms. However, unlike the traditional methods, prior information about the segmentation problem, e.g., anatomical shape information, is not usually incorporated for training the DL algorithms. This can degrade the generalization performance of the DL models on unseen images if their characteristics are somewhat different from those of the training images, e.g., low-quality testing images. In this study, a new shape-constrained deep convolutional neural network (CNN)-called B-spline explicit active surface (BEAS)-Net-is introduced for automatic LV segmentation. The BEAS-Net learns how to associate the image features, encoded by its convolutional layers, with anatomical shape-prior information derived by the BEAS algorithm to generate physiologically meaningful segmentation contours when dealing with artifactual or low-quality images. The performance of the proposed network was evaluated using three different in vivo datasets and was compared with a deep segmentation algorithm based on the U-Net model. Both the networks yielded comparable results when tested on images of acceptable quality, but the BEAS-Net outperformed the benchmark DL model on artifactual and low-quality images.

Enhancing reginal wall abnormality detection accuracy: Integrating machine learning, optical flow algorithms, and temporal convolutional networks in multi-view echocardiography

BACKGROUND

Regional Wall Motion Abnormality (RWMA) serves as an early indicator of myocardial infarction (MI), the global leader in mortality. Accurate and early detection of RWMA is vital for the successful treatment of MI. Current automated echocardiography analyses typically concentrate on peak values from left ventricular (LV) displacement curves, based on LV contour annotations or key frames during the heart's systolic or diastolic phases within a single echocardiographic cycle. This approach may overlook the rich motion field features available in multi-cycle cardiac data, which could enhance RWMA detection.

METHODS

In this research, we put forward an innovative approach to detect RWMA by harnessing motion information across multiple echocardiographic cycles and multi-views. Our methodology synergizes U-Net-based segmentation with optical flow algorithms for detailed cardiac structure delineation, and Temporal Convolutional Networks (ConvNet) to extract nuanced motion features. We utilize a variety of machine learning and deep learning classifiers on both A2C and A4C views echocardiograms to enhance detection accuracy. A three-phase algorithm-originating from the HMC-QU dataset-incorporates U-Net for segmentation, followed by optical flow for cardiac wall motion field features. Temporal ConvNet, inspired by the Temporal Segment Network (TSN), is then applied to interpret these motion field features, independent of traditional cardiac parameter curves or specific key phase frame inputs.

RESULTS

Employing five-fold cross-validation, our SVM classifier demonstrated high performance, with a sensitivity of 93.13%, specificity of 83.61%, precision of 88.52%, and an F1 score of 90.39%. When compared with other studies using the HMC-QU datasets, these Fig s stand out, underlining our method's effectiveness. The classifier also attained an overall accuracy of 89.25% and Area Under the Curve (AUC) of 95%, reinforcing its potential for reliable RWMA detection in echocardiographic analysis.

CONCLUSIONS

This research not only demonstrates a novel technique but also contributes a more comprehensive and precise tool for early myocardial infarction diagnosis.

Automatic Myotendinous Junction Identification in Ultrasound Images Based on Junction-Based Template Measurements

Tracking the myotendinous junction (MTJ) motion in consecutive ultrasound images is essential to assess muscle and tendon interaction and understand the mechanics' muscle-tendon unit and its pathological conditions during motion. However, the inherent speckle noises and ambiguous boundaries deter the reliable identification of MTJ, thus restricting their usage in human motion analysis. This study advances a fully automatic displacement measurement method for MTJ using prior shape knowledge on the Y-shape MTJ, precluding the influence of irregular and complicated hyperechoic structures in muscular ultrasound images. Our proposed method first adopts the junction candidate points using a combined measure of Hessian matrix and phase congruency, followed by a hierarchical clustering technique to refine the candidates approximating the position of the MTJ. Then, based on the prior knowledge of Y-shape MTJ, we finally identify the best matching junction points according to intensity distributions and directions of their branches using multiscale Gaussian templates and a Kalman filter. We evaluated our proposed method using the ultrasound scans of the gastrocnemius from 8 young, healthy volunteers. Our results present more consistent with the manual method in the MTJ tracking method than existing optical flow tracking methods, suggesting its potential in facilitating muscle and tendon function examinations with in vivo ultrasound imaging.

Hadamard-Encoded Synthetic Transmit Aperture Imaging for Improved Lateral Motion Estimation in Ultrasound Elastography

Lateral motion estimation has been a challenge in ultrasound elastography mainly due to the low resolution, low sampling frequency, and lack of phase information in the lateral direction. Synthetic transmit aperture (STA) can achieve high resolution due to two-way focusing and can beamform high-density image lines for improved lateral motion estimation with the disadvantages of low signal-to-noise ratio (SNR) and limited penetration depth. In this study, Hadamard-encoded STA (Hadamard-STA) is proposed for the improvement of lateral motion estimation in elastography, and it is compared with STA and conventional focused wave (CFW) imaging. Simulations, phantom, and in vivo experiments were conducted to make the comparison. The normalized root mean square error (NRMSE) and the contrast-to-noise ratio (CNR) were calculated as the evaluation criteria in the simulations. The results show that, at a noise level of -10 dB and an applied strain of -1% (compression), Hadamard-STA decreases the NRMSEs of lateral displacements by 46.92% and 35.35%, decreases the NRMSEs of lateral strains by 52.34% and 39.75%, and increases the CNRs by 9.70 and 9.75 dB compared with STA and CFW, respectively. In the phantom experiments performed on a heterogeneous tissue-mimicking phantom, the sum of squared differences (SSD) between the reference and the motion-compensated RF data, and the CNR were calculated as the evaluation criteria. At an applied strain of -1.80%, Hadamard-STA is found to decrease the SSDs by 20.91% and 30.99% and increase the CNRs by 14.15 and 24.66 dB compared with STA and CFW, respectively. In the experiments performed on a breast phantom, Hadamard-STA achieves better visualization of the breast inclusion with a clearer boundary between the inclusion and the background than STA and CFW. The in vivo experiments were performed on a patient with a breast tumor, and the tumor could also be better visualized with a more homogeneous background in the strain image obtained by Hadamard-STA than by STA and CFW. These results demonstrate that Hadamard-STA achieves a substantial improvement in lateral motion estimation and maybe a competitive method for quasi-static elastography.

Dynamic Myocardial Ultrasound Localization Angiography

Dynamic Myocardial Ultrasound Localization Angiography (MULA) is an ultrasound-based imaging modality destined to enhance the diagnosis and treatment monitoring of coronary pathologies. Current diagnosis methods of coronary artery disease focus on the observation of vessel narrowing in the coronary vasculature to assess the organ's condition. However, we would strongly benefit from mapping and measuring flow from intramyocardial arterioles and capillaries as they are the direct vehicle of the myocardium blood income. With the advent of ultrafast ultrasound scanners, imaging modalities based on the localization and tracking of injected microbubbles allow for the subwavelength resolution imaging of an organ's vasculature. Yet, the application of these vascular imaging modalities relies on an accumulation of cine loops of a region of interest undergoing no or minimal tissue motion. This work introduces the MULA framework that combines 1) the mapping of the dynamics of the microvascular flow using an ultrasound sequence triggered by the electrocardiogram with a 2) novel Lagrangian beamformer based on non-rigid motion registration algorithm to form images directly in the myocardium's material coordinates and thus correcting for the large myocardial motion and deformation. Specifically, we show that this framework enables the non-invasive imaging of the angioarchitecture and dynamics of intramyocardial flow in vessels as small as a few tens of microns in the rat's beating heart in vivo.

Parameterized Strain Estimation for Vascular Ultrasound Elastography With Sparse Representation

Ultrasound vascular strain imaging has shown its potential to interrogate the motion of the vessel wall induced by the cardiac pulsation for predicting plaque instability. In this study, a sparse model strain estimator (SMSE) is proposed to reconstruct a dense strain field at a high resolution, with no spatial derivatives, and a high computation efficiency. This sparse model utilizes the highly-compacted property of discrete cosine transform (DCT) coefficients, thereby allowing to parameterize displacement and strain fields with truncated DCT coefficients. The derivation of affine strain components (axial and lateral strains and shears) was reformulated into solving truncated DCT coefficients and then reconstructed with them. Moreover, an analytical solution was derived to reduce estimation time. With simulations, the SMSE reduced estimation errors by up to 50% compared with the state-of-the-art window-based Lagrangian speckle model estimator (LSME). The SMSE was also proven to be more robust than the LSME against global and local noise. For in vitro and in vivo tests, residual strains assessing cumulated errors with the SMSE were 2 to 3 times lower than with the LSME. Regarding computation efficiency, the processing time of the SMSE was reduced by 4 to 25 times compared with the LSME, according to simulations, in vitro and in vivo results. Finally, phantom studies demonstrated the enhanced spatial resolution of the proposed SMSE algorithm against LSME.

Stepwise local stitching ultrasound image algorithms based on adaptive iterative threshold Harris corner features

Herein, a Harris corner detection algorithm is proposed based on the concepts of iterated threshold segmentation and adaptive iterative threshold (AIT-Harris), and a stepwise local stitching algorithm is used to obtain wide-field ultrasound (US) images.Cone-beam computer tomography (CBCT) and US images from 9 cervical cancer patients and 1 prostate cancer patient were examined. In the experiment, corner features were extracted based on the AIT-Harris, Harris, and Morave algorithms. Accordingly, wide-field ultrasonic images were obtained based on the extracted features after local stitching, and the corner matching rates of all tested algorithms were compared. The accuracies of the drawn contours of organs at risk (OARs) were compared based on the stitched ultrasonic images and CBCT.The corner matching rate of the Morave algorithm was compared with those obtained by the Harris and AIT-Harris algorithms, and paired sample t tests were conducted (t = 6.142, t = 31.859, P < .05). The results showed that the differences were statistically significant. The average Dice similarity coefficient between the automatically delineated bladder region based on wide-field US images and the manually delineated bladder region based on ground truth CBCT images was 0.924, and the average Jaccard coefficient was 0.894.The proposed algorithm improved the accuracy of corner detection, and the stitched wide-field US image could modify the delineation range of OARs in the pelvic cavity.

Hierarchical Motion Estimation With Bayesian Regularization in Cardiac Elastography: Simulation and In Vivo Validation

Cardiac elastography (CE) is an ultrasound-based technique utilizing radio-frequency (RF) signals for assessing global and regional myocardial function. In this work, a complete strain estimation pipeline for incorporating a Bayesian regularization-based hierarchical block-matching algorithm, with Lagrangian motion description and myocardial polar strain estimation is presented. The proposed regularization approach is validated using finite-element analysis (FEA) simulations of a canine cardiac deformation model that is incorporated into an ultrasound simulation program. Interframe displacements are initially estimated using a hierarchical motion estimation framework. Incremental displacements are then accumulated under a Lagrangian description of cardiac motion from end-diastole (ED) to end-systole (ES). In-plane Lagrangian finite strain tensors are then derived from the accumulated displacements. Cartesian to cardiac coordinate transformation is utilized to calculate radial and longitudinal strains for ease of interpretation. Benefits of regularization are demonstrated by comparing the same hierarchical block-matching algorithm with and without regularization. Application of Bayesian regularization in the canine FEA model provided improved ES radial and longitudinal strain estimation with statistically significant ( ) error reduction of 48.88% and 50.16%, respectively. Bayesian regularization also improved the quality of temporal radial and longitudinal strain curves with error reductions of 78.38% and 86.67% ( ), respectively. Qualitative and quantitative improvements were also visualized for in vivo results on a healthy murine model after Bayesian regularization. Radial strain elastographic signal-to-noise ratio (SNR_e) increased from 3.83 to 4.76 dB, while longitudinal strain SNR_e increased from 2.29 to 4.58 dB with regularization.