Evaluation of Indirect Methods for Motion Compensation in 2-D Focal Liver Lesion Contrast-Enhanced Ultrasound (CEUS) Imaging

A Comprehensive Motion Compensation Method for In-Plane and Out-of-Plane Motion in Dynamic Contrast-Enhanced Ultrasound of Focal Liver Lesions

Contrast-enhanced ultrasound (CEUS) acquisitions of focal liver lesions are affected by motion, which has an impact on contrast signal quantification. We therefore developed and tested, in a large patient cohort, a motion compensation algorithm called the Iterative Local Search Algorithm (ILSA), which can correct for both periodic and non-periodic in-plane motion and can reject frames with out-of-plane motion. CEUS cines of 183 focal liver lesions in 155 patients from three hospitals were used to develop and test ILSA. Performance was evaluated through quantitative metrics, including the root mean square error and R2 in fitting time-intensity curves and standard deviation value of B-mode intensities, computed across cine frames), and qualitative evaluation, including B-mode mean intensity projection images and parametric perfusion imaging. The median root mean square error significantly decreased from 0.032 to 0.024 (p < 0.001). Median R2 significantly increased from 0.88 to 0.93 (p < 0.001). The median standard deviation value of B-mode intensities significantly decreased from 6.2 to 5.0 (p < 0.001). B-Mode mean intensity projection images revealed improved spatial resolution. Parametric perfusion imaging also exhibited improved spatial detail and better differentiation between lesion and background liver parenchyma. ILSA can compensate for all types of motion encountered during liver CEUS, potentially improving contrast signal quantification of focal liver lesions.

Interpretable Machine Learning for Characterization of Focal Liver Lesions by Contrast-Enhanced Ultrasound

This work proposes an interpretable radiomics approach to differentiate between malignant and benign focal liver lesions (FLLs) on contrast-enhanced ultrasound (CEUS). Although CEUS has shown promise for differential FLLs diagnosis, current clinical assessment is performed only by qualitative analysis of the contrast enhancement patterns. Quantitative analysis is often hampered by the unavoidable presence of motion artifacts and by the complex, spatiotemporal nature of liver contrast enhancement, consisting of multiple, overlapping vascular phases. To fully exploit the wealth of information in CEUS, while coping with these challenges, here we propose combining features extracted by the temporal and spatiotemporal analysis in the arterial phase enhancement with spatial features extracted by texture analysis at different time points. Using the extracted features as input, several machine learning classifiers are optimized to achieve semiautomatic FLLs characterization, for which there is no need for motion compensation and the only manual input required is the location of a suspicious lesion. Clinical validation on 87 FLLs from 72 patients at risk for hepatocellular carcinoma (HCC) showed promising performance, achieving a balanced accuracy of 0.84 in the distinction between benign and malignant lesions. Analysis of feature relevance demonstrates that a combination of spatiotemporal and texture features is needed to achieve the best performance. Interpretation of the most relevant features suggests that aspects related to microvascular perfusion and the microvascular architecture, together with the spatial enhancement characteristics at wash-in and peak enhancement, are important to aid the accurate characterization of FLLs.

Four-quadrant fast compressive tracking of breast ultrasound videos for computer-aided response evaluation of neoadjuvant chemotherapy in mice

BACKGROUND AND OBJECTIVE

Neoadjuvant chemotherapy (NAC) is a valuable treatment approach for locally advanced breast cancer. Contrast-enhanced ultrasound (CEUS) potentially enables the assessment of therapeutic response to NAC. In order to evaluate the response accurately, quantitatively and objectively, a method that can effectively compensate motions of breast cancer in CEUS videos is urgently needed.

METHODS

We proposed the four-quadrant fast compressive tracking (FQFCT) approach to automatically perform CEUS video tracking and compensation for mice undergoing NAC. The FQFCT divided a tracking window into four smaller windows at four quadrants of a breast lesion and formulated the tracking at each quadrant as a binary classification task. After the FQFCT of breast cancer videos, the quantitative features of CEUS including the mean transit time (MTT) were computed. All mice showed a pathological response to NAC. The features between pre- (day 1) and post-treatment (day 3 and day 5) in these responders were statistically compared.

RESULTS

When we tracked the CEUS videos of mice with the FQFCT, the average tracking error of FQFCT was 0.65 mm, reduced by 46.72% compared with the classic fast compressive tracking method (1.22 mm). After compensation with the FQFCT, the MTT on day 5 of the NAC was significantly different from the MTT before NAC (day 1) (p = 0.013).

CONCLUSIONS

The FQFCT improves the accuracy of CEUS video tracking and contributes to the computer-aided response evaluation of NAC for breast cancer in mice.

Hierarchical Temporal Attention Network for Thyroid Nodule Recognition Using Dynamic CEUS Imaging

Contrast-enhanced ultrasound (CEUS) has emerged as a popular imaging modality in thyroid nodule diagnosis due to its ability to visualize vascular distribution in real time. Recently, a number of learning-based methods are dedicated to mine pathological-related enhancement dynamics and make prediction at one step, ignoring a native diagnostic dependency. In clinics, the differentiation of benign or malignant nodules always precedes the recognition of pathological types. In this paper, we propose a novel hierarchical temporal attention network (HiTAN) for thyroid nodule diagnosis using dynamic CEUS imaging, which unifies dynamic enhancement feature learning and hierarchical nodules classification into a deep framework. Specifically, this method decomposes the diagnosis of nodules into an ordered two-stage classification task, where diagnostic dependency is modeled by Gated Recurrent Units (GRUs). Besides, we design a local-to-global temporal aggregation (LGTA) operator to perform a comprehensive temporal fusion along the hierarchical prediction path. Particularly, local temporal information is defined as typical enhancement patterns identified with the guidance of perfusion representation learned from the differentiation level. Then, we leverage an attention mechanism to embed global enhancement dynamics into each identified salient pattern. In this study, we evaluate the proposed HiTAN method on the collected CEUS dataset of thyroid nodules. Extensive experimental results validate the efficacy of dynamic patterns learning, fusion and hierarchical diagnosis mechanism.

Irregular Respiratory Motion Compensation for Liver Contrast-Enhanced Ultrasound via Transport-Based Motion Estimation

Contrast-enhanced ultrasound (CEUS) imaging has been widely applied for the detection and characterization of focal liver lesions (FLLs), for its ability to visualize the blood flow in real time. However, cyclic liver motion poses a great challenge to the recovery of perfusion curves as well as quantitative kinetic parameters estimation. Recently, a few gating methods have been proposed to eliminate unexpected intensity fluctuations by the breathing phase estimation, with the assumption that each breathing phase corresponds to a specific lesion position strictly. While practical liver motion tends to be irregular due to changes in the patient's underlying physiologic status, that is, the same phase might not correspond to the same position. To tackle the challenge of motion irregularity, we present a novel motion estimation-based respiratory compensation method, named RCME, which first estimates salient motion information through the framework of optimal transport (OT) by jointly modeling pixel intensity as well as their locations and then employs sparse subspace clustering (SSC) to identify the subset of frames acquired at the same position. Our proposed method is evaluated on 15 clinical CEUS sequences in both qualitative and quantitative manners. Experimental results demonstrate good performance on irregular liver motion compensation.

Accurate and Robust Alignment of Differently Stained Histologic Images Based on Greedy Diffeomorphic Registration

Histopathologic assessment routinely provides rich microscopic information about tissue structure and disease process. However, the sections used are very thin, and essentially capture only 2D representations of a certain tissue sample. Accurate and robust alignment of sequentially cut 2D slices should contribute to more comprehensive assessment accounting for surrounding 3D information. Towards this end, we here propose a two-step diffeomorphic registration approach that aligns differently stained histology slides to each other, starting with an initial affine step followed by estimating a deformation field. It was quantitatively evaluated on ample (n = 481) and diverse data from the automatic non-rigid histological image registration challenge, where it was awarded the second rank. The obtained results demonstrate the ability of the proposed approach to robustly (average robustness = 0.9898) and accurately (average relative target registration error = 0.2%) align differently stained histology slices of various anatomical sites while maintaining reasonable computational efficiency (<1 min per registration). The method was developed by adapting a general-purpose registration algorithm designed for 3D radiographic scans and achieved consistently accurate results for aligning high-resolution 2D histologic images. Accurate alignment of histologic images can contribute to a better understanding of the spatial arrangement and growth patterns of cells, vessels, matrix, nerves, and immune cell interactions.