Carotid plaque segmentation from three-dimensional ultrasound images by direct three-dimensional sparse field level-set optimization

A Dual-Stream Centerline-Guided Network for Segmentation of the Common and Internal Carotid Arteries From 3D Ultrasound Images

Segmentation of the carotid section encompassing the common carotid artery (CCA), the bifurcation and the internal carotid artery (ICA) from three-dimensional ultrasound (3DUS) is required to measure the vessel wall volume (VWV) and localized vessel-wall-plus-plaque thickness (VWT), shown to be sensitive to treatment effect. We proposed an approach to combine a centerline extraction network (CHG-Net) and a dual-stream centerline-guided network (DSCG-Net) to segment the lumen-intima (LIB) and media-adventitia boundaries (MAB) from 3DUS images. Correct arterial location is essential for successful segmentation of the carotid section encompassing the bifurcation. We addressed this challenge by using the arterial centerline to enhance the localization accuracy of the segmentation network. The CHG-Net was developed to generate a heatmap indicating high probability regions for the centerline location, which was then integrated with the 3DUS image by the DSCG-Net to generate the MAB and LIB. The DSCG-Net includes a scale-based and a spatial attention mechanism to fuse multi-level features extracted by the encoder, and a centerline heatmap reconstruction side-branch connected to the end of the encoder to increase the generalization ability of the network. Experiments involving 224 3DUS volumes produce a Dice similarity coefficient (DSC) of 95.8±1.9% and 92.3±5.4% for CCA MAB and LIB, respectively, and 93.2±4.4% and 89.0±10.0% for ICA MAB and LIB, respectively. Our approach outperformed four state-of-the-art 3D CNN models, even after their performances were boosted by centerline guidance. The efficiency afforded by the framework would allow it to be incorporated into the clinical workflow for improved quantification of plaque change.

Deep Learning for Head and Neck CT Angiography: Stenosis and Plaque Classification

Background Studies have rarely investigated stenosis detection from head and neck CT angiography scans because accurate interpretation is time consuming and labor intensive. Purpose To develop an automated convolutional neural network-based method for accurate stenosis detection and plaque classification in head and neck CT angiography images and compare its performance with that of radiologists. Materials and Methods A deep learning (DL) algorithm was constructed and trained with use of head and neck CT angiography images that were collected retrospectively from four tertiary hospitals between March 2020 and July 2021. CT scans were partitioned into training, validation, and independent test sets at a ratio of 7:2:1. An independent test set of CT angiography scans was collected prospectively between October 2021 and December 2021 in one of the four tertiary centers. Stenosis grade categories were as follows: mild stenosis (<50%), moderate stenosis (50%-69%), severe stenosis (70%-99%), and occlusion (100%). The stenosis diagnosis and plaque classification of the algorithm were compared with the ground truth of consensus by two radiologists (with more than 10 years of experience). The performance of the models was analyzed in terms of accuracy, sensitivity, specificity, and areas under the receiver operating characteristic curve. Results There were 3266 patients (mean age ± SD, 62 years ± 12; 2096 men) evaluated. The consistency between radiologists and the DL-assisted algorithm on plaque classification was 85.6% (320 of 374 cases [95% CI: 83.2, 88.6]) on a per-vessel basis. Moreover, the artificial intelligence model assisted in visual assessment, such as increasing confidence in the degree of stenosis. This reduced the time needed for diagnosis and report writing of radiologists from 28.8 minutes ± 5.6 to 12.4 minutes ± 2.0 (P < .001). Conclusion A deep learning algorithm for head and neck CT angiography interpretation accurately determined vessel stenosis and plaque classification and had equivalent diagnostic performance when compared with experienced radiologists. © RSNA, 2023 Supplemental material is available for this article.

Method for Carotid Artery 3-D Ultrasound Image Segmentation Based on CSWin Transformer

Precise segmentation of carotid artery (CA) structure is an important prerequisite for the medical assessment and detection of carotid plaques. For automatic segmentation of the media-adventitia boundary (MAB) and lumen-intima boundary (LIB) in 3-D ultrasound images of the CA, a U-shaped CSWin transformer (U-CSWT) is proposed. Both the encoder and decoder of the U-CSWT are composed of hierarchical CSWT modules, which can capture rich global context information in the 3-D image. Experiments were performed on a 3-D ultrasound image data set of the CA, and the results indicate that the U-CSWT performs better than other convolutional neural network (CNN)-based and CNN-transformer hybrid methods. The model yields Dice coefficients of 94.6 ± 3.0% and 90.8 ± 5.1% for the MAB and LIB in the common carotid artery (CCA) and 92.9 ± 4.9% and 89.6 ± 6.2% for MAB and LIB in the bifurcation, respectively. Our U-CSWT is expected to become an effective method for automatic segmentation of 3-D ultrasound images of CA.

Learning-based initialization for correntropy-based level sets to segment atherosclerotic plaque in ultrasound images

Carotid artery atherosclerosis is a significant cause of stroke. Ultrasound imaging has been widely used in the diagnosis of atherosclerosis. Therefore, segmenting the atherosclerotic carotid plaque in an ultrasound image is an important task. Accurate plaque segmentation is helpful for the measurement of carotid plaque burden. This study proposes an automatic method for atherosclerotic plaque segmentation by using correntropy-based level sets (CLS) with learning-based initialization. We introduce the CLS model, containing the point-based local bias-field corrected image fitting method and correntropy-based distance measurement, to overcome the limitations of the ultrasound images. A supervised learning algorithm is employed to solve the automatic initialization problem of the variational methods. The proposed atherosclerotic plaque segmentation method is validated on 29 carotid ultrasound images, obtaining a Dice ratio of 90.6 ± 1.9% and an overlap index of 83.6 ± 3.2%. Moreover, by comparing the standard deviation of each evaluation index, it can be found that the proposed method is more robust for segmenting the atherosclerotic plaque. Our work shows that our proposed method can be more helpful than other variational models for measuring the carotid plaque burden.

Three-dimensional ultrasound assessment of effects of therapies on carotid atherosclerosis using vessel wall thickness maps

We present a new method for assessing the effects of therapies on atherosclerosis, by measuring the weighted average of carotid vessel-wall-plus-plaque thickness change (ΔVWT¯_Weighted) in 120 patients randomized to pomegranate juice/extract versus placebo. Three-dimensional ultrasound images were acquired at baseline and one year after. Three-dimensional VWT maps were reconstructed and then projected onto a carotid template to obtain two-dimensional VWT maps. Anatomic correspondence on the two-dimensional VWT maps was optimized to reduce misalignment for the same subject and across subjects. A weight was computed at each point on the two-dimensional VWT map to highlight anatomic locations likely to exhibit plaque progression/regression, resulting in ΔVWT¯_Weighted for each subject. The weighted average of VWT-Change measured from the two-dimensional VWT maps with correspondence alignment (ΔVWT¯_Weighted,MDL) detected a significant difference between the pomegranate and placebo groups (P = 0.008). This method improves the cost-effectiveness of proof-of-concept studies involving new therapies for atherosclerosis.

Using a distance map and an active contour model to segment the carotid artery boundary from the lumen contour in proton density weighted magnetic resonance images

Segmentation methods have assumed an important role in image-based diagnosis of several cardiovascular diseases. Particularly, the segmentation of the boundary of the carotid artery is demanded in the detection and characterization of atherosclerosis and assessment of the disease progression. In this article, a fully automatic approach for the segmentation of the carotid artery boundary in Proton Density Weighted Magnetic Resonance Images is presented. The approach relies on the expansion of the lumen contour based on a distance map built using the gray-weighted distance relative to the center of the identified lumen region in the image under analysis. Then, a Snake model with a modified weighted external energy based on the combination of a balloon force along with a Gradient Vector Flow-based external energy is applied to the expanded contour towards the correct boundary of the carotid artery. The average values of the Dice coefficient, Polyline distance, mean contour distance and centroid distance found in the segmentation of 139 carotid arteries were 0.83 ± 0.11, 2.70 ± 1.69 pixels, 2.79 ± 1.89 pixels and 3.44 ± 2.82 pixels, respectively. The segmentation results of the proposed approach were also compared against the ones obtained by related approaches found in the literature, which confirmed the outstanding performance of the new approach. Additionally, the proposed weighted external energy for the Snake model was shown to be also robust to carotid arteries with large thickness and weak boundary image edges.

Carotid Intraplaque-Hemorrhage Volume and Its Association with Cerebrovascular Events

BACKGROUND AND PURPOSE

Our aim was to assess the relationship between volume and percentage of intraplaque hemorrhage measured using CT and the occurrence of cerebrovascular events at the time of CT.

MATERIALS AND METHODS

One-hundred-twenty-three consecutive subjects (246 carotid arteries) with a mean age of 69 years who underwent CTA were included in this retrospective study. Plaque volume of components and subcomponents (including intraplaque hemorrhage volume) was quantified with dedicated software.

RESULTS

Forty-six arteries were excluded because no plaque was identified. In the remaining 200 carotid arteries, a statistically significant difference was found between presentation with cerebrovascular events and lipid volume (P = .002), intraplaque hemorrhage volume (P = .002), percentage of lipid (P = .002), percentage of calcium (P = .001), percentage of intraplaque hemorrhage (P = .001), percentage of lipid-intraplaque hemorrhage (P = .001), and intraplaque hemorrhage/lipid ratio (P = .001). The highest receiver operating characteristic area under the curve was obtained with the intraplaque hemorrhage volume with a value of 0.793 (P = .001), percentage of intraplaque hemorrhage with an area under the curve of 0.812 (P = .001), and the intraplaque hemorrhage/lipid ratio with an area under the curve value of 0.811 (P = .001).

CONCLUSIONS

Results of our study suggest that Hounsfield unit values <25 have a statistically significant association with the presence of cerebrovascular events and that the ratio intraplaque hemorrhage/lipid volume represents a strong parameter for the association of cerebrovascular events.

Deep learning-based carotid media-adventitia and lumen-intima boundary segmentation from three-dimensional ultrasound images

Purpose

Quantification of carotid plaques has been shown to be important for assessing as well as monitoring the progression and regression of carotid atherosclerosis. Various metrics have been proposed and methods of measurements ranging from manual tracing to automated segmentations have also been investigated. Of those metrics, quantification of carotid plaques by measuring vessel‐wall‐volume (VWV) using the segmented media‐adventitia (MAB) and lumen‐intima (LIB) boundaries has been shown to be sensitive to temporal changes in carotid plaque burden. Thus, semi‐automatic MAB and LIB segmentation methods are required to help generate VWV measurements with high accuracy and less user interaction.

Methods

In this paper, we propose a semiautomatic segmentation method based on deep learning to segment the MAB and LIB from carotid three‐dimensional ultrasound (3DUS) images. For the MAB segmentation, we convert the segmentation problem to a pixel‐by‐pixel classification problem. A dynamic convolutional neural network (Dynamic CNN) is proposed to classify the patches generated by sliding a window along the norm line of the initial contour where the CNN model is fine‐tuned dynamically in each test task. The LIB is segmented by applying a region‐of‐interest of carotid images to a U‐Net model, which allows the network to be trained end‐to‐end for pixel‐wise classification.

Results

A total of 144 3DUS images were used in this development, and a threefold cross‐validation technique was used for evaluation of the proposed algorithm. The proposed algorithm‐generated accuracy was significantly higher than the previous methods but with less user interactions. Comparing the algorithm segmentation results with manual segmentations by an expert showed that the average Dice similarity coefficients (DSC) were 96.46 ± 2.22% and 92.84 ± 4.46% for the MAB and LIB, respectively, while only an average of 34 s (vs 1.13, 2.8 and 4.4 min in previous methods) was required to segment a 3DUS image. The interobserver experiment indicated that the DSC was 96.14 ± 1.87% between algorithm‐generated MAB contours of two observers' initialization.

Conclusions

Our results showed that the proposed carotid plaque segmentation method obtains high accuracy and repeatability with less user interactions, suggesting that the method could be used in clinical practice to measure VWV and monitor the progression and regression of carotid plaques.