Prediction of high-risk asymptomatic carotid plaques based on ultrasonic image features

Cardiovascular Disease Risk Stratification Using Hybrid Deep Learning Paradigm: First of Its Kind on Canadian Trial Data

BACKGROUND

The risk of cardiovascular disease (CVD) has traditionally been predicted via the assessment of carotid plaques. In the proposed study, AtheroEdge™ 3.0HDL (AtheroPoint™, Roseville, CA, USA) was designed to demonstrate how well the features obtained from carotid plaques determine the risk of CVD. We hypothesize that hybrid deep learning (HDL) will outperform unidirectional deep learning, bidirectional deep learning, and machine learning (ML) paradigms.

METHODOLOGY

500 people who had undergone targeted carotid B-mode ultrasonography and coronary angiography were included in the proposed study. ML feature selection was carried out using three different methods, namely principal component analysis (PCA) pooling, the chi-square test (CST), and the random forest regression (RFR) test. The unidirectional and bidirectional deep learning models were trained, and then six types of novel HDL-based models were designed for CVD risk stratification. The AtheroEdge™ 3.0HDL was scientifically validated using seen and unseen datasets while the reliability and statistical tests were conducted using CST along with p-value significance. The performance of AtheroEdge™ 3.0HDL was evaluated by measuring the p-value and area-under-the-curve for both seen and unseen data.

RESULTS

The HDL system showed an improvement of 30.20% (0.954 vs. 0.702) over the ML system using the seen datasets. The ML feature extraction analysis showed 70% of common features among all three methods. The generalization of AtheroEdge™ 3.0HDL showed less than 1% (p-value < 0.001) difference between seen and unseen data, complying with regulatory standards.

CONCLUSIONS

The hypothesis for AtheroEdge™ 3.0HDL was scientifically validated, and the model was tested for reliability and stability and is further adaptable clinically.

Identification of vulnerable carotid plaque with CT-based radiomics nomogram

AIM

To develop and validate a radiomics nomogram for identifying high-risk carotid plaques on computed tomography (CT) angiography (CTA).

MATERIALS AND METHODS

A total of 280 patients with symptomatic (n=131) and asymptomatic (n=139) carotid plaques were divided into a training set (n=135), validation set (n=58), and external test set (n=87). Radiomic features were extracted from CTA images. A radiomics model was constructed based on selected features and a radiomics score (rad-score) was calculated. A clinical factor model was constructed by demographics and CT findings. A radiomics nomogram combining independent clinical factors and the rad-score was constructed. The diagnostic performance of three models was evaluated and validated by region of characteristic curves.

RESULTS

Calcification and maximum plaque thickness were the independent clinical factors. Twenty-four features were used to build the radiomics signature. In the validation set, the nomogram (area under the curve [AUC], 0.977; 95% CI, 0.899-0.999) performed better (p=0.017 and p=0.031) than the clinical factor model (AUC, 0.862; 95% CI, 0.746-0.938) and radiomics signature (AUC, 0.944; 95% CI, 0.850-0.987). In external test set, the nomogram (AUC, 0.952; 95% CI, 0.884-0.987) and radiomics signature (AUC, 0.932; 95% CI, 0.857-0.975) showed better discrimination capability (p=0.002 and p=0.037) than clinical factor model (AUC, 0.818; 95% CI, 0.721-0.892).

CONCLUSION

The CT-based nomogram showed satisfactory performance in identification of high-risk plaques in carotid arteries, and it may serve as a potential non-invasive tool to identify carotid plaque vulnerability and risk stratification.

Quality assessment of stroke radiomics studies: Promoting clinical application

PURPOSE

To evaluate the quality of radiomics studies on stroke using a radiomics quality score (RQS), Minimum Information for Medial AI reporting (MINIMAR) and Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD) to promote clinical application.

METHODS

PubMed MEDLINE and Embase were searched to identify radiomics studies on stroke. Of 464 articles, 52 relevant original research articles were included. The RQS, MINIMAR and TRIPOD were scored to evaluate the quality of the studies by neuroradiologists.

RESULTS

Only four studies (7.7 %) performed external validation. The mean RQS was 3.2 of 36 (8.9 %), and the basic adherence rate was 24.9 %. The adherence rate was low for conducting phantom study (1.9 %), stating comparison to 'gold standard' (1.9 %), offering potential clinical utility (13.5 %) and performing cost-effectiveness analysis (1.9 %). None of the studies performed a test-retest, stated biologic correlation, conducted prospective studies, or opened codes and data to the public, resulting in low RQS. The total MINIMAR adherence rate was 47.4 %. The overall adherence rate for TRIPOD was 54.6 %, with low scores for reporting the title (2.0 %), key elements of the study setting (6.1 %), and explaining the sample size (2.0 %).

CONCLUSIONS

The overall radiomics reporting quality and reporting of published radiomics studies on stoke was suboptimal. More thorough validation and open data are needed to increase clinical applicability of radiomics studies.

CurveletTransform-Based Texture Analysis of Carotid B-mode Ultrasound Images in Asymptomatic Men With Moderate and Severe Stenoses: A Preliminary Clinical Study

The curvelet transform, which represents images in terms of their geometric and textural characteristics, was investigated toward revealing differences between moderate (50%-69%, n = 11) and severe (70%-100%, n = 14) stenosis asymptomatic plaque from B-mode ultrasound. Texture features were estimated in original and curvelet transformed images of atheromatous plaque (PL), the adjacent arterial wall (intima-media [IM]) and the plaque shoulder (SH) (i.e., the boundary between plaque and wall), separately at end systole and end diastole. Seventeen features derived from the original images were significantly different between the two groups (4 for IM, 3 for PL and 10 for SH; 9 for end diastole and 8 for end systole); 19 of 234 features (2 for IM and 17 for SH; 8 for end systole and 11 for end diastole) derived from curvelet transformed images were significantly higher in the patients with severe stenosis, indicating higher magnitude, variation and randomness of image gray levels. In these patients, lower body height and higher serum creatinine concentration were observed. Our findings suggest that (a) moderate and severe plaque have similar curvelet-based texture properties, and (b) IM and SH provide useful information about arterial wall pathophysiology, complementary to PL itself. The curvelet transform is promising for identifying novel indices of cardiovascular risk and warrants further investigation in larger cohorts.

Ten Fast Transfer Learning Models for Carotid Ultrasound Plaque Tissue Characterization in Augmentation Framework Embedded with Heatmaps for Stroke Risk Stratification

Background and Purpose: Only 1-2% of the internal carotid artery asymptomatic plaques are unstable as a result of >80% stenosis. Thus, unnecessary efforts can be saved if these plaques can be characterized and classified into symptomatic and asymptomatic using non-invasive B-mode ultrasound. Earlier plaque tissue characterization (PTC) methods were machine learning (ML)-based, which used hand-crafted features that yielded lower accuracy and unreliability. The proposed study shows the role of transfer learning (TL)-based deep learning models for PTC. Methods: As pertained weights were used in the supercomputer framework, we hypothesize that transfer learning (TL) provides improved performance compared with deep learning. We applied 11 kinds of artificial intelligence (AI) models, 10 of them were augmented and optimized using TL approaches-a class of Atheromatic™ 2.0 TL (AtheroPoint™, Roseville, CA, USA) that consisted of (i-ii) Visual Geometric Group-16, 19 (VGG16, 19); (iii) Inception V3 (IV3); (iv-v) DenseNet121, 169; (vi) XceptionNet; (vii) ResNet50; (viii) MobileNet; (ix) AlexNet; (x) SqueezeNet; and one DL-based (xi) SuriNet-derived from UNet. We benchmark 11 AI models against our earlier deep convolutional neural network (DCNN) model. Results: The best performing TL was MobileNet, with accuracy and area-under-the-curve (AUC) pairs of 96.10 ± 3% and 0.961 (p < 0.0001), respectively. In DL, DCNN was comparable to SuriNet, with an accuracy of 95.66% and 92.7 ± 5.66%, and an AUC of 0.956 (p < 0.0001) and 0.927 (p < 0.0001), respectively. We validated the performance of the AI architectures with established biomarkers such as greyscale median (GSM), fractal dimension (FD), higher-order spectra (HOS), and visual heatmaps. We benchmarked against previously developed Atheromatic™ 1.0 ML and showed an improvement of 12.9%. Conclusions: TL is a powerful AI tool for PTC into symptomatic and asymptomatic plaques.

Assessing Ischemic Stroke with Convolutional Image Features in Carotid Color Doppler

Stroke is a leading cause of disability and death worldwide. Early and accurate recognition of acute stroke is critical for achieving a good prognosis. The novel automated system proposed in this study was based on convolutional neural networks (CNNs), which were used to identify lesion findings on carotid color Doppler (CCD) images in patients with acute ischemic stroke. An image database composed of 1032 CCD images from 106 patients with acute ischemic stroke (549 images) and from 79 normal controls (483 images) was retrospectively analyzed. Taking the consensus of two neuroradiologists as the gold standard, different CNN models with and without transfer learning were evaluated with 10-fold cross-validation. The diagnostic information provided from individual color channels was also explored. AlexNet, which was trained from scratch, achieved an accuracy of 91.67%, a sensitivity of 93.33%, a specificity of 90.20% and an area under the receiver operating characteristic curves (AUC) of 0.9432. Other transferred models achieved accuracies between 77.69% and 83.94%. In channel comparisons, the green channel had the best performance, with an accuracy of 87.50%, a sensitivity of 97.78%, a specificity of 78.43% and an AUC of 0.9507. The proposed CNN architecture, as a computer-aided diagnosis system, suggests using automatic feature extraction from CCD images to predict ischemic stroke. The developed scheme has the potential to provide diagnostic suggestions in clinical use.

Multimodality carotid plaque tissue characterization and classification in the artificial intelligence paradigm: a narrative review for stroke application

Cardiovascular disease (CVD) is one of the leading causes of morbidity and mortality in the United States of America and globally. Carotid arterial plaque, a cause and also a marker of such CVD, can be detected by various non-invasive imaging modalities such as magnetic resonance imaging (MRI), computer tomography (CT), and ultrasound (US). Characterization and classification of carotid plaque-type in these imaging modalities, especially into symptomatic and asymptomatic plaque, helps in the planning of carotid endarterectomy or stenting. It can be challenging to characterize plaque components due to (I) partial volume effect in magnetic resonance imaging (MRI) or (II) varying Hausdorff values in plaque regions in CT, and (III) attenuation of echoes reflected by the plaque during US causing acoustic shadowing. Artificial intelligence (AI) methods have become an indispensable part of healthcare and their applications to the non-invasive imaging technologies such as MRI, CT, and the US. In this narrative review, three main types of AI models (machine learning, deep learning, and transfer learning) are analyzed when applied to MRI, CT, and the US. A link between carotid plaque characteristics and the risk of coronary artery disease is presented. With regard to characterization, we review tools and techniques that use AI models to distinguish carotid plaque types based on signal processing and feature strengths. We conclude that AI-based solutions offer an accurate and robust path for tissue characterization and classification for carotid artery plaque imaging in all three imaging modalities. Due to cost, user-friendliness, and clinical effectiveness, AI in the US has dominated the most.

CT texture-based radiomics analysis of carotid arteries identifies vulnerable patients: a preliminary outcome study

PURPOSE

To assess the potential role of computed tomography (CT) texture analysis (CTTA) in identifying vulnerable patients with carotid artery atherosclerosis.

METHODS

In this case-control pilot study, 12 patients with carotid atherosclerosis and a subsequent history of transient ischemic attack or stroke were age and sex matched with 12 control cases with asymptomatic carotid atherosclerosis (follow-up time 103.58 ± 9.2 months). CTTA was performed using a commercially available research software package (TexRAD) by an operator blinded to clinical data. CTTA comprised a filtration-histogram technique to extract features at different scales corresponding to spatial scale filter (fine = 2 mm, medium = 3 mm, coarse = 4 mm), followed by quantification using histogram-based statistical parameters: mean, kurtosis, skewness, entropy, standard deviation, and mean value of positive pixels. A single axial slice was selected to best represent the largest cross-section of the carotid bifurcation or the greatest degree of stenosis, in presence of an atherosclerotic plaque, on each side.

RESULTS

CTTA revealed a statistically significant difference in skewness between symptomatic and asymptomatic patients at the medium (0.22 ± 0.35 vs - 0.18 ± 0.39, p < 0.001) and coarse (0.23 ± 0.22 vs 0.03 ± 0.29, p = 0.003) texture scales. At the fine-texture scale, skewness (0.20 ± 0.59 vs - 0.18 ± 0.58, p = 0.009) and standard deviation (366.11 ± 117.19 vs 300.37 ± 82.51, p = 0.03) were significant before correction.

CONCLUSION

Our pilot study highlights the potential of CTTA to identify vulnerable patients in stroke and TIA. CT texture may have the potential to act as a novel risk stratification tool in patients with carotid atherosclerosis.

Asymptomatic Carotid Stenosis and Risk of Stroke (ACSRS) study: what have we learned from it?

The Asymptomatic Carotid Stenosis and Risk of Stroke (ACSRS) study is the largest natural history study on patients with 50–99% asymptomatic carotid stenosis (ACS). It included 1,121 ACS individuals with a follow-up between 6 and 96 months (mean: 48 months). During the last 15 years, several important ACSRS substudies have been published that have contributed significantly to the optimal management of ACS patients. These studies have demonstrated that specific baseline clinical characteristics and ultrasonic plaque features after image normalization (namely carotid plaque type, gray scale median, carotid plaque area, juxtaluminal black area without a visible echogenic cup, discrete white areas in an echolucent part of a plaque, silent embolic infarcts on brain computed tomography scans, a history of contralateral transient ischemic attacks/strokes) can independently predict future ipsilateral cerebrovascular events. The ACSRS study provided proof that by use of a computer program to normalize plaque images and extract plaque texture features, a combination of features can stratify patients into various categories depending on their stroke risk. The present review will discuss the various reported predictors of future ipsilateral cerebrovascular events and how these characteristics can be used to calculate individual stroke risk.

3-D optimized classification and characterization artificial intelligence paradigm for cardiovascular/stroke risk stratification using carotid ultrasound-based delineated plaque: Atheromatic™ 2.0

BACKGROUND AND PURPOSE

Atherosclerotic plaque tissue rupture is one of the leading causes of strokes. Early carotid plaque monitoring can help reduce cardiovascular morbidity and mortality. Manual ultrasound plaque classification and characterization methods are time-consuming and can be imprecise due to significant variations in tissue characteristics. We report a novel artificial intelligence (AI)-based plaque tissue classification and characterization system.

METHODS

We hypothesize that symptomatic plaque is hypoechoic due to its large lipid core and minimal collagen, as well as its heterogeneous makeup. Meanwhile, asymptomatic plaque is hyperechoic due to its small lipid core, abundant collagen, and the fact that it is often calcified. We designed a computer-aided diagnosis (CADx) system consisting of three kinds of deep learning (DL) classification paradigms: Deep Convolutional Neural Network (DCNN), Visual Geometric Group-16 (VGG16), and transfer learning, (tCNN). DCNN was 3-D optimized by varying the number of CNN layers and data augmentation frameworks. The DL systems were benchmarked against four types of machine learning (ML) classification systems, and the CADx system was characterized using two novel strategies consisting of DL mean feature strength (MFS) and a bispectrum model using higher-order spectra.

RESULTS

After balancing symptomatic and asymptomatic plaque classes, a five-fold augmentation process was applied, yielding 1000 carotid scans in each class. Then, using a K10 protocol (trained to test the ratio of 90%-10%), tCNN and DCNN yielded accuracy (area under the curve (AUC)) pairs of 83.33%, 0.833 (p < 0.0001) and 95.66%, 0.956 (p < 0.0001), respectively. DCNN was superior to ML by 7.01%. As part of the characterization process, the MFS of the symptomatic plaque was found to be higher compared to the asymptomatic plaque by 17.5% (p < 0.0001). A similar pattern was seen in the bispectrum, which was higher for symptomatic plaque by 5.4% (p < 0.0001). It took <2 s to perform the online CADx process on a supercomputer.

CONCLUSIONS

The performance order of the three AI systems was DCNN > tCNN > ML. Bispectrum-based on higher-order spectra proved a powerful paradigm for plaque tissue characterization. Overall, the AI-based systems offer a powerful solution for plaque tissue classification and characterization.

Uses of ultrasound in stroke prevention

Ultrasound methods are useful in stroke prevention in several ways. Measurement of carotid plaque burden, as either total plaque area (TPA) or total plaque volume (TPV) are strong predictors of cardiovascular risk: much stronger than intima-media thickness, which does not represent true atherosclerosis, but a biologically and genetically distinct phenotype. Measurement of plaque burden is also useful for the study of genetics, and of new risk factors such as toxic products of the intestinal microbiome. Carotid plaque burden is highly correlated with and as predictive of risk as coronary calcium scores, but is less costly and does not require radiation. Furthermore, because carotid plaques change in time over a period of months, they can be used for a new approach to vascular prevention: "Treating arteries instead of treating risk factors". In high-risk patients with asymptomatic carotid stenosis (ACS), this approach, implemented in 2003 in our clinics, was associated with a >80% reduction of stroke and myocardial infarction over 2 years. "Treating arteries without measuring plaque would be like treating hypertension without measuring blood pressure". Ultrasound methods can also be used to assess plaque vulnerability, by detecting echolucency, ulceration and plaque inhomogeneity on assessment of plaque texture. Transcranial Doppler (TCD) embolus detection is useful for risk stratification in patients with ACS; patients with two or more microemboli in an hour of monitoring have a 1-year risk of 15.6%, vs. 1% without microemboli, so this very clearly distinguishes which patients with ACS could benefit from intervention. TCD saline studies are more sensitive than trans-esophageal echocardiography for detection of patent foramen ovale, and more predictive of recurrent stroke. These methods should be more widely used, to reduce the increasing burden of stroke in our aging populations.

Choosing the right therapy for a patient with asymptomatic carotid stenosis

Introduction: Most patients with asymptomatic carotid stenosis (ACS) now have a lower risk with intensive medical therapy than with stenting (CAS) or endarterectomy (CEA); the annual risk of stroke or death with intensive medical therapy is ~ 0.5%, vs. a periprocedural risk with CAS of ~ 2.5-4.1% with CAS, and ~ 1.4-1.8% with CEA. The excess risk of CAS is greater in older patients.Areas covered: Discussed are the need for intensive medical therapy, the nature of intensive medical therapy, approaches to identifying the few patients with ACS who could benefit from CEA or CAS, and which patients would be better suited to CEA vs. CAS.Expert opinion: All patients with ACS are at high risk of cardiovascular events, soshould receive intensive medical therapy including lifestyle modification, intensive lipid-lowering, B vitamins to lower homocysteine (using methylcobalamin rather than cyanocobalamin), and appropriate antithrombotic therapy. High-risk patients who could benefit from intervention can be identified by clinical and imaging features including transcranial Doppler embolus detection, ulceration, intraplaque hemorrhage, reduced cerebrovascular reserve, plaque echolucency, silent infarction on brain imaging, and progression of stenosis. Most patients whose risk of stroke warrants intervention would be better treated with CEA than with CAS.

Three-dimensional ultrasound evaluation of the effects of pomegranate therapy on carotid plaque texture using locality preserving projection

BACKGROUND AND OBJECTIVE

Dietary supplements are expected to confer a smaller beneficial effect than medical treatments. Therefore, there is a need to develop cost-effective biomarkers that can demonstrate the efficacy of such supplements for carotid atherosclerosis. The aim of this study is to develop such a biomarker based on the changes of 376 plaque textural features measured from 3D ultrasound images.

METHODS

Since the number of features (376) was greater than the number of subjects (171) in this study, principal component analysis (PCA) was applied to reduce the dimensionality of feature vectors. To generate a scalar biomarker for each subject, elements in the reduced feature vectors produced by PCA were weighted using locality preserving projections (LPP) to capture essential patterns exhibited locally in the feature space. 96 subjects treated by pomegranate juice and tablets, and 75 subjects receiving placebo-matching juice and tablets were evaluated in this study. The discriminative power of the proposed biomarker was evaluated and compared with existing biomarkers using t-tests. As the cost of a clinical trial is directly related to the number of subjects enrolled, the cost-effectiveness of the proposed biomarker was evaluated by sample size estimation.

RESULTS

The proposed biomarker was more able to discriminate plaque changes exhibited by the pomegranate and placebo groups than total plaque volume (TPV) according to the result of t-tests (TPV: p=0.34, Proposed biomarker: p=1.5×10^-5). The sample size required by the new biomarker to detect a significant effect was 20 times smaller than that required by TPV.

CONCLUSION

With the increase in cost-effectiveness afforded by the proposed biomarker, more proof-of-principle studies for novel treatment options could be performed.

Carotid artery ultrasound image analysis: A review of the literature

Stroke is one of the prominent causes of death in the recent days. The existence of susceptible plaque in the carotid artery can be used in ascertaining the possibilities of cardiovascular diseases and long-term disabilities. The imaging modality used for early screening of the disease is B-mode ultrasound image of the person in the artery area. The objective of this article is to give a widespread review of the imaging modes and methods used for studying the carotid artery for identifying stroke, atherosclerosis and related cardiovascular diseases. We encompass the review in methods used for artery wall tracking, intima-media, and lumen segmentation which will help in finding the extent of the disease. Due to the characteristics of the imaging modality used, the images have speckle noise which worsens the image quality. Adaptive homomorphic filtering with wavelet and contourlet transforms, Levy Shrink, gamma distribution were used for image denoising. Learning-based neural network approaches for denoising give better edge preservation. Domain knowledge-based segmentation approaches have proved to provide more accurate intima-media thickness measurements. There is a requirement of useful fully automatic segmentation approaches, 3D, 4D systems, and plaque motion analysis. Taking into consideration the image priors like geometry, imaging physics, intensity and temporal data, image analysis has to be performed. Encouragingly more research has focused on content-specific segmentation and classification techniques. With the evaluation of machine learning algorithms, classifying the image as with or without a fat deposit has gained better accuracy and sensitivity. Machine learning-based approaches like self-organizing map, k-nearest neighborhood and support vector machine achieve promising accuracy and sensitivity in classification. The literature reveals that there is more scope in identifying a patient-specific model in a fully automatic manner.

Global perspective on carotid intima-media thickness and plaque: should the current measurement guidelines be revisited?

Carotid intima-media thickness (cIMT) and carotid plaque (CP) currently act as risk predictors for CVD/Stroke risk assessment. Over 2000 articles have been published that cover either use cIMT/CP or alterations of cIMT/CP and additional image-based phenotypes to associate cIMT related markers with CVD/Stroke risk. These articles have shown variable results, which likely reflect a lack of standardization in the tools for measurement, risk stratification, and risk assessment. Guidelines for cIMT/CP measurement are influenced by major factors like the atherosclerosis disease itself, conventional risk factors, 10-year measurement tools, types of CVD/Stroke risk calculators, incomplete validation of measurement tools, and the fast pace of computer technology advancements. This review discusses the following major points: 1) the American Society of Echocardiography and Mannheim guidelines for cIMT/CP measurements; 2) forces that influence the guidelines; and 3) calculators for risk stratification and assessment under the influence of advanced intelligence methods. The review also presents the knowledge-based learning strategies such as machine and deep learning which may play a future role in CVD/stroke risk assessment. We conclude that both machine learning and non-machine learning strategies will flourish for current and 10-year CVD/Stroke risk prediction as long as they integrate image-based phenotypes with conventional risk factors.

A Special Report on Changing Trends in Preventive Stroke/Cardiovascular Risk Assessment Via B-Mode Ultrasonography

PURPOSE OF REVIEW

Cardiovascular disease (CVD) and stroke risk assessment have been largely based on the success of traditional statistically derived risk calculators such as Pooled Cohort Risk Score or Framingham Risk Score. However, over the last decade, automated computational paradigms such as machine learning (ML) and deep learning (DL) techniques have penetrated into a variety of medical domains including CVD/stroke risk assessment. This review is mainly focused on the changing trends in CVD/stroke risk assessment and its stratification from statistical-based models to ML-based paradigms using non-invasive carotid ultrasonography.

RECENT FINDINGS

In this review, ML-based strategies are categorized into two types: non-image (or conventional ML-based) and image-based (or integrated ML-based). The success of conventional (non-image-based) ML-based algorithms lies in the different data-driven patterns or features which are used to train the ML systems. Typically these features are the patients' demographics, serum biomarkers, and multiple clinical parameters. The integrated (image-based) ML-based algorithms integrate the features derived from the ultrasound scans of the arterial walls (such as morphological measurements) with conventional risk factors in ML frameworks. Even though the review covers ML-based system designs for carotid and coronary ultrasonography, the main focus of the review is on CVD/stroke risk scores based on carotid ultrasound. There are two key conclusions from this review: (i) fusion of image-based features with conventional cardiovascular risk factors can lead to more accurate CVD/stroke risk stratification; (ii) the ability to handle multiple sources of information in big data framework using artificial intelligence-based paradigms (such as ML and DL) is likely to be the future in preventive CVD/stroke risk assessment.

Assessment of Carotid Artery Plaque Components With Machine Learning Classification Using Homodyned-K Parametric Maps and Elastograms

Quantitative ultrasound (QUS) imaging methods, including elastography, echogenicity analysis, and speckle statistical modeling, are available from a single ultrasound (US) radio-frequency data acquisition. Since these US imaging methods provide complementary quantitative tissue information, characterization of carotid artery plaques may gain from their combination. Sixty-six patients with symptomatic ( n = 26 ) and asymptomatic ( n = 40 ) carotid atherosclerotic plaques were included in the study. Of these, 31 underwent magnetic resonance imaging (MRI) to characterize plaque vulnerability and quantify plaque components. US radio-frequency data sequence acquisitions were performed on all patients and were used to compute noninvasive vascular US elastography and other QUS features. Additional QUS features were computed from three types of images: homodyned-K (HK) parametric maps, Nakagami parametric maps, and log-compressed B-mode images. The following six classification tasks were performed: detection of 1) a small area of lipid; 2) a large area of lipid; 3) a large area of calcification; 4) the presence of a ruptured fibrous cap; 5) differentiation of MRI-based classification of nonvulnerable carotid plaques from neovascularized or vulnerable ones; and 6) confirmation of symptomatic versus asymptomatic patients. Feature selection was first applied to reduce the number of QUS parameters to a maximum of three per classification task. A random forest machine learning algorithm was then used to perform classifications. Areas under receiver-operating curves (AUCs) were computed with a bootstrap method. For all tasks, statistically significant higher AUCs were achieved with features based on elastography, HK parametric maps, and B-mode gray levels, when compared to elastography alone or other QUS alone ( ). For detection of a large area of lipid, the combination yielding the highest AUC (0.90, 95% CI 0.80-0.92, ) was based on elastography, HK, and B-mode gray-level features. To detect a large area of calcification, the highest AUC (0.95, 95% CI 0.94-0.96, ) was based on HK and B-mode gray level features. For other tasks, AUCs varied between 0.79 and 0.97. None of the best combinations contained Nakagami features. This study shows the added value of combining different features computed from a single US acquisition with machine learning to characterize carotid artery plaques.

Texture Feature Variability in Ultrasound Video of the Atherosclerotic Carotid Plaque

The objective of this paper was to investigate texture feature variability in ultrasound video of the carotid artery during the cardiac cycle in an attempt to define new discriminatory biomarkers of the vulnerable plaque. More specifically, in this paper, 120 longitudinal ultrasound videos, acquired from 40 normal (N) subjects from the common carotid artery and 40 asymptomatic (A) and 40 symptomatic (S) subjects from the proximal internal carotid artery were investigated. The videos were intensity normalized and despeckled, and the intima-media complex (IMC) (from the N subjects) and the atherosclerotic carotid plaques (from the A and S subjects) were segmented from each video, in order to extract the M-mode image, and the texture features associated with cardiac states of systole and diastole. The main results of this paper can be summarized as follows: 1) texture features varied significantly throughout the cardiac cycle with significant differences identified between the cardiac systolic and cardiac diastolic states; 2) gray scale median was significantly higher at cardiac systole versus diastole for the N, A, and S groups investigated; 3) plaque texture features extracted during the cardiac cycle at the systolic and diastolic states were statistically significantly different between A and S subjects (and can thus be used to discriminate between A and S subjects successfully). The combination of systolic and diastolic features yields better performance than those alone. It is anticipated that the proposed system may aid the physician in clinical practice in classifying between N, A, and S subjects using texture features extracted from ultrasound videos of IMC and carotid artery plaque. However, further evaluation has to be carried out with more videos and additional features.

Comparison of diagnostic values of ultrasound micro-flow imaging and contrast-enhanced ultrasound for neovascularization in carotid plaques

The aim of the present study was to compare the diagnostic values of ultrasound micro-flow imaging (SMI) and contrast-enhanced ultrasound (CEUS) for neovascularization in carotid plaques, and to investigate their capacities for predicting the risks of cerebral stroke. A total of 39 patients (64 carotid plaques) with severe carotid artery stenosis undergoing carotid endarterectomy were selected between February 2015 and February 2016, and SMI and CEUS were used to detect neovascularization in plaques. According to the CEUS dynamic graph of plaques, the enhanced intensity visual scales and contrast parameters were obtained. Carotid atherosclerotic plaques were divided into 4 groups. The differences in the enhanced intensity visual scales, contrast parameters, and gray-scale median (GSM) values among the 4 groups were analyzed. Carotid plaque tissue samples from patients were stained for CD34, and the consistency of the methods for the diagnosis of neovascularization in plaques was analyzed. The differences in GSM values, enhanced intensities, and enhanced densities among the 4 groups of plaques were statistically significant (F=29.365, χ²=29.025, χ²=30.871, P<0.001); the differences in enhanced intensities of carotid atherosclerotic plaques with different echo types were statistically significant (χ²=17.951, P<0.001). The enhanced intensity of plaques was negatively correlated with the GSM value (r=−0.376, P<0.01), and the enhanced density of plaques was negatively correlated with the GSM value (r=−0.252, P<0.01). SMI and CEUS grading had good consistency (κ=0.860>0), there were statistically significant differences in new vessel densities with different SMI gradings (P<0.001), and the clinical symptoms and severity were positively correlated with SMI grading (rs=0.592>0). In conclusion, SMI and CEUS have good consistency for evaluating neovascularization in carotid plaques, and have good clinical value for evaluating neovascularization in carotid plaques.

A Review on Carotid Ultrasound Atherosclerotic Tissue Characterization and Stroke Risk Stratification in Machine Learning Framework

Cardiovascular diseases (including stroke and heart attack) are identified as the leading cause of death in today's world. However, very little is understood about the arterial mechanics of plaque buildup, arterial fibrous cap rupture, and the role of abnormalities of the vasa vasorum. Recently, ultrasonic echogenicity characteristics and morphological characterization of carotid plaque types have been shown to have clinical utility in classification of stroke risks. Furthermore, this characterization supports aggressive and intensive medical therapy as well as procedures, including endarterectomy and stenting. This is the first state-of-the-art review to provide a comprehensive understanding of the field of ultrasonic vascular morphology tissue characterization. This paper presents fundamental and advanced ultrasonic tissue characterization and feature extraction methods for analyzing plaque. Additionally, the paper shows how the risk stratification is achieved using machine learning paradigms. More advanced methods need to be developed which can segment the carotid artery walls into multiple regions such as the bulb region and areas both proximal and distal to the bulb. Furthermore, multimodality imaging is needed for validation of such advanced methods for stroke and cardiovascular risk stratification.

Prediction of the time period of stroke based on ultrasound image analysis of initially asymptomatic carotid plaques

Non-invasive ultrasound imaging of carotid plaques can provide information on the characteristics of the arterial wall including the size, morphology and texture of the atherosclerotic plaques. Several studies were carried out that demonstrated the usefulness of these feature sets for differentiating between asymptomatic and symptomatic plaques and their corresponding cerebrovascular risk stratification. The aim of this study was to develop predictive modelling for estimating the time period of a stroke event by determining the risk for short term (less or equal to three years) or long term (more than three years) events. Data from 108 patients that had a stroke event have been used. The information collected included clinical and ultrasound imaging data. The prediction was performed at base line where patients were still asymptomatic. Several image texture analysis and clinical features were used in order to create a classification model. The different features were statistically analyzed and we conclude that image texture analysis features extracted using Spatial Gray Level Dependencies method had the best statistical significance. Several predictive models were derived based on Binary Logistic Regression (BLR) and Support Vector Machines (SVM) modelling. The best results were obtained with the SVM modelling models with an average correct classifications score of 77±7% for differentiating between stroke event occurrences within 3 years versus more than 3 years. Further work is needed in investigating additional multiscale texture analysis features as well as more modelling techniques on more subjects.

A Comparison of Ultrasound Intima-Media Thickness Measurements of the Left and Right Common Carotid Artery

The intima-media thickness (IMT) of the common carotid artery (CCA) is an established indicator of cardiovascular disease (CVD). There have been reports about the difference between the left and the right sides of the CCA IMT and their relation with CVD. In this paper, we propose an automated system based on image normalization, speckle reduction filtering, and snakes segmentation, for segmenting the CCA, perform IMT measurements, and provide the differences between the left and the right sides. The study was performed on 1104 longitudinal-section ultrasound images acquired from 568 men and 536 women out of which 125 had cardiovascular symptoms (CVD). A cardiovascular expert manually delineated the IMT for the normal and the CVD groups. The corresponding (normal versus CVD) IMT mean ± standard deviation values for the left and the right sides were 0.74 ± 0.24 versus 0.87 ± 0.24 mm and 0.70 ± 0.17 versus 0.80 ± 0.18 mm, respectively. The main findings of this paper can be summarized as follows: 1) there was no significant difference between the CCA left side IMT and the right side IMT. These findings suggest that the measurement of the CCA IMT on one side only is needed for the normal group (and this is in agreement with other studies); 2) there were statistical significant differences for the IMT measurements between the normal group and the CVD group for both the left and the right sides; 3) there was an increasing linear relationship of the left and the right IMT measurements with age for the normal group; and to a lesser extend for the CVD group; 4) no statistical significant differences were found between the manual and the automated IMT measurements for both sides; and 5) the best result for classification disease modeling, using support vector machines, to discriminate between the normal and the CVD groups was a 64%±3.5% correct classifications score when using both the left and the right IMT automated measurements. Further research is required for estimating differences and similarities between left and right intima media complex structure and morphology and their variability with texture features for differentiating between the normal and the CVD group.

Atherosclerotic plaque component segmentation in combined carotid MRI and CTA data incorporating class label uncertainty

Atherosclerotic plaque composition can indicate plaque vulnerability. We segment atherosclerotic plaque components from the carotid artery on a combination of in vivo MRI and CT-angiography (CTA) data using supervised voxelwise classification. In contrast to previous studies the ground truth for training is directly obtained from 3D registration with histology for fibrous and lipid-rich necrotic tissue, and with μCT for calcification. This registration does, however, not provide accurate voxelwise correspondence. We therefore evaluate three approaches that incorporate uncertainty in the ground truth used for training: I) soft labels are created by Gaussian blurring of the original binary histology segmentations to reduce weights at the boundaries between components, and are weighted by the estimated registration accuracy of the histology and in vivo imaging data (measured by overlap), II) samples are weighted by the local contour distance of the lumen and outer wall between histology and in vivo data, and III) 10% of each class is rejected by Gaussian outlier rejection. Classification was evaluated on the relative volumes (% of tissue type in the vessel wall) for calcified, fibrous and lipid-rich necrotic tissue, using linear discriminant (LDC) and support vector machine (SVM) classification. In addition, the combination of MRI and CTA data was compared to using only one imaging modality. Best results were obtained by LDC and outlier rejection: the volume error per vessel was 0.9±1.0% for calcification, 12.7±7.6% for fibrous and 12.1±8.1% for necrotic tissue, with Spearman rank correlation coefficients of 0.91 (calcification), 0.80 (fibrous) and 0.81 (necrotic). While segmentation using only MRI features yielded low accuracy for calcification, and segmentation using only CTA features yielded low accuracy for necrotic tissue, the combination of features from MRI and CTA gave good results for all studied components.

Robust information gain based fuzzy c-means clustering and classification of carotid artery ultrasound images

In this paper, a robust method is proposed for segmentation of medical images by exploiting the concept of information gain. Medical images contain inherent noise due to imaging equipment, operating environment and patient movement during image acquisition. A robust medical image segmentation technique is thus inevitable for accurate results in subsequent stages. The clustering technique proposed in this work updates fuzzy membership values and cluster centroids based on information gain computed from the local neighborhood of a pixel. The proposed approach is less sensitive to noise and produces homogeneous clustering. Experiments are performed on medical and non-medical images and results are compared with state of the art segmentation approaches. Analysis of visual and quantitative results verifies that the proposed approach outperforms other techniques both on noisy and noise free images. Furthermore, the proposed technique is used to segment a dataset of 300 real carotid artery ultrasound images. A decision system for plaque detection in the carotid artery is then proposed. Intima media thickness (IMT) is measured from the segmented images produced by the proposed approach. A feature vector based on IMT values is constructed for making decision about the presence of plaque in carotid artery using probabilistic neural network (PNN). The proposed decision system detects plaque in carotid artery images with high accuracy. Finally, effect of the proposed segmentation technique has also been investigated on classification of carotid artery ultrasound images.

Ultrasonography of carotid plaque for the prevention of stroke

A carotid ultrasonography is a non-invasive technique that provides an accurate and reliable characterization of the broad spectrum of carotid arteriosclerosis, from the intima-media thickness to the atherosclerotic plaque. Carotid ultrasonography has become a useful tool for identifying patients at high risk of stroke and selecting those who can benefit most from revascularization therapies such as carotid endarterectomy and stenting. In addition to the degree of stenosis, plaque echomorphology has emerged in recent years as an important contributory factor to stroke risk. Changes in plaque echogenicity, as measured by the quantitative computer-assisted ultrasonography index, could be a marker of plaque instability as well as an indicator of plaque remodeling, thereby providing the means for monitoring anti-atherosclerosis drugs such as statins.

Association of ultrasonic texture and echodensity features between sides in patients with bilateral carotid atherosclerosis

OBJECTIVES

Our objective was to estimate the correlation of echodensity and textural features, using ultrasound and digital image analysis, between plaques in patients with bilateral carotid stenosis.

DESIGN

Cross-sectional observational study.

METHODS

Patients undergoing carotid endarterectomy were recruited from Vascular Surgery at the Royal Victoria and Jewish General hospitals in Montreal, Canada. Bilateral pre-operative carotid ultrasound and digital image analysis was performed to extract echodensity and textural features using a commercially available Plaque Texture Analysis software (LifeQMedical Ltd). Principal component analysis (PCA) was performed. Partial correlation coefficients for PCA and individual imaging variables between surgical and contralateral plaques were calculated with adjustment for age, sex, contralateral stenosis, and statin use.

RESULTS

In the whole group (n = 104), the six identified PCA variables and 42/50 individual imaging variables were moderately correlated (r = .211-.641). Correlations between sides were increased in patients with ≥50% contralateral stenosis and symptomatic patients.

CONCLUSION

Textural and echodensity features of carotid plaques were similar between two sides in patients with bilateral stenosis, supporting the notion that plaque instability is determined by systemic factors. Patients with unstable features of one plaque should perhaps be monitored more closely or treated more aggressively for their contralateral stenosis, particularly if this is hemodynamically significant.

Cardiovascular health informatics: risk screening and intervention

Despite enormous efforts to prevent cardiovascular disease (CVD) in the past, it remains the leading cause of death in most countries worldwide. Around two-thirds of these deaths are due to acute events, which frequently occur suddenly and are often fatal before medical care can be given. New strategies for screening and early intervening CVD, in addition to the conventional methods, are therefore needed in order to provide personalized and pervasive healthcare. In this special issue, selected emerging technologies in health informatics for screening and intervening CVDs are reported. These papers include reviews or original contributions on 1) new potential genetic biomarkers for screening CVD outcomes and high-throughput techniques for mining genomic data; 2) new imaging techniques for obtaining faster and higher resolution images of cardiovascular imaging biomarkers such as the cardiac chambers and atherosclerotic plaques in coronary arteries, as well as possible automatic segmentation, identification, or fusion algorithms; 3) new physiological biomarkers and novel wearable and home healthcare technologies for monitoring them in daily lives; 4) new personalized prediction models of plaque formation and progression or CVD outcomes; and 5) quantifiable indices and wearable systems to measure them for early intervention of CVD through lifestyle changes. It is hoped that the proposed technologies and systems covered in this special issue can result in improved CVD management and treatment at the point of need, offering a better quality of life to the patient.