Comparison of multiresolution features for texture classification of carotid atherosclerosis from B-mode ultrasound

Radiomics and artificial intelligence: General notions and applications in the carotid vulnerable plaque

Carotid atherosclerosis plays a substantial role in cardiovascular morbidity and mortality. Given the multifaceted impact of this disease, there has been increasing interest in harnessing artificial intelligence (AI) and radiomics as complementary tools for the quantitative analysis of medical imaging data. This integrated approach holds promise not only in refining medical imaging data analysis but also in optimizing the utilization of radiologists' expertise. By automating time consuming tasks, AI allows radiologists to focus on more pertinent responsibilities. Simultaneously, the capacity of AI in radiomics to extract nuanced patterns from raw data enhances the exploration of carotid atherosclerosis, advancing efforts in terms of (1) early detection and diagnosis, (2) risk stratification and predictive modeling, (3) improving workflow efficiency, and (4) contributing to advancements in research. This review provides an overview of general concepts related to radiomics and AI, along with their application in the field of carotid vulnerable plaque. It also offers insights into various research studies conducted on this topic across different imaging techniques.

Optimal Electrodermal Activity Segment for Enhanced Emotion Recognition Using Spectrogram-Based Feature Extraction and Machine Learning

In clinical and scientific research on emotion recognition using physiological signals, selecting the appropriate segment is of utmost importance for enhanced results. In our study, we optimized the electrodermal activity (EDA) segment for an emotion recognition system. Initially, we obtained EDA signals from two publicly available datasets: the Continuously annotated signals of emotion (CASE) and Wearable stress and affect detection (WESAD) for 4-class dimensional and three-class categorical emotional classification, respectively. These signals were pre-processed, and decomposed into phasic signals using the 'convex optimization to EDA' method. Further, the phasic signals were segmented into two equal parts, each subsequently segmented into five nonoverlapping windows. Spectrograms were then generated using short-time Fourier transform and Mel-frequency cepstrum for each window, from which we extracted 85 features. We built four machine learning models for the first part, second part, and whole phasic signals to investigate their performance in emotion recognition. In the CASE dataset, we achieved the highest multi-class accuracy of 62.54% using the whole phasic and 61.75% with the second part phasic signals. Conversely, the WESAD dataset demonstrated superior performance in three-class emotions classification, attaining an accuracy of 96.44% for both whole phasic and second part phasic segments. As a result, the second part of EDA is strongly recommended for optimal outcomes.

Predictive stroke risk model with vision transformer-based Doppler features

BACKGROUND

Acute stroke is the leading cause of death and disability globally, with an estimated 16 million cases each year. The progression of carotid stenosis reduces blood flow to the intracranial vasculature, causing stroke. Early recognition of ischemic stroke is crucial for disease treatment and management.

PURPOSE

A computer-aided diagnosis (CAD) system was proposed in this study to rapidly evaluate ischemic stroke in carotid color Doppler (CCD).

METHODS

Based on the ground truth from the clinical examination report, the vision transformer (ViT) features extracted from all CCD images (513 stroke and 458 normal images) were combined in machine learning classifiers to generate the likelihood of ischemic stroke for each image. The pretrained weights from ImageNet reduced the time-consuming training process. The accuracy, sensitivity, specificity, and area under the receiver operating characteristic curve were calculated to evaluate the stroke prediction model. The chi-square test, DeLong test, and Bonferroni correction for multiple comparisons were applied to deal with the type-I error. Only p values equal to or less than 0.00125 were considered to be statistically significant.

RESULTS

The proposed CAD system achieved an accuracy of 89%, a sensitivity of 94%, a specificity of 84%, and an area under the receiver operating characteristic curve of 0.95, outperforming the convolutional neural networks AlexNet (82%, p < 0.001), Inception-v3 (78%, p < 0.001), ResNet101 (84%, p < 0.001), and DenseNet201 (85%, p < 0.01). The computational time in model training was only 30 s, which would be efficient and practical in clinical use.

CONCLUSIONS

The experiment shows the promising use of CCD images in stroke estimation. Using the pretrained ViT architecture, the image features can be automatically and efficiently generated without human intervention. The proposed CAD system provides a rapid and reliable suggestion for diagnosing ischemic stroke.

The Ultrasound Window Into Vascular Ageing: A Technology Review by the VascAgeNet COST Action

Non-invasive ultrasound (US) imaging enables the assessment of the properties of superficial blood vessels. Various modes can be used for vascular characteristics analysis, ranging from radiofrequency (RF) data, Doppler- and standard B/M-mode imaging, to more recent ultra-high frequency and ultrafast techniques. The aim of the present work was to provide an overview of the current state-of-the-art non-invasive US technologies and corresponding vascular ageing characteristics from a technological perspective. Following an introduction about the basic concepts of the US technique, the characteristics considered in this review are clustered into: 1) vessel wall structure; 2) dynamic elastic properties, and 3) reactive vessel properties. The overview shows that ultrasound is a versatile, non-invasive, and safe imaging technique that can be adopted for obtaining information about function, structure, and reactivity in superficial arteries. The most suitable setting for a specific application must be selected according to spatial and temporal resolution requirements. The usefulness of standardization in the validation process and performance metric adoption emerges. Computer-based techniques should always be preferred to manual measures, as long as the algorithms and learning procedures are transparent and well described, and the performance leads to better results. Identification of a minimal clinically important difference is a crucial point for drawing conclusions regarding robustness of the techniques and for the translation into practice of any biomarker.

Emerging Feature Extraction Techniques for Machine Learning-Based Classification of Carotid Artery Ultrasound Images

Plaque deposits in the carotid artery are the major cause of stroke and atherosclerosis. Ultrasound imaging is used as an early indicator of disease progression. Classification of the images to identify plaque presence and intima-media thickness (IMT) by machine learning algorithms requires features extracted from the images. A total of 361 images were used for feature extraction, which will assist in further classification of the carotid artery. This study presents the extraction of 65 features, which constitute of shape, texture, histogram, correlogram, and morphology features. Principal component analysis (PCA)-based feature selection is performed, and the 22 most significant features, which will improve the classification accuracy, are selected. Naive Bayes algorithm and dynamic learning vector quantization (DLVQ)-based machine learning classifications are performed with the extracted and selected features, and analysis is performed.

CurveletTransform-Based Texture Analysis of Carotid B-mode Ultrasound Images in Asymptomatic Men With Moderate and Severe Stenoses: A Preliminary Clinical Study

The curvelet transform, which represents images in terms of their geometric and textural characteristics, was investigated toward revealing differences between moderate (50%-69%, n = 11) and severe (70%-100%, n = 14) stenosis asymptomatic plaque from B-mode ultrasound. Texture features were estimated in original and curvelet transformed images of atheromatous plaque (PL), the adjacent arterial wall (intima-media [IM]) and the plaque shoulder (SH) (i.e., the boundary between plaque and wall), separately at end systole and end diastole. Seventeen features derived from the original images were significantly different between the two groups (4 for IM, 3 for PL and 10 for SH; 9 for end diastole and 8 for end systole); 19 of 234 features (2 for IM and 17 for SH; 8 for end systole and 11 for end diastole) derived from curvelet transformed images were significantly higher in the patients with severe stenosis, indicating higher magnitude, variation and randomness of image gray levels. In these patients, lower body height and higher serum creatinine concentration were observed. Our findings suggest that (a) moderate and severe plaque have similar curvelet-based texture properties, and (b) IM and SH provide useful information about arterial wall pathophysiology, complementary to PL itself. The curvelet transform is promising for identifying novel indices of cardiovascular risk and warrants further investigation in larger cohorts.

Ten Fast Transfer Learning Models for Carotid Ultrasound Plaque Tissue Characterization in Augmentation Framework Embedded with Heatmaps for Stroke Risk Stratification

Background and Purpose: Only 1-2% of the internal carotid artery asymptomatic plaques are unstable as a result of >80% stenosis. Thus, unnecessary efforts can be saved if these plaques can be characterized and classified into symptomatic and asymptomatic using non-invasive B-mode ultrasound. Earlier plaque tissue characterization (PTC) methods were machine learning (ML)-based, which used hand-crafted features that yielded lower accuracy and unreliability. The proposed study shows the role of transfer learning (TL)-based deep learning models for PTC. Methods: As pertained weights were used in the supercomputer framework, we hypothesize that transfer learning (TL) provides improved performance compared with deep learning. We applied 11 kinds of artificial intelligence (AI) models, 10 of them were augmented and optimized using TL approaches-a class of Atheromatic™ 2.0 TL (AtheroPoint™, Roseville, CA, USA) that consisted of (i-ii) Visual Geometric Group-16, 19 (VGG16, 19); (iii) Inception V3 (IV3); (iv-v) DenseNet121, 169; (vi) XceptionNet; (vii) ResNet50; (viii) MobileNet; (ix) AlexNet; (x) SqueezeNet; and one DL-based (xi) SuriNet-derived from UNet. We benchmark 11 AI models against our earlier deep convolutional neural network (DCNN) model. Results: The best performing TL was MobileNet, with accuracy and area-under-the-curve (AUC) pairs of 96.10 ± 3% and 0.961 (p < 0.0001), respectively. In DL, DCNN was comparable to SuriNet, with an accuracy of 95.66% and 92.7 ± 5.66%, and an AUC of 0.956 (p < 0.0001) and 0.927 (p < 0.0001), respectively. We validated the performance of the AI architectures with established biomarkers such as greyscale median (GSM), fractal dimension (FD), higher-order spectra (HOS), and visual heatmaps. We benchmarked against previously developed Atheromatic™ 1.0 ML and showed an improvement of 12.9%. Conclusions: TL is a powerful AI tool for PTC into symptomatic and asymptomatic plaques.

Texture Analysis and its Applications in Biomedical Imaging: A Survey

Texture analysis describes a variety of image analysis techniques that quantify the variation in intensity and pattern. This paper provides an overview of several texture analysis approaches addressing the rationale supporting them, their advantages, drawbacks, and applications. This surveys emphasis is in collecting and categorising over five decades of active research on texture analysis. Brief descriptions of different approaches are presented along with application examples. From a broad range of texture analysis applications, this surveys final focus is on biomedical image analysis. An up-to-date list of biological tissues and organs in which disorders produce texture changes that may be used to spot disease onset and progression is provided. Finally, the role of texture analysis methods as biomarkers of disease is summarised.

Multimodality carotid plaque tissue characterization and classification in the artificial intelligence paradigm: a narrative review for stroke application

Cardiovascular disease (CVD) is one of the leading causes of morbidity and mortality in the United States of America and globally. Carotid arterial plaque, a cause and also a marker of such CVD, can be detected by various non-invasive imaging modalities such as magnetic resonance imaging (MRI), computer tomography (CT), and ultrasound (US). Characterization and classification of carotid plaque-type in these imaging modalities, especially into symptomatic and asymptomatic plaque, helps in the planning of carotid endarterectomy or stenting. It can be challenging to characterize plaque components due to (I) partial volume effect in magnetic resonance imaging (MRI) or (II) varying Hausdorff values in plaque regions in CT, and (III) attenuation of echoes reflected by the plaque during US causing acoustic shadowing. Artificial intelligence (AI) methods have become an indispensable part of healthcare and their applications to the non-invasive imaging technologies such as MRI, CT, and the US. In this narrative review, three main types of AI models (machine learning, deep learning, and transfer learning) are analyzed when applied to MRI, CT, and the US. A link between carotid plaque characteristics and the risk of coronary artery disease is presented. With regard to characterization, we review tools and techniques that use AI models to distinguish carotid plaque types based on signal processing and feature strengths. We conclude that AI-based solutions offer an accurate and robust path for tissue characterization and classification for carotid artery plaque imaging in all three imaging modalities. Due to cost, user-friendliness, and clinical effectiveness, AI in the US has dominated the most.

Carotid artery ultrasound image analysis: A review of the literature

Stroke is one of the prominent causes of death in the recent days. The existence of susceptible plaque in the carotid artery can be used in ascertaining the possibilities of cardiovascular diseases and long-term disabilities. The imaging modality used for early screening of the disease is B-mode ultrasound image of the person in the artery area. The objective of this article is to give a widespread review of the imaging modes and methods used for studying the carotid artery for identifying stroke, atherosclerosis and related cardiovascular diseases. We encompass the review in methods used for artery wall tracking, intima-media, and lumen segmentation which will help in finding the extent of the disease. Due to the characteristics of the imaging modality used, the images have speckle noise which worsens the image quality. Adaptive homomorphic filtering with wavelet and contourlet transforms, Levy Shrink, gamma distribution were used for image denoising. Learning-based neural network approaches for denoising give better edge preservation. Domain knowledge-based segmentation approaches have proved to provide more accurate intima-media thickness measurements. There is a requirement of useful fully automatic segmentation approaches, 3D, 4D systems, and plaque motion analysis. Taking into consideration the image priors like geometry, imaging physics, intensity and temporal data, image analysis has to be performed. Encouragingly more research has focused on content-specific segmentation and classification techniques. With the evaluation of machine learning algorithms, classifying the image as with or without a fat deposit has gained better accuracy and sensitivity. Machine learning-based approaches like self-organizing map, k-nearest neighborhood and support vector machine achieve promising accuracy and sensitivity in classification. The literature reveals that there is more scope in identifying a patient-specific model in a fully automatic manner.

Rheumatoid Arthritis: Atherosclerosis Imaging and Cardiovascular Risk Assessment Using Machine and Deep Learning-Based Tissue Characterization

PURPOSE OF THE REVIEW

Rheumatoid arthritis (RA) is a chronic, autoimmune disease which may result in a higher risk of cardiovascular (CV) events and stroke. Tissue characterization and risk stratification of patients with rheumatoid arthritis are a challenging problem. Risk stratification of RA patients using traditional risk factor-based calculators either underestimates or overestimates the CV risk. Advancements in medical imaging have facilitated early and accurate CV risk stratification compared to conventional cardiovascular risk calculators.

RECENT FINDING

In recent years, a link between carotid atherosclerosis and rheumatoid arthritis has been widely discussed by multiple studies. Imaging the carotid artery using 2-D ultrasound is a noninvasive, economic, and efficient imaging approach that provides an atherosclerotic plaque tissue-specific image. Such images can help to morphologically characterize the plaque type and accurately measure vital phenotypes such as media wall thickness and wall variability. Intelligence-based paradigms such as machine learning- and deep learning-based techniques not only automate the risk characterization process but also provide an accurate CV risk stratification for better management of RA patients. This review provides a brief understanding of the pathogenesis of RA and its association with carotid atherosclerosis imaged using the B-mode ultrasound technique. Lacunas in traditional risk scores and the role of machine learning-based tissue characterization algorithms are discussed and could facilitate cardiovascular risk assessment in RA patients. The key takeaway points from this review are the following: (i) inflammation is a common link between RA and atherosclerotic plaque buildup, (ii) carotid ultrasound is a better choice to characterize the atherosclerotic plaque tissues in RA patients, and (iii) intelligence-based paradigms are useful for accurate tissue characterization and risk stratification of RA patients.

Fractal dimension based carotid plaque characterization from three-dimensional ultrasound images

Irregularity of the plaque surface associated with previous plaque rupture plays an important role in the risk estimation of stroke caused by carotid atherosclerotic lesions. Thus, the aim of this study is to develop and validate novel vulnerability biomarkers from three-dimensional ultrasound (3DUS) images by analyzing the surface morphological characteristics of carotid plaque using fractal geometry features. In the experiments, a total of 38 3DUS plaque images were obtained from two groups of patients treated with 80 mg of atorvastatin or placebo daily for 3 months respectively. Two types of 3D fractal dimensions (FDs) were used to describe the smoothness of plaque surface morphology and the roughness from intensity of 3DUS images. Student's t test showed that the two fractal features were effective for detecting the statin-related changes in carotid atherosclerosis with p < 0.00023 and p < 0.0113 respectively. It was concluded that the 3D FD measurements were effective for analyzing carotid plaque characteristics and especially effective for evaluating the impact of atorvastatin treatment. Graphical abstract ᅟ.

An improved deep learning approach for detection of thyroid papillary cancer in ultrasound images

Unlike daily routine images, ultrasound images are usually monochrome and low-resolution. In ultrasound images, the cancer regions are usually blurred, vague margin and irregular in shape. Moreover, the features of cancer region are very similar to normal or benign tissues. Therefore, training ultrasound images with original Convolutional Neural Network (CNN) directly is not satisfactory. In our study, inspired by state-of-the-art object detection network Faster R-CNN, we develop a detector which is more suitable for thyroid papillary carcinoma detection in ultrasound images. In order to improve the accuracy of the detection, we add a spatial constrained layer to CNN so that the detector can extract the features of surrounding region in which the cancer regions are residing. In addition, by concatenating the shallow and deep layers of the CNN, the detector can detect blurrier or smaller cancer regions. The experiments demonstrate that the potential of this new methodology can reduce the workload for pathologists and increase the objectivity of diagnoses. We find that 93:5% of papillary thyroid carcinoma regions could be detected automatically while 81:5% of benign and normal tissue could be excluded without the use of any additional immunohistochemical markers or human intervention.

A medical imaging analysis system for trigger finger using an adaptive texture-based active shape model (ATASM) in ultrasound images

Trigger finger has become a prevalent disease that greatly affects occupational activity and daily life. Ultrasound imaging is commonly used for the clinical diagnosis of trigger finger severity. Due to image property variations, traditional methods cannot effectively segment the finger joint’s tendon structure. In this study, an adaptive texture-based active shape model method is used for segmenting the tendon and synovial sheath. Adapted weights are applied in the segmentation process to adjust the contribution of energy terms depending on image characteristics at different positions. The pathology is then determined according to the wavelet and co-occurrence texture features of the segmented tendon area. In the experiments, the segmentation results have fewer errors, with respect to the ground truth, than contours drawn by regular users. The mean values of the absolute segmentation difference of the tendon and synovial sheath are 3.14 and 4.54 pixels, respectively. The average accuracy of pathological determination is 87.14%. The segmentation results are all acceptable in data of both clear and fuzzy boundary cases in 74 images. And the symptom classifications of 42 cases are also a good reference for diagnosis according to the expert clinicians’ opinions.

Evaluation of carotid plaque echogenicity based on the integral of the cumulative probability distribution using gray-scale ultrasound images

OBJECTIVE

Carotid plaque echogenicity is associated with the risk of cardiovascular events. Gray-scale median (GSM) of the ultrasound image of carotid plaques has been widely used as an objective method for evaluation of plaque echogenicity in patients with atherosclerosis. We proposed a computer-aided method to evaluate plaque echogenicity and compared its efficiency with GSM.

METHODS

One hundred and twenty-five carotid plaques (43 echo-rich, 35 intermediate, 47 echolucent) were collected from 72 patients in this study. The cumulative probability distribution curves were obtained based on statistics of the pixels in the gray-level images of plaques. The area under the cumulative probability distribution curve (AUCPDC) was calculated as its integral value to evaluate plaque echogenicity.

RESULTS

The classification accuracy for three types of plaques is 78.4% (kappa value, κ = 0.673), when the AUCPDC is used for classifier training, whereas GSM is 64.8% (κ = 0.460). The receiver operating characteristic curves were produced to test the effectiveness of AUCPDC and GSM for the identification of echolucent plaques. The area under the curve (AUC) was 0.817 when AUCPDC was used for training the classifier, which is higher than that achieved using GSM (AUC = 0.746). Compared with GSM, the AUCPDC showed a borderline association with coronary heart disease (Spearman r = 0.234, p = 0.050).

CONCLUSIONS

Our experimental results suggest that AUCPDC analysis is a promising method for evaluation of plaque echogenicity and predicting cardiovascular events in patients with plaques.

Technical Note: Image filtering to make computer-aided detection robust to image reconstruction kernel choice in lung cancer CT screening

PURPOSE

In lung cancer computed tomography (CT) screening, the performance of a computer-aided detection (CAD) system depends on the selection of the image reconstruction kernel. To reduce this dependence on reconstruction kernels, the authors propose a novel application of an image filtering method previously proposed by their group.

METHODS

The proposed filtering process uses the ratio of modulation transfer functions (MTFs) of two reconstruction kernels as a filtering function in the spatial-frequency domain. This method is referred to as MTFratio filtering. Test image data were obtained from CT screening scans of 67 subjects who each had one nodule. Images were reconstructed using two kernels: fSTD (for standard lung imaging) and fSHARP (for sharp edge-enhancement lung imaging). The MTFratio filtering was implemented using the MTFs measured for those kernels and was applied to the reconstructed fSHARP images to obtain images that were similar to the fSTD images. A mean filter and a median filter were applied (separately) for comparison. All reconstructed and filtered images were processed using their prototype CAD system.

RESULTS

The MTFratio filtered images showed excellent agreement with the fSTD images. The standard deviation for the difference between these images was very small, ∼6.0 Hounsfield units (HU). However, the mean and median filtered images showed larger differences of ∼48.1 and ∼57.9 HU from the fSTD images, respectively. The free-response receiver operating characteristic (FROC) curve for the fSHARP images indicated poorer performance compared with the FROC curve for the fSTD images. The FROC curve for the MTFratio filtered images was equivalent to the curve for the fSTD images. However, this similarity was not achieved by using the mean filter or median filter.

CONCLUSIONS

The accuracy of MTFratio image filtering was verified and the method was demonstrated to be effective for reducing the kernel dependence of CAD performance.

A Review on Carotid Ultrasound Atherosclerotic Tissue Characterization and Stroke Risk Stratification in Machine Learning Framework

Cardiovascular diseases (including stroke and heart attack) are identified as the leading cause of death in today's world. However, very little is understood about the arterial mechanics of plaque buildup, arterial fibrous cap rupture, and the role of abnormalities of the vasa vasorum. Recently, ultrasonic echogenicity characteristics and morphological characterization of carotid plaque types have been shown to have clinical utility in classification of stroke risks. Furthermore, this characterization supports aggressive and intensive medical therapy as well as procedures, including endarterectomy and stenting. This is the first state-of-the-art review to provide a comprehensive understanding of the field of ultrasonic vascular morphology tissue characterization. This paper presents fundamental and advanced ultrasonic tissue characterization and feature extraction methods for analyzing plaque. Additionally, the paper shows how the risk stratification is achieved using machine learning paradigms. More advanced methods need to be developed which can segment the carotid artery walls into multiple regions such as the bulb region and areas both proximal and distal to the bulb. Furthermore, multimodality imaging is needed for validation of such advanced methods for stroke and cardiovascular risk stratification.

Evolution-based hierarchical feature fusion for ultrasonic liver tissue characterization

This paper presents an evolution-based hierarchical feature fusion system that selects the dominant features among multiple feature vectors for ultrasonic liver tissue characterization. After extracting the spatial gray-level dependence matrices, multiresolution fractal feature vectors and multiresolution energy feature vectors, the system utilizes evolution-based algorithms to select features. In each feature space, features are selected independently to compile a feature subset. As the features of different feature vectors contain complementary information, a feature fusion process is used to combine the subsets generated from different vectors. Features are then selected from the fused feature vector to form a fused feature subset. The selected features are used to classify ultrasonic images of liver tissue into three classes: hepatoma, cirrhosis, and normal liver. Experiment results show that the classification accuracy of the fused feature subset is superior to that derived by using individual feature subsets. Moreover, the findings demonstrate that the proposed algorithm is capable of selecting discriminative features among multiple feature vectors to facilitate the early detection of hepatoma and cirrhosis via ultrasonic liver imaging.

Ultrasound texture-based CAD system for detecting neuromuscular diseases

PURPOSE

Diagnosis of neuromuscular diseases in ultrasonography is a challenging task since experts are often unable to discriminate between healthy and pathological cases. A computer-aided diagnosis (CAD) system for skeletal muscle ultrasonography was developed and tested for myositis detection in ultrasound images of biceps brachii.

METHODS

Several types of features were extracted from rectangular and polygonal image regions-of-interest (ROIs), including first-order statistics, wavelet-based features, and Haralick's features. Features were chosen that are sensitive to the change in contrast and structure for pathological ultrasound images of neuromuscular diseases. The number of features was reduced by applying different sequential feature selection strategies followed by a supervised principal component analysis. For classification, two linear approaches were investigated: Fisher's classifier and the linear support vector machine (SVM) as well as the nonlinear [Formula: see text]-nearest neighbor approach. The CAD system was benchmarked on datasets of 18 subjects, seven of which were healthy, while 11 were affected by myositis. Three expert radiologists provided pre-classification and testing interpretations.

RESULTS

Leave-one-out cross-validation on the training data revealed that the linear SVM was best suited for discriminating healthy and pathological muscle tissue, achieving 85/87 % accuracy, 90 % sensitivity, and 83/85 % specificity, depending on the radiologist.

CONCLUSION

A muscle ultrasonography CAD system was developed, allowing a classification of an ultrasound image by one-click positioning of rectangular ROIs with minimal user effort. The applicability of the system was demonstrated with the challenging example of myositis detection, showing highly accurate results that were robust to imprecise user input.

A novel computerized tool to stratify risk in carotid atherosclerosis using kinematic features of the arterial wall

Valid characterization of carotid atherosclerosis (CA) is a crucial public health issue, which would limit the major risks held by CA for both patient safety and state economies. This paper investigated the unexplored potential of kinematic features in assisting the diagnostic decision for CA in the framework of a computer-aided diagnosis (CAD) tool. To this end, 15 CAD schemes were designed and were fed with a wide variety of kinematic features of the atherosclerotic plaque and the arterial wall adjacent to the plaque for 56 patients from two different hospitals. The CAD schemes were benchmarked in terms of their ability to discriminate between symptomatic and asymptomatic patients and the combination of the Fisher discriminant ratio, as a feature-selection strategy, and support vector machines, in the classification module, was revealed as the optimal motion-based CAD tool. The particular CAD tool was evaluated with several cross-validation strategies and yielded higher than 88% classification accuracy; the texture-based CAD performance in the same dataset was 80%. The incorporation of kinematic features of the arterial wall in CAD seems to have a particularly favorable impact on the performance of image-data-driven diagnosis for CA, which remains to be further elucidated in future prospective studies on large datasets.

CAROTID - a web-based platform for optimal personalized management of atherosclerotic patients

Carotid atherosclerosis is the main cause of fatal cerebral ischemic events, thereby posing a major burden for public health and state economies. We propose a web-based platform named CAROTID to address the need for optimal management of patients with carotid atherosclerosis in a twofold sense: (a) objective selection of patients who need carotid-revascularization (i.e., high-risk patients), using a multifaceted description of the disease consisting of ultrasound imaging, biochemical and clinical markers, and (b) effective storage and retrieval of patient data to facilitate frequent follow-ups and direct comparisons with related cases. These two services are achieved by two interconnected modules, namely the computer-aided diagnosis (CAD) tool and the intelligent archival system, in a unified, remotely accessible system. We present the design of the platform and we describe three main usage scenarios to demonstrate the CAROTID utilization in clinical practice. Additionally, the platform was evaluated in a real clinical environment in terms of CAD performance, end-user satisfaction and time spent on different functionalities. CAROTID classification of high- and low-risk cases was 87%; the corresponding stenosis-degree-based classification would have been 61%. Questionnaire-based user satisfaction showed encouraging results in terms of ease-of-use, clinical usefulness and patient data protection. Times for different CAROTID functionalities were generally short; as an example, the time spent for generating the diagnostic decision was 5min in case of 4-s ultrasound video. Large datasets and future evaluation sessions in multiple medical institutions are still necessary to reveal with confidence the full potential of the platform.

Robust information gain based fuzzy c-means clustering and classification of carotid artery ultrasound images

In this paper, a robust method is proposed for segmentation of medical images by exploiting the concept of information gain. Medical images contain inherent noise due to imaging equipment, operating environment and patient movement during image acquisition. A robust medical image segmentation technique is thus inevitable for accurate results in subsequent stages. The clustering technique proposed in this work updates fuzzy membership values and cluster centroids based on information gain computed from the local neighborhood of a pixel. The proposed approach is less sensitive to noise and produces homogeneous clustering. Experiments are performed on medical and non-medical images and results are compared with state of the art segmentation approaches. Analysis of visual and quantitative results verifies that the proposed approach outperforms other techniques both on noisy and noise free images. Furthermore, the proposed technique is used to segment a dataset of 300 real carotid artery ultrasound images. A decision system for plaque detection in the carotid artery is then proposed. Intima media thickness (IMT) is measured from the segmented images produced by the proposed approach. A feature vector based on IMT values is constructed for making decision about the presence of plaque in carotid artery using probabilistic neural network (PNN). The proposed decision system detects plaque in carotid artery images with high accuracy. Finally, effect of the proposed segmentation technique has also been investigated on classification of carotid artery ultrasound images.

SVM-based characterization of liver ultrasound images using wavelet packet texture descriptors

A system to characterize normal liver, cirrhotic liver and hepatocellular carcinoma (HCC) evolved on cirrhotic liver is proposed in this paper. The study is performed with 56 real ultrasound images (15 normal, 16 cirrhotic and 25 HCC liver images) taken from 56 subjects. A total of 180 nonoverlapping regions of interest (ROIs), i.e. 60 from each image class, are extracted by an experienced participating radiologist. The multiresolution wavelet packet texture descriptors, i.e. mean, standard deviation and energy features, are computed from all 180 ROIs by using various compact support wavelet filters including Haar, Daubechies (db4 and db6), biorthogonal (bior3.1,bior3.3 and bior4.4), symlets (sym3 and sym5) and coiflets (coif1 and coif2). It is observed that a combined texture descriptor feature vector of length 48 consisting of 16 mean, 16 standard deviation and 16 energy features estimated from all 16 subband feature images (wavelet packets) obtained by second-level decomposition with two-dimensional wavelet packet transform by using Haar wavelet filter gives the best characterization performance of 86.6 %. Feature selection by genetic algorithm-support vector machine method increased the classification accuracy to 88.8 % with sensitivity of 90 % for detecting normal and cirrhotic cases and sensitivity of 86.6 % for HCC cases. Considering limited sensitivity of B-mode ultrasound for detecting HCCs evolved on cirrhotic liver, the sensitivity of 86.6 % for HCC lesions obtained by the proposed computer-aided diagnostic system is quite promising and suggests that the proposed system can be used in a clinical environment to support radiologists in lesion interpretation.

Robust Texture Analysis Using Multi-Resolution Gray-Scale Invariant Features for Breast Sonographic Tumor Diagnosis

Computer-aided diagnosis (CAD) systems in gray-scale breast ultrasound images have the potential to reduce unnecessary biopsy of breast masses. The purpose of our study is to develop a robust CAD system based on the texture analysis. First, gray-scale invariant features are extracted from ultrasound images via multi-resolution ranklet transform. Thus, one can apply linear support vector machines (SVMs) on the resulting gray-level co-occurrence matrix (GLCM)-based texture features for discriminating the benign and malignant masses. To verify the effectiveness and robustness of the proposed texture analysis, breast ultrasound images obtained from three different platforms are evaluated based on cross-platform training/testing and leave-one-out cross-validation (LOO-CV) schemes. We compare our proposed features with those extracted by wavelet transform in terms of receiver operating characteristic (ROC) analysis. The AUC values derived from the area under the curve for the three databases via ranklet transform are 0.918 (95% confidence interval [CI], 0.848 to 0.961), 0.943 (95% CI, 0.906 to 0.968), and 0.934 (95% CI, 0.883 to 0.961), respectively, while those via wavelet transform are 0.847 (95% CI, 0.762 to 0.910), 0.922 (95% CI, 0.878 to 0.958), and 0.867 (95% CI, 0.798 to 0.914), respectively. Experiments with cross-platform training/testing scheme between each database reveal that the diagnostic performance of our texture analysis using ranklet transform is less sensitive to the sonographic ultrasound platforms. Also, we adopt several co-occurrence statistics in terms of quantization levels and orientations (i.e., descriptor settings) for computing the co-occurrence matrices with 0.632+ bootstrap estimators to verify the use of the proposed texture analysis. These experiments suggest that the texture analysis using multi-resolution gray-scale invariant features via ranklet transform is useful for designing a robust CAD system.

Surface roughness detection of arteries via texture analysis of ultrasound images for early diagnosis of atherosclerosis

There is a strong research interest in identifying the surface roughness of the carotid arterial inner wall via texture analysis for early diagnosis of atherosclerosis. The purpose of this study is to assess the efficacy of texture analysis methods for identifying arterial roughness in the early stage of atherosclerosis. Ultrasound images of common carotid arteries of 15 normal mice fed a normal diet and 28 apoE^−/− mice fed a high-fat diet were recorded by a high-frequency ultrasound system (Vevo 2100, frequency: 40 MHz). Six different texture feature sets were extracted based on the following methods: first-order statistics, fractal dimension texture analysis, spatial gray level dependence matrix, gray level difference statistics, the neighborhood gray tone difference matrix, and the statistical feature matrix. Statistical analysis indicates that 11 of 19 texture features can be used to distinguish between normal and abnormal groups (p<0.05). When the 11 optimal features were used as inputs to a support vector machine classifier, we achieved over 89% accuracy, 87% sensitivity and 93% specificity. The accuracy, sensitivity and specificity for the k-nearest neighbor classifier were 73%, 75% and 70%, respectively. The results show that it is feasible to identify arterial surface roughness based on texture features extracted from ultrasound images of the carotid arterial wall. This method is shown to be useful for early detection and diagnosis of atherosclerosis.

Affine optical flow combined with multiscale image analysis for motion estimation of the arterial wall from B-mode ultrasound

This paper investigated the performance of affine optical flow (AFOF) in motion tracking of the arterial wall from B-mode ultrasound images and the effect of its combination with multiscale image analysis on the accuracy of the process. Multiscale AFOF (MAFOF) exploits the information obtained with AFOF from the approximation sub-images at different spatial resolution levels of the images, obtained using a 2D discrete wavelet transform. Both AFOF and MAFOF were evaluated through their application to synthetic image sequences of the common carotid artery. Multiscale image analysis increased the accuracy in motion tracking, with MAFOF yielding average displacement error reductions of 9% with respect to AFOF. The methods were also effectively applied to real ultrasound image sequences of the carotid artery. The results showed that MAFOF could be considered as a reliable estimator for arterial wall motion from B-mode ultrasound images.