Breast ultrasound despeckling using anisotropic diffusion guided by texture descriptors

BUS-BRA: A breast ultrasound dataset for assessing computer-aided diagnosis systems

PURPOSE

Computer-aided diagnosis (CAD) systems on breast ultrasound (BUS) aim to increase the efficiency and effectiveness of breast screening, helping specialists to detect and classify breast lesions. CAD system development requires a set of annotated images, including lesion segmentation, biopsy results to specify benign and malignant cases, and BI-RADS categories to indicate the likelihood of malignancy. Besides, standardized partitions of training, validation, and test sets promote reproducibility and fair comparisons between different approaches. Thus, we present a publicly available BUS dataset whose novelty is the substantial increment of cases with the above-mentioned annotations and the inclusion of standardized partitions to objectively assess and compare CAD systems.

ACQUISITION AND VALIDATION METHODS

The BUS dataset comprises 1875 anonymized images from 1064 female patients acquired via four ultrasound scanners during systematic studies at the National Institute of Cancer (Rio de Janeiro, Brazil). The dataset includes biopsy-proven tumors divided into 722 benign and 342 malignant cases. Besides, a senior ultrasonographer performed a BI-RADS assessment in categories 2 to 5. Additionally, the ultrasonographer manually outlined the breast lesions to obtain ground truth segmentations. Furthermore, 5- and 10-fold cross-validation partitions are provided to standardize the training and test sets to evaluate and reproduce CAD systems. Finally, to validate the utility of the BUS dataset, an evaluation framework is implemented to assess the performance of deep neural networks for segmenting and classifying breast lesions.

DATA FORMAT AND USAGE NOTES

The BUS dataset is publicly available for academic and research purposes through an open-access repository under the name BUS-BRA: A Breast Ultrasound Dataset for Assessing CAD Systems. BUS images and reference segmentations are saved in Portable Network Graphic (PNG) format files, and the dataset information is stored in separate Comma-Separated Value (CSV) files.

POTENTIAL APPLICATIONS

The BUS-BRA dataset can be used to develop and assess artificial intelligence-based lesion detection and segmentation methods, and the classification of BUS images into pathological classes and BI-RADS categories. Other potential applications include developing image processing methods like despeckle filtering and contrast enhancement methods to improve image quality and feature engineering for image description.

US-Net: A lightweight network for simultaneous speckle suppression and texture enhancement in ultrasound images

BACKGROUND

Numerous traditional filtering approaches and deep learning-based methods have been proposed to improve the quality of ultrasound (US) image data. However, their results tend to suffer from over-smoothing and loss of texture and fine details. Moreover, they perform poorly on images with different degradation levels and mainly focus on speckle reduction, even though texture and fine detail enhancement are of crucial importance in clinical diagnosis.

METHODS

We propose an end-to-end framework termed US-Net for simultaneous speckle suppression and texture enhancement in US images. The architecture of US-Net is inspired by U-Net, whereby a feature refinement attention block (FRAB) is introduced to enable an effective learning of multi-level and multi-contextual representative features. Specifically, FRAB aims to emphasize high-frequency image information, which helps boost the restoration and preservation of fine-grained and textural details. Furthermore, our proposed US-Net is trained essentially with real US image data, whereby real US images embedded with simulated multi-level speckle noise are used as an auxiliary training set.

RESULTS

Extensive quantitative and qualitative experiments indicate that although trained with only one US image data type, our proposed US-Net is capable of restoring images acquired from different body parts and scanning settings with different degradation levels, while exhibiting favorable performance against state-of-the-art image enhancement approaches. Furthermore, utilizing our proposed US-Net as a pre-processing stage for COVID-19 diagnosis results in a gain of 3.6% in diagnostic accuracy.

CONCLUSIONS

The proposed framework can help improve the accuracy of ultrasound diagnosis.

Speckle Reduction via Deep Content-Aware Image Prior for Precise Breast Tumor Segmentation in an Ultrasound Image

The performance of computer-aided diagnosis (CAD) systems that are based on ultrasound imaging has been enhanced owing to the advancement in deep learning. However, because of the inherent speckle noise in ultrasound images, the ambiguous boundaries of lesions deteriorate and are difficult to distinguish, resulting in the performance degradation of CAD. Although several methods have been proposed to reduce speckle noise over decades, this task remains a challenge that must be improved to enhance the performance of CAD. In this article, we propose a deep content-aware image prior (DCAIP) with a content-aware attention module (CAAM) for superior despeckling of ultrasound images without clean images. For the image prior, we developed a CAAM to deal with the content information in an input image. In this module, super-pixel pooling (SPP) is used to give attention to salient regions in an ultrasound image. Therefore, it can provide more content information regarding the input image when compared to other attention modules. The DCAIP consists of deep learning networks based on this attention module. The DCAIP is validated by applying it as a preprocessing step for breast tumor segmentation in ultrasound images, which is one of the tasks in CAD. Our method improved the segmentation performance by 15.89% in terms of the area under the precision-recall (PR) curve (AUPRC). The results demonstrate that our method enhances the quality of ultrasound images by effectively reducing speckle noise while preserving important information in the image, promising for the design of superior CAD systems.

A Novel Speckle Suppression Method with Quantitative Combination of Total Variation and Anisotropic Diffusion PDE Model

Speckle noise seriously affects synthetic aperture radar (SAR) image application. Speckle suppression aims to smooth the homogenous region while preserving edge and texture in the image. A novel speckle suppression method based on the combination of total variation and partial differential equation denoising models is proposed in this paper. Taking full account of the local statistics in the image, a quantization technique—which is different from the normal edge detection method—is supported by the variation coefficient of the image. Accordingly, a quantizer is designed to respond to both noise level and edge strength. This quantizer automatically determines the threshold of diffusion coefficient and controls the weight between total variation filter and anisotropic diffusion partial differential equation filter. A series of experiments are conducted to test the performance of the quantizer and proposed filter. Extensive experimental results have demonstrated the superiority of the proposed method with both synthetic images and natural SAR images.

Restoration and enhancement of breast ultrasound images using extended complex diffusion based unsharp masking

Ultrasound is a well-known imaging modality for the interpretation of breast cancer. It is playing very important role for breast cancer detection that are missed by mammograms. The image acquisition is usually affected by the presence of noise, artifacts, and distortion. To overcome such type of issues, there is a need of image restoration and enhancement to improve the quality of image. This paper proposes a single framework for denoising and enhancement of ultrasound images, where a smoothing filter is replaced with an extended complex diffusion-based filter in an unsharp masking technique. The performance evaluation of the proposed method is tested on real ultrasound breast cancer images database and synthetic ultrasound image. The performance evaluation comprises qualitative and quantitative evaluation along with comparative analysis of pre-existing and proposed method. The quantitative evaluation metrics are mean squared error, peak-signal-to-noise ratio, correlation parameter, normalized absolute error, universal quality index, similarity structure index, edge preservation index, a measure of enhancement, a measure of enhancement by entropy, and second derivative like measurement. The result specifies that the proposed method is better suited approach for the removal of speckle noise which follows Rayleigh distribution, restoration of information, enhancement of abnormalities, and proper edge preservation.

Phase asymmetry ultrasound despeckling with fractional anisotropic diffusion and total variation

We propose an ultrasound speckle filtering method for not only preserving various edge features but also filtering tissue-dependent complex speckle noises in ultrasound images. The key idea is to detect these various edges using a phase congruence-based edge significance measure called phase asymmetry (PAS), which is invariant to the intensity amplitude of edges and takes 0 in non-edge smooth regions and 1 at the idea step edge, while also taking intermediate values at slowly varying ramp edges. By leveraging the PAS metric in designing weighting coefficients to maintain a balance between fractional-order anisotropic diffusion and total variation (TV) filters in TV cost function, we propose a new fractional TV framework to not only achieve the best despeckling performance with ramp edge preservation but also reduce the staircase effect produced by integral-order filters. Then, we exploit the PAS metric in designing a new fractional-order diffusion coefficient to properly preserve low-contrast edges in diffusion filtering. Finally, different from fixed fractional-order diffusion filters, an adaptive fractional order is introduced based on the PAS metric to enhance various weak edges in the spatially transitional areas between objects. The proposed fractional TV model is minimized using the gradient descent method to obtain the final denoised image. The experimental results and real application of ultrasound breast image segmentation show that the proposed method outperforms other state-of-the-art ultrasound despeckling filters for both speckle reduction and feature preservation in terms of visual evaluation and quantitative indices. The best scores on feature similarity indices have achieved 0.867, 0.844 and 0.834 under three different levels of noise, while the best breast ultrasound segmentation accuracy in terms of the mean and median dice similarity coefficient are 96.25% and 96.15%, respectively.

Patch similarity in ultrasound images with hypothesis testing and stochastic distances

Patch-based techniques have been largely applied to process ultrasound (US) images, with applications in various fields as denoising, segmentation, and registration. An important aspect of the performance of these techniques is how to measure the similarity between patches. While it is usual to base the similarity on the Euclidean distance when processing images corrupted by additive Gaussian noise, finding measures suitable for the multiplicative nature of the speckle in US images is still an open research. In this work, we propose new stochastic distances based on the statistical characteristics of speckle in US. Additionally, we derive statistical measures to compose hypothesis tests that allow a quantitative decision on the patch similarity of US images. Good results with experiments in denoising, segmentation and selecting similar patches confirm the potential of the proposed measures.

Geodesic Distances in Probabilistic Spaces for Patch-Based Ultrasound Image Processing

Many recent ultrasound image processing methods are based on patch comparison, such as filtering and segmentation. Identifying similar patches in noise-corrupted images is a key factor for the performance of these methods. While the Euclidean distance is ideal to handle the patch comparison under additive Gaussian noise, finding good measures to compare patches corrupted by multiplicative noise is still an open research. In this paper, we deduce several new geodesic distances, arising from parametric probabilistic spaces, and suggest them as similarity measures to process RF and log-compressed ultrasound images in patch-based methods. We provide practical examples using these measures in the fields of ultrasound image filtering and segmentation, with results that confirm the potential of the technique.

PVCP-based anthropomorphic breast phantoms containing structures similar to lactiferous ducts for ultrasound imaging: A comparison with human breasts

The purpose of this work was to obtain an anthropomorphic phantom with acoustic properties similar to those of breast tissue, possessing lactiferous duct-like structures, which would be a first for this type of phantom. Breast lesions usually grow in glandular tissues or lactiferous ducts. Shape variations in these structures are detectable by using ultrasound imaging. To increase early diagnosis, it is important to develop computer-aided diagnosis (CAD) systems and improve medical training. Using tissue-like materials that mimic known internal structures can help achieve both of these goals. However, most breast ultrasound phantoms described in the literature emulate only fat tissues and lesion-like masses. In addition, commercially available phantoms claim to be realistic, but do not contain lactiferous duct structures. In this work, we collected reference images from both breasts of ten healthy female volunteers aged between 20 and 30 years using a 10 MHz linear transducer of a B-mode medical ultrasound system. Histograms of the grey scale distribution of each tissue component of interest, the grey level means, and standard deviations of the regions of interest were obtained. Phantoms were produced using polyvinyl chloride plastisol (PVCP) suspensions. The lactiferous duct-like structures were prepared using pure PVCP. Solid scatterers, such as alumina (mesh #100) and graphite powders (mesh #140) were added to the phantom matrix to mimic glandular and fat tissue, respectively. The phantom duct-like structure diameters observed on B-mode images (1.92 mm ± 0.44) were similar to real measures obtained with a micrometer (2.08 mm ± 0.23). The phantom ducts are easy to produce and are largely stable for at least one year. This phantom allows the researchers to elaborate the structure at their will and may be used in training and as a reference for development of CAD systems.

Classification of breast lesions in ultrasonography using sparse logistic regression and morphology-based texture features

PURPOSE

This work proposes a new reliable computer-aided diagnostic (CAD) system for the diagnosis of breast cancer from breast ultrasound (BUS) images. The system can be useful to reduce the number of biopsies and pathological tests, which are invasive, costly, and often unnecessary.

METHODS

The proposed CAD system classifies breast tumors into benign and malignant classes using morphological and textural features extracted from breast ultrasound (BUS) images. The images are first preprocessed to enhance the edges and filter the speckles. The tumor is then segmented semiautomatically using the watershed method. Having the tumor contour, a set of 855 features including 21 shape-based, 810 contour-based, and 24 textural features are extracted from each tumor. Then, a Bayesian Automatic Relevance Detection (ARD) mechanism is used for computing the discrimination power of different features and dimensionality reduction. Finally, a logistic regression classifier computed the posterior probabilities of malignant vs benign tumors using the reduced set of features.

RESULTS

A dataset of 104 BUS images of breast tumors, including 72 benign and 32 malignant tumors, was used for evaluation using an eightfold cross-validation. The algorithm outperformed six state-of-the-art methods for BUS image classification with large margins by achieving 97.12% accuracy, 93.75% sensitivity, and 98.61% specificity rates.

CONCLUSIONS

Using ARD, the proposed CAD system selects five new features for breast tumor classification and outperforms state-of-the-art, making a reliable and complementary tool to help clinicians diagnose breast cancer.

Automated breast tumor detection and segmentation with a novel computational framework of whole ultrasound images

Due to the low contrast and ambiguous boundaries of the tumors in breast ultrasound (BUS) images, it is still a challenging task to automatically segment the breast tumors from the ultrasound. In this paper, we proposed a novel computational framework that can detect and segment breast lesions fully automatic in the whole ultrasound images. This framework includes several key components: pre-processing, contour initialization, and tumor segmentation. In the pre-processing step, we applied non-local low-rank (NLLR) filter to reduce the speckle noise. In contour initialization step, we cascaded a two-step Otsu-based adaptive thresholding (OBAT) algorithm with morphologic operations to effectively locate the tumor regions and initialize the tumor contours. Finally, given the initial tumor contours, the improved Chan-Vese model based on the ratio of exponentially weighted averages (CV-ROEWA) method was utilized. This pipeline was tested on a set of 61 breast ultrasound (BUS) images with diagnosed tumors. The experimental results in clinical ultrasound images prove the high accuracy and robustness of the proposed framework, indicating its potential applications in clinical practice. Graphical abstract ᅟ.

Ultrasound Image Despeckling Using Stochastic Distance-Based BM3D

Ultrasound image despeckling is an important research field, since it can improve the interpretability of one of the main categories of medical imaging. Many techniques have been tried over the years for ultrasound despeckling, and more recently, a great deal of attention has been focused on patch-based methods, such as non-local means and block-matching collaborative filtering (BM3D). A common idea in these recent methods is the measure of distance between patches, originally proposed as the Euclidean distance, for filtering additive white Gaussian noise. In this paper, we derive new stochastic distances for the Fisher-Tippett distribution, based on well-known statistical divergences, and use them as patch distance measures in a modified version of the BM3D algorithm for despeckling log-compressed ultrasound images. State-of-the-art results in filtering simulated, synthetic, and real ultrasound images confirm the potential of the proposed approach.

Rayleigh-maximum-likelihood bilateral filter for ultrasound image enhancement

Background

Ultrasound imaging plays an important role in computer diagnosis since it is non-invasive and cost-effective. However, ultrasound images are inevitably contaminated by noise and speckle during acquisition. Noise and speckle directly impact the physician to interpret the images and decrease the accuracy in clinical diagnosis. Denoising method is an important component to enhance the quality of ultrasound images; however, several limitations discourage the results because current denoising methods can remove noise while ignoring the statistical characteristics of speckle and thus undermining the effectiveness of despeckling, or vice versa. In addition, most existing algorithms do not identify noise, speckle or edge before removing noise or speckle, and thus they reduce noise and speckle while blurring edge details. Therefore, it is a challenging issue for the traditional methods to effectively remove noise and speckle in ultrasound images while preserving edge details.

Methods

To overcome the above-mentioned limitations, a novel method, called Rayleigh-maximum-likelihood switching bilateral filter (RSBF) is proposed to enhance ultrasound images by two steps: noise, speckle and edge detection followed by filtering. Firstly, a sorted quadrant median vector scheme is utilized to calculate the reference median in a filtering window in comparison with the central pixel to classify the target pixel as noise, speckle or noise-free. Subsequently, the noise is removed by a bilateral filter and the speckle is suppressed by a Rayleigh-maximum-likelihood filter while the noise-free pixels are kept unchanged. To quantitatively evaluate the performance of the proposed method, synthetic ultrasound images contaminated by speckle are simulated by using the speckle model that is subjected to Rayleigh distribution. Thereafter, the corrupted synthetic images are generated by the original image multiplied with the Rayleigh distributed speckle of various signal to noise ratio (SNR) levels and added with Gaussian distributed noise. Meanwhile clinical breast ultrasound images are used to visually evaluate the effectiveness of the method. To examine the performance, comparison tests between the proposed RSBF and six state-of-the-art methods for ultrasound speckle removal are performed on simulated ultrasound images with various noise and speckle levels.

Results

The results of the proposed RSBF are satisfying since the Gaussian noise and the Rayleigh speckle are greatly suppressed. The proposed method can improve the SNRs of the enhanced images to nearly 15 and 13 dB compared with images corrupted by speckle as well as images contaminated by speckle and noise under various SNR levels, respectively. The RSBF is effective in enhancing edge while smoothing the speckle and noise in clinical ultrasound images. In the comparison experiments, the proposed method demonstrates its superiority in accuracy and robustness for denoising and edge preserving under various levels of noise and speckle in terms of visual quality as well as numeric metrics, such as peak signal to noise ratio, SNR and root mean squared error.

Conclusions

The experimental results show that the proposed method is effective for removing the speckle and the background noise in ultrasound images. The main reason is that it performs a “detect and replace” two-step mechanism. The advantages of the proposed RBSF lie in two aspects. Firstly, each central pixel is classified as noise, speckle or noise-free texture according to the absolute difference between the target pixel and the reference median. Subsequently, the Rayleigh-maximum-likelihood filter and the bilateral filter are switched to eliminate speckle and noise, respectively, while the noise-free pixels are unaltered. Therefore, it is implemented with better accuracy and robustness than the traditional methods. Generally, these traits declare that the proposed RSBF would have significant clinical application.

New Fully Automated Method for Segmentation of Breast Lesions on Ultrasound Based on Texture Analysis

The study described here explored a fully automatic segmentation approach based on texture analysis for breast lesions on ultrasound images. The proposed method involves two main stages: (i) In lesion region detection, the original gray-scale image is transformed into a texture domain based on log-Gabor filters. Local texture patterns are then extracted from overlapping lattices that are further classified by a linear discriminant analysis classifier to distinguish between the "normal tissue" and "breast lesion" classes. Next, an incremental method based on the average radial derivative function reveals the region with the highest probability of being a lesion. (ii) In lesion delineation, using the detected region and the pre-processed ultrasound image, an iterative thresholding procedure based on the average radial derivative function is performed to determine the final lesion contour. The experiments are carried out on a data set of 544 breast ultrasound images (including cysts, benign solid masses and malignant lesions) acquired with three distinct ultrasound machines. In terms of the area under the receiver operating characteristic curve, the one-way analysis of variance test (α=0.05) indicates that the proposed approach significantly outperforms two published fully automatic methods (p<0.001), for which the areas under the curve are 0.91, 0.82 and 0.63, respectively. Hence, these results suggest that the log-Gabor domain improves the discrimination power of texture features to accurately segment breast lesions. In addition, the proposed approach can potentially be used for automated computer diagnosis purposes to assist physicians in detection and classification of breast masses.

Speckle filtering of medical ultrasonic images using wavelet and guided filter

Speckle noise is an inherent yet ineffectual residual artifact in medical ultrasound images, which significantly degrades quality and restricts accuracy in automatic diagnostic techniques. Speckle reduction is therefore an important step prior to the analysis and processing of the ultrasound images. A new de-noising method based on an improved wavelet filter and guided filter is proposed in this paper. According to the characteristics of medical ultrasound images in the wavelet domain, an improved threshold function based on the universal wavelet threshold function is developed. The wavelet coefficients of speckle noise and noise-free signal are modeled as Rayleigh distribution and generalized Gaussian distribution respectively. The Bayesian maximum a posteriori estimation is applied to obtain a new wavelet shrinkage algorithm. The coefficients of the low frequency sub-band in the wavelet domain are filtered by guided filter. The filtered image is then obtained by using the inverse wavelet transformation. Experiments with the comparison of the other seven de-speckling filters are conducted. The results show that the proposed method not only has a strong de-speckling ability, but also keeps the image details, such as the edge of a lesion.

Analysis of the impact of digital watermarking on computer-aided diagnosis in medical imaging

Medical images (MI) are relevant sources of information for detecting and diagnosing a large number of illnesses and abnormalities. Due to their importance, this study is focused on breast ultrasound (BUS), which is the main adjunct for mammography to detect common breast lesions among women worldwide. On the other hand, aiming to enhance data security, image fidelity, authenticity, and content verification in e-health environments, MI watermarking has been widely used, whose main goal is to embed patient meta-data into MI so that the resulting image keeps its original quality. In this sense, this paper deals with the comparison of two watermarking approaches, namely spread spectrum based on the discrete cosine transform (SS-DCT) and the high-capacity data-hiding (HCDH) algorithm, so that the watermarked BUS images are guaranteed to be adequate for a computer-aided diagnosis (CADx) system, whose two principal outcomes are lesion segmentation and classification. Experimental results show that HCDH algorithm is highly recommended for watermarking medical images, maintaining the image quality and without introducing distortion into the output of CADx.