Computer-aided characterization of mammographic masses: accuracy of mass segmentation and its effects on characterization

Metaplastic Breast Cancer: Current Understanding and Future Directions

Metaplastic breast cancers (MBC) encompass a group of highly heterogeneous tumors which share the ability to differentiate into squamous, mesenchymal or neuroectodermal components. While often termed rare breast tumors, given the relatively high prevalence of breast cancer, they are seen with some frequency. Depending upon the definition applied, MBC represents 0.2% to 1% of breast cancers diagnosed in the United States. Less is known about the epidemiology of MBC globally, though a growing number of reports are providing information on this. These tumors are often more advanced at presentation relative to breast cancer broadly. While more indolent subtypes exist, the majority of MBC subtypes are associated with inferior survival. MBC is most commonly of triple-negative phenotype. In less common hormone receptor positive MBCs, hormone receptor status appears not to be prognostic. In contrast, relatively rare HER2-positive MBCs are associated with superior outcomes. Multiple potentially targetable molecular features are overrepresented in MBC including DNA repair deficiency signatures and PIK3/AKT/mTOR and WNT pathways alterations. Data on the prevalence of targets for novel antibody-drug conjugates is also emerging. While chemotherapy appears to be less active in MBC than in other breast cancer subtypes, efficacy is seen in some MBCs. Disease-specific trials, as well as reports of exceptional responses, may provide clues for novel approaches to this often hard-to-treat breast cancer. Strategies which harness newer research tools, such as large data and artificial intelligence hold the promise of overcoming historic barriers to the study of uncommon tumors and could markedly advance disease-specific understanding in MBC.

Recent advances and clinical applications of deep learning in medical image analysis

Deep learning has received extensive research interest in developing new medical image processing algorithms, and deep learning based models have been remarkably successful in a variety of medical imaging tasks to support disease detection and diagnosis. Despite the success, the further improvement of deep learning models in medical image analysis is majorly bottlenecked by the lack of large-sized and well-annotated datasets. In the past five years, many studies have focused on addressing this challenge. In this paper, we reviewed and summarized these recent studies to provide a comprehensive overview of applying deep learning methods in various medical image analysis tasks. Especially, we emphasize the latest progress and contributions of state-of-the-art unsupervised and semi-supervised deep learning in medical image analysis, which are summarized based on different application scenarios, including classification, segmentation, detection, and image registration. We also discuss major technical challenges and suggest possible solutions in the future research efforts.

ASU-Net: U-shape adaptive scale network for mass segmentation in mammograms

U-Net is a commonly used deep learning model for mammogram segmentation. Despite outstanding overall performance in segmenting, U-Net still faces from two aspects of challenges: (1) the skip-connections in U-Net have limitations, which may not be able to effectively extract multi-scale features for breast masses with diverse shapes and sizes. (2) U-Net only merges low-level spatial information and high-level semantic information through concatenating, which neglects interdependencies between channels. To address these two problems, we propose the U-shape adaptive scale network (ASU-Net), which contains two modules: adaptive scale module (ASM) and feature refinement module (FRM). In each level of skip-connections, ASM is used to adaptively adjust the receptive fields according to the different scales of the mass, which makes the network adaptively capture multi-scale features. Besides, FRM is employed to allows the decoder to capture channel-wise dependencies, which make the network can selectively emphasize the feature representation of useful channels. Two commonly used mammogram databases including the DDSM-BCRP database and the INbreast database are used to evaluate the segmentation performance of ASU-Net. Finally, ASU-Net obtains the Dice Index (DI) of 91.41% and 93.55% in the DDSM-BCRP database and the INbreast database, respectively.

Breast Cancer Segmentation Methods: Current Status and Future Potentials

Early breast cancer detection is one of the most important issues that need to be addressed worldwide as it can help increase the survival rate of patients. Mammograms have been used to detect breast cancer in the early stages; if detected in the early stages, it can drastically reduce treatment costs. The detection of tumours in the breast depends on segmentation techniques. Segmentation plays a significant role in image analysis and includes detection, feature extraction, classification, and treatment. Segmentation helps physicians quantify the volume of tissue in the breast for treatment planning. In this work, we have grouped segmentation methods into three groups: classical segmentation that includes region-, threshold-, and edge-based segmentation; machine learning segmentation; and supervised and unsupervised and deep learning segmentation. The findings of our study revealed that region-based segmentation is frequently used for classical methods, and the most frequently used techniques are region growing. Further, a median filter is a robust tool for removing noise. Moreover, the MIAS database is frequently used in classical segmentation methods. Meanwhile, in machine learning segmentation, unsupervised machine learning methods are more frequently used, and U-Net is frequently used for mammogram image segmentation because it does not require many annotated images compared with other deep learning models. Furthermore, reviewed papers revealed that it is possible to train a deep learning model without performing any preprocessing or postprocessing and also showed that the U-Net model is frequently used for mammogram segmentation. The U-Net model is frequently used because it does not require many annotated images and also because of the presence of high-performance GPU computing, which makes it easy to train networks with more layers. Additionally, we identified mammograms and utilised widely used databases, wherein 3 and 28 are public and private databases, respectively.

Shift invariant extrema based feature analysis scheme to discriminate the spiculation nature of mammograms

Since uncontrolled growth of malignant masses introduces uneven shape irregularities and spiculations in the boundary, shape representing shift invariant features are essential to resolve the problem of discrimination. However, ambiguous nature of shape, size, margin, orientation of masses produces imprecise feature values. In this view, a new concept of extrema based feature characterization scheme is proposed for capturing radiating nature of mass morphology. Computation of extrema patterns needs only few algorithmic steps. Beside this, present study employs an automated enhancement procedure to improve the classification accuracy. Experimental results show that extrema characterization reduces the feature redundancy to produce high efficiency in reasonably low time.

AUNet: attention-guided dense-upsampling networks for breast mass segmentation in whole mammograms

Mammography is one of the most commonly applied tools for early breast cancer screening. Automatic segmentation of breast masses in mammograms is essential but challenging due to the low signal-to-noise ratio and the wide variety of mass shapes and sizes. Existing methods deal with these challenges mainly by extracting mass-centered image patches manually or automatically. However, manual patch extraction is time-consuming and automatic patch extraction brings errors that could not be compensated in the following segmentation step. In this study, we propose a novel attention-guided dense-upsampling network (AUNet) for accurate breast mass segmentation in whole mammograms directly. In AUNet, we employ an asymmetrical encoder-decoder structure and propose an effective upsampling block, attention-guided dense-upsampling block (AU block). Especially, the AU block is designed to have three merits. Firstly, it compensates the information loss of bilinear upsampling by dense upsampling. Secondly, it designs a more effective method to fuse high- and low-level features. Thirdly, it includes a channel-attention function to highlight rich-information channels. We evaluated the proposed method on two publicly available datasets, CBIS-DDSM and INbreast. Compared to three state-of-the-art fully convolutional networks, AUNet achieved the best performances with an average Dice similarity coefficient of 81.8% for CBIS-DDSM and 79.1% for INbreast.

Morphological characterization of breast tumors using conventional B-mode ultrasound images

This work aims to develop and test a vendor-independent computer-aided diagnosis (CAD) system that uses conventional B-mode ultrasound images to distinguish between benign and malignant breast tumors. Three morphological features were extracted from 323 breast tumor lesions including the perimeter, regularity variance, and circularity range ratio. Lesions were segmented using the active contour method via semi- andfully-automated algorithms. Then, the support vector machine classifier was used to identify breast lesions. Results of the CAD system exhibited accuracies of 95.98% and 95.67%using the semi- and fully-automated segmentation, respectively. Based on the preliminary results, this CAD system with such unique combination of geometrical features shall improve the diagnostic decisions and may reduce the need of unnecessary needle biopsies.

Mammographic mass segmentation using fuzzy contours

BACKGROUND AND OBJECTIVE

Accurate mass segmentation in mammographic images is a critical requirement for computer-aided diagnosis systems since it allows accurate feature extraction and thus improves classification precision.

METHODS

In this paper, a novel automatic breast mass segmentation approach is presented. This approach consists of mainly three stages: contour initialization applied to a given region of interest; construction of fuzzy contours and estimation of fuzzy membership maps of different classes in the considered image; integration of these maps in the Chan-Vese model to get a fuzzy-energy based model that is used for final delineation of mass.

RESULTS

The proposed approach is evaluated using mass regions of interest extracted from the mini-MIAS database. The experimental results show that the proposed method achieves an average true positive rate of 91.12% with a precision of 88.08%.

CONCLUSIONS

The achieved results show high accuracy in breast mass segmentation when compared to manually annotated ground truth and to other methods from the literature.

Radiomics based detection and characterization of suspicious lesions on full field digital mammograms

BACKGROUND AND OBJECTIVE

Early detection is the important key to reduce breast cancer mortality rate. Detecting the mammographic abnormality as a subtle sign of breast cancer is essential for the proper diagnosis and treatment. The aim of this preliminary study is to develop algorithms which detect suspicious lesions and characterize them to reduce the diagnostic errors regarding false positives and false negatives.

METHODS

The proposed hybrid mechanism detects suspicious lesions automatically using connected component labeling and adaptive fuzzy region growing algorithm. A novel neighboring pixel selection algorithm reduces the computational complexity of the seeded region growing algorithm used to finalize lesion contours. These lesions are characterized using radiomic features and then classified as benign mass or malignant tumor using k-NN and SVM classifiers. Two datasets of 460 full field digital mammograms (FFDM) utilized in this clinical study consists of 210 images with malignant tumors, 30 with benign masses and 220 normal breast images that are validated by radiologists expert in mammography.

RESULTS

The qualitative assessment of segmentation results by the expert radiologists shows 91.67% sensitivity and 58.33% specificity. The effects of seven geometric and 48 textural features on classification accuracy, false positives per image (FPsI), sensitivity and specificity are studied separately and together. The features together achieved the sensitivity of 84.44% and 85.56%, specificity of 91.11% and 91.67% with FPsI of 0.54 and 0.55 using k-NN and SVM classifiers respectively on local dataset.

CONCLUSIONS

The overall breast cancer detection performance of proposed scheme after combining geometric and textural features with both classifiers is improved in terms of sensitivity, specificity, and FPsI.

A deep learning framework for supporting the classification of breast lesions in ultrasound images

In this research, we exploited the deep learning framework to differentiate the distinctive types of lesions and nodules in breast acquired with ultrasound imaging. A biopsy-proven benchmarking dataset was built from 5151 patients cases containing a total of 7408 ultrasound breast images, representative of semi-automatically segmented lesions associated with masses. The dataset comprised 4254 benign and 3154 malignant lesions. The developed method includes histogram equalization, image cropping and margin augmentation. The GoogLeNet convolutionary neural network was trained to the database to differentiate benign and malignant tumors. The networks were trained on the data with augmentation and the data without augmentation. Both of them showed an area under the curve of over 0.9. The networks showed an accuracy of about 0.9 (90%), a sensitivity of 0.86 and a specificity of 0.96. Although target regions of interest (ROIs) were selected by radiologists, meaning that radiologists still have to point out the location of the ROI, the classification of malignant lesions showed promising results. If this method is used by radiologists in clinical situations it can classify malignant lesions in a short time and support the diagnosis of radiologists in discriminating malignant lesions. Therefore, the proposed method can work in tandem with human radiologists to improve performance, which is a fundamental purpose of computer-aided diagnosis.

Computer-Aided Diagnosis with Deep Learning Architecture: Applications to Breast Lesions in US Images and Pulmonary Nodules in CT Scans

This paper performs a comprehensive study on the deep-learning-based computer-aided diagnosis (CADx) for the differential diagnosis of benign and malignant nodules/lesions by avoiding the potential errors caused by inaccurate image processing results (e.g., boundary segmentation), as well as the classification bias resulting from a less robust feature set, as involved in most conventional CADx algorithms. Specifically, the stacked denoising auto-encoder (SDAE) is exploited on the two CADx applications for the differentiation of breast ultrasound lesions and lung CT nodules. The SDAE architecture is well equipped with the automatic feature exploration mechanism and noise tolerance advantage, and hence may be suitable to deal with the intrinsically noisy property of medical image data from various imaging modalities. To show the outperformance of SDAE-based CADx over the conventional scheme, two latest conventional CADx algorithms are implemented for comparison. 10 times of 10-fold cross-validations are conducted to illustrate the efficacy of the SDAE-based CADx algorithm. The experimental results show the significant performance boost by the SDAE-based CADx algorithm over the two conventional methods, suggesting that deep learning techniques can potentially change the design paradigm of the CADx systems without the need of explicit design and selection of problem-oriented features.

Dependence of Shape-Based Descriptors and Mass Segmentation Areas on Initial Contour Placement Using the Chan-Vese Method on Digital Mammograms

Variation in signal intensity within mass lesions and missing boundary information are intensity inhomogeneities inherent in digital mammograms. These inhomogeneities render the performance of a deformable contour susceptible to the location of its initial position and may lead to poor segmentation results for these images. We investigate the dependence of shape-based descriptors and mass segmentation areas on initial contour placement with the Chan-Vese segmentation method and compare these results to the active contours with selective local or global segmentation model. For each mass lesion, final contours were obtained by propagation of a proposed initial level set contour and by propagation of a manually drawn contour enclosing the region of interest. Differences in shape-based descriptors were quantified using absolute percentage differences, Euclidean distances, and Bland-Altman analysis. Segmented areas were evaluated with the area overlap measure. Differences were dependent upon the characteristics of the mass margins. Boundary moments presented large percentage differences. Pearson correlation analysis showed statistically significant correlations between shape-based descriptors from both initial locations. In conclusion, boundary moments of digital mass lesions are sensitive to the placement of initial level set contours while shape-based descriptors such as Fourier descriptors, shape convexity, and shape rectangularity exhibit a certain degree of robustness to changes in the location of the initial level set contours for both segmentation algorithms.

Segmentation of uterine fibroid ultrasound images using a dynamic statistical shape model in HIFU therapy

Segmenting the lesion areas from ultrasound (US) images is an important step in the intra-operative planning of high-intensity focused ultrasound (HIFU). However, accurate segmentation remains a challenge due to intensity inhomogeneity, blurry boundaries in HIFU US images and the deformation of uterine fibroids caused by patient's breathing or external force. This paper presents a novel dynamic statistical shape model (SSM)-based segmentation method to accurately and efficiently segment the target region in HIFU US images of uterine fibroids. For accurately learning the prior shape information of lesion boundary fluctuations in the training set, the dynamic properties of stochastic differential equation and Fokker-Planck equation are incorporated into SSM (referred to as SF-SSM). Then, a new observation model of lesion areas (named to RPFM) in HIFU US images is developed to describe the features of the lesion areas and provide a likelihood probability to the prior shape given by SF-SSM. SF-SSM and RPFM are integrated into active contour model to improve the accuracy and robustness of segmentation in HIFU US images. We compare the proposed method with four well-known US segmentation methods to demonstrate its superiority. The experimental results in clinical HIFU US images validate the high accuracy and robustness of our approach, even when the quality of the images is unsatisfactory, indicating its potential for practical application in HIFU therapy.

Level set segmentation of breast masses in contrast-enhanced dedicated breast CT and evaluation of stopping criteria

Dedicated breast CT (bCT) produces high-resolution 3D tomographic images of the breast, fully resolving fibroglandular tissue structures within the breast and allowing for breast lesion detection and assessment in 3D. In order to enable quantitative analysis, such as volumetrics, automated lesion segmentation on bCT is highly desirable. In addition, accurate output from CAD (computer-aided detection/diagnosis) methods depends on sufficient segmentation of lesions. Thus, in this study, we present a 3D lesion segmentation method for breast masses in contrast-enhanced bCT images. The segmentation algorithm follows a two-step approach. First, 3D radial-gradient index segmentation is used to obtain a crude initial contour, which is then refined by a 3D level set-based active contour algorithm. The data set included contrast-enhanced bCT images from 33 patients containing 38 masses (25 malignant, 13 benign). The mass centers served as input to the algorithm. In this study, three criteria for stopping the contour evolution were compared, based on (1) the change of region volume, (2) the average intensity in the segmented region increase at each iteration, and (3) the rate of change of the average intensity inside and outside the segmented region. Lesion segmentation was evaluated by computing the overlap ratio between computer segmentations and manually drawn lesion outlines. For each lesion, the overlap ratio was averaged across coronal, sagittal, and axial planes. The average overlap ratios for the three stopping criteria ranged from 0.66 to 0.68 (dice coefficient of 0.80 to 0.81), indicating that the proposed segmentation procedure is promising for use in quantitative dedicated bCT analyses.

Optimization of Network Topology in Computer-Aided Detection Schemes Using Phased Searching with NEAT in a Time-Scaled Framework

In the field of computer-aided mammographic mass detection, many different features and classifiers have been tested. Frequently, the relevant features and optimal topology for the artificial neural network (ANN)-based approaches at the classification stage are unknown, and thus determined by trial-and-error experiments. In this study, we analyzed a classifier that evolves ANNs using genetic algorithms (GAs), which combines feature selection with the learning task. The classifier named "Phased Searching with NEAT in a Time-Scaled Framework" was analyzed using a dataset with 800 malignant and 800 normal tissue regions in a 10-fold cross-validation framework. The classification performance measured by the area under a receiver operating characteristic (ROC) curve was 0.856 ± 0.029. The result was also compared with four other well-established classifiers that include fixed-topology ANNs, support vector machines (SVMs), linear discriminant analysis (LDA), and bagged decision trees. The results show that Phased Searching outperformed the LDA and bagged decision tree classifiers, and was only significantly outperformed by SVM. Furthermore, the Phased Searching method required fewer features and discarded superfluous structure or topology, thus incurring a lower feature computational and training and validation time requirement. Analyses performed on the network complexities evolved by Phased Searching indicate that it can evolve optimal network topologies based on its complexification and simplification parameter selection process. From the results, the study also concluded that the three classifiers - SVM, fixed-topology ANN, and Phased Searching with NeuroEvolution of Augmenting Topologies (NEAT) in a Time-Scaled Framework - are performing comparably well in our mammographic mass detection scheme.

Urinary bladder segmentation in CT urography (CTU) using CLASS

PURPOSE

The authors are developing a computerized system for bladder segmentation on CTU, as a critical component for computer aided diagnosis of bladder cancer.

METHODS

A challenge for bladder segmentation is the presence of regions without contrast (NC) and filled with intravenous contrast (C). The authors have designed a Conjoint Level set Analysis and Segmentation System (CLASS) specifically for this application. CLASS performs a series of image processing tasks: preprocessing, initial segmentation, 3D and 2D level set segmentation, and postprocessing, designed according to the characteristics of the bladder in CTU. The NC and the C regions of the bladder were segmented separately in CLASS. The final contour is obtained in the postprocessing stage by the union of the NC and C contours. With Institutional Review Board (IRB) approval, the authors retrospectively collected 81 CTU scans, in which 40 bladders contained lesions, 26 contained diffuse wall thickening, and 15 were considered to be normal. The bladders were segmented by CLASS and the performance was assessed by rating the quality of the contours on a 10-point scale (1 = "very poor," 5 = "fair," 10 = "perfect"). For 30 bladders, 3D hand-segmented contours were obtained and the segmentation accuracy of CLASS was evaluated and compared to that of a single level set method in terms of the average minimum distance, average volume intersection ratio, average volume error and Jaccard index.

RESULTS

Of the 81 bladders, the average quality rating for CLASS was 6.5 ± 1.3. Thirty nine bladders were given quality ratings of 7 or above. Only five bladders had ratings under 5. The average minimum distance, average volume intersection ratio, average volume error, and average Jaccard index for CLASS were 3.5 ± 1.3 mm, (79.0 ± 8.2)%, (16.1 ± 16.3)%, and (75.7 ± 8.4)%, respectively, and for the single level set method were 5.2 ± 2.6 mm, (78.8 ± 16.3)%, (8.3 ± 33.1)%, (71.0 ± 15.4)%, respectively.

CONCLUSIONS

The results demonstrate the potential of CLASS for segmentation of the bladder.

Semiautomatic segmentation of aortic valve from sequenced ultrasound image using a novel shape-constraint GCV model

PURPOSE

Effective and accurate segmentation of the aortic valve (AV) from sequenced ultrasound (US) images remains a technical challenge because of intrinsic factors of ultrasound images that impact the quality and the continuous changes of shape and position of segmented objects. In this paper, a novel shape-constraint gradient Chan-Vese (GCV) model is proposed for segmenting the AV from time serial echocardiography.

METHODS

The GCV model is derived by incorporating the energy of the gradient vector flow into a CV model framework, where the gradient vector energy term is introduced by calculating the deviation angle between the inward normal force of the evolution contour and the gradient vector force. The flow force enlarges the capture range and enhances the blurred boundaries of objects. This is achieved by adding a circle-like contour (constructed using the AV structure region as a constraint shape) as an energy item to the GCV model through the shape comparison function. This shape-constrained energy can enhance the image constraint force by effectively connecting separate gaps of the object edge as well as driving the evolution contour to quickly approach the ideal object. Because of the slight movement of the AV in adjacent frames, the initial constraint shape is defined by users, with the other constraint shapes being derived from the segmentation results of adjacent sequence frames after morphological filtering. The AV is segmented from the US images by minimizing the proposed energy function.

RESULTS

To evaluate the performance of the proposed method, five assessment parameters were used to compare it with manual delineations performed by radiologists (gold standards). Three hundred and fifteen images acquired from nine groups were analyzed in the experiment. The area-metric overlap error rate was 6.89% ± 2.88%, the relative area difference rate 3.94% ± 2.63%, the average symmetric contour distance 1.08 ± 0.43 mm, the root mean square symmetric contour distance 1.37 ± 0.52 mm, and the maximum symmetric contour distance was 3.57 ± 1.72 mm.

CONCLUSIONS

Compared with the CV model, as a result of the combination of the gradient vector and neighborhood shape information, this semiautomatic segmentation method significantly improves the accuracy and robustness of AV segmentation, making it feasible for improved segmentation of aortic valves from US images that have fuzzy boundaries.

Optimization of breast mass classification using sequential forward floating selection (SFFS) and a support vector machine (SVM) model

PURPOSE

Improving radiologists' performance in classification between malignant and benign breast lesions is important to increase cancer detection sensitivity and reduce false-positive recalls. For this purpose, developing computer-aided diagnosis schemes has been attracting research interest in recent years. In this study, we investigated a new feature selection method for the task of breast mass classification.

METHODS

We initially computed 181 image features based on mass shape, spiculation, contrast, presence of fat or calcifications, texture, isodensity, and other morphological features. From this large image feature pool, we used a sequential forward floating selection (SFFS)-based feature selection method to select relevant features and analyzed their performance using a support vector machine (SVM) model trained for the classification task. On a database of 600 benign and 600 malignant mass regions of interest, we performed the study using a tenfold cross-validation method. Feature selection and optimization of the SVM parameters were conducted on the training subsets only.

RESULTS

The area under the receiver operating characteristic curve [Formula: see text] was obtained for the classification task. The results also showed that the most frequently selected features by the SFFS-based algorithm in tenfold iterations were those related to mass shape, isodensity, and presence of fat, which are consistent with the image features frequently used by radiologists in the clinical environment for mass classification. The study also indicated that accurately computing mass spiculation features from the projection mammograms was difficult, and failed to perform well for the mass classification task due to tissue overlap within the benign mass regions.

CONCLUSION

In conclusion, this comprehensive feature analysis study provided new and valuable information for optimizing computerized mass classification schemes that may have potential to be useful as a "second reader" in future clinical practice.

Max-AUC feature selection in computer-aided detection of polyps in CT colonography

We propose a feature selection method based on a sequential forward floating selection (SFFS) procedure to improve the performance of a classifier in computerized detection of polyps in CT colonography (CTC). The feature selection method is coupled with a nonlinear support vector machine (SVM) classifier. Unlike the conventional linear method based on Wilks' lambda, the proposed method selected the most relevant features that would maximize the area under the receiver operating characteristic curve (AUC), which directly maximizes classification performance, evaluated based on AUC value, in the computer-aided detection (CADe) scheme. We presented two variants of the proposed method with different stopping criteria used in the SFFS procedure. The first variant searched all feature combinations allowed in the SFFS procedure and selected the subsets that maximize the AUC values. The second variant performed a statistical test at each step during the SFFS procedure, and it was terminated if the increase in the AUC value was not statistically significant. The advantage of the second variant is its lower computational cost. To test the performance of the proposed method, we compared it against the popular stepwise feature selection method based on Wilks' lambda for a colonic-polyp database (25 polyps and 2624 nonpolyps). We extracted 75 morphologic, gray-level-based, and texture features from the segmented lesion candidate regions. The two variants of the proposed feature selection method chose 29 and 7 features, respectively. Two SVM classifiers trained with these selected features yielded a 96% by-polyp sensitivity at false-positive (FP) rates of 4.1 and 6.5 per patient, respectively. Experiments showed a significant improvement in the performance of the classifier with the proposed feature selection method over that with the popular stepwise feature selection based on Wilks' lambda that yielded 18.0 FPs per patient at the same sensitivity level.

Aortic valve segmentation from ultrasound images based on shape constraint CV model

Image Guided Intervention for valvular heart disease is increasingly making progress in minimally invasive manner, where effective and accurate segmentation of aortic valve (AV) from echocardiography is fundamental to improve the intra operative location accuracy. This paper proposes a shape constraint Chan-Vese (CV) model for segmenting the AV from ultrasound (US) images. Considering the poor quality and speckle noise in AV US images, the problem of the overflow at the weak edge is solved by adding the shape constraint to the CV model. The predefined shape constructed from AV region is applied as an energy constraint to the energy function through a signed distance map, and the AV is detected from the US image by minimizing the energy function. A hundred AV segmentation results are analyzed in the experiment, where the evaluation parameters are 95.38 ± 2.7%, 1.4 ± 0.5 mm, 2.07 ± 1.3 mm in transthoracic AV and 97.21 ± 1.6%, 0.7 ± 0.15 mm, 1.04 ± 0.6 mm in transesophageal AV, which reveal that the shape constraint CV model can segment AV accurately, efficiently and robustly.

Breast image analysis for risk assessment, detection, diagnosis, and treatment of cancer

The role of breast image analysis in radiologists' interpretation tasks in cancer risk assessment, detection, diagnosis, and treatment continues to expand. Breast image analysis methods include segmentation, feature extraction techniques, classifier design, biomechanical modeling, image registration, motion correction, and rigorous methods of evaluation. We present a review of the current status of these task-based image analysis methods, which are being developed for the various image acquisition modalities of mammography, tomosynthesis, computed tomography, ultrasound, and magnetic resonance imaging. Depending on the task, image-based biomarkers from such quantitative image analysis may include morphological, textural, and kinetic characteristics and may depend on accurate modeling and registration of the breast images. We conclude with a discussion of future directions.

Auto-initialized cascaded level set (AI-CALS) segmentation of bladder lesions on multidetector row CT urography

RATIONALE AND OBJECTIVES

To develop a computerized system for segmentation of bladder lesions on computed tomography urography (CTU) scans for detection and characterization of bladder cancer.

MATERIALS AND METHODS

We have developed an auto-initialized cascaded level set method to perform bladder lesion segmentation. The segmentation performance was evaluated on a preliminary dataset including 28 CTU scans from 28 patients collected retrospectively with institutional review board approval. The bladders were partially filled with intravenous contrast material. The lesions were located fully or partially within the contrast-enhanced area or in the non-contrast-enhanced area of the bladder. An experienced abdominal radiologist marked 28 lesions (14 malignant and 14 benign) with bounding boxes that served as input to the automated segmentation system and assigned a difficulty rating on a scale of 1 to 5 (5 = most subtle) to each lesion. The contours from automated segmentation were compared to three-dimensional contours manually drawn by the radiologist. Three performance metric measures were used for comparison. In addition, the automated segmentation quality was assessed by an expert panel of two experienced radiologists, who provided quality ratings of the contours on a scale from 1 to 10 (10 = excellent).

RESULTS

The average volume intersection ratio, the average absolute volume error, and the average distance measure were 67.2 ± 16.9%, 27.3 ± 26.9%, and 2.89 ± 1.69 mm, respectively. Of the 28 segmentations, 18 were given quality ratings of 8 or above. The average rating was 7.9 ± 1.5. The average quality ratings for lesions with difficulty ratings of 1, 2, 3, and 4 were 8.8 ± 0.9, 7.9 ± 1.8, 7.4 ± 0.9, and 6.6 ± 1.5, respectively.

CONCLUSION

Our preliminary study demonstrates the feasibility of using the three-dimensional level set method for segmenting bladder lesions in CTU scans.

Segmentation of ultrasonic breast tumors based on homogeneous patch

PURPOSE

Accurately segmenting breast tumors in ultrasound (US) images is a difficult problem due to their specular nature and appearance of sonographic tumors. The current paper presents a variant of the normalized cut (NCut) algorithm based on homogeneous patches (HP-NCut) for the segmentation of ultrasonic breast tumors.

METHODS

A novel boundary-detection function is defined by combining texture and intensity information to find the fuzzy boundaries in US images. Subsequently, based on the precalculated boundary map, an adaptive neighborhood according to image location referred to as a homogeneous patch (HP) is proposed. HPs are guaranteed to spread within the same tissue region; thus, the statistics of primary features within the HPs is more reliable in distinguishing the different tissues and benefits subsequent segmentation. Finally, the fuzzy distribution of textons within HPs is used as final image features, and the segmentation is obtained using the NCut framework.

RESULTS

The HP-NCut algorithm was evaluated on a large dataset of 100 breast US images (50 benign and 50 malignant). The mean Hausdorff distance measure, the mean minimum Euclidean distance measure and similarity measure achieved 7.1 pixels, 1.58 pixels, and 86.67%, respectively, for benign tumors while those achieved 10.57 pixels, 1.98 pixels, and 84.41%, respectively, for malignant tumors.

CONCLUSIONS

The HP-NCut algorithm provided the improvement in accuracy and robustness compared with state-of-the-art methods. A conclusion that the HP-NCut algorithm is suitable for ultrasonic tumor segmentation problems can be drawn.

Mass segmentation using a combined method for cancer detection

Background

Breast cancer is one of the leading causes of cancer death for women all over the world and mammography is thought of as one of the main tools for early detection of breast cancer. In order to detect the breast cancer, computer aided technology has been introduced. In computer aided cancer detection, the detection and segmentation of mass are very important. The shape of mass can be used as one of the factors to determine whether the mass is malignant or benign. However, many of the current methods are semi-automatic. In this paper, we investigate fully automatic segmentation method.

Results

In this paper, a new mass segmentation algorithm is proposed. In the proposed algorithm, a fully automatic marker-controlled watershed transform is proposed to segment the mass region roughly, and then a level set is used to refine the segmentation. For over-segmentation caused by watershed, we also investigated different noise reduction technologies. Images from DDSM were used in the experiments and the results show that the new algorithm can improve the accuracy of mass segmentation.

Conclusions

The new algorithm combines the advantages of both methods. The combination of the watershed based segmentation and level set method can improve the efficiency of the segmentation. Besides, the introduction of noise reduction technologies can reduce over-segmentation.

Heterogeneity of focal breast lesions and surrounding tissue assessed by mammographic texture analysis: preliminary evidence of an association with tumor invasion and estrogen receptor status

AIM

This pilot study investigates whether heterogeneity in focal breast lesions and surrounding tissue assessed on mammography is potentially related to cancer invasion and hormone receptor status.

MATERIALS AND METHODS

Texture analysis (TA) assessed the heterogeneity of focal lesions and their surrounding tissues in digitized mammograms from 11 patients randomly selected from an imaging archive [ductal carcinoma in situ (DCIS) only, n = 4; invasive carcinoma (IC) with DCIS, n = 3; IC only, n = 4]. TA utilized band-pass image filtration to highlight image features at different spatial frequencies (filter values: 1.0-2.5) from fine to coarse texture. The distribution of features in the derived images was quantified using uniformity.

RESULTS

Significant differences in uniformity were observed between patient groups for all filter values. With medium scale filtration (filter value = 1.5) pure DCIS was more uniform (median = 0.281) than either DCIS with IC (median = 0.246, p = 0.0102) or IC (median = 0.249, p = 0.0021). Lesions with high levels of estrogen receptor expression were more uniform, most notably with coarse filtration (filter values 2.0 and 2.5, r(s) = 0.812, p = 0.002). Comparison of uniformity values in focal lesions and surrounding tissue showed significant differences between DCIS with or without IC versus IC (p = 0.0009).

CONCLUSION

This pilot study shows the potential for computer-based assessments of heterogeneity within focal mammographic lesions and surrounding tissue to identify adverse pathological features in mammographic lesions. The technique warrants further investigation as a possible adjunct to existing computer aided diagnosis systems.

A snake-based method for segmentation of intravascular ultrasound images and its in vivo validation

Image segmentation for detection of vessel walls is necessary for quantitative assessment of vessel diseases by intravascular ultrasound. A new segmentation method based on gradient vector flow (GVF) snake model is proposed in this paper. The main characteristics of the proposed method include two aspects: one is that nonlinear filtering is performed on GVF field to reduce the critical points, change the morphological structure of the parallel curves and extend the capture range; the other is that balloon snake is combined with the model. Thus, the improved GVF and balloon snake can be automatically initialized and overcome the problem caused by local energy minima. Results of 20 in vivo cases validated the accuracy and stability of the segmentation method for intravascular ultrasound images.

Computer-aided classification of breast masses: performance and interobserver variability of expert radiologists versus residents

PURPOSE

To evaluate the interobserver variability in descriptions of breast masses by dedicated breast imagers and radiology residents and determine how any differences in lesion description affect the performance of a computer-aided diagnosis (CAD) computer classification system.

MATERIALS AND METHODS

Institutional review board approval was obtained for this HIPAA-compliant study, and the requirement to obtain informed consent was waived. Images of 50 breast lesions were individually interpreted by seven dedicated breast imagers and 10 radiology residents, yielding 850 lesion interpretations. Lesions were described with use of 11 descriptors from the Breast Imaging Reporting and Data System, and interobserver variability was calculated with the Cohen κ statistic. Those 11 features were selected, along with patient age, and merged together by a linear discriminant analysis (LDA) classification model trained by using 1005 previously existing cases. Variability in the recommendations of the computer model for different observers was also calculated with the Cohen κ statistic.

RESULTS

A significant difference was observed for six lesion features, and radiology residents had greater interobserver variability in their selection of five of the six features than did dedicated breast imagers. The LDA model accurately classified lesions for both sets of observers (area under the receiver operating characteristic curve = 0.94 for residents and 0.96 for dedicated imagers). Sensitivity was maintained at 100% for residents and improved from 98% to 100% for dedicated breast imagers. For residents, the computer model could potentially improve the specificity from 20% to 40% (P < .01) and the κ value from 0.09 to 0.53 (P < .001). For dedicated breast imagers, the computer model could increase the specificity from 34% to 43% (P = .16) and the κ value from 0.21 to 0.61 (P < .001).

CONCLUSION

Among findings showing a significant difference, there was greater interobserver variability in lesion descriptions among residents; however, an LDA model using data from either dedicated breast imagers or residents yielded a consistently high performance in the differentiation of benign from malignant breast lesions, demonstrating potential for improving specificity and decreasing interobserver variability in biopsy recommendations.

Image analysis for classification of dysplasia in Barrett's esophagus using endoscopic optical coherence tomography

Barrett's esophagus (BE) and associated adenocarcinoma have emerged as a major health care problem. Endoscopic optical coherence tomography is a microscopic sub-surface imaging technology that has been shown to differentiate tissue layers of the gastrointestinal wall and identify dysplasia in the mucosa, and is proposed as a surveillance tool to aid in management of BE. In this work a computer-aided diagnosis (CAD) system has been demonstrated for classification of dysplasia in Barrett's esophagus using EOCT. The system is composed of four modules: region of interest segmentation, dysplasia-related image feature extraction, feature selection, and site classification and validation. Multiple feature extraction and classification methods were evaluated and the process of developing the CAD system is described in detail. Use of multiple EOCT images to classify a single site was also investigated. A total of 96 EOCT image-biopsy pairs (63 non-dysplastic, 26 low-grade and 7 high-grade dysplastic biopsy sites) from a previously described clinical study were analyzed using the CAD system, yielding an accuracy of 84% for classification of non-dysplastic vs. dysplastic BE tissue. The results motivate continued development of CAD to potentially enable EOCT surveillance of large surface areas of Barrett's mucosa to identify dysplasia.

Assessing heterogeneity of lesion enhancement kinetics in dynamic contrast-enhanced MRI for breast cancer diagnosis

The current study investigates the feasibility of using texture analysis to quantify the heterogeneity of lesion enhancement kinetics in order to discriminate malignant from benign breast lesions. A total of 82 biopsy-proven breast lesions (51 malignant, 31 benign), originating from 74 women subjected to dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) were analysed. Pixel-wise analysis of DCE-MRI lesion data was performed to generate initial enhancement, post-initial enhancement and signal enhancement ratio (SER) parametric maps; these maps were subsequently subjected to co-occurrence matrix texture analysis. The discriminating ability of texture features extracted from each parametric map was investigated using a least-squares minimum distance classifier and further compared with the discriminating ability of the same texture features extracted from the first post-contrast frame. Selected texture features extracted from the SER map achieved an area under receiver operating characteristic curve of 0.922 +/- 0.029, a performance similar to post-initial enhancement map features (0.906 +/- 0.032) and statistically significantly higher than for initial enhancement map (0.767 +/- 0.053) and first post-contrast frame (0.756 +/- 0.060) features. Quantifying the heterogeneity of parametric maps that reflect lesion washout properties could contribute to the computer-aided diagnosis of breast lesions in DCE-MRI.

Dynamic multiple thresholding breast boundary detection algorithm for mammograms

PURPOSE

Automated detection of breast boundary is one of the fundamental steps for computer-aided analysis of mammograms. In this study, the authors developed a new dynamic multiple thresholding based breast boundary (MTBB) detection method for digitized mammograms.

METHODS

A large data set of 716 screen-film mammograms (442 CC view and 274 MLO view) obtained from consecutive cases of an Institutional Review Board approved project were used. An experienced breast radiologist manually traced the breast boundary on each digitized image using a graphical interface to provide a reference standard. The initial breast boundary (MTBB-Initial) was obtained by dynamically adapting the threshold to the gray level range in local regions of the breast periphery. The initial breast boundary was then refined by using gradient information from horizontal and vertical Sobel filtering to obtain the final breast boundary (MTBB-Final). The accuracy of the breast boundary detection algorithm was evaluated by comparison with the reference standard using three performance metrics: The Hausdorff distance (HDist), the average minimum Euclidean distance (AMinDist), and the area overlap measure (AOM).

RESULTS

In comparison with the authors' previously developed gradient-based breast boundary (GBB) algorithm, it was found that 68%, 85%, and 94% of images had HDist errors less than 6 pixels (4.8 mm) for GBB, MTBB-Initial, and MTBB-Final, respectively. 89%, 90%, and 96% of images had AMinDist errors less than 1.5 pixels (1.2 mm) for GBB, MTBB-Initial, and MTBB-Final, respectively. 96%, 98%, and 99% of images had AOM values larger than 0.9 for GBB, MTBB-Initial, and MTBB-Final, respectively. The improvement by the MTBB-Final method was statistically significant for all the evaluation measures by the Wilcoxon signed rank test (p < 0.0001).

CONCLUSIONS

The MTBB approach that combined dynamic multiple thresholding and gradient information provided better performance than the breast boundary detection algorithm that mainly used gradient information.

Mass auto-detection in mammogram based on wavelet transform modulus maximum

High accurate detection of mass in mammogram is critical for improving the performance and efficiency of computer-aided diagnosis (CAD) system. In this paper, we propose a novel approach to enhance the detection performance of mass in mammograms using Wavelet Transform Modulus Maximum (WTMM). First, hunt the region of interest (ROI) through the whole image and the ROI was approximately located by multi-threshold method. Then the contour of the ROI was extracted from the modulus image acquired by Wavelet Transform Modulus Maximum (WTMM) method. The region of interest was finally refined by the contour extracted. Experimental results indicate that the proposed method is able to detect not only isolate masses, but also the masses connected with the glandular tissues successfully. This technique could potentially improve the performance of CAD system and diagnosis accuracy in mammograms.

A new automated method for the segmentation and characterization of breast masses on ultrasound images

Segmentation is one of the first steps in most computer-aided diagnosis systems for characterization of masses as malignant or benign. In this study, the authors designed an automated method for segmentation of breast masses on ultrasound (US) images. The method automatically estimated an initial contour based on a manually identified point approximately at the mass center. A two-stage active contour method iteratively refined the initial contour and performed self-examination and correction on the segmentation result. To evaluate the method, the authors compared it with manual segmentation by two experienced radiologists (R1 and R2) on a data set of 488 US images from 250 biopsy-proven masses (100 malignant and 150 benign). Two area overlap ratios (AOR1 and AOR2) and an area error measure were used as performance measures to evaluate the segmentation accuracy. Values for AOR1, defined as the ratio of the intersection of the computer and the reference segmented areas to the reference segmented area, were 0.82 +/- 0.16 and 0.84 +/- 0.18, respectively, when manually segmented mass regions by R1 and R2 were used as the reference. Although this indicated a high agreement between the computer and manual segmentations, the two radiologists' manual segmentation results were significantly (p < 0.03) more consistent, with AOR1 = 0.84 +/- 0.16 and 0.91 +/- 0.12, respectively, when the segmented regions by R1 and R2 were used as the reference. To evaluate the segmentation method in terms of lesion classification accuracy, feature spaces were formed by extracting texture, width-to-height, and posterior shadowing features based on either automated computer segmentation or the radiologists' manual segmentation. A linear discriminant analysis classifier was designed using stepwise feature selection and two-fold cross validation to characterize the mass as malignant or benign. For features extracted from computer segmentation, the case-based test A(z) values ranged from 0.88 +/- 0.03 to 0.92 +/- 0.02, indicating a comparable performance to those extracted from manual segmentation by radiologists (A(z) value range: 0.87 +/- 0.03 to 0.90 +/- 0.03).