Robust Texture Analysis Using Multi-Resolution Gray-Scale Invariant Features for Breast Sonographic Tumor Diagnosis

A hybrid features fusion-based framework for classification of breast micronodules using ultrasonography

BACKGROUND

Breast cancer is one of the leading diseases worldwide. According to estimates by the National Breast Cancer Foundation, over 42,000 women are expected to die from this disease in 2024.

OBJECTIVE

The prognosis of breast cancer depends on the early detection of breast micronodules and the ability to distinguish benign from malignant lesions. Ultrasonography is a crucial radiological imaging technique for diagnosing the illness because it allows for biopsy and lesion characterization. The user's level of experience and knowledge is vital since ultrasonographic diagnosis relies on the practitioner's expertise. Furthermore, computer-aided technologies significantly contribute by potentially reducing the workload of radiologists and enhancing their expertise, especially when combined with a large patient volume in a hospital setting.

METHOD

This work describes the development of a hybrid CNN system for diagnosing benign and malignant breast cancer lesions. The models InceptionV3 and MobileNetV2 serve as the foundation for the hybrid framework. Features from these models are extracted and concatenated individually, resulting in a larger feature set. Finally, various classifiers are applied for the classification task.

RESULTS

The model achieved the best results using the softmax classifier, with an accuracy of over 95%.

CONCLUSION

Computer-aided diagnosis greatly assists radiologists and reduces their workload. Therefore, this research can serve as a foundation for other researchers to build clinical solutions.

Ultrasound Radiomics-Based Logistic Regression Model to Differentiate Between Benign and Malignant Breast Nodules

OBJECTIVES

To explore the potential value of ultrasound radiomics in differentiating between benign and malignant breast nodules by extracting the radiomic features of two-dimensional (2D) grayscale ultrasound images and establishing a logistic regression model.

METHODS

The clinical and ultrasound data of 1000 female patients (500 pathologically benign patients, 500 pathologically malignant patients) who underwent breast ultrasound examinations at our hospital were retrospectively analyzed. The cases were randomly divided into training and validation sets at a ratio of 7:3. Once the region of interest (ROI) of the lesion was manually contoured, Spearman's rank correlation, least absolute shrinkage and selection operator (LASSO) regression, and the Boruta algorithm were adopted to determine optimal features and establish a logistic regression classification model. The performance of the model was assessed using the area under the receiver operating characteristic curve (AUC), and calibration and decision curves (DCA).

RESULTS

Eight ultrasound radiomic features were selected to establish the model. The AUC values of the model were 0.979 and 0.977 in the training and validation sets, respectively (P = .0029), indicating good discriminative ability in both datasets. Additionally, the calibration and DCA suggested that the model's calibration efficiency and clinical application value were both superior.

CONCLUSIONS

The proposed logistic regression model based on 2D grayscale ultrasound images could facilitate differential diagnosis of benign and malignant breast nodules. The model, which was constructed using ultrasound radiomic features identified in this study, demonstrated good diagnostic performance and could be useful in helping clinicians formulate individualized treatment plans for patients.

Complete, Fully Automatic Detection and Classification of Benign and Malignant Breast Tumors Based on CT Images Using Artificial Intelligent and Image Processing

Breast cancer is the most common type of cancer in women, and early detection is important to significantly reduce its mortality rate. This study introduces a detection and diagnosis system that automatically detects and classifies breast tumors in CT scan images. First, the contours of the chest wall are extracted from computed chest tomography images, and two-dimensional image characteristics and three-dimensional image features, together with the application of active contours without edge and geodesic active contours methods, are used to detect, locate, and circle the tumor. Then, the computer-assisted diagnostic system extracts features, quantifying and classifying benign and malignant breast tumors using a greedy algorithm and a support vector machine. The study used 174 breast tumors for experiment and training and performed cross-validation 10 times (k-fold cross-validation) to evaluate performance of the system. The accuracy, sensitivity, specificity, and positive and negative predictive values of the system were 99.43%, 98.82%, 100%, 100%, and 98.89% respectively. This system supports the rapid extraction and classification of breast tumors as either benign or malignant, helping physicians to improve clinical diagnosis.

Firefly-SVM predictive model for breast cancer subgroup classification with clinicopathological parameters

Background

Breast cancer is a highly predominant destructive disease among women characterised with varied tumour biology, molecular subgroups and diverse clinicopathological specifications. The potentiality of machine learning to transform complex medical data into meaningful knowledge has led to its application in breast cancer detection and prognostic evaluation.

Objective

The emergence of data-driven diagnostic model for assisting clinicians in diagnostic decision making has gained an increasing curiosity in breast cancer identification and analysis. This motivated us to develop a breast cancer data-driven model for subtype classification more accurately.

Method

In this article, we proposed a firefly-support vector machine (SVM) breast cancer predictive model that uses clinicopathological and demographic data gathered from various tertiary care cancer hospitals or oncological centres to distinguish between patients with triple-negative breast cancer (TNBC) and non-triple-negative breast cancer (non-TNBC).

Results

The results of the firefly-support vector machine (firefly-SVM) predictive model were distinguished from the traditional grid search-support vector machine (Grid-SVM) model, particle swarm optimisation-support vector machine (PSO-SVM) and genetic algorithm-support vector machine (GA-SVM) hybrid models through hyperparameter tuning. The findings show that the recommended firefly-SVM classification model outperformed other existing models in terms of prediction accuracy (93.4%, 86.6%, 69.6%) for automated SVM parameter selection. The effectiveness of the prediction model was also evaluated using well-known metrics, such as the F1-score, mean square error, area under the ROC curve, logarithmic loss and precision-recall curve.

Conclusion

Firefly-SVM predictive model may be treated as an alternate tool for breast cancer subgroup classification that would benefit the clinicians for managing the patient with proper treatment and diagnostic outcome.

Meta-Heuristic Algorithm-Tuned Neural Network for Breast Cancer Diagnosis Using Ultrasound Images

Breast cancer is the most menacing cancer among all types of cancer in women around the globe. Early diagnosis is the only way to increase the treatment options which then decreases the death rate and increases the chance of survival in patients. However, it is a challenging task to differentiate abnormal breast tissues from normal tissues because of their structure and unclear boundaries. Therefore, early and accurate diagnosis and classification of breast lesions into malignant or benign lesions is an active domain of research. Over the decade, numerous artificial neural network (ANN)-based techniques were adopted in order to diagnose and classify breast cancer due to the unique characteristics of learning key features from complex data via a training process. However, these schemes have limitations like slow convergence and longer training time. To address the above mentioned issues, this paper employs a meta-heuristic algorithm for tuning the parameters of the neural network. The main novelty of this work is the computer-aided diagnosis scheme for detecting abnormalities in breast ultrasound images by integrating a wavelet neural network (WNN) and the grey wolf optimization (GWO) algorithm. Here, breast ultrasound (US) images are preprocessed with a sigmoid filter followed by interference-based despeckling and then by anisotropic diffusion. The automatic segmentation algorithm is adopted to extract the region of interest, and subsequently morphological and texture features are computed. Finally, the GWO-tuned WNN is exploited to accomplish the classification task. The classification performance of the proposed scheme is validated on 346 ultrasound images. Efficiency of the proposed methodology is evaluated by computing the confusion matrix and receiver operating characteristic (ROC) curve. Numerical analysis revealed that the proposed work can yield higher classification accuracy when compared to the prevailing methods and thereby proves its potential in effective breast tumor detection and classification. The proposed GWO-WNN method (98%) gives better accuracy than other methods like SOM-SVM (87.5), LOFA-SVM (93.62%), MBA-RF (96.85%), and BAS-BPNN (96.3%)

LRSCnet: Local Reference Semantic Code learning for breast tumor classification in ultrasound images

Purpose

This study proposed a novel Local Reference Semantic Code (LRSC) network for automatic breast ultrasound image classification with few labeled data.

Methods

In the proposed network, the local structure extractor is firstly developed to learn the local reference which describes common local characteristics of tumors. After that, a two-stage hierarchical encoder is developed to encode the local structures of lesion into the high-level semantic code. Based on the learned semantic code, the self-matching layer is proposed for the final classification.

Results

In the experiment, the proposed method outperformed traditional classification methods and AUC (Area Under Curve), ACC (Accuracy), Sen (Sensitivity), Spec (Specificity), PPV (Positive Predictive Values), and NPV(Negative Predictive Values) are 0.9540, 0.9776, 0.9629, 0.93, 0.9774 and 0.9090, respectively. In addition, the proposed method also improved matching speed.

Conclusions

LRSC-network is proposed for breast ultrasound images classification with few labeled data. In the proposed network, a two-stage hierarchical encoder is introduced to learn high-level semantic code. The learned code contains more effective high-level classification information and is simpler, leading to better generalization ability.

Colour and Texture Descriptors for Visual Recognition: A Historical Overview

Colour and texture are two perceptual stimuli that determine, to a great extent, the appearance of objects, materials and scenes. The ability to process texture and colour is a fundamental skill in humans as well as in animals; therefore, reproducing such capacity in artificial (‘intelligent’) systems has attracted considerable research attention since the early 70s. Whereas the main approach to the problem was essentially theory-driven (‘hand-crafted’) up to not long ago, in recent years the focus has moved towards data-driven solutions (deep learning). In this overview we retrace the key ideas and methods that have accompanied the evolution of colour and texture analysis over the last five decades, from the ‘early years’ to convolutional networks. Specifically, we review geometric, differential, statistical and rank-based approaches. Advantages and disadvantages of traditional methods vs. deep learning are also critically discussed, including a perspective on which traditional methods have already been subsumed by deep learning or would be feasible to integrate in a data-driven approach.

Tuberculosis Diagnostics and Localization in Chest X-Rays via Deep Learning Models

For decades, tuberculosis (TB), a potentially serious infectious lung disease, continues to be a leading cause of worldwide death. Proven to be conveniently efficient and cost-effective, chest X-ray (CXR) has become the preliminary medical imaging tool for detecting TB. Arguably, the quality of TB diagnosis will improve vastly with automated CXRs for TB detection and the localization of suspected areas, which may manifest TB. The current line of research aims to develop an efficient computer-aided detection system that will support doctors (and radiologists) to become well-informed when making TB diagnosis from patients' CXRs. Here, an integrated process to improve TB diagnostics via convolutional neural networks (CNNs) and localization in CXRs via deep-learning models is proposed. Three key steps in the TB diagnostics process include (a) modifying CNN model structures, (b) model fine-tuning via artificial bee colony algorithm, and (c) the implementation of linear average–based ensemble method. Comparisons of the overall performance are made across all three steps among the experimented deep CNN models on two publicly available CXR datasets, namely, the Shenzhen Hospital CXR dataset and the National Institutes of Health CXR dataset. Validated performance includes detecting CXR abnormalities and differentiating among seven TB-related manifestations (consolidation, effusion, fibrosis, infiltration, mass, nodule, and pleural thickening). Importantly, class activation mapping is employed to inform a visual interpretation of the diagnostic result by localizing the detected lung abnormality manifestation on CXR. Compared to the state-of-the-art, the resulting approach showcases an outstanding performance both in the lung abnormality detection and the specific TB-related manifestation diagnosis vis-à-vis the localization in CXRs.

Classification of malignant tumours in breast ultrasound using unsupervised machine learning approaches

Traditional computer-aided diagnosis (CAD) processes include feature extraction, selection, and classification. Effective feature extraction in CAD is important in improving the classification’s performance. We introduce a machine-learning method and have designed an analysis procedure of benign and malignant breast tumour classification in ultrasound (US) images without a need for a priori tumour region-selection processing, thereby decreasing clinical diagnosis efforts while maintaining high classification performance. Our dataset constituted 677 US images (benign: 312, malignant: 365). Regarding two-dimensional US images, the oriented gradient descriptors’ histogram pyramid was extracted and utilised to obtain feature vectors. The correlation-based feature selection method was used to evaluate and select significant feature sets for further classification. Sequential minimal optimisation—combining local weight learning—was utilised for classification and performance enhancement. The image dataset’s classification performance showed an 81.64% sensitivity and 87.76% specificity for malignant images (area under the curve = 0.847). The positive and negative predictive values were 84.1 and 85.8%, respectively. Here, a new workflow, utilising machine learning to recognise malignant US images was proposed. Comparison of physician diagnoses and the automatic classifications made using machine learning yielded similar outcomes. This indicates the potential applicability of machine learning in clinical diagnoses.

Classification of malignant tumors in breast ultrasound using a pretrained deep residual network model and support vector machine

In this study, a transfer learning method was utilized to recognize and classify benign and malignant breast tumors, using two-dimensional breast ultrasound (US) images, to decrease the effort expended by physicians and improve the quality of clinical diagnosis. The pretrained deep residual network model was utilized for image feature extraction from the convolutional layer of the trained network; whereas, the linear support vector machine (SVM), with a sequential minimal optimization solver, was used to classify the extracted feature. We used an image dataset with 2099 unlabeled two-dimensional breast US images, collected from 543 patients (benign: 302, malignant: 241). The classification performance yielded a sensitivity of 94.34 % and a specificity of 93.22 % for malignant images (Area under curve = 0.938). The positive and negative predictive values were 92.6 and 94.8, respectively. A comparison between the diagnosis made by the physician and the automated classification by a trained classifier, showed that the latter had significantly better outcomes. This indicates the potential applicability of the proposed approach that incorporates both the pretrained deep learning network and a well-trained classifier, to improve the quality and efficacy of clinical diagnosis.

Identification of Breast Malignancy by Marker-Controlled Watershed Transformation and Hybrid Feature Set for Healthcare

Breast cancer is a highly prevalent disease in females that may lead to mortality in severe cases. The mortality can be subsided if breast cancer is diagnosed at an early stage. The focus of this study is to detect breast malignancy through computer-aided diagnosis (CADx). In the first phase of this work, Hilbert transform is employed to reconstruct B-mode images from the raw data followed by the marker-controlled watershed transformation to segment the lesion. The methods based only on texture analysis are quite sensitive to speckle noise and other artifacts. Therefore, a hybrid feature set is developed after the extraction of shape-based and texture features from the breast lesion. Decision tree, k-nearest neighbor (KNN), and ensemble decision tree model via random under-sampling with Boost (RUSBoost) are utilized to segregate the cancerous lesions from the benign ones. The proposed technique is tested on OASBUD (Open Access Series of Breast Ultrasonic Data) and breast ultrasound (BUS) images collected at Baheya Hospital Egypt (BHE). The OASBUD dataset contains raw ultrasound data obtained from 100 patients containing 52 malignant and 48 benign lesions. The dataset collected at BHE contains 210 malignant and 437 benign images. The proposed system achieved promising accuracy of 97% with confidence interval (CI) of 91.48% to 99.38% for OASBUD and 96.6% accuracy with CI of 94.90% to 97.86% for the BHE dataset using ensemble method.

A Novel Computer-Aided-Diagnosis System for Breast Ultrasound Images Based on BI-RADS Categories

The breast ultrasound is not only one of major devices for breast tissue imaging, but also one of important methods in breast tumor screening. It is non-radiative, non-invasive, harmless, simple, and low cost screening. The American College of Radiology (ACR) proposed the Breast Imaging Reporting and Data System (BI-RADS) to evaluate far more breast lesion severities compared to traditional diagnoses according to five-criterion categories of masses composition described as follows: shape, orientation, margin, echo pattern, and posterior features. However, there exist some problems, such as intensity differences and different resolutions in image acquisition among different types of ultrasound imaging modalities so that clinicians cannot always identify accurately the BI-RADS categories or disease severities. To this end, this article adopted three different brands of ultrasound scanners to fetch breast images for our experimental samples. The breast lesion was detected on the original image using preprocessing, image segmentation, etc. The breast tumor’s severity was evaluated on the features of the breast lesion via our proposed classifiers according to the BI-RADS standard rather than traditional assessment on the severity; i.e., merely using benign or malignant. In this work, we mainly focused on the BI-RADS categories 2–5 after the stage of segmentation as a result of the clinical practice. Moreover, several features related to lesion severities based on the selected BI-RADS categories were introduced into three machine learning classifiers, including a Support Vector Machine (SVM), Random Forest (RF), and Convolution Neural Network (CNN) combined with feature selection to develop a multi-class assessment of breast tumor severity based on BI-RADS. Experimental results show that the proposed CAD system based on BI-RADS can obtain the identification accuracies with SVM, RF, and CNN reaching 80.00%, 77.78%, and 85.42%, respectively. We also validated the performance and adaptability of the classification using different ultrasound scanners. Results also indicate that the evaluations of F-score based on CNN can obtain measures higher than 75% (i.e., prominent adaptability) when samples were tested on various BI-RADS categories.

Assessment of the invariance and discriminant power of morphological features under geometric transformations for breast tumor classification

BACKGROUND AND OBJECTIVES

Computer-aided diagnosis (CAD) systems are intended to assist specialists in the interpretation of images aiming to support clinical conduct. In breast tumor classification, CAD systems involve a feature extraction stage, in which morphological features are used to describe the tumor shape. Such features are expected to satisfy at least two conditions: (1) discriminant to distinguish between benign and malignant tumors, and (2) invariant to geometric transformations. Herein, 39 morphological features were evaluated in terms of invariance and discriminant power for breast tumor classification.

METHODS

Morphological features were divided into region-based features, for describing the irregularity of the tumor shape, and boundary-based features, for measuring the anfractuosity of the tumor margin. Also, two datasets were considered in the experiments: 2054 breast ultrasound images and 892 mammographies. From both datasets, synthetic data augmentation was performed to obtain distinct combinations of rotation and scaling of breast tumors, from which morphological features were calculated. The linear discriminant analysis was used to classify breast tumors in benign and malignant classes. The area under the ROC curve (AUC) quantified the discriminant power of every morphological feature, whereas the relative difference (RD) between AUC values measured the invariance to geometric transformations. For indicating adequate performance, AUC and RD should tend toward unity and zero, respectively.

RESULTS

For both datasets, the convexity was the most discriminant feature that reached AUC > 0.81 with RD<1×10^-2, while the most invariant feature was the roundness that attained RD<1×10^-3 with AUC < 0.72. Additionally, for each dataset, the most discriminant and invariant features were combined for performing tumor classification. For mammography, it was achieved accuracy (ACC) of 0.76, sensitivity (SEN) of 0.76, and specificity (SPE) of 0.84, whereas for breast ultrasound the results were ACC=0.88,SEN=0.81, and SPE=0.91.

CONCLUSIONS

In general, region-based features are more discriminant and invariant than boundary-based features. Moreover, it was observed that an invariant feature is not necessarily a discriminant feature; hence, a balance between invariance and discriminant power should be attained for breast tumor classification.

A combined ultrasonic B-mode and color Doppler system for the classification of breast masses using neural network

OBJECTIVES

To develop a dual-modal neural network model to characterize ultrasound (US) images of breast masses.

MATERIALS AND METHODS

A combined US B-mode and color Doppler neural network model was developed to classify US images of the breast. Three datasets with breast masses were originally detected and interpreted by 20 experienced radiologists according to Breast Imaging-Reporting and Data System (BI-RADS) lexicon ((1) training set, 103212 masses from 45,433 + 12,519 patients. (2) held-out validation set, 2748 masses from 1197 + 395 patients. (3) test set, 605 masses from 337 + 78 patients). The neural network was first trained on training set. Then, the trained model was tested on a held-out validation set to evaluate agreement on BI-RADS category between the model and the radiologists. In addition, the model and a reader study of 10 radiologists were applied to the test set with biopsy-proven results. To evaluate the performance of the model in benign or malignant classifications, the receiver operating characteristic curve, sensitivities, and specificities were compared.

RESULTS

The trained dual-modal model showed favorable agreement with the assessment performed by the radiologists (κ = 0.73; 95% confidence interval, 0.71-0.75) in classifying breast masses into four BI-RADS categories in the validation set. For the binary categorization of benign or malignant breast masses in the test set, the dual-modal model achieved the area under the ROC curve (AUC) of 0.982, while the readers scored an AUC of 0.948 in terms of the ROC convex hull.

CONCLUSION

The dual-modal model can be used to assess breast masses at a level comparable to that of an experienced radiologist.

KEY POINTS

• A neural network model based on ultrasonic imaging can classify breast masses into different Breast Imaging-Reporting and Data System categories according to the probability of malignancy. • A combined ultrasonic B-mode and color Doppler neural network model achieved a high level of agreement with the readings of an experienced radiologist and has the potential to automate the routine characterization of breast masses.

Value of Computer Software for Assisting Sonographers in the Diagnosis of Thyroid Imaging Reporting and Data System Grade 3 and 4 Thyroid Space-Occupying Lesions

OBJECTIVES

To analyze the ability of thyroid ultrasound computer-aided diagnosis (CAD) detection software (AmCAD-UT; AmCAD BioMed Corporation, Taipei, Taiwan) to assist sonographers in diagnosing Thyroid Imaging Reporting and Data System grade 3 and 4 space-occupying lesions and to provide evidence for ultrasound doctors (UDs) to use the diagnostic recommendations of the AmCAD system to inform clinical decisions.

METHODS

In group 1, a retrospective study was performed on 234 cases of thyroid lesions confirmed by surgical pathology. The sensitivities, specificities, and accuracies of the diagnoses determined by the same UD independent of the software (UD) and after consulting the CAD software (UD + CAD) and by the software alone (CAD) were compared. In group 2, a prospective study was performed on 220 individuals with thyroid space-occupying lesions recommended by physicians from our hospital to undergo needle biopsy to confirm the diagnosis. Ultrasound images were imported into AmCAD, and recommendations for needle biopsy or periodic follow-up were obtained. According to the pathologic results of needle biopsy, consistency and coincidence rates of diagnostic recommendations for AmCAD were obtained.

RESULTS

In group 1, CAD and UD + CAD diagnoses achieved significantly higher sensitivities and accuracies of diagnosis than did independent diagnosis by the UD (P < .05). In group 2, the software showed an overall intraclass correlation (κ = 0.786) and a diagnosis coincidence rate of 93.6% with needle biopsy results.

CONCLUSIONS

AmCAD-UT Detection improved the ability of UDs to diagnose Thyroid Imaging Reporting and Data System grade 3 and 4 space-occupying lesions. Diagnostic recommendations of AmCAD are relatively consistent with needle biopsy results and can reduce the rate of unnecessary diagnostic needle biopsies.

Palpable Breast Lump Triage by Minimally Trained Operators in Mexico Using Computer-Assisted Diagnosis and Low-Cost Ultrasound

Purpose

In low- to middle-income countries (LMICs), most breast cancers present as palpable lumps; however, most palpable lumps are benign. We have developed artificial intelligence–based computer-assisted diagnosis (CADx) for an existing low-cost portable ultrasound system to triage which lumps need further evaluation and which are clearly benign. This pilot study was conducted to demonstrate that this approach can be successfully used by minimally trained health care workers in an LMIC country.

Patients and Methods

We recruited and trained three nonradiologist health care workers to participate in an institutional review board–approved, Health Insurance Portability and Accountability Act–compliant pilot study in Jalisco, Mexico, to determine whether they could use portable ultrasound (GE Vscan Dual Probe) to acquire images of palpable breast lumps of adequate quality for accurate computer analysis. Images from 32 women with 32 breast masses were then analyzed with a triage-CADx system, generating an output of benign or suspicious (biopsy recommended). Triage-CADx outputs were compared with radiologist readings.

Results

The nonradiologists were able to acquire adequate images. Triage by the CADx software was as accurate as assessment by specialist radiologists, with two (100%) of two cancers considered suspicious and 30 (100%) of 30 benign lesions classified as benign.

Conclusion

A portable ultrasound system with CADx software can be successfully used by first-level health care workers to triage palpable breast lumps. These results open up the possibility of implementing practical, cost-effective triage of palpable breast lumps, ensuring that scarce resources can be dedicated to suspicious lesions requiring further workup.

Evaluation of TP53/PIK3CA mutations using texture and morphology analysis on breast MRI

PURPOSE

Somatic mutations in TP53 and PIK3CA genes, the two most frequent genetic alternations in breast cancer, are associated with prognosis and therapeutic response. This study predicted the presence of TP53 and PIK3CA mutations in breast cancer by using texture and morphology analyses on breast MRI.

MATERIALS AND METHODS

A total of 107 breast cancers (dataset A) from The Cancer Imaging Archive (TCIA) consisting of 40 TP53 mutation cancer and 67 cancers without TP53 mutation; 35 PIK3CA mutations cancer and 72 without PIK3CA mutation. 122 breast cancer (dataset B) from Seoul National University Hospital containing 54 TP53 mutation cancer and 68 without mutations were used in this study. At first, the tumor area was segmented by a region growing method. Subsequently, gray level co-occurrence matrix (GLCM) texture features were extracted after ranklet transform, and a series of features including compactness, margin, and ellipsoid fitting model were used to describe the morphological characteristics of tumors. Lastly, a logistic regression was used to identify the presence of TP53 and PIK3CA mutations. The classification performances were evaluated by accuracy, sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV). Taking into account the trade-offs of sensitivity and specificity, the overall performances were evaluated by using receiver operating characteristic (ROC) curve analysis.

RESULTS

The GLCM texture feature based on ranklet transform is more capable of recognizing TP53 and PIK3CA mutations than morphological feature, especially for the TP53 mutation that achieves statistically significant. The area under the ROC curve (AUC) for TP53 mutation dataset A and dataset B achieved 0.78 and 0.81 respectively. For PIK3CA mutation, the AUC of ranklet texture feature was 0.70.

CONCLUSION

Texture analysis of segmented tumor on breast MRI based on ranklet transform is potential in recognizing the presence of TP53 mutation and PIK3CA mutation.

Texture Analysis Based on Auto-Mutual Information for Classifying Breast Lesions with Ultrasound

Described here is a novel texture extraction method based on auto-mutual information (AMI) for classifying breast lesions. The objective is to extract discriminating information found in the non-linear relationship of textures in breast ultrasound (BUS) images. The AMI method performs three basic tasks: (i) it transforms the input image using the ranklet transform to handle intensity variations of BUS images acquired with distinct ultrasound scanners; (ii) it extracts the AMI-based texture features in the horizontal and vertical directions from each ranklet image; and (iii) it classifies the breast lesions into benign and malignant classes, in which a support-vector machine is used as the underlying classifier. The image data set is composed of 2050 BUS images consisting of 1347 benign and 703 malignant tumors. Additionally, nine commonly used texture extraction methods proposed in the literature for BUS analysis are compared with the AMI method. The bootstrap method, which considers 1000 bootstrap samples, is used to evaluate classification performance. The experimental results indicate that the proposed approach outperforms its counterparts in terms of area under the receiver operating characteristic curve, sensitivity, specificity and Matthews correlation coefficient, with values of 0.82, 0.80, 0.85 and 0.63, respectively. These results suggest that the AMI method is suitable for breast lesion classification systems.

Effect of a Deep Learning Framework-Based Computer-Aided Diagnosis System on the Diagnostic Performance of Radiologists in Differentiating between Malignant and Benign Masses on Breast Ultrasonography

OBJECTIVE

To investigate whether a computer-aided diagnosis (CAD) system based on a deep learning framework (deep learning-based CAD) improves the diagnostic performance of radiologists in differentiating between malignant and benign masses on breast ultrasound (US).

MATERIALS AND METHODS

B-mode US images were prospectively obtained for 253 breast masses (173 benign, 80 malignant) in 226 consecutive patients. Breast mass US findings were retrospectively analyzed by deep learning-based CAD and four radiologists. In predicting malignancy, the CAD results were dichotomized (possibly benign vs. possibly malignant). The radiologists independently assessed Breast Imaging Reporting and Data System final assessments for two datasets (US images alone or with CAD). For each dataset, the radiologists' final assessments were classified as positive (category 4a or higher) and negative (category 3 or lower). The diagnostic performances of the radiologists for the two datasets (US alone vs. US with CAD) were compared.

RESULTS

When the CAD results were added to the US images, the radiologists showed significant improvement in specificity (range of all radiologists for US alone vs. US with CAD: 72.8-92.5% vs. 82.1-93.1%; p < 0.001), accuracy (77.9-88.9% vs. 86.2-90.9%; p = 0.038), and positive predictive value (PPV) (60.2-83.3% vs. 70.4-85.2%; p = 0.001). However, there were no significant changes in sensitivity (81.3-88.8% vs. 86.3-95.0%; p = 0.120) and negative predictive value (91.4-93.5% vs. 92.9-97.3%; p = 0.259).

CONCLUSION

Deep learning-based CAD could improve radiologists' diagnostic performance by increasing their specificity, accuracy, and PPV in differentiating between malignant and benign masses on breast US.

Automatic classification of ultrasound breast lesions using a deep convolutional neural network mimicking human decision-making

OBJECTIVES

To evaluate a deep convolutional neural network (dCNN) for detection, highlighting, and classification of ultrasound (US) breast lesions mimicking human decision-making according to the Breast Imaging Reporting and Data System (BI-RADS).

METHODS AND MATERIALS

One thousand nineteen breast ultrasound images from 582 patients (age 56.3 ± 11.5 years) were linked to the corresponding radiological report. Lesions were categorized into the following classes: no tissue, normal breast tissue, BI-RADS 2 (cysts, lymph nodes), BI-RADS 3 (non-cystic mass), and BI-RADS 4-5 (suspicious). To test the accuracy of the dCNN, one internal dataset (101 images) and one external test dataset (43 images) were evaluated by the dCNN and two independent readers. Radiological reports, histopathological results, and follow-up examinations served as reference. The performances of the dCNN and the humans were quantified in terms of classification accuracies and receiver operating characteristic (ROC) curves.

RESULTS

In the internal test dataset, the classification accuracy of the dCNN differentiating BI-RADS 2 from BI-RADS 3-5 lesions was 87.1% (external 93.0%) compared with that of human readers with 79.2 ± 1.9% (external 95.3 ± 2.3%). For the classification of BI-RADS 2-3 versus BI-RADS 4-5, the dCNN reached a classification accuracy of 93.1% (external 95.3%), whereas the classification accuracy of humans yielded 91.6 ± 5.4% (external 94.1 ± 1.2%). The AUC on the internal dataset was 83.8 (external 96.7) for the dCNN and 84.6 ± 2.3 (external 90.9 ± 2.9) for the humans.

CONCLUSION

dCNNs may be used to mimic human decision-making in the evaluation of single US images of breast lesion according to the BI-RADS catalog. The technique reaches high accuracies and may serve for standardization of highly observer-dependent US assessment.

KEY POINTS

• Deep convolutional neural networks could be used to classify US breast lesions. • The implemented dCNN with its sliding window approach reaches high accuracies in the classification of US breast lesions. • Deep convolutional neural networks may serve for standardization in US BI-RADS classification.

Joint Weakly and Semi-Supervised Deep Learning for Localization and Classification of Masses in Breast Ultrasound Images

We propose a framework for localization and classification of masses in breast ultrasound images. We have experimentally found that training convolutional neural network-based mass detectors with large, weakly annotated datasets presents a non-trivial problem, while overfitting may occur with those trained with small, strongly annotated datasets. To overcome these problems, we use a weakly annotated dataset together with a smaller strongly annotated dataset in a hybrid manner. We propose a systematic weakly and semi-supervised training scenario with appropriate training loss selection. Experimental results show that the proposed method can successfully localize and classify masses with less annotation effort. The results trained with only 10 strongly annotated images along with weakly annotated images were comparable to results trained from 800 strongly annotated images, with the 95% confidence interval (CI) of difference -3%-5%, in terms of the correct localization (CorLoc) measure, which is the ratio of images with intersection over union with ground truth higher than 0.5. With the same number of strongly annotated images, additional weakly annotated images can be incorporated to give a 4.5% point increase in CorLoc, from 80% to 84.50% (with 95% CIs 76%-83.75% and 81%-88%). The effects of different algorithmic details and varied amount of data are presented through ablative analysis.

Automated diagnosis of breast ultrasonography images using deep neural networks

Ultrasonography images of breast mass aid in the detection and diagnosis of breast cancer. Manually analyzing ultrasonography images is time-consuming, exhausting and subjective. Automated analyzing such images is desired. In this study, we develop an automated breast cancer diagnosis model for ultrasonography images. Traditional methods of automated ultrasonography images analysis employ hand-crafted features to classify images, and lack robustness to the variation in the shapes, size and texture of breast lesions, leading to low sensitivity in clinical applications. To overcome these shortcomings, we propose a method to diagnose breast ultrasonography images using deep convolutional neural networks with multi-scale kernels and skip connections. Our method consists of two components: the first one is to determine whether there are malignant tumors in the image, and the second one is to recognize solid nodules. In order to let the two networks work in a collaborative way, a region enhance mechanism based on class activation maps is proposed. The mechanism helps to improve classification accuracy and sensitivity for both networks. A cross training algorithm is introduced to train the networks. We construct a large annotated dataset containing a total of 8145 breast ultrasonography images to train and evaluate the models. All of the annotations are proven by pathological records. The proposed method is compared with two state-of-the-art approaches, and outperforms both of them by a large margin. Experimental results show that our approach achieves a performance comparable to human sonographers and can be applied to clinical scenarios.

Preliminary Study of Chronic Liver Classification on Ultrasound Images Using an Ensemble Model

Chronic liver diseases are fifth leading cause of fatality in developing countries. Their early diagnosis is extremely important for timely treatment and salvage life. To examine abnormalities of liver, ultrasound imaging is the most frequently used modality. However, the visual differentiation between chronic liver and cirrhosis, and presence of heptocellular carcinomas (HCC) evolved over cirrhotic liver is difficult, as they appear almost similar in ultrasound images. In this paper, to deal with this difficult visualization problem, a method has been developed for classifying four liver stages, that is, normal, chronic, cirrhosis, and HCC evolved over cirrhosis. The method is formulated with selected set of "handcrafted" texture features obtained after hierarchal feature fusion. These multiresolution and higher order features, which are able to characterize echotexture and roughness of liver surface, are extracted by using ranklet, gray-level difference matrix and gray-level co-occurrence matrix methods. Thereafter, these features are applied on proposed ensemble classifier that is designed with voting algorithm in conjunction with three classifiers, namely, k-nearest neighbor (k-NN), support vector machine (SVM), and rotation forest. The experiments are conducted to evaluate the (a) effectiveness of "handcrafted" texture features, (b) performance of proposed ensemble model, (c) effectiveness of proposed ensemble strategy, (d) performance of different classifiers, and (e) performance of proposed ensemble model based on Convolutional Neural Networks (CNN) features to differentiate four liver stages. These experiments are carried out on database of 754 segmented regions of interest formed by clinically acquired ultrasound images. The results show that classification accuracy of 96.6% is obtained by use of proposed classifier model.

Quantitative vessel tortuosity: A potential CT imaging biomarker for distinguishing lung granulomas from adenocarcinomas

Adenocarcinomas and active granulomas can both have a spiculated appearance on computed tomography (CT) and both are often fluorodeoxyglucose (FDG) avid on positron emission tomography (PET) scan, making them difficult to distinguish. Consequently, patients with benign granulomas are often subjected to invasive surgical biopsies or resections. In this study, quantitative vessel tortuosity (QVT), a novel CT imaging biomarker to distinguish between benign granulomas and adenocarcinomas on routine non-contrast lung CT scans is introduced. Our study comprised of CT scans of 290 patients from two different institutions, one cohort for training (N = 145) and the other (N = 145) for independent validation. In conjunction with a machine learning classifier, the top informative and stable QVT features yielded an area under receiver operating characteristic curve (ROC AUC) of 0.85 in the independent validation set. On the same cohort, the corresponding AUCs for two human experts including a radiologist and a pulmonologist were found to be 0.61 and 0.60, respectively. QVT features also outperformed well known shape and textural radiomic features which had a maximum AUC of 0.73 (p-value = 0.002), as well as features learned using a convolutional neural network AUC = 0.76 (p-value = 0.028). Our results suggest that QVT features could potentially serve as a non-invasive imaging biomarker to distinguish granulomas from adenocarcinomas on non-contrast CT scans.

Radiomics of US texture features in differential diagnosis between triple-negative breast cancer and fibroadenoma

Triple-negative breast cancer (TNBC) is sometimes mistaken for fibroadenoma due to its tendency to show benign morphology on breast ultrasound (US) albeit its aggressive nature. This study aims to develop a radiomics score based on US texture analysis for differential diagnosis between TNBC and fibroadenoma, and to evaluate its diagnostic performance compared with pathologic results. We retrospectively included 715 pathology-proven fibroadenomas and 186 pathology-proven TNBCs which were examined by three different US machines. We developed the radiomics score by using penalized logistic regression with a least absolute shrinkage and selection operator (LASSO) analysis from 730 extracted features consisting of 14 intensity-based features, 132 textural features and 584 wavelet-based features. The constructed radiomics score showed significant difference between fibroadenoma and TNBC for all three US machines (p < 0.001). Although the radiomics score showed dependency on the type of US machine, we developed more elaborate radiomics score for a subgroup in which US examinations were performed with iU22. This subsequent radiomics score also showed good diagnostic performance, even for BI-RADS category 3 or 4a lesions (AUC 0.782) which were presumed as probably benign or low suspicious of malignancy by radiologists. It was expected to assist radiologist’s diagnosis and reduce the number of invasive biopsies, although US standardization should be overcome before clinical application.

Computer-aided prediction model for axillary lymph node metastasis in breast cancer using tumor morphological and textural features on ultrasound

BACKGROUND AND OBJECTIVES

Axillary lymph node (ALN) status is a key indicator in assessing and determining the treatment strategy for patients with newly diagnosed breast cancer. Previous studies suggest that sonographic features of a primary tumor have the potential to predict ALN status in the preoperative staging of breast cancer. In this study, a computer-aided prediction (CAP) model as well as the tumor features for ALN metastasis in breast cancers were developed using breast ultrasound (US) images.

METHODS

A total of 249 malignant tumors were acquired from 247 female patients (ages 20-84 years; mean 55 ± 11 years) to test the differences between the non-metastatic (130) and metastatic (119) groups based on various features. After applying semi-automatic tumor segmentation, 69 quantitative features were extracted. The features included morphology and texture of tumors inside a ROI of breast US image. By the backward feature selection and linear logistic regression, the prediction model was constructed and established to estimate the likelihood of ALN metastasis for each sample collected.

RESULTS

In the experiments, the texture features showed higher performance for predicting ALN metastasis compared to morphology (Az, 0.730 vs 0.667). The difference, however, was not statistically significant (p-values > 0.05). Combining the textural and morphological features, the accuracy, sensitivity, specificity, and Az value achieved 75.1% (187/249), 79.0% (94/119), 71.5% (93/130), and 0.757, respectively.

CONCLUSIONS

The proposed CAP model, which combines textural and morphological features of primary tumor, may be a useful method to determine the ALN status in patients with breast cancer.

Classification of breast lesions in ultrasonography using sparse logistic regression and morphology-based texture features

PURPOSE

This work proposes a new reliable computer-aided diagnostic (CAD) system for the diagnosis of breast cancer from breast ultrasound (BUS) images. The system can be useful to reduce the number of biopsies and pathological tests, which are invasive, costly, and often unnecessary.

METHODS

The proposed CAD system classifies breast tumors into benign and malignant classes using morphological and textural features extracted from breast ultrasound (BUS) images. The images are first preprocessed to enhance the edges and filter the speckles. The tumor is then segmented semiautomatically using the watershed method. Having the tumor contour, a set of 855 features including 21 shape-based, 810 contour-based, and 24 textural features are extracted from each tumor. Then, a Bayesian Automatic Relevance Detection (ARD) mechanism is used for computing the discrimination power of different features and dimensionality reduction. Finally, a logistic regression classifier computed the posterior probabilities of malignant vs benign tumors using the reduced set of features.

RESULTS

A dataset of 104 BUS images of breast tumors, including 72 benign and 32 malignant tumors, was used for evaluation using an eightfold cross-validation. The algorithm outperformed six state-of-the-art methods for BUS image classification with large margins by achieving 97.12% accuracy, 93.75% sensitivity, and 98.61% specificity rates.

CONCLUSIONS

Using ARD, the proposed CAD system selects five new features for breast tumor classification and outperforms state-of-the-art, making a reliable and complementary tool to help clinicians diagnose breast cancer.

A computer-aided diagnosis system for breast ultrasound based on weighted BI-RADS classes

BACKGROUND AND OBJECTIVE

Conventional computer-aided diagnosis (CAD) systems for breast ultrasound (BUS) are trained to classify pathological classes, that is, benign and malignant. However, from a clinical perspective, this kind of classification does not agree totally with radiologists' diagnoses. Usually, the tumors are assessed by using a BI-RADS (Breast Imaging-Reporting and Data System) category and, accordingly, a recommendation is emitted: annual study for category 2 (benign), six-month follow-up study for category 3 (probably benign), and biopsy for categories 4 and 5 (suspicious of malignancy). Hence, in this paper, a CAD system based on BI-RADS categories weighted by pathological information is presented. The goal is to increase the classification performance by reducing the common class imbalance found in pathological classes as well as to provide outcomes quite similar to radiologists' recommendations.

METHODS

The BUS dataset considers 781 benign lesions and 347 malignant tumors proven by biopsy. Moreover, every lesion is associated to one BI-RADS category in the set {2, 3, 4, 5}. Thus, the dataset is split into three weighted classes: benign, BI-RADS 2 in benign lesions; probably benign, BI-RADS 3 and 4 in benign lesions; and malignant, BI-RADS 4 and 5 in malignant lesions. Thereafter, a random forest (RF) classifier, denoted by RF_w, is trained to predict the weighted BI-RADS classes. In addition, for comparison purposes, a RF classifier is trained to predict pathological classes, denoted as RF_p.

RESULTS

The ability of the classifiers to predict the pathological classes is measured by the area under the ROC curve (AUC), sensitivity (SEN), and specificity (SPE). The RF_w classifier obtained AUC=0.872,SEN=0.826, and SPE=0.919, whereas the RF_p classifier reached AUC=0.868,SEN=0.808, and SPE=0.929. According to a one-way analysis of variance test, the RF_w classifier statistically outperforms (p < 0.001) the RF_p classifier in terms of the AUC and SEN. Moreover, the classification performance of RF_w to predict weighted BI-RADS classes is given by the Matthews correlation coefficient that obtained 0.614.

CONCLUSIONS

The division of the classification problem into three classes reduces the imbalance between benign and malignant classes; thus, the sensitivity is increased without degrading the specificity. Therefore, the CAD based on weighted BI-RADS classes improves the classification performance of the conventional CAD systems. Additionally, the proposed approach has the advantage of being capable of providing a multiclass outcome related to radiologists' recommendations.

A deep learning framework for supporting the classification of breast lesions in ultrasound images

In this research, we exploited the deep learning framework to differentiate the distinctive types of lesions and nodules in breast acquired with ultrasound imaging. A biopsy-proven benchmarking dataset was built from 5151 patients cases containing a total of 7408 ultrasound breast images, representative of semi-automatically segmented lesions associated with masses. The dataset comprised 4254 benign and 3154 malignant lesions. The developed method includes histogram equalization, image cropping and margin augmentation. The GoogLeNet convolutionary neural network was trained to the database to differentiate benign and malignant tumors. The networks were trained on the data with augmentation and the data without augmentation. Both of them showed an area under the curve of over 0.9. The networks showed an accuracy of about 0.9 (90%), a sensitivity of 0.86 and a specificity of 0.96. Although target regions of interest (ROIs) were selected by radiologists, meaning that radiologists still have to point out the location of the ROI, the classification of malignant lesions showed promising results. If this method is used by radiologists in clinical situations it can classify malignant lesions in a short time and support the diagnosis of radiologists in discriminating malignant lesions. Therefore, the proposed method can work in tandem with human radiologists to improve performance, which is a fundamental purpose of computer-aided diagnosis.

Computer-aided prediction of axillary lymph node status in breast cancer using tumor surrounding tissue features in ultrasound images

BACKGROUND AND OBJECTIVE

The presence or absence of axillary lymph node (ALN) metastasis is the most important prognostic factor for patients with early-stage breast cancer. In this study, a computer-aided prediction (CAP) system using the tumor surrounding tissue features in ultrasound (US) images was proposed to determine the ALN status in breast cancer.

METHODS

The US imaging database used in this study contained 114 cases of invasive breast cancer and 49 of them were ALN metastasis. After the tumor region segmentation by the level set method, image matting method was used to extract surrounding abnormal tissue of tumor from the acquired images. Then, 21 features composed of 2 intensity, 3 morphology, and 16 textural features are extracted from the surrounding tissue and processed by a logistic regression model. Finally, the prediction model is trained and tested from the selected features.

RESULTS

In the experiments, the textural feature set extracted from surrounding tissue showed higher performance than intensity and morphology feature sets (Az, 0.7756 vs 0.7071 and 0.6431). The accuracy, sensitivity, specificity and the area index Az under the receiver operating characteristic (ROC) curve for the CAP system were 81.58% (93/114), 81.63% (40/49), 81.54% (53/65), and 0.8269 for using combined feature set.

CONCLUSIONS

These results indicated that the proposed CAP system can be helpful to determine the ALN status in patients with breast cancer.

Computer-aided diagnosis of malignant or benign thyroid nodes based on ultrasound images

The objective of this study is to evaluate the diagnostic value of combination of artificial neural networks (ANN) and support vector machine (SVM)-based CAD systems in differentiating malignant from benign thyroid nodes with gray-scale ultrasound images. Two morphological and 65 texture features extracted from regions of interest in 610 2D-ultrasound thyroid node images from 543 patients (207 malignant, 403 benign) were used to develop the ANN and SVM models. Tenfold cross validation evaluated their performance; the best models showed accuracy of 99% for ANN and 100% for SVM. From 50 thyroid node ultrasound images from 45 prospectively enrolled patients, the ANN model showed sensitivity, specificity, positive and negative predictive values, Youden index, and accuracy of 88.24, 90.91, 83.33, 93.75, 79.14, and 90.00%, respectively, the SVM model 76.47, 90.91, 81.25, 88.24, 67.38, and 86.00%, respectively, and in combination 100.00, 87.88, 80.95, 100.00, 87.88, and 92.00%, respectively. Both ANN and SVM had high value in classifying thyroid nodes. In combination, the sensitivity increased but specificity decreased. This combination might provide a second opinion for radiologists dealing with difficult to diagnose thyroid node ultrasound images.

The adaptive computer-aided diagnosis system based on tumor sizes for the classification of breast tumors detected at screening ultrasound

Screening ultrasound (US) is increasingly used as a supplement to mammography in women with dense breasts, and more than 80% of cancers detected by US alone are 1cm or smaller. An adaptive computer-aided diagnosis (CAD) system based on tumor size was proposed to classify breast tumors detected at screening US images using quantitative morphological and textural features. In the present study, a database containing 156 tumors (78 benign and 78 malignant) was separated into two subsets of different tumor sizes (<1cm and ⩾1cm) to explore the improvement in the performance of the CAD system. After adaptation, the accuracies, sensitivities, specificities and Az values of the CAD for the entire database increased from 73.1% (114/156), 73.1% (57/78), 73.1% (57/78), and 0.790 to 81.4% (127/156), 83.3% (65/78), 79.5% (62/78), and 0.852, respectively. In the data subset of tumors larger than 1cm, the performance improved from 66.2% (51/77), 68.3% (28/41), 63.9% (23/36), and 0.703 to 81.8% (63/77), 85.4% (35/41), 77.8% (28/36), and 0.855, respectively. The proposed CAD system can be helpful to classify breast tumors detected at screening US.

A Fusion-Based Approach for Breast Ultrasound Image Classification Using Multiple-ROI Texture and Morphological Analyses

Ultrasound imaging is commonly used for breast cancer diagnosis, but accurate interpretation of breast ultrasound (BUS) images is often challenging and operator-dependent. Computer-aided diagnosis (CAD) systems can be employed to provide the radiologists with a second opinion to improve the diagnosis accuracy. In this study, a new CAD system is developed to enable accurate BUS image classification. In particular, an improved texture analysis is introduced, in which the tumor is divided into a set of nonoverlapping regions of interest (ROIs). Each ROI is analyzed using gray-level cooccurrence matrix features and a support vector machine classifier to estimate its tumor class indicator. The tumor class indicators of all ROIs are combined using a voting mechanism to estimate the tumor class. In addition, morphological analysis is employed to classify the tumor. A probabilistic approach is used to fuse the classification results of the multiple-ROI texture analysis and morphological analysis. The proposed approach is applied to classify 110 BUS images that include 64 benign and 46 malignant tumors. The accuracy, specificity, and sensitivity obtained using the proposed approach are 98.2%, 98.4%, and 97.8%, respectively. These results demonstrate that the proposed approach can effectively be used to differentiate benign and malignant tumors.

Computer-aided diagnosis for distinguishing between triple-negative breast cancer and fibroadenomas based on ultrasound texture features

PURPOSE

Triple-negative breast cancer (TNBC), an aggressive subtype, is frequently misclassified as fibroadenoma due to benign morphologic features on breast ultrasound (US). This study aims to develop a computer-aided diagnosis (CAD) system based on texture features for distinguishing between TNBC and benign fibroadenomas in US images.

METHODS

US images of 169 pathology-proven tumors (mean size, 1.65 cm; range, 0.7-3.0 cm) composed of 84 benign fibroadenomas and 85 TNBC tumors are used in this study. After a tumor is segmented out using the level-set method, morphological, conventional texture, and multiresolution gray-scale invariant texture feature sets are computed using a best-fitting ellipse, gray-level co-occurrence matrices, and the ranklet transform, respectively. The linear support vector machine with leave-one-out cross-validation schema is used as a classifier, and the diagnostic performance is assessed with receiver operating characteristic curve analysis.

RESULTS

The Az values of the morphology, conventional texture, and multiresolution gray-scale invariant texture feature sets are 0.8470 [95% confidence intervals (CIs), 0.7826-0.8973], 0.8542 (95% CI, 0.7911-0.9030), and 0.9695 (95% CI, 0.9376-0.9865), respectively. The Az of the CAD system based on the combined feature sets is 0.9702 (95% CI, 0.9334-0.9882).

CONCLUSIONS

The CAD system based on texture features extracted via the ranklet transform may be useful for improving the ability to discriminate between TNBC and benign fibroadenomas.

Computer-Aided Diagnosis with Deep Learning Architecture: Applications to Breast Lesions in US Images and Pulmonary Nodules in CT Scans

This paper performs a comprehensive study on the deep-learning-based computer-aided diagnosis (CADx) for the differential diagnosis of benign and malignant nodules/lesions by avoiding the potential errors caused by inaccurate image processing results (e.g., boundary segmentation), as well as the classification bias resulting from a less robust feature set, as involved in most conventional CADx algorithms. Specifically, the stacked denoising auto-encoder (SDAE) is exploited on the two CADx applications for the differentiation of breast ultrasound lesions and lung CT nodules. The SDAE architecture is well equipped with the automatic feature exploration mechanism and noise tolerance advantage, and hence may be suitable to deal with the intrinsically noisy property of medical image data from various imaging modalities. To show the outperformance of SDAE-based CADx over the conventional scheme, two latest conventional CADx algorithms are implemented for comparison. 10 times of 10-fold cross-validations are conducted to illustrate the efficacy of the SDAE-based CADx algorithm. The experimental results show the significant performance boost by the SDAE-based CADx algorithm over the two conventional methods, suggesting that deep learning techniques can potentially change the design paradigm of the CADx systems without the need of explicit design and selection of problem-oriented features.

Computer Aided Theragnosis Using Quantitative Ultrasound Spectroscopy and Maximum Mean Discrepancy in Locally Advanced Breast Cancer

A noninvasive computer-aided-theragnosis (CAT) system was developed for the early therapeutic cancer response assessment in patients with locally advanced breast cancer (LABC) treated with neoadjuvant chemotherapy. The proposed CAT system was based on multi-parametric quantitative ultrasound (QUS) spectroscopic methods in conjunction with advanced machine learning techniques. Specifically, a kernel-based metric named maximum mean discrepancy (MMD), a technique for learning from imbalanced data based on random undersampling, and supervised learning were investigated with response-monitoring data from LABC patients. The CAT system was tested on 56 patients using statistical significance tests and leave-one-subject-out classification techniques. Textural features using state-of-the-art local binary patterns (LBP), and gray-scale intensity features were extracted from the spectral parametric maps in the proposed CAT system. The system indicated significant differences in changes between the responding and non-responding patient populations as well as high accuracy, sensitivity, and specificity in discriminating between the two patient groups early after the start of treatment, i.e., on weeks 1 and 4 of several months of treatment. The proposed CAT system achieved an accuracy of 85%, 87%, and 90% on weeks 1, 4 and 8, respectively. The sensitivity and specificity of developed CAT system for the same times was 85%, 95%, 90% and 85%, 85%, 91%, respectively. The proposed CAT system thus establishes a noninvasive framework for monitoring cancer treatment response in tumors using clinical ultrasound imaging in conjunction with machine learning techniques. Such a framework can potentially facilitate the detection of refractory responses in patients to treatment early on during a course of therapy to enable possibly switching to more efficacious treatments.

Application of wavelet techniques for cancer diagnosis using ultrasound images: A Review

Ultrasound is an important and low cost imaging modality used to study the internal organs of human body and blood flow through blood vessels. It uses high frequency sound waves to acquire images of internal organs. It is used to screen normal, benign and malignant tissues of various organs. Healthy and malignant tissues generate different echoes for ultrasound. Hence, it provides useful information about the potential tumor tissues that can be analyzed for diagnostic purposes before therapeutic procedures. Ultrasound images are affected with speckle noise due to an air gap between the transducer probe and the body. The challenge is to design and develop robust image preprocessing, segmentation and feature extraction algorithms to locate the tumor region and to extract subtle information from isolated tumor region for diagnosis. This information can be revealed using a scale space technique such as the Discrete Wavelet Transform (DWT). It decomposes an image into images at different scales using low pass and high pass filters. These filters help to identify the detail or sudden changes in intensity in the image. These changes are reflected in the wavelet coefficients. Various texture, statistical and image based features can be extracted from these coefficients. The extracted features are subjected to statistical analysis to identify the significant features to discriminate normal and malignant ultrasound images using supervised classifiers. This paper presents a review of wavelet techniques used for preprocessing, segmentation and feature extraction of breast, thyroid, ovarian and prostate cancer using ultrasound images.

Intensity-Invariant Texture Analysis for Classification of BI-RADS Category 3 Breast Masses

Radiologists likely incorrectly classify benign masses as Breast Imaging Reporting and Data System (BI-RADS) category 3. A computer-aided diagnosis (CAD) system was developed in this study as a second viewer to avoid misclassification of carcinomas. Sixty-nine biopsy-proven BI-RADS category 3 masses, including 21 malignant and 48 benign masses, were used to evaluate the CAD system. To improve the texture features, gray-scale variations between images were reduced by transforming pixels into intensity-invariant ranklet coefficients. The textures of the tumor and speckle pixels were extracted from the transformed ranklet images to provide more robust features than in conventional CAD systems. As a result, tumor texture and speckle texture with ranklet transformation achieved significantly better areas under the receiver operating characteristic curve (Az) compared with those without ranklet transformation (Az = 0.83 vs. 0.58 and Az = 0.80 vs. 0.56, p value < 0.05). The improved CAD system can be a second reader to confirm the classification of BI-RADS category 3 masses.

Robust phase-based texture descriptor for classification of breast ultrasound images

BACKGROUND

Classification of breast ultrasound (BUS) images is an important step in the computer-aided diagnosis (CAD) system for breast cancer. In this paper, a novel phase-based texture descriptor is proposed for efficient and robust classifiers to discriminate benign and malignant tumors in BUS images.

METHOD

The proposed descriptor, namely the phased congruency-based binary pattern (PCBP) is an oriented local texture descriptor that combines the phase congruency (PC) approach with the local binary pattern (LBP). The support vector machine (SVM) is further applied for the tumor classification. To verify the efficiency of the proposed PCBP texture descriptor, we compare the PCBP with other three state-of-art texture descriptors, and experiments are carried out on a BUS image database including 138 cases. The receiver operating characteristic (ROC) analysis is firstly performed and seven criteria are utilized to evaluate the classification performance using different texture descriptors. Then, in order to verify the robustness of the PCBP against illumination variations, we train the SVM classifier on texture features obtained from the original BUS images, and use this classifier to deal with the texture features extracted from BUS images with different illumination conditions (i.e., contrast-improved, gamma-corrected and histogram-equalized). The area under ROC curve (AUC) index is used as the figure of merit to evaluate the classification performances.

RESULTS AND CONCLUSIONS

The proposed PCBP texture descriptor achieves the highest values (i.e. 0.894) and the least variations in respect of the AUC index, regardless of the gray-scale variations. It's revealed in the experimental results that classifications of BUS images with the proposed PCBP texture descriptor are efficient and robust, which may be potentially useful for breast ultrasound CADs.

Ultrasound RF time series for classification of breast lesions

This work reports the use of ultrasound radio frequency (RF) time series analysis as a method for ultrasound-based classification of malignant breast lesions. The RF time series method is versatile and requires only a few seconds of raw ultrasound data with no need for additional instrumentation. Using the RF time series features, and a machine learning framework, we have generated malignancy maps, from the estimated cancer likelihood, for decision support in biopsy recommendation. These maps depict the likelihood of malignancy for regions of size 1 mm(2) within the suspicious lesions. We report an area under receiver operating characteristics curve of 0.86 (95% confidence interval [CI]: 0.84%-0.90%) using support vector machines and 0.81 (95% CI: 0.78-0.85) using Random Forests classification algorithms, on 22 subjects with leave-one-subject-out cross-validation. Changing the classification method yielded consistent results which indicates the robustness of this tissue typing method. The findings of this report suggest that ultrasound RF time series, along with the developed machine learning framework, can help in differentiating malignant from benign breast lesions, subsequently reducing the number of unnecessary biopsies after mammography screening.