Semi-automated segmentation and classification of digital breast tomosynthesis reconstructed images

AMS-U-Net: automatic mass segmentation in digital breast tomosynthesis via U-Net

Purpose

The objective of this study was to develop a fully automatic mass segmentation method called AMS-U-Net for digital breast tomosynthesis (DBT), a popular breast cancer screening imaging modality. The aim was to address the challenges posed by the increasing number of slices in DBT, which leads to higher mass contouring workload and decreased treatment efficiency.

Approach

The study used 50 slices from different DBT volumes for evaluation. The AMS-U-Net approach consisted of four stages: image pre-processing, AMS-U-Net training, image segmentation, and post-processing. The model performance was evaluated by calculating the true positive ratio (TPR), false positive ratio (FPR), F-score, intersection over union (IoU), and 95% Hausdorff distance (pixels) as they are appropriate for datasets with class imbalance.

Results

The model achieved 0.911, 0.003, 0.911, 0.900, 5.82 for TPR, FPR, F-score, IoU, and 95% Hausdorff distance, respectively.

Conclusions

The AMS-U-Net model demonstrated impressive visual and quantitative results, achieving high accuracy in mass segmentation without the need for human interaction. This capability has the potential to significantly increase clinical efficiency and workflow in DBT for breast cancer screening.

Emerging Breast Imaging Technologies on the Horizon

Early detection of breast cancers by mammography in conjunction with adjuvant therapy has contributed to reduction in breast cancer mortality. Mammography remains the "gold-standard" for breast cancer screening but is limited by tissue superposition. Digital breast tomosynthesis and more recently, dedicated breast computed tomography have been developed to alleviate the tissue superposition problem. However, all of these modalities rely upon x-ray attenuation contrast to provide anatomical images, and there are ongoing efforts to develop and clinically translate alternative modalities. These emerging modalities could provide for new contrast mechanisms and may potentially improve lesion detection and diagnosis. In this article, several of these emerging modalities are discussed with a focus on technologies that have advanced to the stage of in vivo clinical evaluation.

Effects of breast density and compression on normal breast tissue hemodynamics through breast tomosynthesis guided near-infrared spectral tomography

Optically derived tissue properties across a range of breast densities and the effects of breast compression on estimates of hemoglobin, oxygen metabolism, and water and lipid concentrations were obtained from a coregistered imaging system that integrates near-infrared spectral tomography (NIRST) with digital breast tomosynthesis (DBT). Image data were analyzed from 27 women who underwent four IRB approved NIRST/DBT exams that included fully and mildly compressed breast acquisitions in two projections—craniocaudal (CC) and mediolateral-oblique (MLO)—and generated four data sets per patient (full and moderate compression in CC and MLO views). Breast density was correlated with HbT (r=0.64, p=0.001), water (r=0.62, p=0.003), and lipid concentrations (r=?0.74, p<0.001), but not oxygen saturation. CC and MLO views were correlated for individual subjects and demonstrated no statistically significant differences in grouped analysis. Comparison of compressed and uncompressed imaging demonstrated a significant decrease in oxygen saturation under compression (58% versus 50%, p=0.04). Mammographic breast density categorization was correlated with measured optically derived properties.

Digital Breast Tomosynthesis: State of the Art

This topical review on digital breast tomosynthesis (DBT) is provided with the intent of describing the state of the art in terms of technology, results from recent clinical studies, advanced applications, and ongoing efforts to develop multimodality imaging systems that include DBT. Particular emphasis is placed on clinical studies. The observations of increase in cancer detection rates, particularly for invasive cancers, and the reduction in false-positive rates with DBT in prospective trials indicate its benefit for breast cancer screening. Retrospective multireader multicase studies show either noninferiority or superiority of DBT compared with mammography. Methods to curtail radiation dose are of importance. (©) RSNA, 2015.

Calibration and optimization of 3D digital breast tomosynthesis guided near infrared spectral tomography

Calibration of a three-dimensional multimodal digital breast tomosynthesis (DBT) x-ray and non-fiber based near infrared spectral tomography (NIRST) system is challenging but essential for clinical studies. Phantom imaging results yielded linear contrast recovery of total hemoglobin (HbT) concentration for cylindrical inclusions of 15 mm, 10 mm and 7 mm with a 3.5% decrease in the HbT estimate for each 1 cm increase in inclusion depth. A clinical exam of a patient's breast containing both benign and malignant lesions was successfully imaged, with greater HbT was found in the malignancy relative to the benign abnormality and fibroglandular regions (11 μM vs. 9.5 μM). Tools developed improved imaging system characterization and optimization of signal quality, which will ultimately improve patient selection and subsequent clinical trial results.

Digital Breast Tomosynthesis guided Near Infrared Spectroscopy: Volumetric estimates of fibroglandular fraction and breast density from tomosynthesis reconstructions

A multimodality system combining a clinical prototype digital breast tomosynthesis with its imaging geometry modified to facilitate near-infrared spectroscopic imaging has been developed. The accuracy of parameters recovered from near-infrared spectroscopy is dependent on fibroglandular tissue content. Hence, in this study, volumetric estimates of fibroglandular tissue from tomosynthesis reconstructions were determined. A kernel-based fuzzy c-means algorithm was implemented to segment tomosynthesis reconstructed slices in order to estimate fibroglandular content and to provide anatomic priors for near-infrared spectroscopy. This algorithm was used to determine volumetric breast density (VBD), defined as the ratio of fibroglandular tissue volume to the total breast volume, expressed as percentage, from 62 tomosynthesis reconstructions of 34 study participants. For a subset of study participants who subsequently underwent mammography, VBD from mammography matched for subject, breast laterality and mammographic view was quantified using commercial software and statistically analyzed to determine if it differed from tomosynthesis. Summary statistics of the VBD from all study participants were compared with prior independent studies. The fibroglandular volume from tomosynthesis and mammography were not statistically different (p=0.211, paired t-test). After accounting for the compressed breast thickness, which were different between tomosynthesis and mammography, the VBD from tomosynthesis was correlated with (r =0.809, p<0.001), did not statistically differ from (p>0.99, paired t-test), and was linearly related to, the VBD from mammography. Summary statistics of the VBD from tomosynthesis were not statistically different from prior studies using high-resolution dedicated breast computed tomography. The observation of correlation and linear association in VBD between mammography and tomosynthesis suggests that breast density associated risk measures determined for mammography are translatable to tomosynthesis. Accounting for compressed breast thickness is important when it differs between the two modalities. The fibroglandular volume from tomosynthesis reconstructions is similar to mammography indicating suitability for use during near-infrared spectroscopy.

Dedicated Breast CT: Feasibility for Monitoring Neoadjuvant Chemotherapy Treatment

Objectives:

In this prospective pilot study, the feasibility of non-contrast dedicated breast computed tomography (bCT) to determine primary tumor volume and monitor its changes during neoadjuvant chemotherapy (NAC) treatment was investigated.

Materials and Methods:

Eleven women who underwent NAC were imaged with a clinical prototype dedicated bCT system at three time points – pre-, mid-, and post-treatment. The study radiologist marked the boundary of the primary tumor from which the tumor volume was quantified. An automated algorithm was developed to quantify the primary tumor volume for comparison with radiologist's segmentation. The correlation between pre-treatment tumor volumes from bCT and MRI, and the correlation and concordance in tumor size between post-treatment bCT and pathology were determined.

Results:

Tumor volumes from automated and radiologist's segmentations were correlated (Pearson's r = 0.935, P < 0.001) and were not different over all time points [P = 0.808, repeated measures analysis of variance (ANOVA)]. Pre-treatment tumor volumes from MRI and bCT were correlated (r = 0.905, P < 0.001). Tumor size from post-treatment bCT was correlated with pathology (r = 0.987, P = 0.002) for invasive ductal carcinoma larger than 5 mm and the maximum difference in tumor size was 0.57 cm. The presence of biopsy clip (3 mm) limited the ability to accurately measure tumors smaller than 5 mm. All study participants were pathologically assessed to be responders, with three subjects experiencing complete pathologic response for invasive cancer and the reminder experiencing partial response. Compared to pre-treatment tumor volume, there was a statistically significant (P = 0.0003, paired t-test) reduction in tumor volume at mid-treatment observed with bCT, with an average tumor volume reduction of 47%.

Conclusions:

This pilot study suggests that dedicated non-contrast bCT has the potential to serve as an expedient imaging tool for monitoring tumor volume changes during NAC. Larger studies are needed in future.

Breast Tissue Classification in Digital Tomosynthesis Images Based on Global Gradient Minimization and Texture Features

Digital breast tomosynthesis (DBT) is a pseudo-three-dimensional x-ray imaging modality proposed to decrease the effect of tissue superposition present in mammography, potentially resulting in an increase in clinical performance for the detection and diagnosis of breast cancer. Tissue classification in DBT images can be useful in risk assessment, computer-aided detection and radiation dosimetry, among other aspects. However, classifying breast tissue in DBT is a challenging problem because DBT images include complicated structures, image noise, and out-of-plane artifacts due to limited angular tomographic sampling. In this project, we propose an automatic method to classify fatty and glandular tissue in DBT images. First, the DBT images are pre-processed to enhance the tissue structures and to decrease image noise and artifacts. Second, a global smooth filter based on L0 gradient minimization is applied to eliminate detailed structures and enhance large-scale ones. Third, the similar structure regions are extracted and labeled by fuzzy C-means (FCM) classification. At the same time, the texture features are also calculated. Finally, each region is classified into different tissue types based on both intensity and texture features. The proposed method is validated using five patient DBT images using manual segmentation as the gold standard. The Dice scores and the confusion matrix are utilized to evaluate the classified results. The evaluation results demonstrated the feasibility of the proposed method for classifying breast glandular and fat tissue on DBT images.

A review of breast tomosynthesis. Part II. Image reconstruction, processing and analysis, and advanced applications

Many important post-acquisition aspects of breast tomosynthesis imaging can impact its clinical performance. Chief among them is the reconstruction algorithm that generates the representation of the three-dimensional breast volume from the acquired projections. But even after reconstruction, additional processes, such as artifact reduction algorithms, computer aided detection and diagnosis, among others, can also impact the performance of breast tomosynthesis in the clinical realm. In this two part paper, a review of breast tomosynthesis research is performed, with an emphasis on its medical physics aspects. In the companion paper, the first part of this review, the research performed relevant to the image acquisition process is examined. This second part will review the research on the post-acquisition aspects, including reconstruction, image processing, and analysis, as well as the advanced applications being investigated for breast tomosynthesis.

Near-infrared spectral tomography integrated with digital breast tomosynthesis: effects of tissue scattering on optical data acquisition design

PURPOSE

Design optimization and phantom validation of an integrated digital breast tomosynthesis (DBT) and near-infrared spectral tomography (NIRST) system targeting improvement in sensitivity and specificity of breast cancer detection is presented. Factors affecting instrumentation design include minimization of cost, complexity, and examination time while maintaining high fidelity NIRST measurements with sufficient information to recover accurate optical property maps.

METHODS

Reconstructed DBT slices from eight patients with abnormal mammograms provided anatomical information for the NIRST simulations. A limited frequency domain (FD) and extensive continuous wave (CW) NIRST system was modeled. The FD components provided tissue scattering estimations used in the reconstruction of the CW data. Scattering estimates were perturbed to study the effects on hemoglobin recovery. Breast mimicking agar phantoms with inclusions were imaged using the combined DBT∕NIRST system for comparison with simulation results.

RESULTS

Patient simulations derived from DBT images show successful reconstruction of both normal and malignant lesions in the breast. They also demonstrate the importance of accurately quantifying tissue scattering. Specifically, 20% errors in optical scattering resulted in 22.6% or 35.1% error in quantification of total hemoglobin concentrations, depending on whether scattering was over- or underestimated, respectively. Limited frequency-domain optical signal sampling provided two regions scattering estimates (for fat and fibroglandular tissues) that led to hemoglobin concentrations that reduced the error in the tumor region by 31% relative to when a single estimate of optical scattering was used throughout the breast volume of interest. Acquiring frequency-domain data with six wavelengths instead of three did not significantly improve the hemoglobin concentration estimates. Simulation results were confirmed through experiments in two-region breast mimicking gelatin phantoms.

CONCLUSIONS

Accurate characterization of scattering is necessary for quantification of hemoglobin. Based on this study, a system design is described to optimally combine breast tomosynthesis with NIRST.