Automated Detection and Segmentation of Nonmass-Enhancing Breast Tumors with Dynamic Contrast-Enhanced Magnetic Resonance Imaging

Segmentation of breast lesion using fuzzy thresholding and deep learning

Breast cancer is a major cause of morbidity and mortality in women. In breast cancer screening, Dynamic Contrast Enhanced Magnetic Resonance Imaging (DCE-MRI) has shown promise as a technique, providing enhanced temporal patterns of breast tissues. This study proposes an enhanced segmentation method for identifying breast lesions. The proposed experiments are done using the breast DCE-MRI images of 123 slices from seven patients in The Cancer Image Archive database. The three methods proposed and tested to segment the lesions are: i) Fuzzy C-mean Thresholding (FCMTH) with morphological operations ii) deep learning networks trained with original images iii) deep learning networks trained with three types of preprocessed images: the core breast image, the filtered core breast image, and the fuzzy thresholded image. In this study, the deep learning networks are trained with preprocessed images generated from the FCMTH technique, resulting in higher segmentation accuracy. FCMTH achieves Dice and Jaccard coefficients of 0.8458 and 0.7471, while DeepLabv3+ with MobileNetv2 trained by preprocessed images achieves 0.9468 and 0.8990, respectively. Thus, the combination of deep learning and FCMTH techniques provides the best performance for lesion detection.

Artificial intelligence in breast imaging: Current situation and clinical challenges

Breast cancer ranks among the most prevalent malignant tumours and is the primary contributor to cancer-related deaths in women. Breast imaging is essential for screening, diagnosis, and therapeutic surveillance. With the increasing demand for precision medicine, the heterogeneous nature of breast cancer makes it necessary to deeply mine and rationally utilize the tremendous amount of breast imaging information. With the rapid advancement of computer science, artificial intelligence (AI) has been noted to have great advantages in processing and mining of image information. Therefore, a growing number of scholars have started to focus on and research the utility of AI in breast imaging. Here, an overview of breast imaging databases and recent advances in AI research are provided, the challenges and problems in this field are discussed, and then constructive advice is further provided for ongoing scientific developments from the perspective of the National Natural Science Foundation of China.

Automatic breast lesion segmentation in phase preserved DCE-MRIs

We offer a framework for automatically and accurately segmenting breast lesions from Dynamic Contrast Enhanced (DCE) MRI in this paper. The framework is built using max flow and min cut problems in the continuous domain over phase preserved denoised images. Three stages are required to complete the proposed approach. First, post-contrast and pre-contrast images are subtracted, followed by image registrations that benefit to enhancing lesion areas. Second, a phase preserved denoising and pixel-wise adaptive Wiener filtering technique is used, followed by max flow and min cut problems in a continuous domain. A denoising mechanism clears the noise in the images by preserving useful and detailed features such as edges. Then, lesion detection is performed using continuous max flow. Finally, a morphological operation is used as a post-processing step to further delineate the obtained results. A series of qualitative and quantitative trials employing nine performance metrics on 21 cases with two different MR image resolutions were used to verify the effectiveness of the proposed method. Performance results demonstrate the quality of segmentation obtained from the proposed method.

Joint Dense Residual and Recurrent Attention Network for DCE-MRI Breast Tumor Segmentation

Breast cancer detection largely relies on imaging characteristics and the ability of clinicians to easily and quickly identify potential lesions. Magnetic resonance imaging (MRI) of breast tumors has recently shown great promise for enabling the automatic identification of breast tumors. Nevertheless, state-of-the-art MRI-based algorithms utilizing deep learning techniques are still limited in their ability to accurately separate tumor and healthy tissue. Therefore, in the current work, we propose an automatic and accurate two-stage U-Net-based segmentation framework for breast tumor detection using dynamic contrast-enhanced MRI (DCE-MRI). This framework was evaluated using T2-weighted MRI data from 160 breast tumor cases, and its performance was compared with that of the standard U-Net model. In the first stage of the proposed framework, a refined U-Net model was utilized to automatically delineate a breast region of interest (ROI) from the surrounding healthy tissue. Importantly, this automatic segmentation step reduced the impact of the background chest tissue on breast tumors' identification. For the second stage, we employed an improved U-Net model that combined a dense residual module based on dilated convolution with a recurrent attention module. This model was used to accurately and automatically segment the tumor tissue from healthy tissue in the breast ROI derived in the previous step. Overall, compared to the U-Net model, the proposed technique exhibited increases in the Dice similarity coefficient, Jaccard similarity, positive predictive value, sensitivity, and Hausdorff distance of 3%, 3%, 3%, 2%, and 16.2, respectively. The proposed model may in the future aid in the clinical diagnosis of breast cancer lesions and help guide individualized patient treatment.

Non-Mass Enhancements on DCE-MRI: Development and Validation of a Radiomics-Based Signature for Breast Cancer Diagnoses

Purpose

We aimed to assess the additional value of a radiomics-based signature for distinguishing between benign and malignant non-mass enhancement lesions (NMEs) on dynamic contrast-enhanced breast magnetic resonance imaging (breast DCE-MRI).

Methods

In this retrospective study, 232 patients with 247 histopathologically confirmed NMEs (malignant: 191; benign: 56) were enrolled from December 2017 to October 2020 as a primary cohort to develop the discriminative models. Radiomic features were extracted from one post-contrast phase (around 90s after contrast injection) of breast DCE-MRI images. The least absolute shrinkage and selection operator (LASSO) regression model was adapted to select features and construct the radiomics-based signature. Based on clinical and routine MR features, radiomics features, and combined information, three discriminative models were built using multivariable logistic regression analyses. In addition, an independent cohort of 72 patients with 72 NMEs (malignant: 50; benign: 22) was collected from November 2020 to April 2021 for the validation of the three discriminative models. Finally, the combined model was assessed using nomogram and decision curve analyses.

Results

The routine MR model with two selected features of the time-intensity curve (TIC) type and MR-reported axillary lymph node (ALN) status showed a high sensitivity of 0.942 (95%CI, 0.906 - 0.974) and low specificity of 0.589 (95%CI, 0.464 - 0.714). The radiomics model with six selected features was significantly correlated with malignancy (P<0.001 for both primary and validation cohorts). Finally, the individual combined model, which contained factors including TIC types and radiomics signatures, showed good discrimination, with an acceptable sensitivity of 0.869 (95%CI, 0.816 to 0.916), improved specificity of 0.839 (95%CI, 0.750 to 0.929). The nomogram was applied to the validation cohort, reaching good discrimination, with a sensitivity of 0.820 (95%CI, 0.700 to 0.920), specificity of 0.864 (95%CI,0.682 to 1.000). The combined model was clinically helpful, as demonstrated by decision curve analysis.

Conclusions

Our study added radiomics signatures into a conventional clinical model and developed a radiomics nomogram including radiomics signatures and TIC types. This radiomics model could be used to differentiate benign from malignant NMEs in patients with suspicious lesions on breast MRI.

Artificial Intelligence in Medical Imaging of the Breast

Artificial intelligence (AI) has invaded our daily lives, and in the last decade, there have been very promising applications of AI in the field of medicine, including medical imaging, in vitro diagnosis, intelligent rehabilitation, and prognosis. Breast cancer is one of the common malignant tumors in women and seriously threatens women's physical and mental health. Early screening for breast cancer via mammography, ultrasound and magnetic resonance imaging (MRI) can significantly improve the prognosis of patients. AI has shown excellent performance in image recognition tasks and has been widely studied in breast cancer screening. This paper introduces the background of AI and its application in breast medical imaging (mammography, ultrasound and MRI), such as in the identification, segmentation and classification of lesions; breast density assessment; and breast cancer risk assessment. In addition, we also discuss the challenges and future perspectives of the application of AI in medical imaging of the breast.

An A.I. classifier derived from 4D radiomics of dynamic contrast-enhanced breast MRI data: potential to avoid unnecessary breast biopsies

Objectives

Due to its high sensitivity, DCE MRI of the breast (bMRI) is increasingly used for both screening and assessment purposes. The high number of detected lesions poses a significant logistic challenge in clinical practice. The aim was to evaluate a temporally and spatially resolved (4D) radiomics approach to distinguish benign from malignant enhancing breast lesions and thereby avoid unnecessary biopsies.

Methods

This retrospective study included consecutive patients with MRI-suspicious findings (BI-RADS 4/5). Two blinded readers analyzed DCE images using a commercially available software, automatically extracting BI-RADS curve types and pharmacokinetic enhancement features. After principal component analysis (PCA), a neural network–derived A.I. classifier to discriminate benign from malignant lesions was constructed and tested using a random split simple approach. The rate of avoidable biopsies was evaluated at exploratory cutoffs (C₁, 100%, and C₂, ≥ 95% sensitivity).

Results

Four hundred seventy (295 malignant) lesions in 329 female patients (mean age 55.1 years, range 18–85 years) were examined. Eighty-six DCE features were extracted based on automated volumetric lesion analysis. Five independent component features were extracted using PCA. The A.I. classifier achieved a significant (p < .001) accuracy to distinguish benign from malignant lesion within the test sample (AUC: 83.5%; 95% CI: 76.8–89.0%). Applying identified cutoffs on testing data not included in training dataset showed the potential to lower the number of unnecessary biopsies of benign lesions by 14.5% (C₁) and 36.2% (C₂).

Conclusion

The investigated automated 4D radiomics approach resulted in an accurate A.I. classifier able to distinguish between benign and malignant lesions. Its application could have avoided unnecessary biopsies.

Key Points

• Principal component analysis of the extracted volumetric and temporally resolved (4D) DCE markers favored pharmacokinetic modeling derived features.

• An A.I. classifier based on 86 extracted DCE features achieved a good to excellent diagnostic performance as measured by the area under the ROC curve with 80.6% (training dataset) and 83.5% (testing dataset).

• Testing the resulting A.I. classifier showed the potential to lower the number of unnecessary biopsies of benign breast lesions by up to 36.2%, p < .001 at the cost of up to 4.5% (n = 4) false negative low-risk cancers.

Supplementary Information

The online version contains supplementary material available at 10.1007/s00330-021-07787-z.

Decision support system for breast lesions via dynamic contrast enhanced magnetic resonance imaging

The presented study aims to design a computer-aided detection and diagnosis system for breast dynamic contrast enhanced magnetic resonance imaging. In the proposed system, the segmentation task is performed in two stages. The first stage is called breast region segmentation in which adaptive noise filtering, local adaptive thresholding, connected component analysis, integral of horizontal projection, and breast region of interest detection algorithms are applied to the breast images consecutively. The second stage of segmentation is breast lesion detection that consists of 32-class Otsu thresholding and Markov random field techniques. Histogram, gray level co-occurrence matrix and neighboring gray tone difference matrix based feature extraction, Fisher score based feature selection and, tenfold and leave-one-out cross-validation steps are carried out after segmentation to increase the reliability of the designed system while decreasing the computational time. Finally, support vector machines, k- nearest neighbor, and artificial neural network classifiers are performed to separate the breast lesions as benign and malignant. The average accuracy, sensitivity, specificity, and positive predictive values of each classifier are calculated and the best results are compared with the existing similar studies. According to the achieved results, the proposed decision support system for breast lesion segmentation distinguishes the breast lesions with 86%, 100%, 67%, and 85% accuracy, sensitivity, specificity, and positive predictive values, respectively. These results show that the proposed system can be used to support the radiologists during a breast cancer diagnosis.

Limited role of DWI with apparent diffusion coefficient mapping in breast lesions presenting as non-mass enhancement on dynamic contrast-enhanced MRI

BACKGROUND

Available data proving the value of DWI for breast cancer diagnosis is mainly for enhancing masses; DWI may be less sensitive and specific in non-mass enhancement (NME) lesions. The objective of this study was to assess the diagnostic accuracy of DWI using different ROI measurement approaches and ADC metrics in breast lesions presenting as NME lesions on dynamic contrast-enhanced (DCE) MRI.

METHODS

In this retrospective study, 95 patients who underwent multiparametric MRI with DCE and DWI from September 2007 to July 2013 and who were diagnosed with a suspicious NME (BI-RADS 4/5) were included. Twenty-nine patients were excluded for lesion non-visibility on DWI (n = 24: 12 benign and 12 malignant) and poor DWI quality (n = 5: 1 benign and 4 malignant). Two readers independently assessed DWI and DCE-MRI findings in two separate randomized readings using different ADC metrics and ROI approaches. NME lesions were classified as either benign (> 1.3 × 10^-3 mm²/s) or malignant (≤ 1.3 × 10^-3 mm²/s). Histopathology was the standard of reference. ROC curves were plotted, and AUCs were determined. Concordance correlation coefficient (CCC) was measured.

RESULTS

There were 39 malignant (59%) and 27 benign (41%) lesions in 66 (65 women, 1 man) patients (mean age, 51.8 years). The mean ADC value of the darkest part of the tumor (Dptu) achieved the highest diagnostic accuracy, with AUCs of up to 0.71. Inter-reader agreement was highest with Dptu ADC max (CCC 0.42) and lowest with the point tumor (Ptu) ADC min (CCC = - 0.01). Intra-reader agreement was highest with Wtu ADC mean (CCC = 0.44 for reader 1, 0.41 for reader 2), but this was not associated with the highest diagnostic accuracy.

CONCLUSIONS

Diagnostic accuracy of DWI with ADC mapping is limited in NME lesions. Thirty-one percent of lesions presenting as NME on DCE-MRI could not be evaluated with DWI, and therefore, DCE-MRI remains indispensable. Best results were achieved using Dptu 2D ROI measurement and ADC mean.