Development and validation of a deep learning model for breast lesion segmentation and characterization in multiparametric MRI

Computer-Aided Detection (CADe) and Segmentation Methods for Breast Cancer Using Magnetic Resonance Imaging (MRI)

Breast cancer continues to be a major health concern, and early detection is vital for enhancing survival rates. Magnetic resonance imaging (MRI) is a key tool due to its substantial sensitivity for invasive breast cancers. Computer-aided detection (CADe) systems enhance the effectiveness of MRI by identifying potential lesions, aiding radiologists in focusing on areas of interest, extracting quantitative features, and integrating with computer-aided diagnosis (CADx) pipelines. This review aims to provide a comprehensive overview of the current state of CADe systems in breast MRI, focusing on the technical details of pipelines and segmentation models including classical intensity-based methods, supervised and unsupervised machine learning (ML) approaches, and the latest deep learning (DL) architectures. It highlights recent advancements from traditional algorithms to sophisticated DL models such as U-Nets, emphasizing CADe implementation of multi-parametric MRI acquisitions. Despite these advancements, CADe systems face challenges like variable false-positive and negative rates, complexity in interpreting extensive imaging data, variability in system performance, and lack of large-scale studies and multicentric models, limiting the generalizability and suitability for clinical implementation. Technical issues, including image artefacts and the need for reproducible and explainable detection algorithms, remain significant hurdles. Future directions emphasize developing more robust and generalizable algorithms, integrating explainable AI to improve transparency and trust among clinicians, developing multi-purpose AI systems, and incorporating large language models to enhance diagnostic reporting and patient management. Additionally, efforts to standardize and streamline MRI protocols aim to increase accessibility and reduce costs, optimizing the use of CADe systems in clinical practice. LEVEL OF EVIDENCE: NA TECHNICAL EFFICACY: Stage 2.

Cross-site Validation of AI Segmentation and Harmonization in Breast MRI

This work aims to perform a cross-site validation of automated segmentation for breast cancers in MRI and to compare the performance to radiologists. A three-dimensional (3D) U-Net was trained to segment cancers in dynamic contrast-enhanced axial MRIs using a large dataset from Site 1 (n = 15,266; 449 malignant and 14,817 benign). Performance was validated on site-specific test data from this and two additional sites, and common publicly available testing data. Four radiologists from each of the three clinical sites provided two-dimensional (2D) segmentations as ground truth. Segmentation performance did not differ between the network and radiologists on the test data from Sites 1 and 2 or the common public data (median Dice score Site 1, network 0.86 vs. radiologist 0.85, n = 114; Site 2, 0.91 vs. 0.91, n = 50; common: 0.93 vs. 0.90). For Site 3, an affine input layer was fine-tuned using segmentation labels, resulting in comparable performance between the network and radiologist (0.88 vs. 0.89, n = 42). Radiologist performance differed on the common test data, and the network numerically outperformed 11 of the 12 radiologists (median Dice: 0.85-0.94, n = 20). In conclusion, a deep network with a novel supervised harmonization technique matches radiologists' performance in MRI tumor segmentation across clinical sites. We make code and weights publicly available to promote reproducible AI in radiology.

Artificial intelligence-based automated breast ultrasound radiomics for breast tumor diagnosis and treatment: a narrative review

Breast cancer (BC) is the most common malignant tumor among women worldwide, posing a substantial threat to their health and overall quality of life. Consequently, for early-stage BC, timely screening, accurate diagnosis, and the development of personalized treatment strategies are crucial for enhancing patient survival rates. Automated Breast Ultrasound (ABUS) addresses the limitations of traditional handheld ultrasound (HHUS), such as operator dependency and inter-observer variability, by providing a more comprehensive and standardized approach to BC detection and diagnosis. Radiomics, an emerging field, focuses on extracting high-dimensional quantitative features from medical imaging data and utilizing them to construct predictive models for disease diagnosis, prognosis, and treatment evaluation. In recent years, the integration of artificial intelligence (AI) with radiomics has significantly enhanced the process of analyzing and extracting meaningful features from large and complex radiomic datasets through the application of machine learning (ML) and deep learning (DL) algorithms. Recently, AI-based ABUS radiomics has demonstrated significant potential in the diagnosis and therapeutic evaluation of BC. However, despite the notable performance and application potential of ML and DL models based on ABUS, the inherent variability in the analyzed data highlights the need for further evaluation of these models to ensure their reliability in clinical applications.

Clinical Application of Artificial Intelligence in Breast MRI

Breast MRI is the most sensitive imaging modality for detecting breast cancer. However, its widespread use is limited by factors such as extended examination times, need for contrast agents, and susceptibility to motion artifacts. Artificial intelligence (AI) has emerged as a promising solution for these challenges by enhancing the efficiency and accuracy of breast MRI in multiple domains. AI-driven image reconstruction techniques have significantly reduced scan times while preserving image quality. This method outperforms traditional parallel imaging and compressed sensing. AI has also shown great promise for lesion classification and segmentation, with convolutional neural networks and U-Net architectures improving the differentiation between benign and malignant lesions. AI-based segmentation methods enable accurate tumor detection and characterization, thereby aiding personalized treatment planning. An AI triaging system has demonstrated the potential to streamline workflow efficiency by identifying low-suspicion cases and reducing the workload of radiologists. Another promising application is synthetic breast MR image generation, which aims to generate contrast enhanced images from non-contrast sequences, thereby improving accessibility and patient safety. Further research is required to validate AI models across diverse populations and imaging protocols. As AI continues to evolve, it is expected to play an important role in the optimization of breast MRI.

Deep learning-based breast cancer diagnosis in breast MRI: systematic review and meta-analysis

OBJECTIVES

The aim of this work is to evaluate the performance of deep learning (DL) models for breast cancer diagnosis with MRI.

MATERIALS AND METHODS

A literature search was conducted on Web of Science, PubMed, and IEEE Xplore for relevant studies published from January 2015 to February 2024. The study was registered with the PROSPERO International Prospective Register of Systematic Reviews (protocol no. CRD42024485371). The quality assessment of diagnostic accuracy studies-2 (QUADAS2) tool and the Must AI Criteria-10 (MAIC-10) checklist were used to assess quality and risk of bias. The meta-analysis included studies reporting DL for breast cancer diagnosis and their performance, from which pooled summary estimates for the area under the curve (AUC), sensitivity, and specificity were calculated.

RESULTS

A total of 40 studies were included, of which only 21 were eligible for quantitative analysis. Convolutional neural networks (CNNs) were used in 62.5% (25/40) of the implemented models, with the remaining 37.5% (15/40) hybrid composite models (HCMs). The pooled estimates of AUC, sensitivity, and specificity were 0.90 (95% CI: 0.87, 0.93), 88% (95% CI: 86, 91%), and 90% (95% CI: 87, 93%), respectively.

CONCLUSIONS

DL models used for breast cancer diagnosis on MRI achieve high performance. However, there is considerable inherent variability in this analysis. Therefore, continuous evaluation and refinement of DL models is essential to ensure their practicality in the clinical setting.

KEY POINTS

Question Can DL models improve diagnostic accuracy in breast MRI, addressing challenges like overfitting and heterogeneity in study designs and imaging sequences? Findings DL achieved high diagnostic accuracy (AUC 0.90, sensitivity 88%, specificity 90%) in breast MRI, with training size significantly impacting performance metrics (p < 0.001). Clinical relevance DL models demonstrate high accuracy in breast cancer diagnosis using MRI, showing the potential to enhance diagnostic confidence and reduce radiologist workload, especially with larger datasets minimizing overfitting and improving clinical reliability.

Deep Learning in Breast Cancer Imaging: A Decade of Progress and Future Directions

Breast cancer has reached the highest incidence rate worldwide among all malignancies since 2020. Breast imaging plays a significant role in early diagnosis and intervention to improve the outcome of breast cancer patients. In the past decade, deep learning has shown remarkable progress in breast cancer imaging analysis, holding great promise in interpreting the rich information and complex context of breast imaging modalities. Considering the rapid improvement in deep learning technology and the increasing severity of breast cancer, it is critical to summarize past progress and identify future challenges to be addressed. This paper provides an extensive review of deep learning-based breast cancer imaging research, covering studies on mammograms, ultrasound, magnetic resonance imaging, and digital pathology images over the past decade. The major deep learning methods and applications on imaging-based screening, diagnosis, treatment response prediction, and prognosis are elaborated and discussed. Drawn from the findings of this survey, we present a comprehensive discussion of the challenges and potential avenues for future research in deep learning-based breast cancer imaging.

Application of machine learning in the analysis of multiparametric MRI data for the differentiation of treatment responses in breast cancer: retrospective study

OBJECTIVE

The objective of this study is to develop and validate a multiparametric MRI model employing machine learning to predict the effectiveness of treatment and the stage of breast cancer.

METHODS

The study encompassed 400 female patients diagnosed with breast cancer, with 200 individuals allocated to both the control and experimental groups, undergoing examinations in Shenzhen, China, during the period 2017-2023. This study pertains to retrospective research. Multiparametric MRI was employed to extract data concerning tumor size, blood flow, and metabolism.

RESULTS

The model achieved high accuracy, predicting treatment outcomes with an accuracy of 92%, sensitivity of 88%, and specificity of 95%. The model effectively classified breast cancer stages: stage I, 38% ( P  = 0.027); stage II, 72% ( P  = 0.014); stage III, 50% ( P  = 0.032); and stage IV, 45% ( P  = 0.041).

CONCLUSIONS

The developed model, utilizing multiparametric MRI and machine learning, exhibits high accuracy in predicting the effectiveness of treatment and breast cancer staging. These findings affirm the model's potential to enhance treatment strategies and personalize approaches for patients diagnosed with breast cancer. Our study presents an innovative approach to the diagnosis and treatment of breast cancer, integrating MRI data with machine learning algorithms. We demonstrate that the developed model exhibits high accuracy in predicting treatment efficacy and differentiating cancer stages. This underscores the importance of utilizing MRI and machine learning algorithms to enhance the diagnosis and individualization of treatment for this disease.

AI Applications to Breast MRI: Today and Tomorrow

In breast imaging, there is an unrelenting increase in the demand for breast imaging services, partly explained by continuous expanding imaging indications in breast diagnosis and treatment. As the human workforce providing these services is not growing at the same rate, the implementation of artificial intelligence (AI) in breast imaging has gained significant momentum to maximize workflow efficiency and increase productivity while concurrently improving diagnostic accuracy and patient outcomes. Thus far, the implementation of AI in breast imaging is at the most advanced stage with mammography and digital breast tomosynthesis techniques, followed by ultrasound, whereas the implementation of AI in breast magnetic resonance imaging (MRI) is not moving along as rapidly due to the complexity of MRI examinations and fewer available dataset. Nevertheless, there is persisting interest in AI-enhanced breast MRI applications, even as the use of and indications of breast MRI continue to expand. This review presents an overview of the basic concepts of AI imaging analysis and subsequently reviews the use cases for AI-enhanced MRI interpretation, that is, breast MRI triaging and lesion detection, lesion classification, prediction of treatment response, risk assessment, and image quality. Finally, it provides an outlook on the barriers and facilitators for the adoption of AI in breast MRI. LEVEL OF EVIDENCE: 5 TECHNICAL EFFICACY: Stage 6.

A background parenchymal enhancement quantification framework of breast magnetic resonance imaging

Background

Background parenchymal enhancement (BPE) is defined as the enhanced proportion of normal fibroglandular tissue on enhanced magnetic resonance imaging. BPE shows promise as a quantitative imaging biomarker (QIB). However, the lack of consensus among radiologists in their semi-quantitative grading of BPE limits its clinical utility.

Methods

The main objective of this study was to develop a BPE quantification model according to clinical expertise, with the BPE integral being used as a QIB to incorporate both the volume and intensity of the enhancement metrics. The model was applied to 2,786 cases to compare our quantitative results with radiologists' semi-quantitative BPE grading to evaluate the effectiveness of using the BPE integral as a QIB for analyzing BPE. Comparisons between multiple groups of nonnormally distributed BPE integrals were performed using the Kruskal-Wallis test.

Results

Our study found a considerable degree of concordance between our BPE quantitative integral and radiologists' semi-quantitative assessments. Specifically, our research results revealed significant variability in BPE integral attained through the BPE quantification framework among all semi-quantitative BPE grading groups labeled by experienced radiologists, including mild-moderate (P<0.001), mild-marked (P<0.001), and moderate-marked (P<0.001). Furthermore, there was an apparent correlation between BPE integral and BPE grades, with marked BPE displaying the highest BPE integral, followed by moderate BPE, with mild BPE exhibiting the lowest BPE integral value.

Conclusions

The study developed and implemented a BPE quantification framework, which incorporated both the volume and intensity of enhancement and which could serve as a QIB for BPE.

Multiparametric MRI: From Simultaneous Rapid Acquisition Methods and Analysis Techniques Using Scoring, Machine Learning, Radiomics, and Deep Learning to the Generation of Novel Metrics

ABSTRACT

With the recent advancements in rapid imaging methods, higher numbers of contrasts and quantitative parameters can be acquired in less and less time. Some acquisition models simultaneously obtain multiparametric images and quantitative maps to reduce scan times and avoid potential issues associated with the registration of different images. Multiparametric magnetic resonance imaging (MRI) has the potential to provide complementary information on a target lesion and thus overcome the limitations of individual techniques. In this review, we introduce methods to acquire multiparametric MRI data in a clinically feasible scan time with a particular focus on simultaneous acquisition techniques, and we discuss how multiparametric MRI data can be analyzed as a whole rather than each parameter separately. Such data analysis approaches include clinical scoring systems, machine learning, radiomics, and deep learning. Other techniques combine multiple images to create new quantitative maps associated with meaningful aspects of human biology. They include the magnetic resonance g-ratio, the inner to the outer diameter of a nerve fiber, and the aerobic glycolytic index, which captures the metabolic status of tumor tissues.

The Role of Deep Learning in Advancing Breast Cancer Detection Using Different Imaging Modalities: A Systematic Review

Breast cancer is among the most common and fatal diseases for women, and no permanent treatment has been discovered. Thus, early detection is a crucial step to control and cure breast cancer that can save the lives of millions of women. For example, in 2020, more than 65% of breast cancer patients were diagnosed in an early stage of cancer, from which all survived. Although early detection is the most effective approach for cancer treatment, breast cancer screening conducted by radiologists is very expensive and time-consuming. More importantly, conventional methods of analyzing breast cancer images suffer from high false-detection rates. Different breast cancer imaging modalities are used to extract and analyze the key features affecting the diagnosis and treatment of breast cancer. These imaging modalities can be divided into subgroups such as mammograms, ultrasound, magnetic resonance imaging, histopathological images, or any combination of them. Radiologists or pathologists analyze images produced by these methods manually, which leads to an increase in the risk of wrong decisions for cancer detection. Thus, the utilization of new automatic methods to analyze all kinds of breast screening images to assist radiologists to interpret images is required. Recently, artificial intelligence (AI) has been widely utilized to automatically improve the early detection and treatment of different types of cancer, specifically breast cancer, thereby enhancing the survival chance of patients. Advances in AI algorithms, such as deep learning, and the availability of datasets obtained from various imaging modalities have opened an opportunity to surpass the limitations of current breast cancer analysis methods. In this article, we first review breast cancer imaging modalities, and their strengths and limitations. Then, we explore and summarize the most recent studies that employed AI in breast cancer detection using various breast imaging modalities. In addition, we report available datasets on the breast-cancer imaging modalities which are important in developing AI-based algorithms and training deep learning models. In conclusion, this review paper tries to provide a comprehensive resource to help researchers working in breast cancer imaging analysis.