Convolutional Neural Network of Multiparametric MRI Accurately Detects Axillary Lymph Node Metastasis in Breast Cancer Patients With Pre Neoadjuvant Chemotherapy

Incorporating radiomic MRI models for presurgical response assessment in patients with early breast cancer undergoing neoadjuvant systemic therapy: Collaborative insights from breast oncologists and radiologists

The assessment of neoadjuvant treatment's response is critical for selecting the most suitable therapeutic options for patients with breast cancer to reduce the need for invasive local therapies. Breast magnetic resonance imaging (MRI) is so far one of the most accurate approaches for assessing pathological complete response, although this is limited by the qualitative and subjective nature of radiologists' assessment, often making it insufficient for deciding whether to forgo additional locoregional therapy measures. To increase the accuracy and prediction of radiomic MRI with the aid of machine learning models and deep learning methods, as part of artificial intelligence, have been used to analyse the different subtypes of breast cancer and the specific changes observed before and after therapy. This review discusses recent advancements in radiomic MRI models for presurgical response assessment for patients with early breast cancer receiving preoperative treatments, with a focus on their implications for clinical practice.

Deep learning-based breast MRI for predicting axillary lymph node metastasis: a systematic review and meta-analysis

BACKGROUND

To perform a systematic review and meta-analysis that assesses the diagnostic performance of deep learning algorithms applied to breast MRI for predicting axillary lymph nodes metastases in patients of breast cancer.

METHODS

A systematic literature search in PubMed, MEDLINE, and Embase databases for articles published from January 2004 to February 2025. Inclusion criteria were: patients with breast cancer; deep learning using MRI images was applied to predict axillary lymph nodes metastases; sufficient data were present; original research articles. Quality Assessment of Diagnostic Accuracy Studies-AI and Checklist for Artificial Intelligence in Medical Imaging was used to assess the quality. Statistical analysis included pooling of diagnostic accuracy and investigating between-study heterogeneity. A summary receiver operating characteristic curve (SROC) was performed. R statistical software (version 4.4.0) was used for statistical analyses.

RESULTS

A total of 10 studies were included. The pooled sensitivity and specificity were 0.76 (95% CI, 0.67-0.83) and 0.81 (95% CI, 0.74-0.87), respectively, with both measures having moderate between-study heterogeneity (I2 = 61% and 60%, respectively; p < 0.01). The SROC analysis yielded a weighted AUC of 0.788.

CONCLUSION

This meta-analysis demonstrates that deep learning algorithms applied to breast MRI offer promising diagnostic performance for predicting axillary lymph node metastases in breast cancer patients. Incorporating deep learning into clinical practice may enhance decision-making by providing a non-invasive method to more accurately predict lymph node involvement, potentially reducing unnecessary surgeries.

Deep Learning in Breast Cancer Imaging: A Decade of Progress and Future Directions

Breast cancer has reached the highest incidence rate worldwide among all malignancies since 2020. Breast imaging plays a significant role in early diagnosis and intervention to improve the outcome of breast cancer patients. In the past decade, deep learning has shown remarkable progress in breast cancer imaging analysis, holding great promise in interpreting the rich information and complex context of breast imaging modalities. Considering the rapid improvement in deep learning technology and the increasing severity of breast cancer, it is critical to summarize past progress and identify future challenges to be addressed. This paper provides an extensive review of deep learning-based breast cancer imaging research, covering studies on mammograms, ultrasound, magnetic resonance imaging, and digital pathology images over the past decade. The major deep learning methods and applications on imaging-based screening, diagnosis, treatment response prediction, and prognosis are elaborated and discussed. Drawn from the findings of this survey, we present a comprehensive discussion of the challenges and potential avenues for future research in deep learning-based breast cancer imaging.

Application of machine learning in the analysis of multiparametric MRI data for the differentiation of treatment responses in breast cancer: retrospective study

OBJECTIVE

The objective of this study is to develop and validate a multiparametric MRI model employing machine learning to predict the effectiveness of treatment and the stage of breast cancer.

METHODS

The study encompassed 400 female patients diagnosed with breast cancer, with 200 individuals allocated to both the control and experimental groups, undergoing examinations in Shenzhen, China, during the period 2017-2023. This study pertains to retrospective research. Multiparametric MRI was employed to extract data concerning tumor size, blood flow, and metabolism.

RESULTS

The model achieved high accuracy, predicting treatment outcomes with an accuracy of 92%, sensitivity of 88%, and specificity of 95%. The model effectively classified breast cancer stages: stage I, 38% ( P  = 0.027); stage II, 72% ( P  = 0.014); stage III, 50% ( P  = 0.032); and stage IV, 45% ( P  = 0.041).

CONCLUSIONS

The developed model, utilizing multiparametric MRI and machine learning, exhibits high accuracy in predicting the effectiveness of treatment and breast cancer staging. These findings affirm the model's potential to enhance treatment strategies and personalize approaches for patients diagnosed with breast cancer. Our study presents an innovative approach to the diagnosis and treatment of breast cancer, integrating MRI data with machine learning algorithms. We demonstrate that the developed model exhibits high accuracy in predicting treatment efficacy and differentiating cancer stages. This underscores the importance of utilizing MRI and machine learning algorithms to enhance the diagnosis and individualization of treatment for this disease.

Flamingo Search Sailfish Optimizer Based SqueezeNet for Detection of Breast Cancer Using MRI Images

Breast cancer with increased risk in women is identified with Breast Magnetic Resonance Imaging (Breast MRI) and this helps in evaluating treatment therapies. Breast MRI is time time-consuming process that involves the assessment of current imaging. This research work depends on the detection of breast cancer at the earlier stages. Among various cancers, breast cancer in women occurs in larger accounts for almost 30% of estimated cancer cases. In this research, many steps are followed for breast cancer detection like pre-processing, segmentation, augmentation, extraction of features, and cancer detection. Here, the median filter is utilized for pre-processing, as well as segmentation is followed after pre-processing, which is done by Psi-Net. Moreover, the process of augmentation like shearing, translation, and cropping are followed after segmentation. Also, the segmented image tends to process feature extraction, where features like shape features, Completed Local Binary Pattern (CLBP), Pyramid Histogram of Oriented Gradients (PHOG), and statistical features are extracted. Finally, breast cancer is detected using the DL model, SqueezeNet. Here, the newly devised Flamingo Search SailFish Optimizer (FSSFO) is used in training Psi-Net as well as SqueezeNet. Furthermore, FSSFO is the combination of both the Flamingo Search Algorithm (FSA) and SailFish Optimizer (SFO).

Role of Radiology in the Diagnosis and Treatment of Breast Cancer in Women: A Comprehensive Review

Breast cancer remains a leading cause of morbidity and mortality among women worldwide. Early detection and precise diagnosis are critical for effective treatment and improved patient outcomes. This review explores the evolving role of radiology in the diagnosis and treatment of breast cancer, highlighting advancements in imaging technologies and the integration of artificial intelligence (AI). Traditional imaging modalities such as mammography, ultrasound, and magnetic resonance imaging have been the cornerstone of breast cancer diagnostics, with each modality offering unique advantages. The advent of radiomics, which involves extracting quantitative data from medical images, has further augmented the diagnostic capabilities of these modalities. AI, particularly deep learning algorithms, has shown potential in improving diagnostic accuracy and reducing observer variability across imaging modalities. AI-driven tools are increasingly being integrated into clinical workflows to assist in image interpretation, lesion classification, and treatment planning. Additionally, radiology plays a crucial role in guiding treatment decisions, particularly in the context of image-guided radiotherapy and monitoring response to neoadjuvant chemotherapy. The review also discusses the emerging field of theranostics, where diagnostic imaging is combined with therapeutic interventions to provide personalized cancer care. Despite these advancements, challenges such as the need for large annotated datasets and the integration of AI into clinical practice remain. The review concludes that while the role of radiology in breast cancer management is rapidly evolving, further research is required to fully realize the potential of these technologies in improving patient outcomes.

Breast Cancer Subtype Prediction Model Employing Artificial Neural Network and 18F-Fluorodeoxyglucose Positron Emission Tomography/ Computed Tomography

Introduction

Although positron emission tomography/computed tomography (PET/CT) is a common tool for measuring breast cancer (BC), subtypes are not automatically classified by it. Therefore, the purpose of this research is to use an artificial neural network (ANN) to evaluate the clinical subtypes of BC based on the value of the tumor marker.

Materials and Methods

In our nuclear medical facility, 122 BC patients (training and testing) had 18F-fluoro-D-glucose (18F-FDG) PET/CT to identify the various subtypes of the disease. 18F-FDG-18 injections were administered to the patients before the scanning process. We carried out the scan according to protocol. Based on the tumor marker value, the ANN's output layer uses the Softmax function with cross-entropy loss to detect different subtypes of BC.

Results

With an accuracy of 95.77%, the result illustrates the ANN model for K-fold cross-validation. The mean values of specificity and sensitivity were 0.955 and 0.958, respectively. The area under the curve on average was 0.985.

Conclusion

Subtypes of BC may be categorized using the suggested approach. The PET/CT may be updated to diagnose BC subtypes using the appropriate tumor maker value when the suggested model is clinically implemented.

Machine learning and new insights for breast cancer diagnosis

Breast cancer (BC) is the most prominent form of cancer among females all over the world. The current methods of BC detection include X-ray mammography, ultrasound, computed tomography, magnetic resonance imaging, positron emission tomography and breast thermographic techniques. More recently, machine learning (ML) tools have been increasingly employed in diagnostic medicine for its high efficiency in detection and intervention. The subsequent imaging features and mathematical analyses can then be used to generate ML models, which stratify, differentiate and detect benign and malignant breast lesions. Given its marked advantages, radiomics is a frequently used tool in recent research and clinics. Artificial neural networks and deep learning (DL) are novel forms of ML that evaluate data using computer simulation of the human brain. DL directly processes unstructured information, such as images, sounds and language, and performs precise clinical image stratification, medical record analyses and tumour diagnosis. Herein, this review thoroughly summarizes prior investigations on the application of medical images for the detection and intervention of BC using radiomics, namely DL and ML. The aim was to provide guidance to scientists regarding the use of artificial intelligence and ML in research and the clinic.

Machine learning prediction of pathological complete response and overall survival of breast cancer patients in an underserved inner-city population

BACKGROUND

Generalizability of predictive models for pathological complete response (pCR) and overall survival (OS) in breast cancer patients requires diverse datasets. This study employed four machine learning models to predict pCR and OS up to 7.5 years using data from a diverse and underserved inner-city population.

METHODS

Demographics, staging, tumor subtypes, income, insurance status, and data from radiology reports were obtained from 475 breast cancer patients on neoadjuvant chemotherapy in an inner-city health system (01/01/2012 to 12/31/2021). Logistic regression, Neural Network, Random Forest, and Gradient Boosted Regression models were used to predict outcomes (pCR and OS) with fivefold cross validation.

RESULTS

pCR was not associated with age, race, ethnicity, tumor staging, Nottingham grade, income, and insurance status (p > 0.05). ER-/HER2+ showed the highest pCR rate, followed by triple negative, ER+/HER2+, and ER+/HER2- (all p < 0.05), tumor size (p < 0.003) and background parenchymal enhancement (BPE) (p < 0.01). Machine learning models ranked ER+/HER2-, ER-/HER2+, tumor size, and BPE as top predictors of pCR (AUC = 0.74-0.76). OS was associated with race, pCR status, tumor subtype, and insurance status (p < 0.05), but not ethnicity and incomes (p > 0.05). Machine learning models ranked tumor stage, pCR, nodal stage, and triple-negative subtype as top predictors of OS (AUC = 0.83-0.85). When grouping race and ethnicity by tumor subtypes, neither OS nor pCR were different due to race and ethnicity for each tumor subtype (p > 0.05).

CONCLUSION

Tumor subtypes and imaging characteristics were top predictors of pCR in our inner-city population. Insurance status, race, tumor subtypes and pCR were associated with OS. Machine learning models accurately predicted pCR and OS.

Improved Cervical Lymph Node Characterization among Patients with Head and Neck Squamous Cell Carcinoma Using MR Texture Analysis Compared to Traditional FDG-PET/MR Features Alone

Accurate differentiation of benign and malignant cervical lymph nodes is important for prognosis and treatment planning in patients with head and neck squamous cell carcinoma. We evaluated the diagnostic performance of magnetic resonance image (MRI) texture analysis and traditional 18F-deoxyglucose positron emission tomography (FDG-PET) features. This retrospective study included 21 patients with head and neck squamous cell carcinoma. We used texture analysis of MRI and FDG-PET features to evaluate 109 histologically confirmed cervical lymph nodes (41 metastatic, 68 benign). Predictive models were evaluated using area under the curve (AUC). Significant differences were observed between benign and malignant cervical lymph nodes for 36 of 41 texture features (p < 0.05). A combination of 22 MRI texture features discriminated benign and malignant nodal disease with AUC, sensitivity, and specificity of 0.952, 92.7%, and 86.7%, which was comparable to maximum short-axis diameter, lymph node morphology, and maximum standard uptake value (SUVmax). The addition of MRI texture features to traditional FDG-PET features differentiated these groups with the greatest AUC, sensitivity, and specificity (0.989, 97.5%, and 94.1%). The addition of the MRI texture feature to lymph node morphology improved nodal assessment specificity from 70.6% to 88.2% among FDG-PET indeterminate lymph nodes. Texture features are useful for differentiating benign and malignant cervical lymph nodes in patients with head and neck squamous cell carcinoma. Lymph node morphology and SUVmax remain accurate tools. Specificity is improved by the addition of MRI texture features among FDG-PET indeterminate lymph nodes. This approach is useful for differentiating benign and malignant cervical lymph nodes.

Development and validation of convolutional neural network-based model to predict the risk of sentinel or non-sentinel lymph node metastasis in patients with breast cancer: a machine learning study

Background

For patients with sentinel lymph node (SLN) metastasis and low risk of residual non-SLN (NSLN) metastasis, axillary lymph node (ALN) dissection could lead to overtreatment. This study aimed to develop and validate an automated preoperative deep learning-based tool to predict the risk of SLN and NSLN metastasis in patients with breast cancer (BC) using dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) images.

Methods

In this machine learning study, we retrospectively enrolled 988 women with BC from three hospitals in Zhejiang, China between June 1, 2013 to December 31, 2021, June 1, 2017 to December 31, 2021, and January 1, 2019 to June 30, 2023, respectively. Patients were divided into the training set (n = 519), internal validation set (n = 129), external test set 1 (n = 296), and external test set 2 (n = 44). A convolutional neural network (CNN) model was proposed to predict the SLN and NSLN metastasis and was compared with clinical and radiomics approaches. The performance of different models to detect ALN metastasis was measured by the area under the curve (AUC), accuracy, sensitivity, and specificity. This study is registered at ChiCTR, ChiCTR2300070740.

Findings

For SLN prediction, the top-performing model (i.e., the CNN algorithm) achieved encouraging predictive performance in the internal validation set (AUC 0.899, 95% CI, 0.887-0.911), external test set 1 (AUC 0.885, 95% CI, 0.867-0.903), and external test set 2 (AUC 0.768, 95% CI, 0.738-0.798). For NSLN prediction, the CNN-based model also exhibited satisfactory performance in the internal validation set (AUC 0.800, 95% CI, 0.783-0.817), external test set 1 (AUC 0.763, 95% CI, 0.732-0.794), and external test set 2 (AUC 0.728, 95% CI, 0.719-0.738). Based on the subgroup analysis, the CNN model performed well in tumour group smaller than 2.0 cm, with the AUC of 0.801 (internal validation set) and 0.823 (external test set 1). Of 469 patients with BC, the false positive rate of SLN prediction declined from 77.9% to 32.9% using CNN model.

Interpretation

The CNN model can predict the SLN status of any detectable lesion size and condition of NSLN in patients with BC. Overall, the CNN model, employing ready DCE-MRI images could serve as a potential technique to assist surgeons in the personalized axillary treatment of in patients with BC non-invasively.

Funding

National Key Research and Development projects intergovernmental cooperation in science and technology of China, National Natural Science Foundation of China, Natural Science Foundation of Zhejiang Province, and Zhejiang Medical and Health Science Project.

Breast Cancer Histopathological Images Segmentation Using Deep Learning

Hospitals generate a significant amount of medical data every day, which constitute a very rich database for research. Today, this database is still not exploitable because to make its valorization possible, the images require an annotation which remains a costly and difficult task. Thus, the use of an unsupervised segmentation method could facilitate the process. In this article, we propose two approaches for the semantic segmentation of breast cancer histopathology images. On the one hand, an autoencoder architecture for unsupervised segmentation is proposed, and on the other hand, an improvement U-Net architecture for supervised segmentation is proposed. We evaluate these models on a public dataset of histological images of breast cancer. In addition, the performance of our segmentation methods is measured using several evaluation metrics such as accuracy, recall, precision and F1 score. The results are competitive with those of other modern methods.

Deep learning applications to breast cancer detection by magnetic resonance imaging: a literature review

Deep learning analysis of radiological images has the potential to improve diagnostic accuracy of breast cancer, ultimately leading to better patient outcomes. This paper systematically reviewed the current literature on deep learning detection of breast cancer based on magnetic resonance imaging (MRI). The literature search was performed from 2015 to Dec 31, 2022, using Pubmed. Other database included Semantic Scholar, ACM Digital Library, Google search, Google Scholar, and pre-print depositories (such as Research Square). Articles that were not deep learning (such as texture analysis) were excluded. PRISMA guidelines for reporting were used. We analyzed different deep learning algorithms, methods of analysis, experimental design, MRI image types, types of ground truths, sample sizes, numbers of benign and malignant lesions, and performance in the literature. We discussed lessons learned, challenges to broad deployment in clinical practice and suggested future research directions.

Attention-based Deep Learning for the Preoperative Differentiation of Axillary Lymph Node Metastasis in Breast Cancer on DCE-MRI

BACKGROUND

Previous studies have explored the potential on radiomics features of primary breast cancer tumor to identify axillary lymph node (ALN) metastasis. However, the value of deep learning (DL) to identify ALN metastasis remains unclear.

PURPOSE

To investigate the potential of the proposed attention-based DL model for the preoperative differentiation of ALN metastasis in breast cancer on dynamic contrast-enhanced MRI (DCE-MRI).

STUDY TYPE

Retrospective.

POPULATION

A total of 941 breast cancer patients who underwent DCE-MRI before surgery were included in the training (742 patients), internal test (83 patients), and external test (116 patients) cohorts.

FIELD STRENGTH/SEQUENCE

A 3.0 T MR scanner, DCE-MRI sequence.

ASSESSMENT

A DL model containing a 3D deep residual network (ResNet) architecture and a convolutional block attention module, named RCNet, was proposed for ALN metastasis identification. Three RCNet models were established based on the tumor, ALN, and combined tumor-ALN regions on the images. The performance of these models was compared with ResNet models, radiomics models, the Memorial Sloan-Kettering Cancer Center (MSKCC) model, and three radiologists (W.L., H.S., and F. L.).

STATISTICAL TESTS

Dice similarity coefficient for breast tumor and ALN segmentation. Accuracy, sensitivity, specificity, intercorrelation and intracorrelation coefficients, area under the curve (AUC), and Delong test for ALN classification.

RESULTS

The optimal RCNet model, that is, RCNet-tumor+ALN , achieved an AUC of 0.907, an accuracy of 0.831, a sensitivity of 0.824, and a specificity of 0.837 in the internal test cohort, as well as an AUC of 0.852, an accuracy of 0.828, a sensitivity of 0.792, and a specificity of 0.853 in the external test cohort. Additionally, with the assistance of RCNet-tumor+ALN , the radiologists' performance was improved (external test cohort, P < 0.05).

DATA CONCLUSION

DCE-MRI-based RCNet model could provide a noninvasive auxiliary tool to identify ALN metastasis preoperatively in breast cancer, which may assist radiologists in conducting more accurate evaluation of ALN status.

EVIDENCE LEVEL

3 TECHNICAL EFFICACY: Stage 2.

Emerging uses of artificial intelligence in breast and axillary ultrasound

Breast ultrasound is a valuable adjunctive tool to mammography in detecting breast cancer, especially in women with dense breasts. Ultrasound also plays an important role in staging breast cancer by assessing axillary lymph nodes. However, its utility is limited by operator dependence, high recall rate, low positive predictive value and low specificity. These limitations present an opportunity for artificial intelligence (AI) to improve diagnostic performance and pioneer novel uses of ultrasound. Research in developing AI for radiology has flourished over the past few years. A subset of AI, deep learning, uses interconnected computational nodes to form a neural network, which extracts complex visual features from image data to train itself into a predictive model. This review summarizes several key studies evaluating AI programs' performance in predicting breast cancer and demonstrates that AI can assist radiologists and address limitations of ultrasound by acting as a decision support tool. This review also touches on how AI programs allow for novel predictive uses of ultrasound, particularly predicting molecular subtypes of breast cancer and response to neoadjuvant chemotherapy, which have the potential to change how breast cancer is managed by providing non-invasive prognostic and treatment data from ultrasound images. Lastly, this review explores how AI programs demonstrate improved diagnostic accuracy in predicting axillary lymph node metastasis. The limitations and future challenges in developing and implementing AI for breast and axillary ultrasound will also be discussed.

The Role of AI in Breast Cancer Lymph Node Classification: A Comprehensive Review

Breast cancer is a significant health issue affecting women worldwide, and accurately detecting lymph node metastasis is critical in determining treatment and prognosis. While traditional diagnostic methods have limitations and complications, artificial intelligence (AI) techniques such as machine learning (ML) and deep learning (DL) offer promising solutions for improving and supplementing diagnostic procedures. Current research has explored state-of-the-art DL models for breast cancer lymph node classification from radiological images, achieving high performances (AUC: 0.71-0.99). AI models trained on clinicopathological features also show promise in predicting metastasis status (AUC: 0.74-0.77), whereas multimodal (radiomics + clinicopathological features) models combine the best from both approaches and also achieve good results (AUC: 0.82-0.94). Once properly validated, such models could greatly improve cancer care, especially in areas with limited medical resources. This comprehensive review aims to compile knowledge about state-of-the-art AI models used for breast cancer lymph node metastasis detection, discusses proper validation techniques and potential pitfalls and limitations, and presents future directions and best practices to achieve high usability in real-world clinical settings.

Clinical applications of deep learning in breast MRI

Deep learning (DL) is one of the most powerful data-driven machine-learning techniques in artificial intelligence (AI). It can automatically learn from raw data without manual feature selection. DL models have led to remarkable advances in data extraction and analysis for medical imaging. Magnetic resonance imaging (MRI) has proven useful in delineating the characteristics and extent of breast lesions and tumors. This review summarizes the current state-of-the-art applications of DL models in breast MRI. Many recent DL models were examined in this field, along with several advanced learning approaches and methods for data normalization and breast and lesion segmentation. For clinical applications, DL-based breast MRI models were proven useful in five aspects: diagnosis of breast cancer, classification of molecular types, classification of histopathological types, prediction of neoadjuvant chemotherapy response, and prediction of lymph node metastasis. For subsequent studies, further improvement in data acquisition and preprocessing is necessary, additional DL techniques in breast MRI should be investigated, and wider clinical applications need to be explored.

Deep learning prediction of pathological complete response, residual cancer burden, and progression-free survival in breast cancer patients

The goal of this study was to employ novel deep-learning convolutional-neural-network (CNN) to predict pathological complete response (PCR), residual cancer burden (RCB), and progression-free survival (PFS) in breast cancer patients treated with neoadjuvant chemotherapy using longitudinal multiparametric MRI, demographics, and molecular subtypes as inputs. In the I-SPY-1 TRIAL, 155 patients with stage 2 or 3 breast cancer with breast tumors underwent neoadjuvant chemotherapy met the inclusion/exclusion criteria. The inputs were dynamic-contrast-enhanced (DCE) MRI, and T2- weighted MRI as three-dimensional whole-images without the tumor segmentation, as well as molecular subtypes and demographics. The outcomes were PCR, RCB, and PFS. Three ("Integrated", "Stack" and "Concatenation") CNN were evaluated using receiver-operating characteristics and mean absolute errors. The Integrated approach outperformed the "Stack" or "Concatenation" CNN. Inclusion of both MRI and non-MRI data outperformed either alone. The combined pre- and post-neoadjuvant chemotherapy data outperformed either alone. Using the best model and data combination, PCR prediction yielded an accuracy of 0.81±0.03 and AUC of 0.83±0.03; RCB prediction yielded an accuracy of 0.80±0.02 and Cohen's κ of 0.73±0.03; PFS prediction yielded a mean absolute error of 24.6±0.7 months (survival ranged from 6.6 to 127.5 months). Deep learning using longitudinal multiparametric MRI, demographics, and molecular subtypes accurately predicts PCR, RCB, and PFS in breast cancer patients. This approach may prove useful for treatment selection, planning, execution, and mid-treatment adjustment.

Machine learning with textural analysis of longitudinal multiparametric MRI and molecular subtypes accurately predicts pathologic complete response in patients with invasive breast cancer

PURPOSE

To predict pathological complete response (pCR) after neoadjuvant chemotherapy using extreme gradient boosting (XGBoost) with MRI and non-imaging data at multiple treatment timepoints.

MATERIAL AND METHODS

This retrospective study included breast cancer patients (n = 117) who underwent neoadjuvant chemotherapy. Data types used included tumor ADC values, diffusion-weighted and dynamic-contrast-enhanced MRI at three treatment timepoints, and patient demographics and tumor data. GLCM textural analysis was performed on MRI data. An extreme gradient boosting machine learning algorithm was used to predict pCR. Prediction performance was evaluated using the area under the curve (AUC) of the receiver operating curve along with precision and recall.

RESULTS

Prediction using texture features of DWI and DCE images at multiple treatment time points (AUC = 0.871; 95% CI: (0.768, 0.974; p<0.001) and (AUC = 0.903 95% CI: 0.854, 0.952; p<0.001) respectively), outperformed that using mean tumor ADC (AUC = 0.850 (95% CI: 0.764, 0.936; p<0.001)). The AUC using all MRI data was 0.933 (95% CI: 0.836, 1.03; p<0.001). The AUC using non-MRI data was 0.919 (95% CI: 0.848, 0.99; p<0.001). The highest AUC of 0.951 (95% CI: 0.909, 0.993; p<0.001) was achieved with all MRI and all non-MRI data at all time points as inputs.

CONCLUSION

Using XGBoost on extracted GLCM features and non-imaging data accurately predicts pCR. This early prediction of response can minimize exposure to toxic chemotherapy, allowing regimen modification mid-treatment and ultimately achieving better outcomes.

Predicting of axillary lymph node metastasis in invasive breast cancer using multiparametric MRI dataset based on CNN model

Purpose

To develop a multiparametric MRI model for predicting axillary lymph node metastasis in invasive breast cancer.

Methods

Clinical data and T2WI, DWI, and DCE-MRI images of 252 patients with invasive breast cancer were retrospectively analyzed and divided into the axillary lymph node metastasis (ALNM) group and non-ALNM group using biopsy results as a reference standard. The regions of interest (ROI) in T2WI, DWI, and DCE-MRI images were segmented using MATLAB software, and the ROI was unified into 224 × 224 sizes, followed by image normalization as input to T2WI, DWI, and DCE-MRI models, all of which were based on ResNet 50 networks. The idea of a weighted voting method in ensemble learning was employed, and then T2WI, DWI, and DCE-MRI models were used as the base models to construct a multiparametric MRI model. The entire dataset was randomly divided into training sets and testing sets (the training set 202 cases, including 78 ALNM, 124 non-ALNM; the testing set 50 cases, including 20 ALNM, 30 non-ALNM). Accuracy, sensitivity, specificity, positive predictive value, and negative predictive value of models were calculated. The receiver operating characteristic (ROC) curve and area under the curve (AUC) were used to evaluate the diagnostic performance of each model for axillary lymph node metastasis, and the DeLong test was performed, P< 0.05 statistically significant.

Results

For the assessment of axillary lymph node status in invasive breast cancer on the test set, multiparametric MRI models yielded an AUC of 0.913 (95% CI, 0.799-0.974); T2WI-based model yielded an AUC of 0.908 (95% CI, 0.792-0.971); DWI-based model achieved an AUC of 0.702 (95% CI, 0.556-0.823); and the AUC of the DCE-MRI-based model was 0.572 (95% CI, 0.424-0.711). The improvement in the diagnostic performance of the multiparametric MRI model compared with the DWI and DCE-MRI-based models were significant (P< 0.01 for both). However, the increase was not meaningful compared with the T2WI-based model (P = 0.917).

Conclusion

Multiparametric MRI image analysis based on an ensemble CNN model with deep learning is of practical application and extension for preoperative prediction of axillary lymph node metastasis in invasive breast cancer.

Deep Learning Prediction of Pathologic Complete Response in Breast Cancer Using MRI and Other Clinical Data: A Systematic Review

Breast cancer patients who have pathological complete response (pCR) to neoadjuvant chemotherapy (NAC) are more likely to have better clinical outcomes. The ability to predict which patient will respond to NAC early in the treatment course is important because it could help to minimize unnecessary toxic NAC and to modify regimens mid-treatment to achieve better efficacy. Machine learning (ML) is increasingly being used in radiology and medicine because it can identify relationships amongst complex data elements to inform outcomes without the need to specify such relationships a priori. One of the most popular deep learning methods that applies to medical images is the Convolutional Neural Networks (CNN). In contrast to supervised ML, deep learning CNN can operate on the whole images without requiring radiologists to manually contour the tumor on images. Although there have been many review papers on supervised ML prediction of pCR, review papers on deep learning prediction of pCR are sparse. Deep learning CNN could also incorporate multiple image types, clinical data such as demographics and molecular subtypes, as well as data from multiple treatment time points to predict pCR. The goal of this study is to perform a systematic review of deep learning methods that use whole-breast MRI images without annotation or tumor segmentation to predict pCR in breast cancer.

Deep learning radiomics under multimodality explore association between muscle/fat and metastasis and survival in breast cancer patients

Sarcopenia is correlated with poor clinical outcomes in breast cancer (BC) patients. However, there is no precise quantitative study on the correlation between body composition changes and BC metastasis and survival. The present study proposed a deep learning radiomics (DLR) approach to investigate the effects of muscle and fat on distant metastasis and death outcomes in BC patients. Image feature extraction was performed on 4th thoracic vertebra (T4) and 11th thoracic vertebra (T11) on computed tomography (CT) image levels by DLR, and image features were combined with clinical information to predict distant metastasis in BC patients. Clinical information combined with DLR significantly predicted distant metastasis in BC patients. In the test cohort, the area under the curve of model performance on clinical information combined with DLR was 0.960 (95% CI: 0.942-0.979, P < 0.001). The patients with distant metastases had a lower pectoral muscle index in T4 (PMI/T4) than in patients without metastases. PMI/T4 and visceral fat tissue area in T11 (VFA/T11) were independent prognostic factors for the overall survival in BC patients. The pectoralis muscle area in T4 (PMA/T4) and PMI/T4 is an independent prognostic factor for distant metastasis-free survival in BC patients. The current study further confirmed that muscle/fat of T4 and T11 levels have a significant effect on the distant metastasis of BC. Appending the network features of T4 and T11 to the model significantly enhances the prediction performance of distant metastasis of BC, providing a valuable biomarker for the early treatment of BC patients.

A nomogram based on radiomics signature and deep-learning signature for preoperative prediction of axillary lymph node metastasis in breast cancer

PURPOSE

To develop a nomogram based on radiomics signature and deep-learning signature for predicting the axillary lymph node (ALN) metastasis in breast cancer.

METHODS

A total of 151 patients were assigned to a training cohort (n = 106) and a test cohort (n = 45) in this study. Radiomics features were extracted from DCE-MRI images, and deep-learning features were extracted by VGG-16 algorithm. Seven machine learning models were built using the selected features to evaluate the predictive value of radiomics or deep-learning features for the ALN metastasis in breast cancer. A nomogram was then constructed based on the multivariate logistic regression model incorporating radiomics signature, deep-learning signature, and clinical risk factors.

RESULTS

Five radiomics features and two deep-learning features were selected for machine learning model construction. In the test cohort, the AUC was above 0.80 for most of the radiomics models except DecisionTree and ExtraTrees. In addition, the K-nearest neighbor (KNN), XGBoost, and LightGBM models using deep-learning features had AUCs above 0.80 in the test cohort. The nomogram, which incorporated the radiomics signature, deep-learning signature, and MRI-reported LN status, showed good calibration and performance with the AUC of 0.90 (0.85-0.96) in the training cohort and 0.90 (0.80-0.99) in the test cohort. The DCA showed that the nomogram could offer more net benefit than radiomics signature or deep-learning signature.

CONCLUSIONS

Both radiomics and deep-learning features are diagnostic for predicting ALN metastasis in breast cancer. The nomogram incorporating radiomics and deep-learning signatures can achieve better prediction performance than every signature used alone.

Artificial Intelligence in Breast Ultrasound: The Emerging Future of Modern Medicine

In today's world, progressively enormous popularity prevails around artificial intelligence (AI). AI is gaining popularity in the identification of various images. Therefore, it has been widely used in the ultrasound of the breast. Furthermore, AI can perform a quantitative evaluation, which further helps maintain the diagnosis's accuracy. Moreover, breast cancer is the most common cancer in women, posing a severe threat to women's health. Hence, its early detection is usually associated with a patient's prognosis. As a result, using AI in breast cancer screening and detection is highly crucial. The concept of AI in the perspective of breast ultrasound has been highlighted in this brief review article. It tends to focus on early AI, i.e., traditional machine learning and deep learning algorithms. Also, the use of AI in ultrasound and the use of it in mammography, magnetic resonance imaging, nuclear medicine imaging, and classification of breast lesions is broadly explained, along with the challenges faced in bringing AI into daily practice.

Artificial intelligence in multi-parametric magnetic resonance imaging: A review

Multi-parametric magnetic resonance imaging (mpMRI) is an indispensable tool in the clinical workflow for the diagnosis and treatment planning of various diseases. Machine learning-based artificial intelligence (AI) methods, especially those adopting the deep learning technique, have been extensively employed to perform mpMRI image classification, segmentation, registration, detection, reconstruction, and super-resolution. The current availability of increasing computational power and fast-improving AI algorithms have empowered numerous computer-based systems for applying mpMRI to disease diagnosis, imaging-guided radiotherapy, patient risk and overall survival time prediction, and the development of advanced quantitative imaging technology for magnetic resonance fingerprinting. However, the wide application of these developed systems in the clinic is still limited by a number of factors, including robustness, reliability, and interpretability. This survey aims to provide an overview for new researchers in the field as well as radiologists with the hope that they can understand the general concepts, main application scenarios, and remaining challenges of AI in mpMRI. This article is protected by copyright. All rights reserved.