Attention-based Deep Learning for the Preoperative Differentiation of Axillary Lymph Node Metastasis in Breast Cancer on DCE-MRI

A novel fully automatic segmentation and counting system for metastatic lymph nodes on multimodal magnetic resonance imaging: Evaluation and prognostic implications in nasopharyngeal carcinoma

BACKGROUND

The number of metastatic lymph nodes (MLNs) is crucial for the survival of nasopharyngeal carcinoma (NPC), but manual counting is laborious. This study aims to explore the feasibility and prognostic value of automatic MLNs segmentation and counting.

METHODS

We retrospectively enrolled 980 newly diagnosed patients in the primary cohort and 224 patients from two external cohorts. We utilized the nnUnet model for automatic MLNs segmentation on multimodal magnetic resonance imaging. MLNs counting methods, including manual delineation-assisted counting (MDAC) and fully automatic lymph node counting system (AMLNC), were compared with manual evaluation (Gold standard).

RESULTS

In the internal validation group, the MLNs segmentation results showed acceptable agreement with manual delineation, with a mean Dice coefficient of 0.771. The consistency among three counting methods was as follows 0.778 (Gold vs. AMLNC), 0.638 (Gold vs. MDAC), and 0.739 (AMLNC vs. MDAC). MLNs numbers were categorized into three-category variable (1-4, 5-9, > 9) and two-category variable (<4, ≥ 4) based on the gold standard and AMLNC. These categorical variables demonstrated acceptable discriminating abilities for 5-year overall survival (OS), progression-free, and distant metastasis-free survival. Compared with base prediction model, the model incorporating two-category AMLNC-counting numbers showed improved C-indexes for 5-year OS prediction (0.658 vs. 0.675, P = 0.045). All results have been successfully validated in the external cohort.

CONCLUSIONS

The AMLNC system offers a time- and labor-saving approach for fully automatic MLNs segmentation and counting in NPC. MLNs counting using AMLNC demonstrated non-inferior performance in survival discrimination compared to manual detection.

Multitask Deep Learning-Based Whole-Process System for Automatic Diagnosis of Breast Lesions and Axillary Lymph Node Metastasis Discrimination from Dynamic Contrast-Enhanced-MRI: A Multicenter Study

BACKGROUND

Accurate diagnosis of breast lesions and discrimination of axillary lymph node (ALN) metastases largely depend on radiologist experience.

PURPOSE

To develop a deep learning-based whole-process system (DLWPS) for segmentation and diagnosis of breast lesions and discrimination of ALN metastasis.

STUDY TYPE

Retrospective.

POPULATION

1760 breast patients, who were divided into training and validation sets (1110 patients), internal (476 patients), and external (174 patients) test sets.

FIELD STRENGTH/SEQUENCE

3.0T/dynamic contrast-enhanced (DCE)-MRI sequence.

ASSESSMENT

DLWPS was developed using segmentation and classification models. The DLWPS-based segmentation model was developed by the U-Net framework, which combined the attention module and the edge feature extraction module. The average score of the output scores of three networks was used as the result of the DLWPS-based classification model. Moreover, the radiologists' diagnosis without and with the DLWPS-assistance was explored. To reveal the underlying biological basis of DLWPS, genetic analysis was performed based on RNA-sequencing data.

STATISTICAL TESTS

Dice similarity coefficient (DI), area under receiver operating characteristic curve (AUC), accuracy, sensitivity, specificity, and kappa value.

RESULTS

The segmentation model reached a DI of 0.828 and 0.813 in the internal and external test sets, respectively. Within the breast lesions diagnosis, the DLWPS achieved AUCs of 0.973 in internal test set and 0.936 in external test set. For ALN metastasis discrimination, the DLWPS achieved AUCs of 0.927 in internal test set and 0.917 in external test set. The agreement of radiologists improved with the DLWPS-assistance from 0.547 to 0.794, and from 0.848 to 0.892 in breast lesions diagnosis and ALN metastasis discrimination, respectively. Additionally, 10 breast cancers with ALN metastasis were associated with pathways of aerobic electron transport chain and cytoplasmic translation.

DATA CONCLUSION

The performance of DLWPS indicates that it can promote radiologists in the judgment of breast lesions and ALN metastasis and nonmetastasis.

LEVEL OF EVIDENCE

4 TECHNICAL EFFICACY STAGE: 3.

MRI-Based Kinetic Heterogeneity Evaluation in the Accurate Access of Axillary Lymph Node Status in Breast Cancer Using a Hybrid CNN-RNN Model

BACKGROUND

Accurate evaluation of the axillary lymph node (ALN) status is needed for determining the treatment protocol for breast cancer (BC). The value of magnetic resonance imaging (MRI)-based tumor heterogeneity in assessing ALN metastasis in BC is unclear.

PURPOSE

To assess the value of deep learning (DL)-derived kinetic heterogeneity parameters based on BC dynamic contrast-enhanced (DCE)-MRI to infer the ALN status.

STUDY TYPE

Retrospective.

SUBJECTS

1256/539/153/115 patients in the training cohort, internal validation cohort, and external validation cohorts I and II, respectively.

FIELD STRENGTH/SEQUENCE

1.5 T/3.0 T, non-contrast T1-weighted spin-echo sequence imaging (T1WI), DCE-T1WI, and diffusion-weighted imaging.

ASSESSMENT

Clinical pathological and MRI semantic features were obtained by reviewing histopathology and MRI reports. The segmentation of the tumor lesion on the first phase of T1WI DCE-MRI images was applied to other phases after registration. A DL architecture termed convolutional recurrent neural network (ConvRNN) was developed to generate the KHimage (kinetic heterogeneity of DCE-MRI image) score that indicated the ALN status in patients with BC. The model was trained and optimized on training and internal validation cohorts, tested on two external validation cohorts. We compared ConvRNN model with other 10 models and the subgroup analyses of tumor size, magnetic field strength, and molecular subtype were also evaluated.

STATISTICAL TESTS

Chi-squared, Fisher's exact, Student's t, Mann-Whitney U tests, and receiver operating characteristics (ROC) analysis were performed. P < 0.05 was considered significant.

RESULTS

The ConvRNN model achieved area under the curve (AUC) of 0.802 in the internal validation cohort and 0.785-0.806 in the external validation cohorts. The ConvRNN model could well evaluate the ALN status of the four molecular subtypes (AUC = 0.685-0.868). The patients with larger tumor sizes (>5 cm) were more susceptible to ALN metastasis with KHimage scores of 0.527-0.827.

DATA CONCLUSION

A ConvRNN model outperformed traditional models for determining the ALN status in patients with BC.

LEVEL OF EVIDENCE

3 TECHNICAL EFFICACY: Stage 2.

Artificial intelligence in breast imaging: potentials and challenges

Breast cancer, which is the most common type of malignant tumor among humans, is a leading cause of death in females. Standard treatment strategies, including neoadjuvant chemotherapy, surgery, postoperative chemotherapy, targeted therapy, endocrine therapy, and radiotherapy, are tailored for individual patients. Such personalized therapies have tremendously reduced the threat of breast cancer in females. Furthermore, early imaging screening plays an important role in reducing the treatment cycle and improving breast cancer prognosis. The recent innovative revolution in artificial intelligence (AI) has aided radiologists in the early and accurate diagnosis of breast cancer. In this review, we introduce the necessity of incorporating AI into breast imaging and the applications of AI in mammography, ultrasonography, magnetic resonance imaging, and positron emission tomography/computed tomography based on published articles since 1994. Moreover, the challenges of AI in breast imaging are discussed.

Deep Learning for Fully Automatic Tumor Segmentation on Serially Acquired Dynamic Contrast-Enhanced MRI Images of Triple-Negative Breast Cancer

Accurate tumor segmentation is required for quantitative image analyses, which are increasingly used for evaluation of tumors. We developed a fully automated and high-performance segmentation model of triple-negative breast cancer using a self-configurable deep learning framework and a large set of dynamic contrast-enhanced MRI images acquired serially over the patients' treatment course. Among all models, the top-performing one that was trained with the images across different time points of a treatment course yielded a Dice similarity coefficient of 93% and a sensitivity of 96% on baseline images. The top-performing model also produced accurate tumor size measurements, which is valuable for practical clinical applications.

Development and validation of convolutional neural network-based model to predict the risk of sentinel or non-sentinel lymph node metastasis in patients with breast cancer: a machine learning study

Background

For patients with sentinel lymph node (SLN) metastasis and low risk of residual non-SLN (NSLN) metastasis, axillary lymph node (ALN) dissection could lead to overtreatment. This study aimed to develop and validate an automated preoperative deep learning-based tool to predict the risk of SLN and NSLN metastasis in patients with breast cancer (BC) using dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) images.

Methods

In this machine learning study, we retrospectively enrolled 988 women with BC from three hospitals in Zhejiang, China between June 1, 2013 to December 31, 2021, June 1, 2017 to December 31, 2021, and January 1, 2019 to June 30, 2023, respectively. Patients were divided into the training set (n = 519), internal validation set (n = 129), external test set 1 (n = 296), and external test set 2 (n = 44). A convolutional neural network (CNN) model was proposed to predict the SLN and NSLN metastasis and was compared with clinical and radiomics approaches. The performance of different models to detect ALN metastasis was measured by the area under the curve (AUC), accuracy, sensitivity, and specificity. This study is registered at ChiCTR, ChiCTR2300070740.

Findings

For SLN prediction, the top-performing model (i.e., the CNN algorithm) achieved encouraging predictive performance in the internal validation set (AUC 0.899, 95% CI, 0.887-0.911), external test set 1 (AUC 0.885, 95% CI, 0.867-0.903), and external test set 2 (AUC 0.768, 95% CI, 0.738-0.798). For NSLN prediction, the CNN-based model also exhibited satisfactory performance in the internal validation set (AUC 0.800, 95% CI, 0.783-0.817), external test set 1 (AUC 0.763, 95% CI, 0.732-0.794), and external test set 2 (AUC 0.728, 95% CI, 0.719-0.738). Based on the subgroup analysis, the CNN model performed well in tumour group smaller than 2.0 cm, with the AUC of 0.801 (internal validation set) and 0.823 (external test set 1). Of 469 patients with BC, the false positive rate of SLN prediction declined from 77.9% to 32.9% using CNN model.

Interpretation

The CNN model can predict the SLN status of any detectable lesion size and condition of NSLN in patients with BC. Overall, the CNN model, employing ready DCE-MRI images could serve as a potential technique to assist surgeons in the personalized axillary treatment of in patients with BC non-invasively.

Funding

National Key Research and Development projects intergovernmental cooperation in science and technology of China, National Natural Science Foundation of China, Natural Science Foundation of Zhejiang Province, and Zhejiang Medical and Health Science Project.

Integrating Proteomics and Lipidomics for Evaluating the Risk of Breast Cancer Progression: A Pilot Study

Metastasis is a serious and often life-threatening condition, representing the leading cause of death among women with breast cancer (BC). Although the current clinical classification of BC is well-established, the addition of minimally invasive laboratory tests based on peripheral blood biomarkers that reflect pathological changes in the body is of utmost importance. In the current study, the serum proteome and lipidome profiles for 50 BC patients with (25) and without (25) metastasis were studied. Targeted proteomic analysis for concertation measurements of 125 proteins in the serum was performed via liquid chromatography-multiple reaction monitoring mass spectrometry (LC-MRM MS) using the BAK 125 kit (MRM Proteomics Inc., Victoria, BC, Canada). Untargeted label-free lipidomic analysis was performed using liquid chromatography coupled to tandem mass-spectrometry (LC-MS/MS), in both positive and negative ion modes. Finally, 87 serum proteins and 295 lipids were quantified and showed a moderate correlation with tumor grade, histological and biological subtypes, and the number of lymph node metastases. Two highly accurate classifiers that enabled distinguishing between metastatic and non-metastatic BC were developed based on proteomic (accuracy 90%) and lipidomic (accuracy 80%) features. The best classifier (91% sensitivity, 89% specificity, AUC = 0.92) for BC metastasis diagnostics was based on logistic regression and the serum levels of 11 proteins: alpha-2-macroglobulin, coagulation factor XII, adiponectin, leucine-rich alpha-2-glycoprotein, alpha-2-HS-glycoprotein, Ig mu chain C region, apolipoprotein C-IV, carbonic anhydrase 1, apolipoprotein A-II, apolipoprotein C-II and alpha-1-acid glycoprotein 1.

The Role of AI in Breast Cancer Lymph Node Classification: A Comprehensive Review

Breast cancer is a significant health issue affecting women worldwide, and accurately detecting lymph node metastasis is critical in determining treatment and prognosis. While traditional diagnostic methods have limitations and complications, artificial intelligence (AI) techniques such as machine learning (ML) and deep learning (DL) offer promising solutions for improving and supplementing diagnostic procedures. Current research has explored state-of-the-art DL models for breast cancer lymph node classification from radiological images, achieving high performances (AUC: 0.71-0.99). AI models trained on clinicopathological features also show promise in predicting metastasis status (AUC: 0.74-0.77), whereas multimodal (radiomics + clinicopathological features) models combine the best from both approaches and also achieve good results (AUC: 0.82-0.94). Once properly validated, such models could greatly improve cancer care, especially in areas with limited medical resources. This comprehensive review aims to compile knowledge about state-of-the-art AI models used for breast cancer lymph node metastasis detection, discusses proper validation techniques and potential pitfalls and limitations, and presents future directions and best practices to achieve high usability in real-world clinical settings.

Freehand 1.5T MR-Guided Vacuum-Assisted Breast Biopsy (MR-VABB): Contribution of Radiomics to the Differentiation of Benign and Malignant Lesions

Radiomics and artificial intelligence have been increasingly applied in breast MRI. However, the advantages of using radiomics to evaluate lesions amenable to MR-guided vacuum-assisted breast biopsy (MR-VABB) are unclear. This study includes patients scheduled for MR-VABB, corresponding to subjects with MRI-only visible lesions, i.e., with a negative second-look ultrasound. The first acquisition of the multiphase dynamic contrast-enhanced MRI (DCE-MRI) sequence was selected for image segmentation and radiomics analysis. A total of 80 patients with a mean age of 55.8 years ± 11.8 (SD) were included. The dataset was then split into a training set (50 patients) and a validation set (30 patients). Twenty out of the 30 patients with a positive histology for cancer were in the training set, while the remaining 10 patients with a positive histology were included in the test set. Logistic regression on the training set provided seven features with significant p values (<0.05): (1) ‘AverageIntensity’, (2) ‘Autocorrelation’, (3) ‘Contrast’, (4) ‘Compactness’, (5) ‘StandardDeviation’, (6) ‘MeanAbsoluteDeviation’ and (7) ‘InterquartileRange’. AUC values of 0.86 (95% C.I. 0.73–0.94) for the training set and 0.73 (95% C.I. 0.54–0.87) for the test set were obtained for the radiomics model. Radiological evaluation of the same lesions scheduled for MR-VABB had AUC values of 0.42 (95% C.I. 0.28–0.57) for the training set and 0.4 (0.23–0.59) for the test set. In this study, a radiomics logistic regression model applied to DCE-MRI images increased the diagnostic accuracy of standard radiological evaluation of MRI suspicious findings in women scheduled for MR-VABB. Confirming this performance in large multicentric trials would imply that using radiomics in the assessment of patients scheduled for MR-VABB has the potential to reduce the number of biopsies, in suspicious breast lesions where MR-VABB is required, with clear advantages for patients and healthcare resources.