Quantitative ultrasound image analysis of axillary lymph node status in breast cancer patients

Artificial intelligence performance in ultrasound-based lymph node diagnosis: a systematic review and meta-analysis

BACKGROUND AND OBJECTIVES

Accurate classification of lymphadenopathy is essential for determining the pathological nature of lymph nodes (LNs), which plays a crucial role in treatment selection. The biopsy method is invasive and carries the risk of sampling failure, while the utilization of non-invasive approaches such as ultrasound can minimize the probability of iatrogenic injury and infection. With the advancement of artificial intelligence (AI) and machine learning, the diagnostic efficiency of LNs is further enhanced. This study evaluates the performance of ultrasound-based AI applications in the classification of benign and malignant LNs.

METHODS

The literature research was conducted using the PubMed, EMBASE, and Cochrane Library databases as of June 2024. The quality of the included studies was evaluated using the QUADAS-2 tool. The pooled sensitivity, specificity, and diagnostic odds ratio (DOR) were calculated to assess the diagnostic efficacy of ultrasound-based AI in classifying benign and malignant LNs. Subgroup analyses were also conducted to identify potential sources of heterogeneity.

RESULTS

A total of 1,355 studies were identified and reviewed. Among these studies, 19 studies met the inclusion criteria, and 2,354 cases were included in the analysis. The pooled sensitivity, specificity, and DOR of ultrasound-based machine learning in classifying benign and malignant LNs were 0.836 (95% CI [0.805, 0.863]), 0.850 (95% CI [0.805, 0.886]), and 33.331 (95% CI [22.873, 48.57]), respectively, indicating no publication bias (p = 0.12). Subgroup analyses may suggest that the location of lymph nodes, validation methods, and type of primary tumor are the sources of heterogeneity.

CONCLUSION

AI can accurately differentiate benign from malignant LNs. Given the widespread use of ultrasonography in diagnosing malignant LNs in cancer patients, there is significant potential for integrating AI-based decision support systems into clinical practice to enhance the diagnostic accuracy.

Artificial intelligence assisted ultrasound for the non-invasive prediction of axillary lymph node metastasis in breast cancer

PURPOSE

A practical noninvasive method is needed to identify lymph node (LN) status in breast cancer patients diagnosed with a suspicious axillary lymph node (ALN) at ultrasound but a negative clinical physical examination. To predict ALN metastasis effectively and noninvasively, we developed an artificial intelligence-assisted ultrasound system and validated it in a retrospective study.

METHODS

A total of 266 patients treated with sentinel LN biopsy and ALN dissection at Peking Union Medical College & Hospital(PUMCH) between the year 2017 and 2019 were assigned to training, validation and test sets (8:1:1). A deep learning model architecture named DeepLabV3 + was used together with ResNet-101 as the backbone network to create an ultrasound image segmentation diagnosis model. Subsequently, the segmented images are classified by a Convolutional Neural Network to predict ALN metastasis.

RESULTS

The area under the receiver operating characteristic curve of the model for identifying metastasis was 0.799 (95% CI: 0.514-1.000), with good end-to-end classification accuracy of 0.889 (95% CI: 0.741-1.000). Moreover, the specificity and positive predictive value of this model was 100%, providing high accuracy for clinical diagnosis.

CONCLUSION

This model can be a direct and reliable tool for the evaluation of individual LN status. Our study focuses on predicting ALN metastasis by radiomic analysis, which can be used to guide further treatment planning in breast cancer.

Axilla View of Mammography in Preoperative Axillary Lymph Node Evaluation of Breast Cancer Patients: A Pilot Study

PURPOSE

This study aimed to explore a novel position of mammography named axilla view in axillary lymph node (ALN) evaluation in breast cancer.

PATIENTS AND METHODS

Patients were prospectively enrolled and scheduled for mammography before surgery. Investigated imaging patterns included mediolateral oblique (2D-MLO) and axilla view (2D-axilla) of mammography, and axilla view of digital breast tomosynthesis (3D-axilla). The correlation of ALN numbers between imaging and pathology was analyzed. Diagnostic performance was analyzed via AUC.

RESULTS

75 patients were included. A larger and clearer axillary region was displayed in axilla view. The total number of ALNs detected under 2D/3D-axilla view was significantly higher than that under 2D-MLO view (4.6 vs. 2.5, P < .001; 5.6 vs. 4.6, P = .034). Correlations between number of positive ALNs detected under 2D/3D-axilla view and pathologically confirmed metastatic ALNs were stronger than 2D-MLO view (Pearson correlation coefficients: 0.7084,0.7044 and 0.4744). The proportion of cases with ≥5 positive ALNs detected under 3D-axilla view was significantly higher than that under 2D-MLO (38.2% vs. 14.7%, P = .028). The overweight and obese group showed a higher AUC value than the underweight and lean group in ALN evaluation, although not significantly (2D-MLO: 0.7643 vs. 0.6458, P = .2656; 2D-axilla: 0.8083 vs. 0.6586, P = .1522; 3D-axilla: 0.8045 vs. 0.6615, P = .1874). This difference was more pronounced in axilla view.

CONCLUSION

Axilla view exhibited advantages over conventional MLO view in the extent of axilla displayed by mammography in breast cancer. Further studies with larger sample sizes are needed.

A machine learning model based on ultrasound image features to assess the risk of sentinel lymph node metastasis in breast cancer patients: Applications of scikit-learn and SHAP

Background

This study aimed to determine an optimal machine learning (ML) model for evaluating the preoperative diagnostic value of ultrasound signs of breast cancer lesions for sentinel lymph node (SLN) status.

Method

This study retrospectively analyzed the ultrasound images and postoperative pathological findings of lesions in 952 breast cancer patients. Firstly, the univariate analysis of the relationship between the ultrasonographic features of breast cancer morphological features and SLN metastasis. Then, based on the ultrasound signs of breast cancer lesions, we screened ten ML models: support vector machine (SVM), extreme gradient boosting (XGBoost), random forest (RF), linear discriminant analysis (LDA), logistic regression (LR), naive bayesian model (NB), k-nearest neighbors (KNN), multilayer perceptron (MLP), long short-term memory (LSTM), and convolutional neural network (CNN). The diagnostic performance of the model was evaluated using the area under the receiver operating characteristic (ROC) curve (AUC), Kappa value, accuracy, F1-score, sensitivity, and specificity. Then we constructed a clinical prediction model which was based on the ML algorithm with the best diagnostic performance. Finally, we used SHapley Additive exPlanation (SHAP) to visualize and analyze the diagnostic process of the ML model.

Results

Of 952 patients with breast cancer, 394 (41.4%) had SLN metastasis, and 558 (58.6%) had no metastasis. Univariate analysis found that the shape, orientation, margin, posterior features, calculations, architectural distortion, duct changes and suspicious lymph node of breast cancer lesions in ultrasound signs were associated with SLN metastasis. Among the 10 ML algorithms, XGBoost had the best comprehensive diagnostic performance for SLN metastasis, with Average-AUC of 0.952, Average-Kappa of 0.763, and Average-Accuracy of 0.891. The AUC of the XGBoost model in the validation cohort was 0.916, the accuracy was 0.846, the sensitivity was 0.870, the specificity was 0.862, and the F1-score was 0.826. The diagnostic performance of the XGBoost model was significantly higher than that of experienced radiologists in some cases (P<0.001). Using SHAP to visualize the interpretation of the ML model screen, it was found that the ultrasonic detection of suspicious lymph nodes, microcalcifications in the primary tumor, burrs on the edge of the primary tumor, and distortion of the tissue structure around the lesion contributed greatly to the diagnostic performance of the XGBoost model.

Conclusions

The XGBoost model based on the ultrasound signs of the primary breast tumor and its surrounding tissues and lymph nodes has a high diagnostic performance for predicting SLN metastasis. Visual explanation using SHAP made it an effective tool for guiding clinical courses preoperatively.

Assessment of Axillary Lymph Nodes for Metastasis on Ultrasound Using Artificial Intelligence

The purpose of this study was to evaluate an artificial intelligence (AI) system for the classification of axillary lymph nodes on ultrasound compared to radiologists. Ultrasound images of 317 axillary lymph nodes from patients referred for ultrasound guided fine needle aspiration or core needle biopsy and corresponding pathology findings were collected. Lymph nodes were classified into benign and malignant groups with histopathological result serving as the reference. Google Cloud AutoML Vision (Mountain View, CA) was used for AI image classification. Three experienced radiologists also classified the images and gave a level of suspicion score (1-5). To test the accuracy of AI, an external testing dataset of 64 images from 64 independent patients was evaluated by three AI models and the three readers. The diagnostic performance of AI and the humans were then quantified using receiver operating characteristics curves. In the complete set of 317 images, AutoML achieved a sensitivity of 77.1%, positive predictive value (PPV) of 77.1%, and an area under the precision recall curve of 0.78, while the three radiologists showed a sensitivity of 87.8% ± 8.5%, specificity of 50.3% ± 16.4%, PPV of 61.1% ± 5.4%, negative predictive value (NPV) of 84.1% ± 6.6%, and accuracy of 67.7% ± 5.7%. In the three external independent test sets, AI and human readers achieved sensitivity of 74.0% ± 0.14% versus 89.9% ± 0.06% (p = .25), specificity of 64.4% ± 0.11% versus 50.1 ± 0.20% (p = .22), PPV of 68.3% ± 0.04% versus 65.4 ± 0.07% (p = .50), NPV of 72.6% ± 0.11% versus 82.1% ± 0.08% (p = .33), and accuracy of 69.5% ± 0.06% versus 70.1% ± 0.07% (p = .90), respectively. These preliminary results indicate AI has comparable performance to trained radiologists and could be used to predict the presence of metastasis in ultrasound images of axillary lymph nodes.

Quantitative Ultrasound Image Analysis of Axillary Lymph Nodes to Diagnose Metastatic Involvement in Breast Cancer

This study aimed to assess the potential of state-of-the-art ultrasound analysis techniques to non-invasively diagnose axillary lymph nodes involvement in breast cancer. After exclusion criteria, 105 patients were selected from two different hospitals. The 118 lymph node ultrasound images taken from these patients were divided into 53 cases and 65 controls, which made up the study series. The clinical outcome of each node was verified by ultrasound-guided fine needle aspiration, core needle biopsy or surgical biopsy. The achieved accuracy of the proposed method was 86.4%, with 84.9% sensitivity and 87.7% specificity. When tested on breast cancer patients only, the proposed method improved the accuracy of the sonographic assessment of axillary lymph nodes performed by expert radiologists by 9% (87.0% vs 77.9%). In conclusion, the results demonstrate the potential of ultrasound image analysis to detect the microstructural and compositional changes that occur in lymph nodes because of metastatic involvement.

Machine learning techniques for breast cancer computer aided diagnosis using different image modalities: A systematic review

BACKGROUND AND OBJECTIVE

The high incidence of breast cancer in women has increased significantly in the recent years. Physician experience of diagnosing and detecting breast cancer can be assisted by using some computerized features extraction and classification algorithms. This paper presents the conduction and results of a systematic review (SR) that aims to investigate the state of the art regarding the computer aided diagnosis/detection (CAD) systems for breast cancer.

METHODS

The SR was conducted using a comprehensive selection of scientific databases as reference sources, allowing access to diverse publications in the field. The scientific databases used are Springer Link (SL), Science Direct (SD), IEEE Xplore Digital Library, and PubMed. Inclusion and exclusion criteria were defined and applied to each retrieved work to select those of interest. From 320 studies retrieved, 154 studies were included. However, the scope of this research is limited to scientific and academic works and excludes commercial interests.

RESULTS

This survey provides a general analysis of the current status of CAD systems according to the used image modalities and the machine learning based classifiers. Potential research studies have been discussed to create a more objective and efficient CAD systems.

Application of Computer-Aided Diagnosis to the Sonographic Evaluation of Cervical Lymph Nodes

We initiated an observer study to evaluate a computerized system developed in our previous study for automatic extraction of 10 features and estimation of the malignancy probability of cervical nodes in sonograms. In the present study, five expert radiologists and five resident radiologists interpreted the sonograms of 178 nodes. The malignancy rating and patient management recommendation (biopsy or follow-up) were made without and then with the computer aid. Under these two reading conditions, the performances of radiologists and agreement among a group of radiologists were evaluated by using the receiver operating characteristic (ROC) analysis and the κ statistic, respectively. With the computer aid, the performances of radiologists improved significantly, as indicated by the increase in the area under the ROC curve (Az) from 0.843 to 0.896 (p = 0.031) and from 0.705 to 0.822 (p < 0.001), for the expert and resident groups, respectively. Agreement among all 10 radiologists improved from slight to moderate as indicated by an increase in the κ value from 0.195 to 0.421 (p < 0.001). The average performance of residents with aid (Az = 0.822) was close to that of experts without aid (Az = 0.843). Results indicate that computer-aided diagnosis is useful to improve radiologist performance (especially that of inexperienced radiologists) in the ultrasonographic evaluation of cervical nodes and to reduce variability among radiologists.

Possible Synchronous Lung Metastasis of Breast Mass Detected Using Breast Ultrasonography: A Report of Two Cases

Ultrasonography (US), which is used for the diagnosis of breast cancer and the evaluation of its local metastasis, has proven its worth as a diagnostic method. In breast ultrasonographic examination peripherally localized metastatic lesions at the posterior of the screened breast tissue can also be detected. In this case report, two female patients whose breast ultrasonography showed lumps. Their peripheral lung metastases were screened ultrasonographically, and the patients were diagnosed in a timely manner. Ultrasonographic examination at a patient's first appointment - and especially during routine check-ups after the primary treatment - can allow an early diagnosis of peripherally localized lung metastasis at the posterior of the screened breast tissue and make a vital contribution to the patient's prognosis.