Diagnostic performance of radiomics in predicting axillary lymph node metastasis in breast cancer: A systematic review and meta-analysis

The Quality and Accuracy of Radiomics Model in Diagnosing Osteoporosis: A Systematic Review and Meta-analysis

RATIONALE AND OBJECTIVES

The purpose of this study is to conduct a meta-analysis to evaluate the diagnostic performance of current radiomics models for diagnosing osteoporosis, as well as to assess the methodology and reporting quality of these radiomics studies.

METHODS

According to PRISMA guidelines, four databases including MEDLINE, Web of Science, Embase and the Cochrane Library were searched systematically to select relevant studies published before July 18, 2024. The articles that used radiomics models for diagnosing osteoporosis were considered eligible. The Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2) tool and radiomics quality score (RQS) were used to assess the quality of included studies. The pooled diagnostic odds ratio (DOR), sensitivity, specificity, area under the summary receiver operator characteristic curve (AUC) were calculated to estimated diagnostic efficiency of pooled model.

RESULTS

A total of 25 studies were included, of which 24 provided usable data that were utilized for the meta-analysis, including 1553 patients with osteoporosis and 2200 patients without osteoporosis. The mean RQS score of included studies was 11.48 ± 4.92, with an adherence rate of 31.89%. The pooled DOR, sensitivity and specificity for model to diagnose osteoporosis were 81.72 (95% CI: 51.08 - 130.73), 0.90 (95% CI: 0.87-0.93) and 0.90 (95% CI: 0.87-0.93), respectively. The AUC was 0.96, indicating a high diagnostic capability. Subgroup analysis revealed that the use of different imaging modalities to construct radiomics models might be one source of heterogeneity. Radiomics models built using CT images and deep learning algorithms demonstrated higher diagnostic accuracy for osteoporosis.

CONCLUSION

Radiomics models for the diagnosis of osteoporosis have high diagnostic efficacy. In the future, radiomics models for diagnosing osteoporosis will be an efficient instrument to assist clinical doctors in screening osteoporosis patients. However, relevant guidelines should be followed strictly to improve the quality of radiomics studies.

Diagnostic performance of DCE-MRI radiomics in predicting axillary lymph node metastasis in breast cancer patients: A meta-analysis

Radiomics offers a novel strategy for the differential diagnosis, prognosis evaluation, and prediction of treatment responses in breast cancer. Studies have explored radiomic signatures from dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) for predicting axillary lymph node metastasis (ALNM) and sentinel lymph node metastasis (SLNM), but the diagnostic accuracy varies widely. To evaluate this performance, we conducted a meta-analysis performing a comprehensive literature search across databases including PubMed, EMBASE, SCOPUS, Web of Science (WOS), Cochrane Library, China National Knowledge Infrastructure (CNKI), Wanfang Data, and the Chinese BioMedical Literature Database (CBM) until March 31, 2024. The pooled sensitivity, specificity, positive likelihood ratio (PLR), negative likelihood ratio (NLR), diagnostic odds ratio (DOR), and the area under the receiver operating characteristic curve (AUC) were calculated. Twenty-four eligible studies encompassing 5588 breast cancer patients were included in the meta-analysis. The meta-analysis yielded a pooled sensitivity of 0.81 (95% confidence interval [CI]: 0.77-0.84), specificity of 0.85 (95%CI: 0.81-0.87), PLR of 5.24 (95%CI: 4.32-6.34), NLR of 0.23 (95%CI: 0.19-0.27), DOR of 23.16 (95%CI: 17.20-31.19), and AUC of 0.90 (95%CI: 0.87-0.92), indicating good diagnostic performance. Significant heterogeneity was observed in analyses of sensitivity (I2 = 74.64%) and specificity (I2 = 83.18%). Spearman's correlation coefficient suggested no significant threshold effect (P = 0.538). Meta-regression and subgroup analyses identified several potential heterogeneity sources, including data source, integration of clinical factors and peritumor features, MRI equipment, magnetic field strength, lesion segmentation, and modeling methods. In conclusion, DCE-MRI radiomic models exhibit good diagnostic performance in predicting ALNM and SLNM in breast cancer. This non-invasive and effective tool holds potential for the preoperative diagnosis of lymph node metastasis in breast cancer patients.

Peritumoral edema enhances MRI-based deep learning radiomic model for axillary lymph node metastasis burden prediction in breast cancer

To investigate whether peritumoral edema (PE) could enhance deep learning radiomic (DLR) model in predicting axillary lymph node metastasis (ALNM) burden in breast cancer. Invasive breast cancer patients with preoperative MRI were retrospectively enrolled and categorized into low (< 2 lymph nodes involved (LNs+)) and high (≥ 2 LNs+) burden groups based on surgical pathology. PE was evaluated on T2WI, and intra- and peri-tumoral radiomic features were extracted from MRI-visible tumors in DCE-MRI. Deep learning models were developed for LN burden prediction in the training cohort and validated in an independent cohort. The incremental value of PE was evaluated through receiver operating characteristic (ROC) analysis, confirming the improvement in the area under the curve (AUC) using the Delong test. This was complemented by net reclassification improvement (NRI) and integrated discrimination improvement (IDI) metrics. The deep learning combined model, incorporating PE with selected radiomic features, demonstrated significantly higher AUC values compared to the MRI model and the DLR model in the training cohort (n = 177) (AUC: 0.953 vs. 0.849 and 0.867, p < 0.05) and the validation cohort (n = 111) (AUC: 0.963 vs. 0.883 and 0.882, p < 0.05). The complementary analysis demonstrated that PE significantly enhances the prediction performance of the DLR model (Categorical NRI: 0.551, p < 0.001; IDI = 0.343, p < 0.001). These findings were confirmed in the validation cohort (Categorical NRI: 0.539, p < 0.001; IDI = 0.387, p < 0.001). PE improved preoperative ALNM burden prediction of DLR model, facilitating personalized axillary management in breast cancer patients.

Radiomics and deep learning models for CT pre-operative lymph node staging in pancreatic ductal adenocarcinoma: A systematic review and meta-analysis

PURPOSE

To evaluate the diagnostic accuracy of computed tomography (CT)-based radiomic algorithms and deep learning models to preoperatively identify lymph node metastasis (LNM) in patients with pancreatic ductal adenocarcinoma (PDAC).

METHODS

PubMed, CENTRAL, Scopus, Web of Science and IEEE databases were searched to identify relevant studies published up until February 11, 2024. Two reviewers screened all papers independently for eligibility. Studies reporting the accuracy of CT-based radiomics or deep learning models for detecting LNM in PDAC, using histopathology as the reference standard, were included. Quality was assessed using the Quality Assessment of Diagnostic Accuracy Studies 2, the Radiomics Quality Score (RQS) and the the METhodological RadiomICs Score (METRICS). Overall sensitivity (SE), specificity (SP), diagnostic odds ratio (DOR), and the area under the curve (AUC) were calculated.

RESULTS

Four radiomics studies comprising 213 patients and four deep learning studies with 272 patients were included. The average RQS total score was 12.00 ± 3.89, corresponding to an RQS percentage of 33.33 ± 10.80, while the average METRICS score was 63.60 ± 10.88. A significant and strong positive correlation was found between RQS and METRICS (p = 0.016; r = 0.810). The pooled SE, SP, DOR, and AUC of all the studies were 0.83 (95 %CI = 0.77-0.88), 0.76 (95 %CI = 0.62-0.86), 15.70 (95 %CI = 8.12-27.50) and 0.85 (95 %CI = 0.77-0.88). Meta-regression analysis results indicated that neither the study type (radiomics vs deep learning) nor the dataset size of the studies had a significant effect on the DOR (p = 0.09 and p = 0.26, respectively).

CONCLUSION

Based on our meta-analysis findings, preoperative CT-based radiomics algorithms and deep learning models demonstrate favorable performance in predicting LNM in patients with PDAC, with a strong correlation between RQS and METRICS of the included studies.

Ultrasound-based radiomics nomogram for predicting axillary lymph node metastasis in invasive breast cancer

OBJECTIVE

To develop a nomogram for predicting axillary lymph node metastasis (ALNM) in patients with invasive breast cancer.

METHODS

We included 307 patients with clinicopathologically confirmed invasive breast cancer. The cohort was divided into a training group (n=215) and a validation group (n=92). Ultrasound images were used to extract radiomics features. The least absolute shrinkage and selection operator (LASSO) algorithm helped select pertinent features, from which Radiomics Scores (Radscores) were calculated using the LASSO regression equation. We developed three logistic regression models based on Radscores and 2D image features, and assessed the models' performance in the validation group. A nomogram was created from the best-performing model.

RESULTS

In the training set, the area under the curve (AUC) for the Radscore model, 2D feature model, and combined model were 0.76, 0.85, and 0.88, respectively. In the validation set, the AUCs were 0.71, 0.78, and 0.83, respectively. The combined model demonstrated good calibration and promising clinical utility.

CONCLUSION

Our ultrasound-based radiomics nomogram can accurately and non-invasively predict ALNM in breast cancer, suggesting potential clinical applications to optimize surgical and medical strategies.

Radiomics diagnostic performance for predicting lymph node metastasis in esophageal cancer: a systematic review and meta-analysis

BACKGROUND

Esophageal cancer, a global health concern, impacts predominantly men, particularly in Eastern Asia. Lymph node metastasis (LNM) significantly influences prognosis, and current imaging methods exhibit limitations in accurate detection. The integration of radiomics, an artificial intelligence (AI) driven approach in medical imaging, offers a transformative potential. This meta-analysis evaluates existing evidence on the accuracy of radiomics models for predicting LNM in esophageal cancer.

METHODS

We conducted a systematic review following PRISMA 2020 guidelines, searching Embase, PubMed, and Web of Science for English-language studies up to November 16, 2023. Inclusion criteria focused on preoperatively diagnosed esophageal cancer patients with radiomics predicting LNM before treatment. Exclusion criteria were applied, including non-English studies and those lacking sufficient data or separate validation cohorts. Data extraction encompassed study characteristics and radiomics technical details. Quality assessment employed modified Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) and Radiomics Quality Score (RQS) tools. Statistical analysis involved random-effects models for pooled sensitivity, specificity, diagnostic odds ratio (DOR), and area under the curve (AUC). Heterogeneity and publication bias were assessed using Deek's test and funnel plots. Analysis was performed using Stata version 17.0 and meta-DiSc.

RESULTS

Out of 426 initially identified citations, nine studies met inclusion criteria, encompassing 719 patients. These retrospective studies utilized CT, PET, and MRI imaging modalities, predominantly conducted in China. Two studies employed deep learning-based radiomics. Quality assessment revealed acceptable QUADAS-2 scores. RQS scores ranged from 9 to 14, averaging 12.78. The diagnostic meta-analysis yielded a pooled sensitivity, specificity, and AUC of 0.72, 0.76, and 0.74, respectively, representing fair diagnostic performance. Meta-regression identified the use of combined models as a significant contributor to heterogeneity (p-value = 0.05). Other factors, such as sample size (> 75) and least absolute shrinkage and selection operator (LASSO) usage for feature extraction, showed potential influence but lacked statistical significance (0.05 < p-value < 0.10). Publication bias was not statistically significant.

CONCLUSION

Radiomics shows potential for predicting LNM in esophageal cancer, with a moderate diagnostic performance. Standardized approaches, ongoing research, and prospective validation studies are crucial for realizing its clinical applicability.

Machine learning approaches in the prediction of positive axillary lymph nodes post neoadjuvant chemotherapy using MRI, CT, or ultrasound: A systematic review

Background and objective

Neoadjuvant chemotherapy is a standard treatment approach for locally advanced breast cancer. Conventional imaging modalities, such as magnetic resonance imaging (MRI), computed tomography (CT), and ultrasound, have been used for axillary lymph node evaluation which is crucial for treatment planning and prognostication. This systematic review aims to comprehensively examine the current research on applying machine learning algorithms for predicting positive axillary lymph nodes following neoadjuvant chemotherapy utilizing imaging modalities, including MRI, CT, and ultrasound.

Methods

A systematic search was conducted across databases, including PubMed, Scopus, and Web of Science, to identify relevant studies published up to December 2023. Articles employing machine learning algorithms to predict positive axillary lymph nodes using MRI, CT, or ultrasound data after neoadjuvant chemotherapy were included. The review follows the preferred reporting items for systematic reviews and meta-analyses (PRISMA) guidelines, encompassing data extraction and quality assessment.

Results

Seven studies were included, comprising 1502 patients. Four studies used MRI, two used CT, and one applied ultrasound. Two studies developed deep-learning models, while five used classic machine-learning models mainly based on multiple regression. Across the studies, the models showed high predictive accuracy, with the best-performing models combining radiomics and clinical data.

Conclusion

This systematic review demonstrated the potential of utilizing advanced data analysis techniques, such as deep learning radiomics, in improving the prediction of positive axillary lymph nodes in breast cancer patients following neoadjuvant chemotherapy.

Radiomics in cone-beam breast CT for the prediction of axillary lymph node metastasis in breast cancer: a multi-center multi-device study

OBJECTIVES

To develop a radiomics model in contrast-enhanced cone-beam breast CT (CE-CBBCT) for preoperative prediction of axillary lymph node (ALN) status and metastatic burden of breast cancer.

METHODS

Two hundred and seventy-four patients who underwent CE-CBBCT examination with two scanners between 2012 and 2021 from two institutions were enrolled. The primary tumor was annotated in each patient image, from which 1781 radiomics features were extracted with PyRadiomics. After feature selection, support vector machine models were developed to predict ALN status and metastatic burden. To avoid overfitting on a specific patient subset, 100 randomly stratified splits were made to assign the patients to either training/fine-tuning or test set. Area under the receiver operating characteristic curve (AUC) of these radiomics models was compared to those obtained when training the models only with clinical features and combined clinical-radiomics descriptors. Ground truth was established by histopathology.

RESULTS

One hundred and eighteen patients had ALN metastasis (N + (≥ 1)). Of these, 74 had low burden (N + (1~2)) and 44 high burden (N + (≥ 3)). The remaining 156 patients had none (N0). AUC values across the 100 test repeats in predicting ALN status (N0/N + (≥ 1)) were 0.75 ± 0.05 (0.67~0.93, radiomics model), 0.68 ± 0.07 (0.53~0.85, clinical model), and 0.74 ± 0.05 (0.67~0.88, combined model). For metastatic burden prediction (N + (1~2)/N + (≥ 3)), AUC values were 0.65 ± 0.10 (0.50~0.88, radiomics model), 0.55 ± 0.10 (0.40~0.80, clinical model), and 0.64 ± 0.09 (0.50~0.90, combined model), with all the ranges spanning 0.5. In both cases, the radiomics model was significantly better than the clinical model (both p < 0.01) and comparable with the combined model (p = 0.56 and 0.64).

CONCLUSIONS

Radiomics features of primary tumors could have potential in predicting ALN metastasis in CE-CBBCT imaging.

CLINICAL RELEVANCE STATEMENT

The findings support potential clinical use of radiomics for predicting axillary lymph node metastasis in breast cancer patients and addressing the limited axilla coverage of cone-beam breast CT.

KEY POINTS

• Contrast-enhanced cone-beam breast CT-based radiomics could have potential to predict N0 vs. N + (≥ 1) and, to a limited extent, N + (1~2) vs. N + (≥ 3) from primary tumor, and this could help address the limited axilla coverage, pending future verifications on larger cohorts. • The average AUC of radiomics and combined models was significantly higher than that of clinical models but showed no significant difference between themselves. • Radiomics features descriptive of tumor texture were found informative on axillary lymph node status, highlighting a higher heterogeneity for tumor with positive axillary lymph node.

MRI-Based Radiomics Methods for Predicting Ki-67 Expression in Breast Cancer: A Systematic Review and Meta-analysis

RATIONALE AND OBJECTIVES

The purpose of this systematic review and meta-analysis was to assess the quality and diagnostic accuracy of MRI-based radiomics for predicting Ki-67 expression in breast cancer.

MATERIALS AND METHODS

A systematic literature search was performed to find relevant studies published in different databases, including PubMed, Web of Science, and Embase up until March 10, 2023. All papers were independently evaluated for eligibility by two reviewers. Studies that matched research questions and provided sufficient data for quantitative synthesis were included in the systematic review and meta-analysis, respectively. The quality of the articles was assessed using Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2) and Radiomics Quality Score (RQS) tools. The predictive value of MRI-based radiomics for Ki-67 antigen in patients with breast cancer was assessed using pooled sensitivity (SEN), specificity, and area under the curve (AUC). Meta-regression was performed to explore the cause of heterogeneity. Different covariates were used for subgroup analysis.

RESULTS

31 studies were included in the systematic review; among them, 21 reported sufficient data for meta-analysis. 20 training cohorts and five validation cohorts were pooled separately. The pooled sensitivity, specificity, and AUC of MRI-based radiomics for predicting Ki-67 expression in training cohorts were 0.80 [95% CI, 0.73-0.86], 0.82 [95% CI, 0.78-0.86], and 0.88 [95%CI, 0.85-0.91], respectively. The corresponding values for validation cohorts were 0.81 [95% CI, 0.72-0.87], 0.73 [95% CI, 0.62-0.82], and 0.84 [95%CI, 0.80-0.87], respectively. Based on QUADAS-2, some risks of bias were detected for reference standard and flow and timing domains. However, the quality of the included article was acceptable. The mean RQS score of the included articles was close to 6, corresponding to 16.6% of the maximum possible score. Significant heterogeneity was observed in pooled sensitivity and specificity of training cohorts (I2 > 75%). We found that using deep learning radiomic methods, magnetic field strength (3 T vs. 1.5 T), scanner manufacturer, region of interest structure (2D vs. 3D), route of tissue sampling, Ki-67 cut-off, logistic regression for model construction, and LASSO for feature reduction as well as PyRadiomics software for feature extraction had a great impact on heterogeneity according to our joint model analysis. Diagnostic performance in studies that used deep learning-based radiomics and multiple MRI sequences (e.g., DWI+DCE) was slightly higher. In addition, radiomic features derived from DWI sequences performed better than contrast-enhanced sequences in terms of specificity and sensitivity. No publication bias was found based on Deeks' funnel plot. Sensitivity analysis showed that eliminating every study one by one does not impact overall results.

CONCLUSION

This meta-analysis showed that MRI-based radiomics has a good diagnostic accuracy in differentiating breast cancer patients with high Ki-67 expression from low-expressing groups. However, the sensitivity and specificity of these methods still do not surpass 90%, restricting them from being used as a supplement to current pathological assessments (e.g., biopsy or surgery) to predict Ki-67 expression accurately.

Deep learning to predict breast cancer sentinel lymph node status on INSEMA histological images

BACKGROUND

Sentinel lymph node (SLN) status is a clinically important prognostic biomarker in breast cancer and is used to guide therapy, especially for hormone receptor-positive, HER2-negative cases. However, invasive lymph node staging is increasingly omitted before therapy, and studies such as the randomised Intergroup Sentinel Mamma (INSEMA) trial address the potential for further de-escalation of axillary surgery. Therefore, it would be helpful to accurately predict the pretherapeutic sentinel status using medical images.

METHODS

Using a ResNet 50 architecture pretrained on ImageNet and a previously successful strategy, we trained deep learning (DL)-based image analysis algorithms to predict sentinel status on hematoxylin/eosin-stained images of predominantly luminal, primary breast tumours from the INSEMA trial and three additional, independent cohorts (The Cancer Genome Atlas (TCGA) and cohorts from the University hospitals of Mannheim and Regensburg), and compared their performance with that of a logistic regression using clinical data only. Performance on an INSEMA hold-out set was investigated in a blinded manner.

RESULTS

None of the generated image analysis algorithms yielded significantly better than random areas under the receiver operating characteristic curves on the test sets, including the hold-out test set from INSEMA. In contrast, the logistic regression fitted on the Mannheim cohort retained a better than random performance on INSEMA and Regensburg. Including the image analysis model output in the logistic regression did not improve performance further on INSEMA.

CONCLUSIONS

Employing DL-based image analysis on histological slides, we could not predict SLN status for unseen cases in the INSEMA trial and other predominantly luminal cohorts.

Radiomics nomogram for predicting axillary lymph node metastasis-a potential method to address the limitation of axilla coverage in cone-beam breast CT: a bi-center retrospective study

PURPOSE

Cone-beam breast CT (CBBCT) has an inherent limitation that the axilla cannot be imaged in its entirety. We aimed to develop and validate a nomogram based on clinical factors and contrast-enhanced (CE) CBBCT radiomics features to predict axillary lymph node (ALN) metastasis and complement limited axilla coverage.

MATERIAL AND METHODS

This retrospective study included 312 patients with breast cancer from two hospitals who underwent CE-CBBCT examination in a clinical trial (NCT01792999) during 2012-2020. Patients from TCIH comprised training set (n = 176) and validation set (n = 43), and patients from SYSUCC comprised external test set (n = 93). 3D ROIs were delineated manually and radiomics features were extracted by 3D Slicer software. RadScore was calculated and radiomics model was constructed after feature selection. Clinical model was built on independent predictors. Nomogram was developed with independent clinical predictors and RadScore. Diagnostic performance was compared among three models by ROC curve, and decision curve analysis (DCA) was used to evaluate the clinical utility of nomogram.

RESULTS

A total of 139 patients were ALN positive and 173 patients were negative. Twelve radiomics features remained after feature selection. Location and focality were selected as independent predictors for ALN status. The AUC of nomogram in external test set was higher than that of clinical model (0.80 vs. 0.66, p = 0.012). DCA demonstrated that the nomogram had higher overall net benefit than that of clinical model.

CONCLUSION

The nomogram combined CE-CBBCT-based radiomics features and clinical factors could have potential in distinguishing ALN positive from negative and addressing the limitation of axilla coverage in CBBCT.

Radiomics nomogram based on digital breast tomosynthesis: preoperative evaluation of axillary lymph node metastasis in breast carcinoma

PURPOSE

This study aimed to establish a radiomics nomogram model based on digital breast tomosynthesis (DBT) images, to predict the status of axillary lymph nodes (ALN) in patients with breast carcinoma.

METHODS

The data of 120 patients with confirmed breast carcinoma, including 49 cases with axillary lymph node metastasis (ALNM), were retrospectively analyzed in this study. The dataset was randomly divided into a training group consisting of 84 patients (37 with ALNM) and a validation group comprising 36 patients (12 with ALNM). Clinical information was collected for all cases, and radiomics features were extracted from DBT images. Feature selection was performed to develop the Radscore model. Univariate and multivariate logistic regression analysis were employed to identify independent risk factors for constructing both the clinical model and nomogram model. To evaluate the performance of these models, receiver operating characteristic (ROC) curve analysis, calibration curve, decision curve analysis (DCA), net reclassification improvement (NRI), and integrated discriminatory improvement (IDI) were conducted.

RESULTS

The clinical model identified tumor margin and DBT_reported_LNM as independent risk factors, while the Radscore model was constructed using 9 selected radiomics features. Incorporating tumor margin, DBT_reported_LNM, and Radscore, the radiomics nomogram model exhibited superior performance with AUC values of 0.933 and 0.920 in both datasets, respectively. The NRI and IDI showed a significant improvement, suggesting that the Radscore may serve as a useful biomarker for predicting ALN status.

CONCLUSION

The radiomics nomogram based on DBT demonstrated effective preoperative prediction performance for ALNM in patients with breast cancer.