1
|
Vos D, Yaffe N, Cabrera CI, Fowler NM, D'Anza BD. Diagnostic Performance of Radiomics Modeling in Predicting the Human Papillomavirus Status of Oropharyngeal Cancer: A Systematic Review and Meta-Analysis. Cureus 2025; 17:e82085. [PMID: 40351986 PMCID: PMC12066096 DOI: 10.7759/cureus.82085] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 04/11/2025] [Indexed: 05/14/2025] Open
Abstract
In this review, we sought to assess the diagnostic performance and methodological quality of studies utilizing radiomics for the prediction of human papillomavirus (HPV) status in patients with oropharyngeal squamous cell carcinoma. A comprehensive literature search of PubMed, Ovid, Cochrane, Web of Science, and Scopus from inception until June 7, 2022, was performed to identify eligible studies. Strict inclusion and exclusion criteria were applied to the identified studies. Data collection was performed by two independent reviewers with disagreements resolved by consensus review with a third reviewer. In total, 14 articles were chosen, with a total of 15 radiomics models. Of the included studies, 12 models reported sensitivity, with a mean of 0.778 (standard deviation (SD) = 0.073). Similarly, 12 models reported specificity, with a mean of 0.751 (SD = 0.111). The area under the curve (AUC) was reported by all 15 models, with a mean of 0.814 (SD = 0.081). Finally, accuracy was reported by eight models, with a mean of 0.768 (SD = 0.044). A meta-analysis was performed on eight studies that reported AUCs with confidence intervals (CIs), returning a pooled AUC of 0.764 (95% CI = 0.758 to 0.770). The Radiomics Quality Score (RQS) was applied to each included study as a measure of quality. RQS ranged from -1 to 22, with a mean of 13.4 and an intraclass coefficient of 0.874. Radiomics modeling has shown promise in serving as a diagnostic indicator for HPV status in patients with oropharyngeal cancer. Nevertheless, the quality of research methodologies in this area is a limiting factor for its broader clinical application and highlights the need for enhanced funding to support further research efforts.
Collapse
Affiliation(s)
- Derek Vos
- Otolaryngology, Case Western Reserve University School of Medicine, Cleveland, USA
| | - Noah Yaffe
- Otolaryngology, Case Western Reserve University School of Medicine, Cleveland, USA
| | - Claudia I Cabrera
- Otolaryngology - Head and Neck Surgery, University Hospitals Cleveland Medical Center, Cleveland, USA
| | - Nicole M Fowler
- Otolaryngology - Head and Neck Surgery, University Hospitals Cleveland Medical Center, Cleveland, USA
| | - Brian D D'Anza
- Otolaryngology - Head and Neck Surgery, University Hospitals Cleveland Medical Center, Cleveland, USA
| |
Collapse
|
2
|
Lee CF, Lin J, Huang YL, Chen ST, Chou CT, Chen DR, Wu WP. Deep learning-based breast MRI for predicting axillary lymph node metastasis: a systematic review and meta-analysis. Cancer Imaging 2025; 25:44. [PMID: 40165212 PMCID: PMC11956454 DOI: 10.1186/s40644-025-00863-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2024] [Accepted: 03/12/2025] [Indexed: 04/02/2025] Open
Abstract
BACKGROUND To perform a systematic review and meta-analysis that assesses the diagnostic performance of deep learning algorithms applied to breast MRI for predicting axillary lymph nodes metastases in patients of breast cancer. METHODS A systematic literature search in PubMed, MEDLINE, and Embase databases for articles published from January 2004 to February 2025. Inclusion criteria were: patients with breast cancer; deep learning using MRI images was applied to predict axillary lymph nodes metastases; sufficient data were present; original research articles. Quality Assessment of Diagnostic Accuracy Studies-AI and Checklist for Artificial Intelligence in Medical Imaging was used to assess the quality. Statistical analysis included pooling of diagnostic accuracy and investigating between-study heterogeneity. A summary receiver operating characteristic curve (SROC) was performed. R statistical software (version 4.4.0) was used for statistical analyses. RESULTS A total of 10 studies were included. The pooled sensitivity and specificity were 0.76 (95% CI, 0.67-0.83) and 0.81 (95% CI, 0.74-0.87), respectively, with both measures having moderate between-study heterogeneity (I2 = 61% and 60%, respectively; p < 0.01). The SROC analysis yielded a weighted AUC of 0.788. CONCLUSION This meta-analysis demonstrates that deep learning algorithms applied to breast MRI offer promising diagnostic performance for predicting axillary lymph node metastases in breast cancer patients. Incorporating deep learning into clinical practice may enhance decision-making by providing a non-invasive method to more accurately predict lymph node involvement, potentially reducing unnecessary surgeries.
Collapse
Affiliation(s)
- Chia-Fen Lee
- Department of Radiology, Changhua Christian Hospital, Changhua, Taiwan
- Department of Biomedical Imaging and Radiological Sciences, National Yang Ming Chiao Tung University, Taipei, Taiwan
| | - Joseph Lin
- Division of General Surgery, Changhua Christian Hospital, Changhua, Taiwan
- Comprehensive Breast Cancer Center, Changhua Christian Hospital, Changhua, Taiwan
- Division of Breast Surgery, Yuanlin Christian Hospital, Yuanlin, Taiwan
| | - Yu-Len Huang
- Department of Computer Science, Tunghai University, Taichung, Taiwan
| | - Shou-Tung Chen
- Division of General Surgery, Changhua Christian Hospital, Changhua, Taiwan
- Comprehensive Breast Cancer Center, Changhua Christian Hospital, Changhua, Taiwan
| | - Chen-Te Chou
- Department of Radiology, Changhua Christian Hospital, Changhua, Taiwan
| | - Dar-Ren Chen
- Division of General Surgery, Changhua Christian Hospital, Changhua, Taiwan
- Comprehensive Breast Cancer Center, Changhua Christian Hospital, Changhua, Taiwan
| | - Wen-Pei Wu
- Department of Radiology, Changhua Christian Hospital, Changhua, Taiwan.
- Department of Biomedical Imaging and Radiological Sciences, National Yang Ming Chiao Tung University, Taipei, Taiwan.
- Department of Medical Imaging, Changhua Christian Hospital, 135 Nanxiao Street, Changhua, 500, Taiwan.
| |
Collapse
|
3
|
Dong F, Li J, Wang J, Yang X. Diagnostic performance of DCE-MRI radiomics in predicting axillary lymph node metastasis in breast cancer patients: A meta-analysis. PLoS One 2024; 19:e0314653. [PMID: 39625963 PMCID: PMC11614294 DOI: 10.1371/journal.pone.0314653] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/08/2024] [Accepted: 11/13/2024] [Indexed: 12/06/2024] Open
Abstract
Radiomics offers a novel strategy for the differential diagnosis, prognosis evaluation, and prediction of treatment responses in breast cancer. Studies have explored radiomic signatures from dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) for predicting axillary lymph node metastasis (ALNM) and sentinel lymph node metastasis (SLNM), but the diagnostic accuracy varies widely. To evaluate this performance, we conducted a meta-analysis performing a comprehensive literature search across databases including PubMed, EMBASE, SCOPUS, Web of Science (WOS), Cochrane Library, China National Knowledge Infrastructure (CNKI), Wanfang Data, and the Chinese BioMedical Literature Database (CBM) until March 31, 2024. The pooled sensitivity, specificity, positive likelihood ratio (PLR), negative likelihood ratio (NLR), diagnostic odds ratio (DOR), and the area under the receiver operating characteristic curve (AUC) were calculated. Twenty-four eligible studies encompassing 5588 breast cancer patients were included in the meta-analysis. The meta-analysis yielded a pooled sensitivity of 0.81 (95% confidence interval [CI]: 0.77-0.84), specificity of 0.85 (95%CI: 0.81-0.87), PLR of 5.24 (95%CI: 4.32-6.34), NLR of 0.23 (95%CI: 0.19-0.27), DOR of 23.16 (95%CI: 17.20-31.19), and AUC of 0.90 (95%CI: 0.87-0.92), indicating good diagnostic performance. Significant heterogeneity was observed in analyses of sensitivity (I2 = 74.64%) and specificity (I2 = 83.18%). Spearman's correlation coefficient suggested no significant threshold effect (P = 0.538). Meta-regression and subgroup analyses identified several potential heterogeneity sources, including data source, integration of clinical factors and peritumor features, MRI equipment, magnetic field strength, lesion segmentation, and modeling methods. In conclusion, DCE-MRI radiomic models exhibit good diagnostic performance in predicting ALNM and SLNM in breast cancer. This non-invasive and effective tool holds potential for the preoperative diagnosis of lymph node metastasis in breast cancer patients.
Collapse
Affiliation(s)
- Fei Dong
- Department of Medical Imaging, Yuncheng Central Hospital Affiliated to Shanxi Medical University, Yuncheng, Shanxi Province, China
| | - Jie Li
- Department of Anesthesiology, Yuncheng Central Hospital Affiliated to Shanxi Medical University, Yuncheng, Shanxi Province, China
| | - Junbo Wang
- Department of Medical Imaging, Yuncheng Central Hospital Affiliated to Shanxi Medical University, Yuncheng, Shanxi Province, China
| | - Xiaohui Yang
- Department of Medical Imaging, Yuncheng Central Hospital Affiliated to Shanxi Medical University, Yuncheng, Shanxi Province, China
| |
Collapse
|
4
|
Luo H, Chen Z, Xu H, Ren J, Zhou P. Peritumoral edema enhances MRI-based deep learning radiomic model for axillary lymph node metastasis burden prediction in breast cancer. Sci Rep 2024; 14:18900. [PMID: 39143315 PMCID: PMC11324898 DOI: 10.1038/s41598-024-69725-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/06/2024] [Accepted: 08/08/2024] [Indexed: 08/16/2024] Open
Abstract
To investigate whether peritumoral edema (PE) could enhance deep learning radiomic (DLR) model in predicting axillary lymph node metastasis (ALNM) burden in breast cancer. Invasive breast cancer patients with preoperative MRI were retrospectively enrolled and categorized into low (< 2 lymph nodes involved (LNs+)) and high (≥ 2 LNs+) burden groups based on surgical pathology. PE was evaluated on T2WI, and intra- and peri-tumoral radiomic features were extracted from MRI-visible tumors in DCE-MRI. Deep learning models were developed for LN burden prediction in the training cohort and validated in an independent cohort. The incremental value of PE was evaluated through receiver operating characteristic (ROC) analysis, confirming the improvement in the area under the curve (AUC) using the Delong test. This was complemented by net reclassification improvement (NRI) and integrated discrimination improvement (IDI) metrics. The deep learning combined model, incorporating PE with selected radiomic features, demonstrated significantly higher AUC values compared to the MRI model and the DLR model in the training cohort (n = 177) (AUC: 0.953 vs. 0.849 and 0.867, p < 0.05) and the validation cohort (n = 111) (AUC: 0.963 vs. 0.883 and 0.882, p < 0.05). The complementary analysis demonstrated that PE significantly enhances the prediction performance of the DLR model (Categorical NRI: 0.551, p < 0.001; IDI = 0.343, p < 0.001). These findings were confirmed in the validation cohort (Categorical NRI: 0.539, p < 0.001; IDI = 0.387, p < 0.001). PE improved preoperative ALNM burden prediction of DLR model, facilitating personalized axillary management in breast cancer patients.
Collapse
Affiliation(s)
- Hongbing Luo
- Department of Radiology, Sichuan Cancer Hospital & Institute, Sichuan Cancer Center, Affiliated Cancer Hospital of University of Electronic Science and Technology of China, No. 55, 4th Section of South Ren-Min Road, Chengdu, 610041, China.
| | - Zhe Chen
- Department of Radiology, Sichuan Cancer Hospital & Institute, Sichuan Cancer Center, Affiliated Cancer Hospital of University of Electronic Science and Technology of China, No. 55, 4th Section of South Ren-Min Road, Chengdu, 610041, China
| | - Hao Xu
- Department of Radiology, Sichuan Cancer Hospital & Institute, Sichuan Cancer Center, Affiliated Cancer Hospital of University of Electronic Science and Technology of China, No. 55, 4th Section of South Ren-Min Road, Chengdu, 610041, China
| | - Jing Ren
- Department of Radiology, Sichuan Cancer Hospital & Institute, Sichuan Cancer Center, Affiliated Cancer Hospital of University of Electronic Science and Technology of China, No. 55, 4th Section of South Ren-Min Road, Chengdu, 610041, China
| | - Peng Zhou
- Department of Radiology, Sichuan Cancer Hospital & Institute, Sichuan Cancer Center, Affiliated Cancer Hospital of University of Electronic Science and Technology of China, No. 55, 4th Section of South Ren-Min Road, Chengdu, 610041, China.
| |
Collapse
|
5
|
Yang F, Feng Y, Sun P, Traverso A, Dekker A, Zhang B, Huang Z, Wang Z, Yan D. Preoperative prediction of high-grade osteosarcoma response to neoadjuvant therapy based on a plain CT radiomics model: A dual-center study. J Bone Oncol 2024; 47:100614. [PMID: 38975332 PMCID: PMC11225658 DOI: 10.1016/j.jbo.2024.100614] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2024] [Revised: 05/05/2024] [Accepted: 06/01/2024] [Indexed: 07/09/2024] Open
Abstract
Objective To develop a model combining clinical and radiomics features from CT scans for a preoperative noninvasive evaluation of Huvos grading of neoadjuvant chemotherapy in patients with HOS. Methods 183 patients from center A and 42 from center B were categorized into training and validation sets. Features derived from radiomics were obtained from unenhanced CT scans.Following dimensionality reduction, the most optimal features were selected and utilized in creating a radiomics model through logistic regression analysis. Integrating clinical features, a composite clinical radiomics model was developed, and a nomogram was constructed. Predictive performance of the model was evaluated using ROC curves and calibration curves. Additionally, decision curve analysis was conducted to assess practical utility of nomogram in clinical settings. Results LASSO LR analysis was performed, and finally, three selected image omics features were obtained.Radiomics model yielded AUC values with a good diagnostic effect for both patient sets (AUCs: 0.69 and 0.68, respectively). Clinical models (including sex, age, pre-chemotherapy ALP and LDH levels, new lung metastases within 1 year after surgery, and incidence) performed well in terms of Huvos grade prediction, with an AUC of 0.74 for training set. The AUC for independent validation set stood at 0.70. Notably, the amalgamation of radiomics and clinical features exhibited commendable predictive prowess in training set, registering an AUC of 0.78. This robust performance was subsequently validated in the independent validation set, where the AUC remained high at 0.75. Calibration curves of nomogram showed that the predictions were in good agreement with actual observations. Conclusion Combined model can be used for Huvos grading in patients with HOS after preoperative chemotherapy, which is helpful for adjuvant treatment decisions.
Collapse
Affiliation(s)
- Fan Yang
- Department of Radiation, Beijing Jishuitan Hospital,Capital Medical University, Beijing 100035, China
| | - Ying Feng
- Department of Ultrasound, Beijing Friendship Hospital, Capital Medical University, Beijing 100050, China
| | - Pengfei Sun
- Department of Ultrasound, Beijing Friendship Hospital, Capital Medical University, Beijing 100050, China
| | - Alberto Traverso
- Department of Radiation Oncology (Maastro), GROW-School for Oncology and Reproduction, Maastricht University Medical Centre+, Maastricht, The Netherlands
| | - Andre Dekker
- Department of Radiation Oncology (Maastro), GROW-School for Oncology and Reproduction, Maastricht University Medical Centre+, Maastricht, The Netherlands
| | - Bin Zhang
- Department of Radiation, Peking University Shougang Hospital, Beijing 100144, China
| | - Zhen Huang
- Department of Bone Oncology, Beijing Jishuitan Hospital,Capital Medical University, Beijing 100035, China
| | - Zhixiang Wang
- Department of Ultrasound, Beijing Friendship Hospital, Capital Medical University, Beijing 100050, China
| | - Dong Yan
- Department of Radiation, Beijing Jishuitan Hospital,Capital Medical University, Beijing 100035, China
| |
Collapse
|
6
|
Grossen AA, Evans AR, Ernst GL, Behnen CC, Zhao X, Bauer AM. The current landscape of machine learning-based radiomics in arteriovenous malformations: a systematic review and radiomics quality score assessment. Front Neurol 2024; 15:1398876. [PMID: 38915798 PMCID: PMC11194423 DOI: 10.3389/fneur.2024.1398876] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2024] [Accepted: 05/21/2024] [Indexed: 06/26/2024] Open
Abstract
Background Arteriovenous malformations (AVMs) are rare vascular anomalies involving a disorganization of arteries and veins with no intervening capillaries. In the past 10 years, radiomics and machine learning (ML) models became increasingly popular for analyzing diagnostic medical images. The goal of this review was to provide a comprehensive summary of current radiomic models being employed for the diagnostic, therapeutic, prognostic, and predictive outcomes in AVM management. Methods A systematic literature review was conducted according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) 2020 guidelines, in which the PubMed and Embase databases were searched using the following terms: (cerebral OR brain OR intracranial OR central nervous system OR spine OR spinal) AND (AVM OR arteriovenous malformation OR arteriovenous malformations) AND (radiomics OR radiogenomics OR machine learning OR artificial intelligence OR deep learning OR computer-aided detection OR computer-aided prediction OR computer-aided treatment decision). A radiomics quality score (RQS) was calculated for all included studies. Results Thirteen studies were included, which were all retrospective in nature. Three studies (23%) dealt with AVM diagnosis and grading, 1 study (8%) gauged treatment response, 8 (62%) predicted outcomes, and the last one (8%) addressed prognosis. No radiomics model had undergone external validation. The mean RQS was 15.92 (range: 10-18). Conclusion We demonstrated that radiomics is currently being studied in different facets of AVM management. While not ready for clinical use, radiomics is a rapidly emerging field expected to play a significant future role in medical imaging. More prospective studies are warranted to determine the role of radiomics in the diagnosis, prediction of comorbidities, and treatment selection in AVM management.
Collapse
Affiliation(s)
- Audrey A. Grossen
- Department of Neurosurgery, University of Oklahoma Health Sciences Center, Oklahoma City, OK, United States
| | - Alexander R. Evans
- Department of Neurosurgery, University of Oklahoma Health Sciences Center, Oklahoma City, OK, United States
| | - Griffin L. Ernst
- Department of Neurosurgery, University of Oklahoma Health Sciences Center, Oklahoma City, OK, United States
| | - Connor C. Behnen
- Data Science and Analytics, University of Oklahoma, Norman, OK, United States
| | - Xiaochun Zhao
- Department of Neurosurgery, University of Oklahoma Health Sciences Center, Oklahoma City, OK, United States
| | - Andrew M. Bauer
- Department of Neurosurgery, University of Oklahoma Health Sciences Center, Oklahoma City, OK, United States
| |
Collapse
|
7
|
Zhu Y, Ma Y, Zhai Z, Liu A, Wang Y, Zhang Y, Li H, Zhao M, Han P, Yin L, He N, Wu Y, Sechopoulos I, Ye Z, Caballo M. Radiomics in cone-beam breast CT for the prediction of axillary lymph node metastasis in breast cancer: a multi-center multi-device study. Eur Radiol 2024; 34:2576-2589. [PMID: 37782338 DOI: 10.1007/s00330-023-10256-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2022] [Revised: 07/09/2023] [Accepted: 07/30/2023] [Indexed: 10/03/2023]
Abstract
OBJECTIVES To develop a radiomics model in contrast-enhanced cone-beam breast CT (CE-CBBCT) for preoperative prediction of axillary lymph node (ALN) status and metastatic burden of breast cancer. METHODS Two hundred and seventy-four patients who underwent CE-CBBCT examination with two scanners between 2012 and 2021 from two institutions were enrolled. The primary tumor was annotated in each patient image, from which 1781 radiomics features were extracted with PyRadiomics. After feature selection, support vector machine models were developed to predict ALN status and metastatic burden. To avoid overfitting on a specific patient subset, 100 randomly stratified splits were made to assign the patients to either training/fine-tuning or test set. Area under the receiver operating characteristic curve (AUC) of these radiomics models was compared to those obtained when training the models only with clinical features and combined clinical-radiomics descriptors. Ground truth was established by histopathology. RESULTS One hundred and eighteen patients had ALN metastasis (N + (≥ 1)). Of these, 74 had low burden (N + (1~2)) and 44 high burden (N + (≥ 3)). The remaining 156 patients had none (N0). AUC values across the 100 test repeats in predicting ALN status (N0/N + (≥ 1)) were 0.75 ± 0.05 (0.67~0.93, radiomics model), 0.68 ± 0.07 (0.53~0.85, clinical model), and 0.74 ± 0.05 (0.67~0.88, combined model). For metastatic burden prediction (N + (1~2)/N + (≥ 3)), AUC values were 0.65 ± 0.10 (0.50~0.88, radiomics model), 0.55 ± 0.10 (0.40~0.80, clinical model), and 0.64 ± 0.09 (0.50~0.90, combined model), with all the ranges spanning 0.5. In both cases, the radiomics model was significantly better than the clinical model (both p < 0.01) and comparable with the combined model (p = 0.56 and 0.64). CONCLUSIONS Radiomics features of primary tumors could have potential in predicting ALN metastasis in CE-CBBCT imaging. CLINICAL RELEVANCE STATEMENT The findings support potential clinical use of radiomics for predicting axillary lymph node metastasis in breast cancer patients and addressing the limited axilla coverage of cone-beam breast CT. KEY POINTS • Contrast-enhanced cone-beam breast CT-based radiomics could have potential to predict N0 vs. N + (≥ 1) and, to a limited extent, N + (1~2) vs. N + (≥ 3) from primary tumor, and this could help address the limited axilla coverage, pending future verifications on larger cohorts. • The average AUC of radiomics and combined models was significantly higher than that of clinical models but showed no significant difference between themselves. • Radiomics features descriptive of tumor texture were found informative on axillary lymph node status, highlighting a higher heterogeneity for tumor with positive axillary lymph node.
Collapse
Affiliation(s)
- Yueqiang Zhu
- Department of Radiology, Tianjin Medical University Cancer Institute and Hospital; National Clinical Research Center for Cancer; Tianjin's Clinical Research Center for Cancer; Key Laboratory of Cancer Prevention and Therapy, Tianjin; Key Laboratory of Breast Cancer Prevention and Therapy, Tianjin Medical University, Ministry of Education, Huan-Hu-Xi Road, Ti-Yuan-Bei, Hexi District, Tianjin, 300060, China
- Department of Medical Imaging, Radboud University Medical Center, PO Box 9101, Nijmegen, 6500 HB, The Netherlands
| | - Yue Ma
- Department of Radiology, Tianjin Medical University Cancer Institute and Hospital; National Clinical Research Center for Cancer; Tianjin's Clinical Research Center for Cancer; Key Laboratory of Cancer Prevention and Therapy, Tianjin; Key Laboratory of Breast Cancer Prevention and Therapy, Tianjin Medical University, Ministry of Education, Huan-Hu-Xi Road, Ti-Yuan-Bei, Hexi District, Tianjin, 300060, China
| | - Zhenzhen Zhai
- Department of Radiology, The Fifth Affiliated Hospital of Sun Yat-Sen University, Mei-Hua-Dong Road, Xiangzhou District, Zhuhai, 519000, China
| | - Aidi Liu
- Department of Radiology, Tianjin Medical University Cancer Institute and Hospital; National Clinical Research Center for Cancer; Tianjin's Clinical Research Center for Cancer; Key Laboratory of Cancer Prevention and Therapy, Tianjin; Key Laboratory of Breast Cancer Prevention and Therapy, Tianjin Medical University, Ministry of Education, Huan-Hu-Xi Road, Ti-Yuan-Bei, Hexi District, Tianjin, 300060, China
| | - Yafei Wang
- Department of Radiology, Tianjin Medical University Cancer Institute and Hospital; National Clinical Research Center for Cancer; Tianjin's Clinical Research Center for Cancer; Key Laboratory of Cancer Prevention and Therapy, Tianjin; Key Laboratory of Breast Cancer Prevention and Therapy, Tianjin Medical University, Ministry of Education, Huan-Hu-Xi Road, Ti-Yuan-Bei, Hexi District, Tianjin, 300060, China
| | - Yuwei Zhang
- Department of Radiology, Tianjin Medical University Cancer Institute and Hospital; National Clinical Research Center for Cancer; Tianjin's Clinical Research Center for Cancer; Key Laboratory of Cancer Prevention and Therapy, Tianjin; Key Laboratory of Breast Cancer Prevention and Therapy, Tianjin Medical University, Ministry of Education, Huan-Hu-Xi Road, Ti-Yuan-Bei, Hexi District, Tianjin, 300060, China
| | - Haijie Li
- Department of Radiology, Tianjin Medical University Cancer Institute and Hospital; National Clinical Research Center for Cancer; Tianjin's Clinical Research Center for Cancer; Key Laboratory of Cancer Prevention and Therapy, Tianjin; Key Laboratory of Breast Cancer Prevention and Therapy, Tianjin Medical University, Ministry of Education, Huan-Hu-Xi Road, Ti-Yuan-Bei, Hexi District, Tianjin, 300060, China
| | - Mengran Zhao
- Department of Radiology, Tianjin Medical University Cancer Institute and Hospital; National Clinical Research Center for Cancer; Tianjin's Clinical Research Center for Cancer; Key Laboratory of Cancer Prevention and Therapy, Tianjin; Key Laboratory of Breast Cancer Prevention and Therapy, Tianjin Medical University, Ministry of Education, Huan-Hu-Xi Road, Ti-Yuan-Bei, Hexi District, Tianjin, 300060, China
| | - Peng Han
- Department of Radiology, Tianjin Medical University Cancer Institute and Hospital; National Clinical Research Center for Cancer; Tianjin's Clinical Research Center for Cancer; Key Laboratory of Cancer Prevention and Therapy, Tianjin; Key Laboratory of Breast Cancer Prevention and Therapy, Tianjin Medical University, Ministry of Education, Huan-Hu-Xi Road, Ti-Yuan-Bei, Hexi District, Tianjin, 300060, China
| | - Lu Yin
- Department of Radiology, Tianjin Medical University Cancer Institute and Hospital; National Clinical Research Center for Cancer; Tianjin's Clinical Research Center for Cancer; Key Laboratory of Cancer Prevention and Therapy, Tianjin; Key Laboratory of Breast Cancer Prevention and Therapy, Tianjin Medical University, Ministry of Education, Huan-Hu-Xi Road, Ti-Yuan-Bei, Hexi District, Tianjin, 300060, China
| | - Ni He
- Department of Medical Imaging and Image-guided Therapy, Sun Yat-Sen University Cancer Center, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Dong-Feng-Dong Road, Yuexiu District, Guangzhou, 510060, China
| | - Yaopan Wu
- Department of Medical Imaging and Image-guided Therapy, Sun Yat-Sen University Cancer Center, State Key Laboratory of Oncology in South China, Collaborative Innovation Center for Cancer Medicine, Dong-Feng-Dong Road, Yuexiu District, Guangzhou, 510060, China
| | - Ioannis Sechopoulos
- Department of Medical Imaging, Radboud University Medical Center, PO Box 9101, Nijmegen, 6500 HB, The Netherlands
- Dutch Expert Center for Screening (LRCB), PO Box 6873, Nijmegen, 6503 GJ, The Netherlands
- Technical Medicine Centre, University of Twente, PO Box 217, Enschede, 7500 AE, The Netherlands
| | - Zhaoxiang Ye
- Department of Radiology, Tianjin Medical University Cancer Institute and Hospital; National Clinical Research Center for Cancer; Tianjin's Clinical Research Center for Cancer; Key Laboratory of Cancer Prevention and Therapy, Tianjin; Key Laboratory of Breast Cancer Prevention and Therapy, Tianjin Medical University, Ministry of Education, Huan-Hu-Xi Road, Ti-Yuan-Bei, Hexi District, Tianjin, 300060, China.
| | - Marco Caballo
- Department of Medical Imaging, Radboud University Medical Center, PO Box 9101, Nijmegen, 6500 HB, The Netherlands
| |
Collapse
|
8
|
Wang M, Liu Z, Ma L. Application of artificial intelligence in ultrasound imaging for predicting lymph node metastasis in breast cancer: A meta-analysis. Clin Imaging 2024; 106:110048. [PMID: 38065024 DOI: 10.1016/j.clinimag.2023.110048] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2023] [Revised: 11/22/2023] [Accepted: 11/27/2023] [Indexed: 01/15/2024]
Abstract
BACKGROUND This study aims to comprehensively evaluate the accuracy and effectiveness of ultrasound imaging based on artificial intelligence algorithms in predicting lymph node metastasis in breast cancer patients through a meta-analysis. METHODS We systematically searched PubMed, Embase, and Cochrane Library for literature published up to May 2023. The search terms included artificial intelligence, ultrasound, breast cancer, and lymph node. Studies meeting the inclusion criteria were selected, and data were extracted for analysis. The main evaluation indicators included sensitivity, specificity, positive likelihood ratio, negative likelihood ratio, and area under the curve (AUC). The heterogeneity was assessed using the Cochrane Q test combined with the I^2 statistic expressing the percentage of total effect variation that can be attributed to the effect variation between studies, as recommended by the Cochrane Handbook for heterogeneity quantification. A threshold p-value of 0.10 was considered to compensate for the low power of the Q test. Sensitivity analysis was performed to assess the stability of individual studies, and publication bias was determined with funnel plots. Additionally, fagan plots were used to assess clinical utility. RESULTS Ten studies involving 4726 breast cancer patients were included in the meta-analysis. The results showed that ultrasound imaging based on artificial intelligence algorithms had high accuracy and effectiveness in predicting lymph node metastasis in breast cancer patients. The pooled sensitivity was 0.88 (95% CI: 0.81-0.93; P < 0.001; I2 = 84.68), specificity was 0.75 (95% CI: 0.66-0.83; P < 0.001; I2 = 91.11), and AUC was 0.89 (95% CI: 0.86-0.91). The positive likelihood ratio was 3.5 (95% CI: 2.6-4.8), negative likelihood ratio was 0.16 (95% CI: 0.10-0.26), and diagnostic odds ratio was 23 (95% CI: 13-40). However, the combined sensitivity of ultrasound imaging based on non-AI algorithms for predicting lymph node metastasis in breast cancer patients was 0.78 (95%CI: 0.63-0.88), the specificity was 0.76 (95%CI: 0.63-0.86), and the AUC was 0.84 (95%CI: 0.80-0.87). The positive likelihood ratio was 3.3 (95% CI: 1.9-5.6), the negative likelihood ratio was 0.29 (95% CI: 0.15-0.54), and the diagnostic odds ratio was 11 (95% CI: 4-33). Due to limited sample size (n = 2), meta-analysis was not conducted for the outcome of predicting lymph node metastasis burden. CONCLUSION Ultrasound imaging based on artificial intelligence algorithms holds promise in predicting lymph node metastasis in breast cancer patients, demonstrating high accuracy and effectiveness. The application of this technology helps in the diagnosis and treatment decisions for breast cancer patients and is expected to become an important tool in future clinical practice.
Collapse
Affiliation(s)
- Minghui Wang
- Department of Breast Surgery, Affiliate Hospital of Chengde Medical University, Hebei 067000, China
| | - Zihui Liu
- Department of Pathology, Affiliate Hospital of Chengde Medical University, Hebei 067000, China
| | - Lihui Ma
- Department of Breast Surgery, Affiliate Hospital of Chengde Medical University, Hebei 067000, China.
| |
Collapse
|
9
|
Liu CJ, Zhang L, Sun Y, Geng L, Wang R, Shi KM, Wan JX. Application of CT and MRI images based on an artificial intelligence algorithm for predicting lymph node metastasis in breast cancer patients: a meta-analysis. BMC Cancer 2023; 23:1134. [PMID: 37993845 PMCID: PMC10666295 DOI: 10.1186/s12885-023-11638-z] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2023] [Accepted: 11/13/2023] [Indexed: 11/24/2023] Open
Abstract
BACKGROUND This study aimed to comprehensively evaluate the accuracy and effect of computed tomography (CT) and magnetic resonance imaging (MRI) based on artificial intelligence (AI) algorithms for predicting lymph node metastasis in breast cancer patients. METHODS We systematically searched the PubMed, Embase and Cochrane Library databases for literature from inception to June 2023 using keywords that included 'artificial intelligence', 'CT,' 'MRI', 'breast cancer' and 'lymph nodes'. Studies that met the inclusion criteria were screened and their data were extracted for analysis. The main outcome measures included sensitivity, specificity, positive likelihood ratio, negative likelihood ratio and area under the curve (AUC). RESULTS A total of 16 studies were included in the final meta-analysis, covering 4,764 breast cancer patients. Among them, 11 studies used the manual algorithm MRI to calculate breast cancer risk, which had a sensitivity of 0.85 (95% confidence interval [CI] 0.79-0.90; p < 0.001; I2 = 75.3%), specificity of 0.81 (95% CI 0.66-0.83; p < 0.001; I2 = 0%), a positive likelihood ratio of 4.6 (95% CI 4.0-4.8), a negative likelihood ratio of 0.18 (95% CI 0.13-0.26) and a diagnostic odds ratio of 25 (95% CI 17-38). Five studies used manual algorithm CT to calculate breast cancer risk, which had a sensitivity of 0.88 (95% CI 0.79-0.94; p < 0.001; I2 = 87.0%), specificity of 0.80 (95% CI 0.69-0.88; p < 0.001; I2 = 91.8%), a positive likelihood ratio of 4.4 (95% CI 2.7-7.0), a negative likelihood ratio of 0.15 (95% CI 0.08-0.27) and a diagnostic odds ratio of 30 (95% CI 12-72). For MRI and CT, the AUC after study pooling was 0.85 (95% CI 0.82-0.88) and 0.91 (95% CI 0.88-0.93), respectively. CONCLUSION Computed tomography and MRI images based on an AI algorithm have good diagnostic accuracy in predicting lymph node metastasis in breast cancer patients and have the potential for clinical application.
Collapse
Affiliation(s)
- Cheng-Jie Liu
- Department of Information Center, Lianyungang Human Resources and Social Security Bureau, Lianyungang, 222000, JiangSu, China
| | - Lei Zhang
- Department of Information System, Lianyungang 149 Hospital, Lianyungang, 222000, Jiangsu, China
| | - Yi Sun
- Department of Medical Imaging, The Second People's Hospital of Lianyungang, 161 Xingfu Road, Haizhou District, Lianyungang, 222000, Jiangsu, China
| | - Lei Geng
- Department of Medical Imaging, The Second People's Hospital of Lianyungang, 161 Xingfu Road, Haizhou District, Lianyungang, 222000, Jiangsu, China
| | - Rui Wang
- Department of Medical Imaging, The Second People's Hospital of Lianyungang, 161 Xingfu Road, Haizhou District, Lianyungang, 222000, Jiangsu, China
| | - Kai-Min Shi
- Department of Information Center, Lianyungang Shuangcheng Information Technology Co., Ltd, Lianyungang, 222000, China
| | - Jin-Xin Wan
- Department of Medical Imaging, The Second People's Hospital of Lianyungang, 161 Xingfu Road, Haizhou District, Lianyungang, 222000, Jiangsu, China.
| |
Collapse
|
10
|
Ma Q, Li Z, Li W, Chen Q, Liu X, Feng W, Lei J. MRI radiomics for the preoperative evaluation of lymphovascular invasion in breast cancer: A meta-analysis. Eur J Radiol 2023; 168:111127. [PMID: 37801997 DOI: 10.1016/j.ejrad.2023.111127] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2023] [Revised: 09/08/2023] [Accepted: 09/28/2023] [Indexed: 10/08/2023]
Abstract
PURPOSE To evaluate the ability of preoperative MRI-based radiomic features in predicting lymphovascular invasion (LVI) in patients with breast cancer. METHODS PubMed, Embase, Web of Science, Cochrane Library databases, and four Chinese databases were searched to identify relevant studies published up until June 15, 2023. Two reviewers screened all papers independently for eligibility. We included diagnostic accuracy studies that used radiomics-MRI for LVI in patients with breast cancer, using histopathology as the reference standard. Quality was assessed using the Quality Assessment of Diagnostic Accuracy Studies 2 and Radiomics Quality Score. Overall diagnostic odds ratio (DOR), sensitivity, specificity and area under the curve (AUC) were calculated to assess the prediction efficacy of MRI-based radiomic features in patients with breast cancer. Spearman's correlation coefficient was calculated and subgroup analysis performed to investigate causes of heterogeneity. RESULTS Eight studies comprising 1685 female patients were included. The pooled DOR, sensitivity, specificity, and AUC of radiomics in detecting LVI were 23 [confidence interval (CI) 16,32], 0.89(0.86,0.92), 0.82 (0.78,0.86), and 0.83(0.78,0.87), respectively. The meta-analysis showed significant heterogeneity among the included studies. No threshold effect was detected. Subgroup analysis showed that more than 200 participants, radiomics with clinical factors, semiautomatic segmentation method and peritumoral or intra- and peritumoral model [DOR: 28(18,42), 26(19,37), 34(16,70), 40(10,156), respectively] could improve diagnostic performance compared with less than 200 participants, only radiomics, manual segmentation method, and tumor model [DOR: 16(7,37), 21(6,73), 20(12,32), 21(13,32), respectively], but 3.0 T MR and multiple sequences approach [DOR: 27(15,49),17(8,35)] couldn't improve diagnostic performance compared with 1.5 T and DCE radiomic features [DOR:27(7,99),25(17,37)]. CONCLUSION Our meta-analysis showed that preoperative MRI-based radiomic features performs well in predicting LVI in patients with breast cancer. This noninvasive and convenient tool may be used to facilitate preoperative identification of LVI in breast cancer.
Collapse
Affiliation(s)
- Qinqin Ma
- Lanzhou University, Lanzhou 730000, China; Intelligent Imaging Medical Engineering Research Center of Gansu Province, Lanzhou 730000, China; Accurate Image Collaborative Innovation International Science and Technology Cooperation Base of Gansu Province, Lanzhou 730000, China.
| | - Zhifan Li
- Lanzhou University, Lanzhou 730000, China; Intelligent Imaging Medical Engineering Research Center of Gansu Province, Lanzhou 730000, China; Accurate Image Collaborative Innovation International Science and Technology Cooperation Base of Gansu Province, Lanzhou 730000, China.
| | - Wenjing Li
- Lanzhou University, Lanzhou 730000, China; Intelligent Imaging Medical Engineering Research Center of Gansu Province, Lanzhou 730000, China; Accurate Image Collaborative Innovation International Science and Technology Cooperation Base of Gansu Province, Lanzhou 730000, China.
| | - Qitian Chen
- No.2 Hospital of Baiyin City, Baiyin 730900, China.
| | - Xinran Liu
- Lanzhou University, Lanzhou 730000, China; Intelligent Imaging Medical Engineering Research Center of Gansu Province, Lanzhou 730000, China; Accurate Image Collaborative Innovation International Science and Technology Cooperation Base of Gansu Province, Lanzhou 730000, China.
| | - Wen Feng
- Lanzhou University, Lanzhou 730000, China; Department of Radiology, the First Hospital of Lanzhou University, Lanzhou 730000, China; Intelligent Imaging Medical Engineering Research Center of Gansu Province, Lanzhou 730000, China; Accurate Image Collaborative Innovation International Science and Technology Cooperation Base of Gansu Province, Lanzhou 730000, China.
| | - Junqiang Lei
- Department of Radiology, the First Hospital of Lanzhou University, Lanzhou 730000, China; Intelligent Imaging Medical Engineering Research Center of Gansu Province, Lanzhou 730000, China; Accurate Image Collaborative Innovation International Science and Technology Cooperation Base of Gansu Province, Lanzhou 730000, China.
| |
Collapse
|
11
|
HajiEsmailPoor Z, Tabnak P, Baradaran B, Pashazadeh F, Aghebati-Maleki L. Diagnostic performance of CT scan-based radiomics for prediction of lymph node metastasis in gastric cancer: a systematic review and meta-analysis. Front Oncol 2023; 13:1185663. [PMID: 37936604 PMCID: PMC10627242 DOI: 10.3389/fonc.2023.1185663] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2023] [Accepted: 08/30/2023] [Indexed: 11/09/2023] Open
Abstract
Objective The purpose of this study was to evaluate the diagnostic performance of computed tomography (CT) scan-based radiomics in prediction of lymph node metastasis (LNM) in gastric cancer (GC) patients. Methods PubMed, Embase, Web of Science, and Cochrane Library databases were searched for original studies published until 10 November 2022, and the studies satisfying the inclusion criteria were included. Characteristics of included studies and radiomics approach and data for constructing 2 × 2 tables were extracted. The radiomics quality score (RQS) and Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) were utilized for the quality assessment of included studies. Overall sensitivity, specificity, diagnostic odds ratio (DOR), and area under the curve (AUC) were calculated to assess diagnostic accuracy. The subgroup analysis and Spearman's correlation coefficient was done for exploration of heterogeneity sources. Results Fifteen studies with 7,010 GC patients were included. We conducted analyses on both radiomics signature and combined (based on signature and clinical features) models. The pooled sensitivity, specificity, DOR, and AUC of radiomics models compared to combined models were 0.75 (95% CI, 0.67-0.82) versus 0.81 (95% CI, 0.75-0.86), 0.80 (95% CI, 0.73-0.86) versus 0.85 (95% CI, 0.79-0.89), 13 (95% CI, 7-23) versus 23 (95% CI, 13-42), and 0.85 (95% CI, 0.81-0.86) versus 0.90 (95% CI, 0.87-0.92), respectively. The meta-analysis indicated a significant heterogeneity among studies. The subgroup analysis revealed that arterial phase CT scan, tumoral and nodal regions of interest (ROIs), automatic segmentation, and two-dimensional (2D) ROI could improve diagnostic accuracy compared to venous phase CT scan, tumoral-only ROI, manual segmentation, and 3D ROI, respectively. Overall, the quality of studies was quite acceptable based on both QUADAS-2 and RQS tools. Conclusion CT scan-based radiomics approach has a promising potential for the prediction of LNM in GC patients preoperatively as a non-invasive diagnostic tool. Methodological heterogeneity is the main limitation of the included studies. Systematic review registration https://www.crd.york.ac.uk/Prospero/display_record.php?RecordID=287676, identifier CRD42022287676.
Collapse
Affiliation(s)
| | - Peyman Tabnak
- Faculty of Medicine, Tabriz University of Medical Sciences, Tabriz, Iran
| | - Behzad Baradaran
- Immunology Research Center, Tabriz University of Medical Sciences, Tabriz, Iran
- Department of Immunology, Faculty of Medicine, Tabriz University of Medical Sciences, Tabriz, Iran
| | - Fariba Pashazadeh
- Research Center for Evidence-based Medicine, Iranian Evidence-Based Medicine (EBM) Centre: A Joanna Briggs Institute (JBI) Centre of Excellence, Faculty of Medicine, Tabriz University of Medical Sciences, Tabriz, Iran
| | - Leili Aghebati-Maleki
- Immunology Research Center, Tabriz University of Medical Sciences, Tabriz, Iran
- Department of Immunology, Faculty of Medicine, Tabriz University of Medical Sciences, Tabriz, Iran
| |
Collapse
|
12
|
Romeo V, Kapetas P, Clauser P, Rasul S, Cuocolo R, Caruso M, Helbich TH, Baltzer PAT, Pinker K. Simultaneous 18F-FDG PET/MRI Radiomics and Machine Learning Analysis of the Primary Breast Tumor for the Preoperative Prediction of Axillary Lymph Node Status in Breast Cancer. Cancers (Basel) 2023; 15:5088. [PMID: 37894455 PMCID: PMC10604950 DOI: 10.3390/cancers15205088] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2023] [Revised: 10/08/2023] [Accepted: 10/17/2023] [Indexed: 10/29/2023] Open
Abstract
In this prospective study, 117 female patients (mean age = 53 years) with 127 histologically proven breast cancer lesions (lymph node (LN) positive = 85, LN negative = 42) underwent simultaneous 18F-FDG PET/MRI of the breast. Quantitative parameters were calculated from dynamic contrast-enhanced (DCE) imaging (tumor Mean Transit Time, Volume Distribution, Plasma Flow), diffusion-weighted imaging (DWI) (tumor ADCmean), and PET (tumor SUVmax, mean and minimum, SUVmean of ipsilateral breast parenchyma). Manual whole-lesion segmentation was also performed on DCE, T2-weighted, DWI, and PET images, and radiomic features were extracted. The dataset was divided into a training (70%) and a test set (30%). Multi-step feature selection was performed, and a support vector machine classifier was trained and tested for predicting axillary LN status. 13 radiomic features from DCE, DWI, T2-weighted, and PET images were selected for model building. The classifier obtained an accuracy of 79.8 (AUC = 0.798) in the training set and 78.6% (AUC = 0.839), with sensitivity and specificity of 67.9% and 100%, respectively, in the test set. A machine learning-based radiomics model comprising 18F-FDG PET/MRI radiomic features extracted from the primary breast cancer lesions allows high accuracy in non-invasive identification of axillary LN metastasis.
Collapse
Affiliation(s)
- Valeria Romeo
- Department of Advanced Biomedical Sciences, University of Naples Federico II, Via S. Pansini 5, 80138 Naples, Italy; (V.R.); (M.C.)
- Department of Biomedical Imaging and Image-Guided Therapy, Division of General and Pediatric Radiology, Medical University of Vienna, Waehringer Guertel 18-20, 1090 Wien, Austria
| | - Panagiotis Kapetas
- Department of Biomedical Imaging and Image-Guided Therapy, Division of General and Pediatric Radiology, Medical University of Vienna, Waehringer Guertel 18-20, 1090 Wien, Austria
| | - Paola Clauser
- Department of Biomedical Imaging and Image-Guided Therapy, Division of General and Pediatric Radiology, Medical University of Vienna, Waehringer Guertel 18-20, 1090 Wien, Austria
| | - Sazan Rasul
- Department of Biomedical Imaging and Image-Guided Therapy, Division of Nuclear Medicine, Medical University of Vienna, Waehringer Guertel 18-20, 1090 Wien, Austria;
| | - Renato Cuocolo
- Department of Medicine, Surgery, and Dentistry, University of Salerno, 84081 Baronissi, Italy;
- Augmented Reality for Health Monitoring Laboratory (ARHeMLab), Department of Electrical Engineering and Information Technology, University of Naples “Federico II”, 80131 Naples, Italy
| | - Martina Caruso
- Department of Advanced Biomedical Sciences, University of Naples Federico II, Via S. Pansini 5, 80138 Naples, Italy; (V.R.); (M.C.)
| | - Thomas H. Helbich
- Department of Biomedical Imaging and Image-Guided Therapy, Division of General and Pediatric Radiology, Medical University of Vienna, Waehringer Guertel 18-20, 1090 Wien, Austria
- Department of Biomedical Imaging and Image-guided Therapy, Division of Structural Preclinical Imaging, Medical University of Vienna, Waehringer Guertel 18-20, 1090 Wien, Austria
| | - Pascal A. T. Baltzer
- Department of Biomedical Imaging and Image-Guided Therapy, Division of General and Pediatric Radiology, Medical University of Vienna, Waehringer Guertel 18-20, 1090 Wien, Austria
| | - Katja Pinker
- Department of Radiology, Breast Imaging Service, Memorial Sloan Kettering Cancer Center, 300 E 66th Street, New York, NY 10065, USA
| |
Collapse
|
13
|
Zheng B, Chen Q. Novel model based on ultrasound predict axillary lymph node metastasis in breast cancer. BMC Med Imaging 2023; 23:135. [PMID: 37723421 PMCID: PMC10506204 DOI: 10.1186/s12880-023-01090-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2023] [Accepted: 08/29/2023] [Indexed: 09/20/2023] Open
Abstract
BACKGROUND Whether there is axillary lymph node metastasis is crucial for formulating the treatment plan for breast cancer. Currently, invasive methods are still used for preoperative evaluation of lymph nodes. If non-invasive preoperative evaluation can be achieved, it will effectively improve the treatment plan. OBJECTIVE Constructed a predict model based on ultrasound examination, which forest axillary lymph node metastasis in breast cancer, and validated this model. METHOD Patients admitted to Xiamen First Hospital from April 2018 to August 2021 with complete case data were included in this study. Patients who had undergone breast cancer resection and axillary lymph node dissection or sentinel lymph node biopsy were divided into a training and validation cohort in a 7:3 ratio. In the training cohort, patients were divided into metastatic and non-metastatic groups based on whether axillary lymph nodes had metastasis. The parameters of the two groups were compared, and statistically significant parameters were included in multivariate analysis. Then, a Nomogram model was constructed, named Lymph metastasis predict model (LMPM). Calibration curves, receiver operating curve (ROC), and decision curve analysis (DCA) were plotted between the training and validation cohort, calculate the risk score of each patient, identify the optimal cutoff value, and test the predictive efficacy of LMPM. RESULT Two hundred seventy-three patients were enrolled in final study, the average age 49.7 ± 8.7, training cohort included 191 patients, the diameter of breast cancer, the lymph node peak systolic flow velocity (LNPS) and the cortex area hilum ratio (CH) of lymph node were exist significant difference in metastatic and non-metastatic group. Multivariate analysis showed cancer diameter, LNPS and CH included in LMPM, the cutoff value was 95, the calibration curve, ROC, DCA in training and validation cohort show satisfactory result. CONCLUSION The predict model-LMPM, can predict axillary lymph node metastasis in breast cancer, which is useful for developing personalized treatment plans. However, further validation of the model is required by incorporating a larger number of patients.
Collapse
Affiliation(s)
- Biyu Zheng
- Department of Ultrasound, The First Affiliated Hospital of Xiamen University, School of Medicine, No. 55, Zhenhai Road, Siming District, Xiamen, Fujian, China.
| | - Qingshuang Chen
- Department of Ultrasound, The First Affiliated Hospital of Xiamen University, School of Medicine, No. 55, Zhenhai Road, Siming District, Xiamen, Fujian, China
| |
Collapse
|
14
|
Bian J, Wang X, Hao W, Zhang G, Wang Y. The differential diagnosis value of radiomics-based machine learning in Parkinson's disease: a systematic review and meta-analysis. Front Aging Neurosci 2023; 15:1199826. [PMID: 37484694 PMCID: PMC10357514 DOI: 10.3389/fnagi.2023.1199826] [Citation(s) in RCA: 14] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2023] [Accepted: 06/21/2023] [Indexed: 07/25/2023] Open
Abstract
Background In recent years, radiomics has been increasingly utilized for the differential diagnosis of Parkinson's disease (PD). However, the application of radiomics in PD diagnosis still lacks sufficient evidence-based support. To address this gap, we carried out a systematic review and meta-analysis to evaluate the diagnostic value of radiomics-based machine learning (ML) for PD. Methods We systematically searched Embase, Cochrane, PubMed, and Web of Science databases as of November 14, 2022. The radiomics quality assessment scale (RQS) was used to evaluate the quality of the included studies. The outcome measures were the c-index, which reflects the overall accuracy of the model, as well as sensitivity and specificity. During this meta-analysis, we discussed the differential diagnostic value of radiomics-based ML for Parkinson's disease and various atypical parkinsonism syndromes (APS). Results Twenty-eight articles with a total of 6,057 participants were included. The mean RQS score for all included articles was 10.64, with a relative score of 29.56%. The pooled c-index, sensitivity, and specificity of radiomics for predicting PD were 0.862 (95% CI: 0.833-0.891), 0.91 (95% CI: 0.86-0.94), and 0.93 (95% CI: 0.87-0.96) in the training set, and 0.871 (95% CI: 0.853-0.890), 0.86 (95% CI: 0.81-0.89), and 0.87 (95% CI: 0.83-0.91) in the validation set, respectively. Additionally, the pooled c-index, sensitivity, and specificity of radiomics for differentiating PD from APS were 0.866 (95% CI: 0.843-0.889), 0.86 (95% CI: 0.84-0.88), and 0.80 (95% CI: 0.75-0.84) in the training set, and 0.879 (95% CI: 0.854-0.903), 0.87 (95% CI: 0.85-0.89), and 0.82 (95% CI: 0.77-0.86) in the validation set, respectively. Conclusion Radiomics-based ML can serve as a potential tool for PD diagnosis. Moreover, it has an excellent performance in distinguishing Parkinson's disease from APS. The support vector machine (SVM) model exhibits excellent robustness when the number of samples is relatively abundant. However, due to the diverse implementation process of radiomics, it is expected that more large-scale, multi-class image data can be included to develop radiomics intelligent tools with broader applicability, promoting the application and development of radiomics in the diagnosis and prediction of Parkinson's disease and related fields. Systematic review registration https://www.crd.york.ac.uk/PROSPERO/display_record.php?RecordID=383197, identifier ID: CRD42022383197.
Collapse
Affiliation(s)
- Jiaxiang Bian
- School of Clinical Medicine, Weifang Medical University, Weifang, China
| | - Xiaoyang Wang
- School of Clinical Medicine, Weifang Medical University, Weifang, China
| | - Wei Hao
- School of Clinical Medicine, Weifang Medical University, Weifang, China
| | - Guangjian Zhang
- Department of Neurosurgery, Weifang People’s Hospital, Weifang, China
| | - Yuting Wang
- Department of Neurosurgery, Weifang People’s Hospital, Weifang, China
| |
Collapse
|
15
|
Zhong J, Lu J, Zhang G, Mao S, Chen H, Yin Q, Hu Y, Xing Y, Ding D, Ge X, Zhang H, Yao W. An overview of meta-analyses on radiomics: more evidence is needed to support clinical translation. Insights Imaging 2023; 14:111. [PMID: 37336830 DOI: 10.1186/s13244-023-01437-2] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2023] [Accepted: 04/14/2023] [Indexed: 06/21/2023] Open
Abstract
OBJECTIVE To conduct an overview of meta-analyses of radiomics studies assessing their study quality and evidence level. METHODS A systematical search was updated via peer-reviewed electronic databases, preprint servers, and systematic review protocol registers until 15 November 2022. Systematic reviews with meta-analysis of primary radiomics studies were included. Their reporting transparency, methodological quality, and risk of bias were assessed by PRISMA (Preferred Reporting Items for Systematic reviews and Meta-Analyses) 2020 checklist, AMSTAR-2 (A MeaSurement Tool to Assess systematic Reviews, version 2) tool, and ROBIS (Risk Of Bias In Systematic reviews) tool, respectively. The evidence level supporting the radiomics for clinical use was rated. RESULTS We identified 44 systematic reviews with meta-analyses on radiomics research. The mean ± standard deviation of PRISMA adherence rate was 65 ± 9%. The AMSTAR-2 tool rated 5 and 39 systematic reviews as low and critically low confidence, respectively. The ROBIS assessment resulted low, unclear and high risk in 5, 11, and 28 systematic reviews, respectively. We reperformed 53 meta-analyses in 38 included systematic reviews. There were 3, 7, and 43 meta-analyses rated as convincing, highly suggestive, and weak levels of evidence, respectively. The convincing level of evidence was rated in (1) T2-FLAIR radiomics for IDH-mutant vs IDH-wide type differentiation in low-grade glioma, (2) CT radiomics for COVID-19 vs other viral pneumonia differentiation, and (3) MRI radiomics for high-grade glioma vs brain metastasis differentiation. CONCLUSIONS The systematic reviews on radiomics were with suboptimal quality. A limited number of radiomics approaches were supported by convincing level of evidence. CLINICAL RELEVANCE STATEMENT The evidence supporting the clinical application of radiomics are insufficient, calling for researches translating radiomics from an academic tool to a practicable adjunct towards clinical deployment.
Collapse
Affiliation(s)
- Jingyu Zhong
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200336, China
| | - Junjie Lu
- Department of Social and Behavioral Sciences, Harvard T.H. Chan School of Public Health, Boston, MA, 02115, USA
| | - Guangcheng Zhang
- Department of Orthopedics, Shanghai Sixth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200233, China
| | - Shiqi Mao
- Department of Medical Oncology, Shanghai Pulmonary Hospital, Tongji University School of Medicine, Shanghai, 200433, China
| | - Haoda Chen
- Department of General Surgery, Pancreatic Disease Center, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200025, China
| | - Qian Yin
- Department of Pathology, Shanghai Sixth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200233, China
| | - Yangfan Hu
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200336, China
| | - Yue Xing
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200336, China
| | - Defang Ding
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200336, China
| | - Xiang Ge
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200336, China
| | - Huan Zhang
- Department of Radiology, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200025, China.
| | - Weiwu Yao
- Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, 200336, China.
| |
Collapse
|
16
|
Haraguchi T, Kobayashi Y, Hirahara D, Kobayashi T, Takaya E, Nagai MT, Tomita H, Okamoto J, Kanemaki Y, Tsugawa K. Radiomics model of diffusion-weighted whole-body imaging with background signal suppression (DWIBS) for predicting axillary lymph node status in breast cancer. JOURNAL OF X-RAY SCIENCE AND TECHNOLOGY 2023; 31:627-640. [PMID: 37038802 DOI: 10.3233/xst-230009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/16/2023]
Abstract
BACKGROUND In breast cancer diagnosis and treatment, non-invasive prediction of axillary lymph node (ALN) metastasis can help avoid complications related to sentinel lymph node biopsy. OBJECTIVE This study aims to develop and evaluate machine learning models using radiomics features extracted from diffusion-weighted whole-body imaging with background signal suppression (DWIBS) examination for predicting the ALN status. METHODS A total of 100 patients with histologically proven, invasive, clinically N0 breast cancer who underwent DWIBS examination consisting of short tau inversion recovery (STIR) and DWIBS sequences before surgery were enrolled. Radiomic features were calculated using segmented primary lesions in DWIBS and STIR sequences and were divided into training (n = 75) and test (n = 25) datasets based on the examination date. Using the training dataset, optimal feature selection was performed using the least absolute shrinkage and selection operator algorithm, and the logistic regression model and support vector machine (SVM) classifier model were constructed with DWIBS, STIR, or a combination of DWIBS and STIR sequences to predict ALN status. Receiver operating characteristic curves were used to assess the prediction performance of radiomics models. RESULTS For the test dataset, the logistic regression model using DWIBS, STIR, and a combination of both sequences yielded an area under the curve (AUC) of 0.765 (95% confidence interval: 0.548-0.982), 0.801 (0.597-1.000), and 0.779 (0.567-0.992), respectively, whereas the SVM classifier model using DWIBS, STIR, and a combination of both sequences yielded an AUC of 0.765 (0.548-0.982), 0.757 (0.538-0.977), and 0.779 (0.567-0.992), respectively. CONCLUSIONS Use of machine learning models incorporating with the quantitative radiomic features derived from the DWIBS and STIR sequences can potentially predict ALN status.
Collapse
Affiliation(s)
- Takafumi Haraguchi
- Department of Advanced Biomedical Imaging and Informatics, St. Marianna University School of Medicine, Sugao, Miyamae-ku, Kawasaki, Kanagawa, Japan
| | - Yasuyuki Kobayashi
- Department of Medical Information and Communication Technology Research, St. Marianna University School of Medicine, Sugao, Miyamae-ku, Kawasaki, Kanagawa, Japan
| | - Daisuke Hirahara
- Department of Medical Information and Communication Technology Research, St. Marianna University School of Medicine, Sugao, Miyamae-ku, Kawasaki, Kanagawa, Japan
- Department of AI Research Lab, Harada Academy, Higashitaniyama, Kagoshima, Kagoshima, Japan
| | - Tatsuaki Kobayashi
- Department of Medical Information and Communication Technology Research, St. Marianna University School of Medicine, Sugao, Miyamae-ku, Kawasaki, Kanagawa, Japan
| | - Eichi Takaya
- Department of Medical Information and Communication Technology Research, St. Marianna University School of Medicine, Sugao, Miyamae-ku, Kawasaki, Kanagawa, Japan
- AI Lab, Tohoku University Hospital, Seiryomachi, Aoba-ku, Sendai, Miyagi, Japan
- School of Science for Open and Environmental Systems, Graduate School of Science and Technology, Keio University, Hiyoshi, Kohoku-ku, Yokohama, Kanagawa, Japan
| | - Mariko Takishita Nagai
- Division of Breast and Endocrine Surgery, Department of Surgery, St. Marianna University School of Medicine, Sugao, Miyamae-ku, Kawasaki, Kanagawa, Japan
| | - Hayato Tomita
- Department of Radiology, St. Marianna University School of Medicine, Sugao, Miyamae-ku, Kawasaki, Kanagawa, Japan
| | - Jun Okamoto
- Department of Radiology, St. Marianna University School of Medicine, Sugao, Miyamae-ku, Kawasaki, Kanagawa, Japan
| | - Yoshihide Kanemaki
- Department of Radiology, Breast and Imaging Center, St. Marianna University School of Medicine, Manpukuji, Asao-ku, Kawasaki, Kanagawa, Japan
| | - Koichiro Tsugawa
- Division of Breast and Endocrine Surgery, Department of Surgery, St. Marianna University School of Medicine, Sugao, Miyamae-ku, Kawasaki, Kanagawa, Japan
| |
Collapse
|
17
|
Gong X, Guo Y, Zhu T, Peng X, Xing D, Zhang M. Diagnostic performance of radiomics in predicting axillary lymph node metastasis in breast cancer: A systematic review and meta-analysis. Front Oncol 2022; 12:1046005. [PMID: 36518318 PMCID: PMC9742555 DOI: 10.3389/fonc.2022.1046005] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2022] [Accepted: 11/11/2022] [Indexed: 10/03/2023] Open
Abstract
BACKGROUND This study aimed to perform a meta-analysis to evaluate the diagnostic performance of radiomics in predicting axillary lymph node metastasis (ALNM) and sentinel lymph node metastasis (SLNM) in breast cancer. MATERIALS AND METHODS Multiple electronic databases were systematically searched to identify relevant studies published before April 29, 2022: PubMed, Embase, Web of Science, Cochrane Library, China National Knowledge Infrastructure, and Wanfang Data. The quality of the included studies was assessed using the Quality Assessment of Diagnostic Accuracy Studies-2 tool. The overall diagnostic odds ratio (DOR), sensitivity, specificity, and area under the curve (AUC) were calculated to evaluate the diagnostic performance of radiomic features for lymph node metastasis (LNM) in patients with breast cancer. Spearman's correlation coefficient was determined to assess the threshold effect, and meta-regression and subgroup analyses were performed to explore the possible causes of heterogeneity. RESULTS A total of 30 studies with 5611 patients were included in the meta-analysis. Pooled estimates suggesting overall diagnostic accuracy of radiomics in detecting LNM were determined: DOR, 23 (95% CI, 16-33); sensitivity, 0.86 (95% CI, 0.82-0.88); specificity, 0.79 (95% CI, 0.73-0.84); and AUC, 0.90 (95% CI, 0.87-0.92). The meta-analysis showed significant heterogeneity between sensitivity and specificity across the included studies, with no evidence for a threshold effect. Meta-regression and subgroup analyses showed that combined clinical factors, modeling method, region, and imaging modality (magnetic resonance imaging [MRI], ultrasound, computed tomography [CT], and X-ray mammography [MMG]) contributed to the heterogeneity in the sensitivity analysis (P < 0.05). Furthermore, modeling methods, MRI, and MMG contributed to the heterogeneity in the specificity analysis (P < 0.05). CONCLUSION Our results show that radiomics has good diagnostic performance in predicting ALNM and SLNM in breast cancer. Thus, we propose this approach as a clinical method for the preoperative identification of LNM.
Collapse
Affiliation(s)
| | | | | | | | | | - Minguang Zhang
- Shanghai Municipal Hospital of Traditional Chinese Medicine, Shanghai University of Traditional Chinese Medicine, Shanghai, China
| |
Collapse
|
18
|
Gu H, Cui W, Luo S, Deng X. Diagnostic Performance of Diffusion Kurtosis Imaging for Benign and Malignant Breast Lesions: A Systematic Review and Meta-Analysis. Appl Bionics Biomech 2022; 2022:2042736. [PMID: 35721236 PMCID: PMC9203235 DOI: 10.1155/2022/2042736] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2022] [Revised: 05/09/2022] [Accepted: 05/12/2022] [Indexed: 11/21/2022] Open
Abstract
Purpose Magnetic resonance imaging (MRI) has a high sensitivity for differentiating between malignant and non-malignant breast lesions but is sometimes limited due to its low specificity. Here, we performed a meta-analysis to evaluate the diagnostic performance of mean kurtosis (MK) and mean diffusivity (MD) values in magnetic resonance diffusion kurtosis imaging (DKI) for benign and malignant breast lesions. Methods Original articles on relevant topics, published from 2010 to 2019, in PubMed, EMBASE, and WanFang databases were systematically reviewed. According to the purpose of the study and the characteristics of DKI reported, the diagnostic performances of MK and MD were evaluated, and meta-regression was conducted to explore the source of heterogeneity. Results Fourteen studies involving 1,099 (451 benign and 648 malignant) lesions were analyzed. The pooled sensitivity, pooled specificity, positive likelihood ratio, and negative likelihood ratio for MD were 0.84 (95% confidence interval (CI), 0.81-0.87), 0.83 (95% CI, 0.79-0.86), 4.44 (95% CI, 3.54-5.57), and 0.18 (95% CI, 0.13-0.26), while those for MK were 0.89 (95% CI, 0.86-0.91), 0.86 (95% CI, 0.82-0.89), 5.72 (95% CI, 4.26-7.69), and 0.13 (95% CI, 0.09-0.19), respectively. The overall area under the curve (AUC) was 0.91 for MD and 0.95 for MK. Conclusions Analysis of the data from 14 studies showed that MK had a higher pooled sensitivity, pooled specificity, and diagnostic performance for differentiating between breast lesions, compared with MD.
Collapse
Affiliation(s)
- Hongyu Gu
- Department of Radiology, Affiliated Aoyang Hospital of Jiangsu University, Jiangsu 215600, China
| | - Wenjing Cui
- Department of Radiology, Affiliated Hospital of Nanjing University of Chinese Medicine, Jiangsu 210029, China
| | - Song Luo
- Department of Diagnostic Radiology, Jinling Hospital, Medical School of Nanjing University, Nanjing, Jiangsu 210002, China
| | - Xiaoyi Deng
- Department of Radiology, Affiliated Aoyang Hospital of Jiangsu University, Jiangsu 215600, China
| |
Collapse
|