1
|
Dai X, Lu H, Wang X, Zhao B, Liu Z, Sun T, Gao F, Xie P, Yu H, Sui X. Development of ultrasound-based clinical, radiomics and deep learning fusion models for the diagnosis of benign and malignant soft tissue tumors. Front Oncol 2024; 14:1443029. [PMID: 39600644 PMCID: PMC11588752 DOI: 10.3389/fonc.2024.1443029] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2024] [Accepted: 10/16/2024] [Indexed: 11/29/2024] Open
Abstract
Objectives The aim of this study is to develop an ultrasound-based fusion model of clinical, radiomics and deep learning (CRDL) for accurate diagnosis of benign and malignant soft tissue tumors (STTs). Methods In this retrospective study, ultrasound images and clinical data of patients with STTs from two hospitals were collected between January 2021 and December 2023. Radiomics features and deep learning features were extracted from the ultrasound images, and the optimal features were selected to construct fusion models using support vector machines. The predictive performance of the model was evaluated based on three aspects: discrimination, calibration and clinical usefulness. The DeLong test was used to compare whether there was a significant difference in AUC between the models. Finally, two radiologists who were unaware of the clinical information performed an independent diagnosis and a model-assisted diagnosis of the tumor to compare the performance of the two diagnoses. Results A training cohort of 516 patients from Hospital-1 and an external validation cohort of 78 patients from Hospital-2 were included in the study. The Pre-FM CRDL showed the best performance in predicting STTs, with area under the curve (AUC) of 0.911 (95%CI: 0.894-0.928) and 0.948 (95%CI: 0.906-0.990) for training cohort and external validation cohort, respectively. The DeLong test showed that the Pre-FM CRDL significantly outperformed the clinical models (P< 0.05). In addition, the Pre-FM CRDL can improve the diagnostic accuracy of radiologists. Conclusion This study demonstrates the high clinical applicability of the fusion model in the differential diagnosis of STTs.
Collapse
Affiliation(s)
- Xinpeng Dai
- Third Hospital of Hebei Medical University, Shijiazhuang, China
| | - Haiyong Lu
- First Affiliated Hospital of Hebei North University, Zhangjiakou, Hebei, China
| | - Xinying Wang
- Third Hospital of Hebei Medical University, Shijiazhuang, China
| | - Bingxin Zhao
- Third Hospital of Hebei Medical University, Shijiazhuang, China
| | - Zongjie Liu
- Third Hospital of Hebei Medical University, Shijiazhuang, China
| | - Tao Sun
- Third Hospital of Hebei Medical University, Shijiazhuang, China
| | - Feng Gao
- Department of Pathology, The Third Hospital of Hebei Medical University, Shijiazhuang, Hebei, China
| | - Peng Xie
- Department of Nuclear Medicine, The Third Hospital of Hebei Medical University, Shijiazhuang, Hebei, China
| | - Hong Yu
- Third Hospital of Hebei Medical University, Shijiazhuang, China
| | - Xin Sui
- Third Hospital of Hebei Medical University, Shijiazhuang, China
| |
Collapse
|
2
|
Dai X, Zhao B, Zang J, Wang X, Liu Z, Sun T, Yu H, Sui X. Diagnostic Performance of Radiomics and Deep Learning to Identify Benign and Malignant Soft Tissue Tumors: A Systematic Review and Meta-analysis. Acad Radiol 2024; 31:3956-3967. [PMID: 38614826 DOI: 10.1016/j.acra.2024.03.033] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2024] [Revised: 03/24/2024] [Accepted: 03/24/2024] [Indexed: 04/15/2024]
Abstract
RATIONALE AND OBJECTIVES To systematically evaluate the application value of radiomics and deep learning (DL) in the differential diagnosis of benign and malignant soft tissue tumors (STTs). MATERIALS AND METHODS A systematic review was conducted on studies published up to December 11, 2023, that utilized radiomics and DL methods for the diagnosis of STTs. The methodological quality and risk of bias were evaluated using the Radiomics Quality Score (RQS) 2.0 system and Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2) tool, respectively. A bivariate random-effects model was used to calculate the summarized sensitivity and specificity. To identify factors contributing to heterogeneity, meta-regression and subgroup analyses were performed to assess the following covariates: diagnostic modality, region/volume of interest, imaging examination, study design, and pathology type. The asymmetry of Deeks' funnel plot was used to assess publication bias. RESULTS A total of 21 studies involving 3866 patients were included, with 13 studies using independent test/validation sets included in the quantitative statistical analysis. The average RQS was 21.31, with substantial or near-perfect inter-rater agreement. The combined sensitivity and specificity were 0.84 (95% CI: 0.76-0.89) and 0.88 (95% CI: 0.69-0.96), respectively. Meta-regression and subgroup analyses showed that study design and the region/volume of interest were significant factors affecting study heterogeneity (P < 0.05). No publication bias was observed. CONCLUSION Radiomics and DL can accurately distinguish between benign and malignant STTs. Future research should concentrate on enhancing the rigor of study designs, conducting multicenter prospective validations, amplifying the interpretability of DL models, and integrating multimodal data to elevate the diagnostic accuracy and clinical utility of soft tissue tumor assessments.
Collapse
Affiliation(s)
- Xinpeng Dai
- Department of Ultrasound, Hebei Medical University Third Hospital, Hebei, China
| | - Bingxin Zhao
- Department of Ultrasound, Hebei Medical University Third Hospital, Hebei, China
| | - Jiangnan Zang
- Hebei Medical University, Shijiazhuang, Hebei, China
| | - Xinying Wang
- Department of Ultrasound, Hebei Medical University Third Hospital, Hebei, China
| | - Zongjie Liu
- Department of Ultrasound, Hebei Medical University Third Hospital, Hebei, China
| | - Tao Sun
- Department of Orthopaedic Oncology, Hebei Medical University Third Hospital, Hebei, China
| | - Hong Yu
- Department of CT/MR, Hebei Medical University Third Hospital, Hebei, China
| | - Xin Sui
- Department of Ultrasound, Hebei Medical University Third Hospital, No.139 Ziqiang road, Qiaoxi Area, Shijiazhuang, Hebei Province, China.
| |
Collapse
|
3
|
Meyers SP, Hirad A, Gonzalez P, Bazarian JJ, Mirabelli MH, Rizzone KH, Ma HM, Rosella P, Totterman S, Schreyer E, Tamez-Pena JG. Clinical performance of a multiparametric MRI-based post concussive syndrome index. Front Neurol 2023; 14:1282833. [PMID: 38170071 PMCID: PMC10759224 DOI: 10.3389/fneur.2023.1282833] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2023] [Accepted: 12/01/2023] [Indexed: 01/05/2024] Open
Abstract
Introduction Diffusion Tensor Imaging (DTI) has revealed measurable changes in the brains of patients with persistent post-concussive syndrome (PCS). Because of inconsistent results in univariate DTI metrics among patients with mild traumatic brain injury (mTBI), there is currently no single objective and reliable MRI index for clinical decision-making in patients with PCS. Purpose This study aimed to evaluate the performance of a newly developed PCS Index (PCSI) derived from machine learning of multiparametric magnetic resonance imaging (MRI) data to classify and differentiate subjects with mTBI and PCS history from those without a history of mTBI. Materials and methods Data were retrospectively extracted from 139 patients aged between 18 and 60 years with PCS who underwent MRI examinations at 2 weeks to 1-year post-mTBI, as well as from 336 subjects without a history of head trauma. The performance of the PCS Index was assessed by comparing 69 patients with a clinical diagnosis of PCS with 264 control subjects. The PCSI values for patients with PCS were compared based on the mechanism of injury, time interval from injury to MRI examination, sex, history of prior concussion, loss of consciousness, and reported symptoms. Results Injured patients had a mean PCSI value of 0.57, compared to the control group, which had a mean PCSI value of 0.12 (p = 8.42e-23) with accuracy of 88%, sensitivity of 64%, and specificity of 95%, respectively. No statistically significant differences were found in the PCSI values when comparing the mechanism of injury, sex, or loss of consciousness. Conclusion The PCSI for individuals aged between 18 and 60 years was able to accurately identify patients with post-concussive injuries from 2 weeks to 1-year post-mTBI and differentiate them from the controls. The results of this study suggest that multiparametric MRI-based PCSI has great potential as an objective clinical tool to support the diagnosis, treatment, and follow-up care of patients with post-concussive syndrome. Further research is required to investigate the replicability of this method using other types of clinical MRI scanners.
Collapse
Affiliation(s)
- Steven P. Meyers
- Department of Imaging Sciences, University of Rochester School of Medicine and Dentistry, Rochester, NY, United States
| | - Adnan Hirad
- Department of Vascular Surgery, University of Rochester School of Medicine and Dentistry, Rochester, NY, United States
| | | | - Jeffrey J. Bazarian
- Departments of Emergency Medicine, Neurology, Neurosurgery, University of Rochester School of Medicine and Dentistry, Rochester, NY, United States
| | - Mark H. Mirabelli
- Department of Orthopedics, University of Rochester School of Medicine and Dentistry, Rochester, NY, United States
| | - Katherine H. Rizzone
- Department of Orthopedics, University of Rochester School of Medicine and Dentistry, Rochester, NY, United States
| | - Heather M. Ma
- Department of Physical Medicine and Rehabilitation, University of Rochester School of Medicine and Dentistry, Rochester, NY, United States
| | - Peter Rosella
- Department of Imaging Sciences, University of Rochester School of Medicine and Dentistry, Rochester, NY, United States
| | | | | | - Jose G. Tamez-Pena
- School of Medicine and Health Sciences, Tecnologico de Monterey, Monterrey, Mexico
| |
Collapse
|
4
|
Zhu YF, Li YS, Zhang Y, Liu YJ, Zhang YN, Tao J, Wang SW. Radiomics model based on intravoxel incoherent motion and diffusion kurtosis imaging for predicting histopathological grade and Ki-67 expression level of soft tissue sarcomas. Acta Radiol 2023; 64:2541-2551. [PMID: 37312501 DOI: 10.1177/02841851231179933] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
BACKGROUND Accurate identification of the histopathological grade and the Ki-67 expression level is important in clinical cases of soft tissue sarcomas (STSs). PURPOSE To explore the feasibility of a radiomics model based on intravoxel incoherent motion (IVIM) magnetic resonance imaging (MRI) and diffusion kurtosis imaging (DKI) MRI parameter maps in predicting the histopathological grade and Ki-67 expression level of STSs. MATERIAL AND METHODS In total, 42 patients diagnosed with STSs between May 2018 and January 2020 were selected. The MADC software in Functool of GE ADW 4.7 workstation was used to obtain standard apparent diffusion coefficient (ADC), D, D*, f, mean diffusivity, and mean kurtosis (MK). The histopathological grade and Ki-67 expression level of STSs were identified. The radiomics features of IVIM and DKI parameter maps were used as the dataset. The area under the receiver operating characteristic curve (AUC) and F1-score were calculated. RESULTS D-SVM achieved the best diagnostic performance for histopathological grade. The AUC in the validation cohort was 0.88 (sensitivity: 0.75 [low level] and 0.83 [high level]; specificity: 0.83 [low level] and 0.75 [high level]; F1-score: 0.75 [low level] and 0.83 [high level]). MK-SVM achieved the best diagnostic performance for Ki-67 expression level. The AUC in the validation cohort was 0.83 (sensitivity: 0.83 [low level] and 0.50 [high level; specificity: 0.50 [low level] and 0.83 [high level]; F1-score: 0.77 [low level] and 0.57 [high level]). CONCLUSION The proposed radiomics classifier could predict the pathological grade of STSs and the Ki-67 expression level in STSs.
Collapse
Affiliation(s)
- Yi-Feng Zhu
- Department of Radiology, The Second Hospital, Dalian Medical University, Dalian, PR China
| | - Yu-Shi Li
- Department of Radiology, The Second Hospital, Dalian Medical University, Dalian, PR China
| | - Yu Zhang
- Department of Medical Imaging, Cancer Hospital of China Medical University, Liaoning Cancer Hospital & Institute, Shenyang, PR China
| | - Ya-Jie Liu
- Department of Radiology, The Second Hospital, Dalian Medical University, Dalian, PR China
| | - Yi-Ni Zhang
- Department of Pathology, The Second Hospital, Dalian Medical University, Dalian, PR China
| | - Juan Tao
- Department of Pathology, The Second Hospital, Dalian Medical University, Dalian, PR China
| | - Shao-Wu Wang
- Department of Radiology, The Second Hospital, Dalian Medical University, Dalian, PR China
| |
Collapse
|