2
|
Zhang J, Xia L, Tang J, Xia J, Liu Y, Zhang W, Liu J, Liang Z, Zhang X, Zhang L, Tang G. Constructing a Deep Learning Radiomics Model Based on X-ray Images and Clinical Data for Predicting and Distinguishing Acute and Chronic Osteoporotic Vertebral Fractures: A Multicenter Study. Acad Radiol 2024; 31:2011-2026. [PMID: 38016821 DOI: 10.1016/j.acra.2023.10.061] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2023] [Revised: 09/13/2023] [Accepted: 10/31/2023] [Indexed: 11/30/2023]
Abstract
RATIONALE AND OBJECTIVES To construct and validate a deep learning radiomics (DLR) model based on X-ray images for predicting and distinguishing acute and chronic osteoporotic vertebral fractures (OVFs). METHODS A total of 942 cases (1076 vertebral bodies) with both vertebral X-ray examination and MRI scans were included in this study from three hospitals. They were divided into a training cohort (n = 712), an internal validation cohort (n = 178), an external validation cohort (n = 111), and a prospective validation cohort (n = 75). The ResNet-50 model architecture was used for deep transfer learning (DTL), with pre-training performed on RadImageNet and ImageNet datasets. DTL features and radiomics features were extracted from lateral X-ray images of OVFs patients and fused together. A logistic regression model with the least absolute shrinkage and selection operator was established, with MRI showing bone marrow edema as the gold standard for acute OVFs. The performance of the model was evaluated using receiver operating characteristic curves. Eight machine learning classification models were evaluated for their ability to distinguish between acute and chronic OVFs. The Nomogram was constructed by combining clinical baseline data to achieve visualized classification assessment. The predictive performance of the best RadImageNet model and ImageNet model was compared using the Delong test. The clinical value of the Nomogram was evaluated using decision curve analysis (DCA). RESULTS Pre-training resulted in 34 and 39 fused features after feature selection and fusion. The most effective machine learning algorithm in both DLR models was Light Gradient Boosting Machine. Using the Delong test, the area under the curve (AUC) for distinguishing between acute and chronic OVFs in the training cohort was 0.979 and 0.972 for the RadImageNet and ImageNet models, respectively, with no statistically significant difference between them (P = 0.235). In the internal validation cohort, external validation cohort, and prospective validation cohort, the AUCs for the two models were 0.967 vs 0.629, 0.886 vs 0.817, and 0.933 vs 0.661, respectively, with statistically significant differences in all comparisons (P < 0.05). The deep learning radiomics nomogram (DLRN) was constructed by combining the predictive model of RadImageNet with clinical baseline features, resulting in AUCs of 0.981, 0.974, 0.895, and 0.902 in the training cohort, internal validation cohort, external validation cohort, and prospective validation cohort, respectively. Using the Delong test, the AUCs for the fused feature model and the DLRN in the training cohort were 0.979 and 0.981, respectively, with no statistically significant difference between them (P = 0.169). In the internal validation cohort, external validation cohort, and prospective validation cohort, the AUCs for the two models were 0.967 vs 0.974, 0.886 vs 0.895, and 0.933 vs 0.902, respectively, with statistically significant differences in all comparisons (P < 0.05). The Nomogram showed a slight improvement in predictive performance in the internal and external validation cohort, but a slight decrease in the prospective validation cohort (0.933 vs 0.902). DCA showed that the Nomogram provided more benefits to patients compared to the DLR models. CONCLUSION Compared to the ImageNet model, the RadImageNet model has higher diagnostic value in distinguishing between acute and chronic OVFs. Furthermore, the diagnostic performance of the model is further improved when combined with clinical baseline features to construct the Nomogram.
Collapse
Affiliation(s)
- Jun Zhang
- Department of Radiology, Shanghai Tenth People's Hospital, Clinical Medical College of Nanjing Medical University, 301 Middle Yanchang Road, Shanghai, 200072, PR China (J.Z., G.T.); Department of Radiology, Sir RunRun Hospital affiliated to Nanjing Medical University, 109 Longmian Road, Nanjing, Jiangsu, 211002, PR China (J.Z., L.X., W.Z., J.L., Z.L.)
| | - Liang Xia
- Department of Radiology, Sir RunRun Hospital affiliated to Nanjing Medical University, 109 Longmian Road, Nanjing, Jiangsu, 211002, PR China (J.Z., L.X., W.Z., J.L., Z.L.)
| | - Jun Tang
- Department of Radiology, The Affiliated Taizhou People's Hospital of Nanjing Medical University, 366 Taihu Road, Taizhou, Jiangsu, 225300, PR China (J.T., J.X.)
| | - Jianguo Xia
- Department of Radiology, The Affiliated Taizhou People's Hospital of Nanjing Medical University, 366 Taihu Road, Taizhou, Jiangsu, 225300, PR China (J.T., J.X.)
| | - Yongkang Liu
- Department of Radiology, The Affiliated Hospital of Nanjing University of Chinese Medicine, 155 Hanzhong Road, Nanjing, Jiangsu, 210004, PR China (Y.L.)
| | - Weixiao Zhang
- Department of Radiology, Sir RunRun Hospital affiliated to Nanjing Medical University, 109 Longmian Road, Nanjing, Jiangsu, 211002, PR China (J.Z., L.X., W.Z., J.L., Z.L.)
| | - Jiayi Liu
- Department of Radiology, Sir RunRun Hospital affiliated to Nanjing Medical University, 109 Longmian Road, Nanjing, Jiangsu, 211002, PR China (J.Z., L.X., W.Z., J.L., Z.L.)
| | - Zhipeng Liang
- Department of Radiology, Sir RunRun Hospital affiliated to Nanjing Medical University, 109 Longmian Road, Nanjing, Jiangsu, 211002, PR China (J.Z., L.X., W.Z., J.L., Z.L.)
| | - Xueli Zhang
- Department of Radiology, Shanghai Tenth People's Hospital, Tongji University School of Medicine, 301 Middle Yanchang Road, Shanghai, 200072, PR China (X.Z., L.Z., G.T.)
| | - Lin Zhang
- Department of Radiology, Shanghai Tenth People's Hospital, Tongji University School of Medicine, 301 Middle Yanchang Road, Shanghai, 200072, PR China (X.Z., L.Z., G.T.).
| | - Guangyu Tang
- Department of Radiology, Shanghai Tenth People's Hospital, Clinical Medical College of Nanjing Medical University, 301 Middle Yanchang Road, Shanghai, 200072, PR China (J.Z., G.T.); Department of Radiology, Shanghai Tenth People's Hospital, Tongji University School of Medicine, 301 Middle Yanchang Road, Shanghai, 200072, PR China (X.Z., L.Z., G.T.)
| |
Collapse
|
9
|
Kim AY, Yoon MA, Ham SJ, Cho YC, Ko Y, Park B, Kim S, Lee E, Lee RW, Chee CG, Lee MH, Lee SH, Chung HW. Prediction of the Acuity of Vertebral Compression Fractures on CT Using Radiologic and Radiomic Features. Acad Radiol 2022; 29:1512-1520. [PMID: 34998683 DOI: 10.1016/j.acra.2021.12.008] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/18/2021] [Revised: 12/08/2021] [Accepted: 12/08/2021] [Indexed: 12/14/2022]
Abstract
RATIONALE AND OBJECTIVES To develop and validate prediction models to differentiate acute and chronic vertebral compression fractures based on radiologic and radiomic features on CT. MATERIALS AND METHODS This study included acute and chronic compression fractures in patients who underwent both spine CT and MRI examinations. For each fractured vertebra, three CT findings ([1] cortical disruption, [2] hypoattenuating cleft or sclerotic line, and [3] relative bone marrow attenuation) were assessed by two radiologists. A radiomic score was built from 280 radiomic features extracted from non-contrast-enhanced CT images. Weighted multivariable logistic regression analysis was performed to build a radiologic model based on CT findings and an integrated model combining the radiomic score and CT findings. Model performance was evaluated and compared. Models were externally validated using an independent test cohort. RESULTS A total to 238 fractures (159 acute and 79 chronic) in 122 patients and 58 fractures (39 acute and 19 chronic) in 32 patients were included in the training and test cohorts, respectively. The AUC of the radiomic score was 0.95 in the training and 0.93 in the test cohorts. The AUC of the radiologic model was 0.89 in the training and 0.83 in the test cohorts. The discriminatory performance of the integrated model was significantly higher than the radiologic model in both the training (AUC, 0.97; p<0.01) and the test (AUC, 0.95; p=0.01) cohorts. CONCLUSION Combining radiomics with radiologic findings significantly improved the performance of CT in determining the acuity of vertebral compression fractures.
Collapse
Affiliation(s)
- A Yeon Kim
- Department of Radiology and Research Institute of Radiology (A.Y.K., M.A.Y., S.J.H., C.G.C., M.H.L., S.H.L., H.W.C.), University of Ulsan College of Medicine, Asan Medical Center, 88 Olympic-ro 43-gil, Songpa-gu, Seoul 05505, Korea; Biomedical Research Center (Y.C.C., Y.K.), Asan Institute for Life Sciences, Asan Medical Center, Songpa-gu, Seoul, Korea; Health Innovation Big Data Center (B.P.), Asan Institute for Life Sciences, Asan Medical Center, Songpa-gu, Seoul, Korea; Department of Clinical Epidemiology and Biostatistics (S.K.), Asan Medical Center, Songpa-gu, Seoul, Korea; Department of Radiology (E.L.), Seoul National University Bundang Hospital, Seongnam-si, Gyeonggi-do, Korea; Department of Radiology (R.W.L.), Inha University Hospital, Jung-gu, Incheon, Korea
| | - Min A Yoon
- Department of Radiology and Research Institute of Radiology (A.Y.K., M.A.Y., S.J.H., C.G.C., M.H.L., S.H.L., H.W.C.), University of Ulsan College of Medicine, Asan Medical Center, 88 Olympic-ro 43-gil, Songpa-gu, Seoul 05505, Korea; Biomedical Research Center (Y.C.C., Y.K.), Asan Institute for Life Sciences, Asan Medical Center, Songpa-gu, Seoul, Korea; Health Innovation Big Data Center (B.P.), Asan Institute for Life Sciences, Asan Medical Center, Songpa-gu, Seoul, Korea; Department of Clinical Epidemiology and Biostatistics (S.K.), Asan Medical Center, Songpa-gu, Seoul, Korea; Department of Radiology (E.L.), Seoul National University Bundang Hospital, Seongnam-si, Gyeonggi-do, Korea; Department of Radiology (R.W.L.), Inha University Hospital, Jung-gu, Incheon, Korea.
| | - Su Jung Ham
- Department of Radiology and Research Institute of Radiology (A.Y.K., M.A.Y., S.J.H., C.G.C., M.H.L., S.H.L., H.W.C.), University of Ulsan College of Medicine, Asan Medical Center, 88 Olympic-ro 43-gil, Songpa-gu, Seoul 05505, Korea; Biomedical Research Center (Y.C.C., Y.K.), Asan Institute for Life Sciences, Asan Medical Center, Songpa-gu, Seoul, Korea; Health Innovation Big Data Center (B.P.), Asan Institute for Life Sciences, Asan Medical Center, Songpa-gu, Seoul, Korea; Department of Clinical Epidemiology and Biostatistics (S.K.), Asan Medical Center, Songpa-gu, Seoul, Korea; Department of Radiology (E.L.), Seoul National University Bundang Hospital, Seongnam-si, Gyeonggi-do, Korea; Department of Radiology (R.W.L.), Inha University Hospital, Jung-gu, Incheon, Korea
| | - Young Chul Cho
- Department of Radiology and Research Institute of Radiology (A.Y.K., M.A.Y., S.J.H., C.G.C., M.H.L., S.H.L., H.W.C.), University of Ulsan College of Medicine, Asan Medical Center, 88 Olympic-ro 43-gil, Songpa-gu, Seoul 05505, Korea; Biomedical Research Center (Y.C.C., Y.K.), Asan Institute for Life Sciences, Asan Medical Center, Songpa-gu, Seoul, Korea; Health Innovation Big Data Center (B.P.), Asan Institute for Life Sciences, Asan Medical Center, Songpa-gu, Seoul, Korea; Department of Clinical Epidemiology and Biostatistics (S.K.), Asan Medical Center, Songpa-gu, Seoul, Korea; Department of Radiology (E.L.), Seoul National University Bundang Hospital, Seongnam-si, Gyeonggi-do, Korea; Department of Radiology (R.W.L.), Inha University Hospital, Jung-gu, Incheon, Korea
| | - Yousun Ko
- Department of Radiology and Research Institute of Radiology (A.Y.K., M.A.Y., S.J.H., C.G.C., M.H.L., S.H.L., H.W.C.), University of Ulsan College of Medicine, Asan Medical Center, 88 Olympic-ro 43-gil, Songpa-gu, Seoul 05505, Korea; Biomedical Research Center (Y.C.C., Y.K.), Asan Institute for Life Sciences, Asan Medical Center, Songpa-gu, Seoul, Korea; Health Innovation Big Data Center (B.P.), Asan Institute for Life Sciences, Asan Medical Center, Songpa-gu, Seoul, Korea; Department of Clinical Epidemiology and Biostatistics (S.K.), Asan Medical Center, Songpa-gu, Seoul, Korea; Department of Radiology (E.L.), Seoul National University Bundang Hospital, Seongnam-si, Gyeonggi-do, Korea; Department of Radiology (R.W.L.), Inha University Hospital, Jung-gu, Incheon, Korea
| | - Bumwoo Park
- Department of Radiology and Research Institute of Radiology (A.Y.K., M.A.Y., S.J.H., C.G.C., M.H.L., S.H.L., H.W.C.), University of Ulsan College of Medicine, Asan Medical Center, 88 Olympic-ro 43-gil, Songpa-gu, Seoul 05505, Korea; Biomedical Research Center (Y.C.C., Y.K.), Asan Institute for Life Sciences, Asan Medical Center, Songpa-gu, Seoul, Korea; Health Innovation Big Data Center (B.P.), Asan Institute for Life Sciences, Asan Medical Center, Songpa-gu, Seoul, Korea; Department of Clinical Epidemiology and Biostatistics (S.K.), Asan Medical Center, Songpa-gu, Seoul, Korea; Department of Radiology (E.L.), Seoul National University Bundang Hospital, Seongnam-si, Gyeonggi-do, Korea; Department of Radiology (R.W.L.), Inha University Hospital, Jung-gu, Incheon, Korea
| | - Seonok Kim
- Department of Radiology and Research Institute of Radiology (A.Y.K., M.A.Y., S.J.H., C.G.C., M.H.L., S.H.L., H.W.C.), University of Ulsan College of Medicine, Asan Medical Center, 88 Olympic-ro 43-gil, Songpa-gu, Seoul 05505, Korea; Biomedical Research Center (Y.C.C., Y.K.), Asan Institute for Life Sciences, Asan Medical Center, Songpa-gu, Seoul, Korea; Health Innovation Big Data Center (B.P.), Asan Institute for Life Sciences, Asan Medical Center, Songpa-gu, Seoul, Korea; Department of Clinical Epidemiology and Biostatistics (S.K.), Asan Medical Center, Songpa-gu, Seoul, Korea; Department of Radiology (E.L.), Seoul National University Bundang Hospital, Seongnam-si, Gyeonggi-do, Korea; Department of Radiology (R.W.L.), Inha University Hospital, Jung-gu, Incheon, Korea
| | - Eugene Lee
- Department of Radiology and Research Institute of Radiology (A.Y.K., M.A.Y., S.J.H., C.G.C., M.H.L., S.H.L., H.W.C.), University of Ulsan College of Medicine, Asan Medical Center, 88 Olympic-ro 43-gil, Songpa-gu, Seoul 05505, Korea; Biomedical Research Center (Y.C.C., Y.K.), Asan Institute for Life Sciences, Asan Medical Center, Songpa-gu, Seoul, Korea; Health Innovation Big Data Center (B.P.), Asan Institute for Life Sciences, Asan Medical Center, Songpa-gu, Seoul, Korea; Department of Clinical Epidemiology and Biostatistics (S.K.), Asan Medical Center, Songpa-gu, Seoul, Korea; Department of Radiology (E.L.), Seoul National University Bundang Hospital, Seongnam-si, Gyeonggi-do, Korea; Department of Radiology (R.W.L.), Inha University Hospital, Jung-gu, Incheon, Korea
| | - Ro Woon Lee
- Department of Radiology and Research Institute of Radiology (A.Y.K., M.A.Y., S.J.H., C.G.C., M.H.L., S.H.L., H.W.C.), University of Ulsan College of Medicine, Asan Medical Center, 88 Olympic-ro 43-gil, Songpa-gu, Seoul 05505, Korea; Biomedical Research Center (Y.C.C., Y.K.), Asan Institute for Life Sciences, Asan Medical Center, Songpa-gu, Seoul, Korea; Health Innovation Big Data Center (B.P.), Asan Institute for Life Sciences, Asan Medical Center, Songpa-gu, Seoul, Korea; Department of Clinical Epidemiology and Biostatistics (S.K.), Asan Medical Center, Songpa-gu, Seoul, Korea; Department of Radiology (E.L.), Seoul National University Bundang Hospital, Seongnam-si, Gyeonggi-do, Korea; Department of Radiology (R.W.L.), Inha University Hospital, Jung-gu, Incheon, Korea
| | - Choong Guen Chee
- Department of Radiology and Research Institute of Radiology (A.Y.K., M.A.Y., S.J.H., C.G.C., M.H.L., S.H.L., H.W.C.), University of Ulsan College of Medicine, Asan Medical Center, 88 Olympic-ro 43-gil, Songpa-gu, Seoul 05505, Korea; Biomedical Research Center (Y.C.C., Y.K.), Asan Institute for Life Sciences, Asan Medical Center, Songpa-gu, Seoul, Korea; Health Innovation Big Data Center (B.P.), Asan Institute for Life Sciences, Asan Medical Center, Songpa-gu, Seoul, Korea; Department of Clinical Epidemiology and Biostatistics (S.K.), Asan Medical Center, Songpa-gu, Seoul, Korea; Department of Radiology (E.L.), Seoul National University Bundang Hospital, Seongnam-si, Gyeonggi-do, Korea; Department of Radiology (R.W.L.), Inha University Hospital, Jung-gu, Incheon, Korea
| | - Min Hee Lee
- Department of Radiology and Research Institute of Radiology (A.Y.K., M.A.Y., S.J.H., C.G.C., M.H.L., S.H.L., H.W.C.), University of Ulsan College of Medicine, Asan Medical Center, 88 Olympic-ro 43-gil, Songpa-gu, Seoul 05505, Korea; Biomedical Research Center (Y.C.C., Y.K.), Asan Institute for Life Sciences, Asan Medical Center, Songpa-gu, Seoul, Korea; Health Innovation Big Data Center (B.P.), Asan Institute for Life Sciences, Asan Medical Center, Songpa-gu, Seoul, Korea; Department of Clinical Epidemiology and Biostatistics (S.K.), Asan Medical Center, Songpa-gu, Seoul, Korea; Department of Radiology (E.L.), Seoul National University Bundang Hospital, Seongnam-si, Gyeonggi-do, Korea; Department of Radiology (R.W.L.), Inha University Hospital, Jung-gu, Incheon, Korea
| | - Sang Hoon Lee
- Department of Radiology and Research Institute of Radiology (A.Y.K., M.A.Y., S.J.H., C.G.C., M.H.L., S.H.L., H.W.C.), University of Ulsan College of Medicine, Asan Medical Center, 88 Olympic-ro 43-gil, Songpa-gu, Seoul 05505, Korea; Biomedical Research Center (Y.C.C., Y.K.), Asan Institute for Life Sciences, Asan Medical Center, Songpa-gu, Seoul, Korea; Health Innovation Big Data Center (B.P.), Asan Institute for Life Sciences, Asan Medical Center, Songpa-gu, Seoul, Korea; Department of Clinical Epidemiology and Biostatistics (S.K.), Asan Medical Center, Songpa-gu, Seoul, Korea; Department of Radiology (E.L.), Seoul National University Bundang Hospital, Seongnam-si, Gyeonggi-do, Korea; Department of Radiology (R.W.L.), Inha University Hospital, Jung-gu, Incheon, Korea
| | - Hye Won Chung
- Department of Radiology and Research Institute of Radiology (A.Y.K., M.A.Y., S.J.H., C.G.C., M.H.L., S.H.L., H.W.C.), University of Ulsan College of Medicine, Asan Medical Center, 88 Olympic-ro 43-gil, Songpa-gu, Seoul 05505, Korea; Biomedical Research Center (Y.C.C., Y.K.), Asan Institute for Life Sciences, Asan Medical Center, Songpa-gu, Seoul, Korea; Health Innovation Big Data Center (B.P.), Asan Institute for Life Sciences, Asan Medical Center, Songpa-gu, Seoul, Korea; Department of Clinical Epidemiology and Biostatistics (S.K.), Asan Medical Center, Songpa-gu, Seoul, Korea; Department of Radiology (E.L.), Seoul National University Bundang Hospital, Seongnam-si, Gyeonggi-do, Korea; Department of Radiology (R.W.L.), Inha University Hospital, Jung-gu, Incheon, Korea
| |
Collapse
|