1
|
Zhao Q, Guo S, Zhang Y, Zhou J, Zhou P. Multimodal ultrasound radiomics model combined with clinical model for differentiating follicular thyroid adenoma from carcinoma. BMC Med Imaging 2025; 25:152. [PMID: 40325381 PMCID: PMC12054042 DOI: 10.1186/s12880-025-01685-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/10/2024] [Accepted: 04/21/2025] [Indexed: 05/07/2025] Open
Abstract
OBJECTIVE This study aimed to develop a nomogram integrating radiomics features derived from contrast-enhanced ultrasound (CEUS) and B-mode ultrasound (B-US) with clinical features to improve preoperative differentiation between follicular thyroid carcinoma (FTC) and follicular thyroid adenoma (FTA). Accurate preoperative diagnosis is critical for guiding appropriate treatment strategies and reducing unnecessary interventions. METHODS We retrospectively included 201 patients with histopathologically confirmed FTC (n = 133) or FTA (n = 68). Radiomics features were extracted from B-US and CEUS images, followed by feature selection and machine-learning model development. Five models were evaluated, and the one with the highest area under the curve (AUC) was used to construct a radiomics signature. A Clinical Risk model was developed using statistically significant clinical features, which outperformed the conventional Chinese Thyroid Imaging Reporting and Data System (C-TIRADS) in both training and test groups. The radiomics signature and Clinical Risk model were integrated into a nomogram, whose diagnostic performance, calibration and clinical utility were assessed. RESULTS The Clinical Risk model achieved superior diagnostic performance compared to the C-TIRADS model, with AUCs of 0.802 vs. 0.719 in the training group and 0.745 vs. 0.703 in the test group. The nomogram further improved diagnostic efficacy, with AUCs of 0.867 (95% CI, 0.800-0.933) in the training group and 0.833 (95% CI, 0.729-0.937) in the test group. It also demonstrated excellent calibration. Decision curve analysis (DCA) also indicated that the nomogram showed good clinical utility. CONCLUSION By combining CEUS and B-US radiomics features with clinical data, we developed a robust nomogram for distinguishing FTC from FTA. The model demonstrated superior diagnostic performance compared to existing methods and holds promise for enhancing clinical decision-making in thyroid nodule management. CLINICAL TRIAL NUMBER Not applicable.
Collapse
Affiliation(s)
- Qianqian Zhao
- Department of Ultrasound, The Third Xiangya Hospital, Central South University, NO. 138, Tongzipo Road Yuelu District, Changsha, Hunan Province, 410013, China
| | - Shiyan Guo
- Department of Ultrasound, The Third Xiangya Hospital, Central South University, NO. 138, Tongzipo Road Yuelu District, Changsha, Hunan Province, 410013, China
| | - Yan Zhang
- Department of Ultrasound, The Third Xiangya Hospital, Central South University, NO. 138, Tongzipo Road Yuelu District, Changsha, Hunan Province, 410013, China
| | - Jinguang Zhou
- Department of Ultrasound, The Third Xiangya Hospital, Central South University, NO. 138, Tongzipo Road Yuelu District, Changsha, Hunan Province, 410013, China
| | - Ping Zhou
- Department of Ultrasound, The Third Xiangya Hospital, Central South University, NO. 138, Tongzipo Road Yuelu District, Changsha, Hunan Province, 410013, China.
| |
Collapse
|
2
|
Deng Y, Zeng Q, Zhao Y, Hu Z, Zhan C, Guo L, Lai B, Huang Z, Fu Z, Zhang C. Model Based on Ultrasound Radiomics and Machine Learning to Preoperative Differentiation of Follicular Thyroid Neoplasm. JOURNAL OF ULTRASOUND IN MEDICINE : OFFICIAL JOURNAL OF THE AMERICAN INSTITUTE OF ULTRASOUND IN MEDICINE 2025; 44:567-579. [PMID: 39555618 DOI: 10.1002/jum.16620] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/29/2024] [Revised: 10/03/2024] [Accepted: 11/03/2024] [Indexed: 11/19/2024]
Abstract
OBJECTIVES To evaluate the value of radiomics based on ultrasonography in differentiating follicular thyroid carcinoma (FTC) and follicular thyroid adenoma (FTA) and construct a tool for preoperative noninvasive predicting FTC and FTA. METHODS The clinical data and ultrasound images of 389 patients diagnosed with FTC or FTA postoperatively were retrospectively analyzed at 3 institutions from January 2017 to December 2023. Patients in our hospital were randomly assigned in a 7:3 ratio to training cohort and validation cohort. External test cohort consisted of data collected from other 2 hospitals. Radiomics features were used to develop models based on different machine learning classifiers. A combined model was developed combining radiomics features with clinical characteristics and a nomogram was depicted. The performance of the models was assessed by area under the receiver operating characteristic curve (AUC), calibration curve and decision curve. RESULTS Radiomics model based on random forest showed best performance in discriminating FTC and FTA, with AUCs 0.880 (95% confidence interval [CI]: 0.8290-0.9308), 0.871 (95% CI: 0.7690-0.9734), and 0.821 (95% CI: 0.7036-0.9389) in training, validation, and test cohort, respectively. The combined model presented better efficacy comparing with clinical model and radiomics model, with AUCs 0.883 (95% CI: 0.8359-0.9295), 0.874 (95% CI: 0.7873-0.9615), and 0.876 (0.7809-0.9714) in training, validation, and test cohort, respectively. The calibration curves suggested good consistency and decision curves showed the highest overall clinical benefit for the combined model. CONCLUSIONS Ultrasound radiomics model based on random forest is feasible to differentiate FTC and FTA, and the combined model is an intuitively noninvasive tool for FTC and FTA preoperative identification.
Collapse
Affiliation(s)
- Yiwen Deng
- Department of Ultrasound, The Second Affiliated Hospital, Jiangxi Medical College, Nanchang University, Nanchang, China
| | - Qiao Zeng
- Department of Radiology, Jiangxi Cancer Hospital & Institute, Jiangxi Clinical Research Center for Cancer, The Second Affiliated Hospital of Nanchang Medical College, Nanchang, China
| | - Yu Zhao
- Department of Ultrasound, The Second Affiliated Hospital, Jiangxi Medical College, Nanchang University, Nanchang, China
| | - Zhen Hu
- Department of Ultrasound, The Second Affiliated Hospital, Jiangxi Medical College, Nanchang University, Nanchang, China
| | - Changmiao Zhan
- Department of Ultrasound, The Second Affiliated Hospital, Jiangxi Medical College, Nanchang University, Nanchang, China
| | - Liangyun Guo
- Department of Ultrasound, The Second Affiliated Hospital, Jiangxi Medical College, Nanchang University, Nanchang, China
| | - Binghuang Lai
- Department of Ultrasound, Ganzhou People's Hospital, Ganzhou, China
| | - Zhiping Huang
- Department of Ultrasound, Ganzhou People's Hospital, Ganzhou, China
| | - Zhiyong Fu
- Department of Ultrasound, Jiangxi Cancer Hospital & Institute, Jiangxi Clinical Research Center for Cancer, The Second Affiliated Hospital of Nanchang Medical College, Nanchang, China
| | - Chunquan Zhang
- Department of Ultrasound, The Second Affiliated Hospital, Jiangxi Medical College, Nanchang University, Nanchang, China
| |
Collapse
|
3
|
Yang L, Wang X, Zhang S, Cao K, Yang J. Research progress on artificial intelligence technology-assisted diagnosis of thyroid diseases. Front Oncol 2025; 15:1536039. [PMID: 40052126 PMCID: PMC11882420 DOI: 10.3389/fonc.2025.1536039] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2024] [Accepted: 01/31/2025] [Indexed: 03/09/2025] Open
Abstract
With the rapid development of the "Internet + Medical" model, artificial intelligence technology has been widely used in the analysis of medical images. Among them, the technology of using deep learning algorithms to identify features of ultrasound and pathological images and realize intelligent diagnosis of diseases has entered the clinical verification stage. This study is based on the application research of artificial intelligence technology in medical diagnosis and reviews the early screening and diagnosis of thyroid diseases. The cure rate of thyroid disease is high in the early stage, but once it deteriorates into thyroid cancer, the risk of death and treatment costs of the patient increase. At present, the early diagnosis of the disease still depends on the examination equipment and the clinical experience of doctors, and there is a certain misdiagnosis rate. Based on the above background, it is particularly important to explore a technology that can achieve objective screening of thyroid lesions in the early stages. This paper provides a comprehensive review of recent research on the early diagnosis of thyroid diseases using artificial intelligence technology. It integrates the findings of multiple studies and that traditional machine learning algorithms are widely used as research objects. The convolutional neural network model has a high recognition accuracy for thyroid nodules and thyroid pathological cell lesions. U-Net network model can significantly improve the recognition accuracy of thyroid nodule ultrasound images when used as a segmentation algorithm. This article focuses on reviewing the intelligent recognition technology of thyroid ultrasound images and pathological sections, hoping to provide researchers with research ideas and help clinicians achieve intelligent early screening of thyroid cancer.
Collapse
Affiliation(s)
- Lina Yang
- Development Department of the Wisdom Hospital, Shandong Provincial Third Hospital, Jinan, China
| | - XinYuan Wang
- Information Department, Shandong First Rehabilitation Hospital, Linyi, China
| | - Shixia Zhang
- Development Department of the Wisdom Hospital, Shandong Provincial Third Hospital, Jinan, China
| | - Kun Cao
- Development Department of the Wisdom Hospital, Shandong Provincial Third Hospital, Jinan, China
| | - Jianjun Yang
- General Practice Medicine, Shandong Provincial Third Hospital, Jinan, China
| |
Collapse
|
4
|
Shan R, Li X, Chen J, Chen Z, Cheng YJ, Han B, Hu RZ, Huang JP, Kong GL, Liu H, Mei F, Song SB, Sun BK, Tian H, Wang Y, Xiao WC, Yao XY, Ye JM, Yu B, Yuan CH, Zhang F, Liu Z. Interpretable Machine Learning to Predict the Malignancy Risk of Follicular Thyroid Neoplasms in Extremely Unbalanced Data: Retrospective Cohort Study and Literature Review. JMIR Cancer 2025; 11:e66269. [PMID: 39930991 PMCID: PMC11833187 DOI: 10.2196/66269] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/09/2024] [Revised: 12/03/2024] [Accepted: 12/04/2024] [Indexed: 02/20/2025] Open
Abstract
Background Diagnosing and managing follicular thyroid neoplasms (FTNs) remains a significant challenge, as the malignancy risk cannot be determined until after diagnostic surgery. Objective We aimed to use interpretable machine learning to predict the malignancy risk of FTNs preoperatively in a real-world setting. Methods We conducted a retrospective cohort study at the Peking University Third Hospital in Beijing, China. Patients with postoperative pathological diagnoses of follicular thyroid adenoma (FTA) or follicular thyroid carcinoma (FTC) were included, excluding those without preoperative thyroid ultrasonography. We used 22 predictors involving demographic characteristics, thyroid sonography, and hormones to train 5 machine learning models: logistic regression, least absolute shrinkage and selection operator regression, random forest, extreme gradient boosting, and support vector machine. The optimal model was selected based on discrimination, calibration, interpretability, and parsimony. To address the highly imbalanced data (FTA:FTC ratio>5:1), model discrimination was assessed using both the area under the receiver operating characteristic curve and the area under the precision-recall curve (AUPRC). To interpret the model, we used Shapley Additive Explanations values and partial dependence and individual conditional expectation plots. Additionally, a systematic review was performed to synthesize existing evidence and validate the discrimination ability of the previously developed Thyroid Imaging Reporting and Data System for Follicular Neoplasm scoring criteria to differentiate between benign and malignant FTNs using our data. Results The cohort included 1539 patients (mean age 47.98, SD 14.15 years; female: n=1126, 73.16%) with 1672 FTN tumors (FTA: n=1414; FTC: n=258; FTA:FTC ratio=5.5). The random forest model emerged as optimal, identifying mean thyroid-stimulating hormone (TSH) score, mean tumor diameter, mean TSH, TSH instability, and TSH measurement levels as the top 5 predictors in discriminating FTA from FTC, with the area under the receiver operating characteristic curve of 0.79 (95% CI 0.77-0.81) and AUPRC of 0.40 (95% CI 0.37-0.44). Malignancy risk increased nonlinearly with larger tumor diameters and higher TSH instability but decreased nonlinearly with higher mean TSH scores or mean TSH levels. FTCs with small sizes (mean diameter 2.88, SD 1.38 cm) were more likely to be misclassified as FTAs compared to larger ones (mean diameter 3.71, SD 1.36 cm). The systematic review of the 7 included studies revealed that (1) the FTA:FTC ratio varied from 0.6 to 4.0, lower than the natural distribution of 5.0; (2) no studies assessed prediction performance using AUPRC in unbalanced datasets; and (3) external validations of Thyroid Imaging Reporting and Data System for Follicular Neoplasm scoring criteria underperformed relative to the original study. Conclusions Tumor size and TSH measurements were important in screening FTN malignancy risk preoperatively, but accurately predicting the risk of small-sized FTNs remains challenging. Future research should address the limitations posed by the extreme imbalance in FTA and FTC distributions in real-world data.
Collapse
Affiliation(s)
- Rui Shan
- Department of Maternal and Child Health, School of Public Health, Peking University, Beijing, China
| | - Xin Li
- Department of General Surgery, Peking University Third Hospital, Beijing, China
| | - Jing Chen
- Department of Maternal and Child Health, School of Public Health, Peking University, Beijing, China
| | - Zheng Chen
- Department of Ultrasound, Peking University People's Hospital, Beijing, China
| | - Yuan-Jia Cheng
- Department of Thyroid and Breast Surgery, Peking University First Hospital, Beijing, China
| | - Bo Han
- Department of Pathology, Peking University People's Hospital, Beijing, China
- The Key Laboratory of Experimental Teratology, Ministry of Education and Department of Pathology, School of Basic Medical Sciences, Jinan, China
| | - Run-Ze Hu
- Department of Maternal and Child Health, School of Public Health, Peking University, Beijing, China
| | - Jiu-Ping Huang
- Department of Ultrasound, Peking University Third Hospital, Beijing, China
| | - Gui-Lan Kong
- National Institute of Health Data Science, Peking University, Beijing, China
- Advanced Institute of Information Technology, Peking University, Beijing, China
| | - Hui Liu
- Institute of Advanced Clinical Medicine, Peking University, Beijing, China
| | - Fang Mei
- Department of Pathology, Peking University Third Hospital, Beijing, China
- School of Basic Medical Sciences, Peking University Health Science Center, Beijing, China
| | - Shi-Bing Song
- Department of General Surgery, Peking University Third Hospital, Beijing, China
| | - Bang-Kai Sun
- Information Management and Big Data Center, Peking University Third Hospital, Beijing, China
| | - Hui Tian
- Department of Ultrasound, Peking University People's Hospital, Beijing, China
| | - Yang Wang
- Department of Cardiovascular Medicine, First Affiliated Hospital of Xi’an Jiaotong University, Xi'an, China
| | - Wu-Cai Xiao
- Department of Maternal and Child Health, School of Public Health, Peking University, Beijing, China
| | - Xiang-Yun Yao
- Department of Ultrasound, Peking University Third Hospital, Beijing, China
| | - Jing-Ming Ye
- Department of Thyroid and Breast Surgery, Peking University First Hospital, Beijing, China
| | - Bo Yu
- Department of Ultrasound, Peking University Third Hospital, Beijing, China
| | - Chun-Hui Yuan
- Department of General Surgery, Peking University Third Hospital, Beijing, China
| | - Fan Zhang
- Department of Ultrasound, Peking University Third Hospital, Beijing, China
| | - Zheng Liu
- Department of Maternal and Child Health, School of Public Health, Peking University, Beijing, China
| |
Collapse
|
5
|
Song B, Zheng T, Wang H, Tang L, Xie X, Fu Q, Liu W, Wu PY, Zeng M. Prediction of Follicular Thyroid Neoplasm and Malignancy of Follicular Thyroid Neoplasm Using Multiparametric MRI. JOURNAL OF IMAGING INFORMATICS IN MEDICINE 2024; 37:2852-2864. [PMID: 38839672 PMCID: PMC11612114 DOI: 10.1007/s10278-024-01102-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/09/2024] [Revised: 03/21/2024] [Accepted: 03/22/2024] [Indexed: 06/07/2024]
Abstract
The study aims to evaluate multiparametric magnetic resonance imaging (MRI) for differentiating Follicular thyroid neoplasm (FTN) from non-FTN and malignant FTN (MFTN) from benign FTN (BFTN). We retrospectively analyzed 702 postoperatively confirmed thyroid nodules, and divided them into training (n = 482) and validation (n = 220) cohorts. The 133 FTNs were further split into BFTN (n = 116) and MFTN (n = 17) groups. Employing univariate and multivariate logistic regression, we identified independent predictors of FTN and MFTN, and subsequently develop a nomogram for FTN and a risk score system (RSS) for MFTN prediction. We assessed performance of nomogram through its discrimination, calibration, and clinical utility. The diagnostic performance of the RSS for MFTN was further compared with the performance of the Thyroid Imaging Reporting and Data System (TIRADS). The nomogram, integrating independent predictors, demonstrated robust discrimination and calibration in differentiating FTN from non-FTN in both training cohort (AUC = 0.947, Hosmer-Lemeshow P = 0.698) and validation cohort (AUC = 0.927, Hosmer-Lemeshow P = 0.088). Key risk factors for differentiating MFTN from BFTN included tumor size, restricted diffusion, and cystic degeneration. The AUC of the RSS for MFTN prediction was 0.902 (95% CI 0.798-0.971), outperforming five TIRADS with a sensitivity of 73.3%, specificity of 95.1%, accuracy of 92.4%, and positive and negative predictive values of 68.8% and 96.1%, respectively, at the optimal cutoff. MRI-based models demonstrate excellent diagnostic performance for preoperative predicting of FTN and MFTN, potentially guiding clinicians in optimizing therapeutic decision-making.
Collapse
Affiliation(s)
- Bin Song
- Department of Radiology, Zhongshan Hospital, Shanghai Medical Imaging Institute, Fudan University, No180, Fenglin Road, Xuhui District, 200032, Shanghai, China
- Department of Radiology, Minhang Hospital, Fudan University, No 170, Xinsong Road, Minhang District, 201199, Shanghai, China
| | - Tingting Zheng
- Department of Radiology, Minhang Hospital, Fudan University, No 170, Xinsong Road, Minhang District, 201199, Shanghai, China
| | - Hao Wang
- Department of Radiology, Minhang Hospital, Fudan University, No 170, Xinsong Road, Minhang District, 201199, Shanghai, China
| | - Lang Tang
- Department of Ultrasound, Minhang Hospital, Fudan University, No 170, Xinsong Road, Minhang District, 201199, Shanghai, China
| | - Xiaoli Xie
- Department of Pathology, Minhang Hospital, Fudan University, No 170, Xinsong Road, Minhang District, 201199, Shanghai, China
| | - Qingyin Fu
- Department of Ultrasound, Minhang Hospital, Fudan University, No 170, Xinsong Road, Minhang District, 201199, Shanghai, China
| | - Weiyan Liu
- Department of General Surgery, Minhang Hospital, Fudan University, No 170, Xinsong Road, Minhang District, 201199, Shanghai, China
| | - Pu-Yeh Wu
- GE Healthcare, MR Research China, Beijing, China
| | - Mengsu Zeng
- Department of Radiology, Zhongshan Hospital, Shanghai Medical Imaging Institute, Fudan University, No180, Fenglin Road, Xuhui District, 200032, Shanghai, China.
| |
Collapse
|
6
|
Zheng Y, Zhang Y, Lu K, Wang J, Li L, Xu D, Liu J, Lou J. Diagnostic value of an interpretable machine learning model based on clinical ultrasound features for follicular thyroid carcinoma. Quant Imaging Med Surg 2024; 14:6311-6324. [PMID: 39281129 PMCID: PMC11400673 DOI: 10.21037/qims-24-601] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/25/2024] [Accepted: 07/11/2024] [Indexed: 09/18/2024]
Abstract
Background Follicular thyroid carcinoma (FTC) and follicular thyroid adenoma (FTA) present diagnostic challenges due to overlapping clinical and ultrasound features. Improving the diagnosis of FTC can enhance patient prognosis and effectiveness in clinical management. This study seeks to develop a predictive model for FTC based on ultrasound features using machine learning (ML) algorithms and assess its diagnostic effectiveness. Methods Patients diagnosed with FTA or FTC based on surgical pathology between January 2009 and February 2023 at Zhejiang Provincial Cancer Hospital and Zhejiang Provincial People's Hospital were retrospectively included. A total of 562 patients from Zhejiang Provincial Cancer Hospital comprised the training set, and 218 patients from Zhejiang Provincial People's Hospital constituted the validation set. Subsequently, clinical parameters and ultrasound characteristics of the patients were collected. The diagnostic parameters were analyzed using the least absolute shrinkage and selection operator and multivariate logistic regression screening methods. Next, a comparative analysis was performed using seven ML models. The area under the receiver operating characteristic (ROC) curve (AUC), accuracy, sensitivity, specificity, positive predicted value (PPV), negative predicted value (NPV), precision, recall, and comprehensive evaluation index (F-score) were calculated to compare the diagnostic efficacy among the seven models and determine the optimal model. Further, the optimal model was validated, and the SHapley Additive ExPlanations (SHAP) approach was applied to explain the significance of the model variables. Finally, an individualized risk assessment was conducted. Results Age, echogenicity, thyroglobulin antibody (TGAb), echotexture, composition, triiodothyronine (T3), thyroglobulin (TG), margin, thyroid-stimulating hormone (TSH), calcification, and halo thickness >2 mm were influential factors for diagnosing FTC. The XGBoost model was identified as the optimal model after a comprehensive evaluation. The AUC of this model in the validation set was 0.969 [95% confidence interval (CI), 0.946-0.992], while its precision sensitivity, specificity, and accuracy were 0.791, 0.930, 0.913 and 0.917, respectively. Conclusions XGBoost model based on ultrasound features was constructed and interpreted using the SHAP method, providing evidence for the diagnosis of FTC and guidance for the personalized treatment of patients.
Collapse
Affiliation(s)
- Yuxin Zheng
- Second Clinical College, Zhejiang University of Traditional Chinese Medicine, Hangzhou, China
- Department of Diagnostic Ultrasound Imaging & Interventional Therapy, Zhejiang Cancer Hospital, Hangzhou, China
- Key Laboratory of Head & Neck Cancer Translational Research of Zhejiang Province, Hangzhou, China
| | - Yajiao Zhang
- Second Clinical College, Zhejiang University of Traditional Chinese Medicine, Hangzhou, China
- Department of Diagnostic Ultrasound Imaging & Interventional Therapy, Zhejiang Cancer Hospital, Hangzhou, China
- Key Laboratory of Head & Neck Cancer Translational Research of Zhejiang Province, Hangzhou, China
| | - Kefeng Lu
- Department of Ultrasound, Zhejiang Provincial People's Hospital, Affiliated People's Hospital, Hangzhou Medical College, Hangzhou, China
| | - Jiafeng Wang
- Otolaryngology & Head and Neck Center, Cancer Center, Department of Head and Neck Surgery, Zhejiang Provincial People's Hospital (Affiliated People's Hospital), Hangzhou Medical College, Hangzhou, China
- Department of Thyroid and Breast Surgery, Zhejiang Provincial People's Hospital Bijie Hospital, Bijie, China
| | - Linlin Li
- Otolaryngology & Head and Neck Center, Cancer Center, Department of Head and Neck Surgery, Zhejiang Provincial People's Hospital (Affiliated People's Hospital), Hangzhou Medical College, Hangzhou, China
| | - Dong Xu
- Department of Diagnostic Ultrasound Imaging & Interventional Therapy, Zhejiang Cancer Hospital, Hangzhou, China
- Hangzhou Institute of Medicine (HIM), Chinese Academy of Sciences, Hangzhou, China
| | - Junping Liu
- Department of Diagnostic Ultrasound Imaging & Interventional Therapy, Zhejiang Cancer Hospital, Hangzhou, China
- Hangzhou Institute of Medicine (HIM), Chinese Academy of Sciences, Hangzhou, China
| | - Jiangyan Lou
- Department of Pediatrics, Zhejiang Provincial People's Hospital, Affiliated People's Hospital, Hangzhou Medical College, Hangzhou, China
| |
Collapse
|
7
|
Zhang H, Yang YF, Yang C, Yang YY, He XH, Chen C, Song XL, Ying LL, Wang Y, Xu LC, Li WT. A Novel Interpretable Radiomics Model to Distinguish Nodular Goiter From Malignant Thyroid Nodules. J Comput Assist Tomogr 2024; 48:334-342. [PMID: 37757802 DOI: 10.1097/rct.0000000000001544] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/29/2023]
Abstract
OBJECTIVES The purpose of this study is to inquire about the potential association between radiomics features and the pathological nature of thyroid nodules (TNs), and to propose an interpretable radiomics-based model for predicting the risk of malignant TN. METHODS In this retrospective study, computed tomography (CT) imaging and pathological data from 141 patients with TN were collected. The data were randomly stratified into a training group (n = 112) and a validation group (n = 29) at a ratio of 4:1. A total of 1316 radiomics features were extracted by using the pyradiomics tool. The redundant features were removed through correlation testing, and the least absolute shrinkage and selection operator (LASSO) or the minimum redundancy maximum relevance standard was used to select features. Finally, 4 different machine learning models (RF Hybrid Feature, SVM Hybrid Feature, RF, and LASSO) were constructed. The performance of the 4 models was evaluated using the receiver operating characteristic curve. The calibration curve, decision curve analysis, and SHapley Additive exPlanations method were used to evaluate or explain the best radiomics machine learning model. RESULTS The optimal radiomics model (RF Hybrid Feature model) demonstrated a relatively high degree of discrimination with an area under the receiver operating characteristic curve (AUC) of 0.87 (95% CI, 0.70-0.97; P < 0.001) for the validation cohort. Compared with the commonly used LASSO model (AUC, 0.78; 95% CI, 0.60-0.91; P < 0.01), there is a significant improvement in AUC in the validation set, net reclassification improvement, 0.79 (95% CI, 0.13-1.46; P < 0.05), and integrated discrimination improvement, 0. 20 (95% CI, 0.10-0.30; P < 0.001). CONCLUSION The interpretable radiomics model based on CT performs well in predicting benign and malignant TNs by using quantitative radiomics features of the unilateral total thyroid. In addition, the data preprocessing method incorporating different layers of features has achieved excellent experimental results. CLINICAL RELEVANCE STATEMENT As the detection rate of TNs continues to increase, so does the diagnostic burden on radiologists. This study establishes a noninvasive, interpretable and accurate machine learning model to rapidly identify the nature of TN found in CT.
Collapse
Affiliation(s)
- Hao Zhang
- From the Department of Interventional Radiology, Fudan University Shanghai Cancer Center
| | | | - Chao Yang
- Department of Radiology, The First Affiliated Hospital of Dalian Medical University
| | | | | | | | - Xue-Lin Song
- Department of Radiology, The Second Affiliated Hospital of Dalian Medical University, Dalian, Liaoning, China
| | | | | | | | | |
Collapse
|
8
|
Lin AC, Liu Z, Lee J, Ranvier GF, Taye A, Owen R, Matteson DS, Lee D. Generating a multimodal artificial intelligence model to differentiate benign and malignant follicular neoplasms of the thyroid: A proof-of-concept study. Surgery 2024; 175:121-127. [PMID: 37925261 DOI: 10.1016/j.surg.2023.06.053] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/06/2023] [Revised: 05/08/2023] [Accepted: 06/18/2023] [Indexed: 11/06/2023]
Abstract
BACKGROUND Machine learning has been increasingly used to develop algorithms that can improve medical diagnostics and prognostication and has shown promise in improving the classification of thyroid ultrasound images. This proof-of-concept study aims to develop a multimodal machine-learning model to classify follicular carcinoma from adenoma. METHODS This is a retrospective study of patients with follicular adenoma or carcinoma at a single institution between 2010 and 2022. Demographics, imaging, and perioperative variables were collected. The region of interest was annotated on ultrasound and used to perform radiomics analysis. Imaging features and clinical variables were then used to create a random forest classifier to predict malignancy. Leave-one-out cross-validation was conducted to evaluate classifier performance using the area under the receiver operating characteristic curve. RESULTS Patients with follicular adenomas (n = 7) and carcinomas (n = 11) with complete imaging and perioperative data were included. A total of 910 features were extracted from each image. The t-distributed stochastic neighbor embedding method reduced the dimension to 2 primary represented components. The random forest classifier achieved an area under the receiver operating characteristic curve of 0.76 (clinical only), 0.29 (image only), and 0.79 (multimodal data). CONCLUSION Our multimodal machine learning model demonstrates promising results in classifying follicular carcinoma from adenoma. This approach can potentially be applied in future studies to generate models for preoperative differentiation of follicular thyroid neoplasms.
Collapse
Affiliation(s)
- Ann C Lin
- Department of Surgery, Icahn School of Medicine at Mount Sinai, New York City, NY
| | - Zelong Liu
- BioMedical Engineering and Imaging Institute, Icahn School of Medicine at Mount Sinai, New York City, NY
| | - Justine Lee
- Department of Diagnostic, Molecular, and Interventional Radiology, Icahn School of Medicine at Mount Sinai, New York City, NY
| | | | - Aida Taye
- Department of Surgery, Icahn School of Medicine at Mount Sinai, New York City, NY
| | - Randall Owen
- Department of Surgery, Icahn School of Medicine at Mount Sinai, New York City, NY
| | - David S Matteson
- Department of Statistics and Data Science, Cornell University, Ithaca, NY
| | - Denise Lee
- Department of Surgery, Icahn School of Medicine at Mount Sinai, New York City, NY.
| |
Collapse
|
9
|
Cao CL, Li QL, Tong J, Shi LN, Li WX, Xu Y, Cheng J, Du TT, Li J, Cui XW. Artificial intelligence in thyroid ultrasound. Front Oncol 2023; 13:1060702. [PMID: 37251934 PMCID: PMC10213248 DOI: 10.3389/fonc.2023.1060702] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2022] [Accepted: 04/07/2023] [Indexed: 05/31/2023] Open
Abstract
Artificial intelligence (AI), particularly deep learning (DL) algorithms, has demonstrated remarkable progress in image-recognition tasks, enabling the automatic quantitative assessment of complex medical images with increased accuracy and efficiency. AI is widely used and is becoming increasingly popular in the field of ultrasound. The rising incidence of thyroid cancer and the workload of physicians have driven the need to utilize AI to efficiently process thyroid ultrasound images. Therefore, leveraging AI in thyroid cancer ultrasound screening and diagnosis cannot only help radiologists achieve more accurate and efficient imaging diagnosis but also reduce their workload. In this paper, we aim to present a comprehensive overview of the technical knowledge of AI with a focus on traditional machine learning (ML) algorithms and DL algorithms. We will also discuss their clinical applications in the ultrasound imaging of thyroid diseases, particularly in differentiating between benign and malignant nodules and predicting cervical lymph node metastasis in thyroid cancer. Finally, we will conclude that AI technology holds great promise for improving the accuracy of thyroid disease ultrasound diagnosis and discuss the potential prospects of AI in this field.
Collapse
Affiliation(s)
- Chun-Li Cao
- Department of Ultrasound, The First Affiliated Hospital of Shihezi University, Shihezi, China
- NHC Key Laboratory of Prevention and Treatment of Central Asia High Incidence Diseases, First Affiliated Hospital, School of Medicine, Shihezi University, Shihezi, China
| | - Qiao-Li Li
- Department of Ultrasound, The First Affiliated Hospital of Shihezi University, Shihezi, China
- NHC Key Laboratory of Prevention and Treatment of Central Asia High Incidence Diseases, First Affiliated Hospital, School of Medicine, Shihezi University, Shihezi, China
| | - Jin Tong
- Department of Ultrasound, The First Affiliated Hospital of Shihezi University, Shihezi, China
| | - Li-Nan Shi
- Department of Ultrasound, The First Affiliated Hospital of Shihezi University, Shihezi, China
- NHC Key Laboratory of Prevention and Treatment of Central Asia High Incidence Diseases, First Affiliated Hospital, School of Medicine, Shihezi University, Shihezi, China
| | - Wen-Xiao Li
- Department of Ultrasound, The First Affiliated Hospital of Shihezi University, Shihezi, China
- NHC Key Laboratory of Prevention and Treatment of Central Asia High Incidence Diseases, First Affiliated Hospital, School of Medicine, Shihezi University, Shihezi, China
| | - Ya Xu
- Department of Ultrasound, The First Affiliated Hospital of Shihezi University, Shihezi, China
| | - Jing Cheng
- Department of Ultrasound, The First Affiliated Hospital of Shihezi University, Shihezi, China
| | - Ting-Ting Du
- Department of Ultrasound, The First Affiliated Hospital of Shihezi University, Shihezi, China
| | - Jun Li
- Department of Ultrasound, The First Affiliated Hospital of Shihezi University, Shihezi, China
- NHC Key Laboratory of Prevention and Treatment of Central Asia High Incidence Diseases, First Affiliated Hospital, School of Medicine, Shihezi University, Shihezi, China
| | - Xin-Wu Cui
- Department of Medical Ultrasound, Tongji Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, Hubei, China
| |
Collapse
|
10
|
Zhou L, Zheng LL, Zhang CJ, Wei HF, Xu LL, Zhang MR, Li Q, He GF, Ghamor-Amegavi EP, Li SY. Comparison of S-Detect and thyroid imaging reporting and data system classifications in the diagnosis of cytologically indeterminate thyroid nodules. Front Endocrinol (Lausanne) 2023; 14:1098031. [PMID: 36761203 PMCID: PMC9902707 DOI: 10.3389/fendo.2023.1098031] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/14/2022] [Accepted: 01/11/2023] [Indexed: 01/26/2023] Open
Abstract
Purpose The aim of this study was to investigate the value of S-Detect for predicting the malignant risk of cytologically indeterminate thyroid nodules (CITNs). Methods The preoperative prediction of 159 CITNs (Bethesda III, IV and V) were performed using S-Detect, Thyroid Imaging Reporting and Data System of American College of Radiology (ACR TI-RADS) and Chinese TI-RADS (C-TIRADS). First, Linear-by-Linear Association test and chi-square test were used to analyze the malignant risk of CITNs. McNemar's test and receiver operating characteristic curve were used to compare the diagnostic efficacy of S-Detect and the two TI-RADS classifications for CITNs. In addition, the McNemar's test was used to compare the diagnostic accuracy of the above three methods for different pathological types of nodules. Results The maximum diameter of the benign nodules was significantly larger than that of malignant nodules [0.88(0.57-1.42) vs 0.57(0.46-0.81), P=0.002]. The risk of malignant CITNs in Bethesda system and the two TI-RADS classifications increased with grade (all P for trend<0.001). In all the enrolled CITNs, the diagnostic results of S-Detect were significantly different from those of ACR TI-RADS and C-TIRADS, respectively (P=0.021 and P=0.007). The sensitivity and accuracy of S-Detect [95.9%(90.1%-98.5%) and 88.1%(81.7%-92.5%)] were higher than those of ACR TI-RADS [87.6%(80.1%-92.7%) and 81.8%(74.7%-87.3%)] (P=0.006 and P=0.021) and C-TIRADS [84.3%(76.3%-90.0%) and 78.6%(71.3%-84.5%)] (P=0.001 and P=0.001). Moreover, the negative predictive value and the area under curve value of S-Detect [82.8% (63.5%-93.5%) and 0.795%(0.724%-0.855%)] was higher than that of C-TIRADS [54.8%(38.8%-69.8%) and 0.724%(0.648%-0.792%] (P=0.024 and P=0.035). However, the specificity and positive predictive value of S-Detect were similar to those of ACR TI-RADS (P=1.000 and P=0.154) and C-TIRADS (P=1.000 and P=0.072). There was no significant difference in all the evaluated indicators between ACR TI-RADS and C-TIRADS (all P>0.05). The diagnostic accuracy of S-Detect (97.4%) for papillary thyroid carcinoma (PTC) was higher than that of ACR TI-RADS (90.4%) and C-TIRADS (87.8%) (P=0.021 and P=0.003). Conclusion The diagnostic performance of S-Detect in differentiating CITNs was similar to ACR TI-RADS and superior to C-TIRADS, especially for PTC.
Collapse
Affiliation(s)
- Ling Zhou
- Sir Run Run Shaw Hospital, School of Medicine, Zhejiang University, Hangzhou, China
| | - Lin-lin Zheng
- Sir Run Run Shaw Hospital, School of Medicine, Zhejiang University, Hangzhou, China
| | - Chuan-ju Zhang
- Sir Run Run Shaw Hospital, School of Medicine, Zhejiang University, Hangzhou, China
| | - Hong-fen Wei
- Sir Run Run Shaw Hospital, School of Medicine, Zhejiang University, Hangzhou, China
| | - Li-long Xu
- Sir Run Run Shaw Hospital, School of Medicine, Zhejiang University, Hangzhou, China
| | - Mu-rui Zhang
- Sir Run Run Shaw Hospital, School of Medicine, Zhejiang University, Hangzhou, China
| | - Qiang Li
- Sir Run Run Shaw Hospital, School of Medicine, Zhejiang University, Hangzhou, China
| | - Gao-fei He
- Sir Run Run Shaw Hospital, School of Medicine, Zhejiang University, Hangzhou, China
| | | | - Shi-yan Li
- Sir Run Run Shaw Hospital, School of Medicine, Zhejiang University, Hangzhou, China
| |
Collapse
|
11
|
Zhu H, Yu B, Li Y, Zhang Y, Jin J, Ai Y, Jin X, Yang Y. Models of ultrasonic radiomics and clinical characters for lymph node metastasis assessment in thyroid cancer: a retrospective study. PeerJ 2023; 11:e14546. [PMID: 36650830 PMCID: PMC9840861 DOI: 10.7717/peerj.14546] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2022] [Accepted: 11/18/2022] [Indexed: 01/14/2023] Open
Abstract
Background Preoperative prediction of cervical lymph node metastasis in papillary thyroid carcinoma provided a basis for tumor staging and treatment decision. This study aimed to investigate the utility of machine learning and develop different models to preoperatively predict cervical lymph node metastasis based on ultrasonic radiomic features and clinical characteristics in papillary thyroid carcinoma nodules. Methods Data from 400 papillary thyroid carcinoma nodules were included and divided into training and validation group. With the help of machine learning, clinical characteristics and ultrasonic radiomic features were extracted and selected using randomforest and least absolute shrinkage and selection operator regression before classified by five classifiers. Finally, 10 models were built and their area under the receiver operating characteristic curve, accuracy, sensitivity, specificity, positive predictive value and negative predictive value were measured. Results Among the 10 models, RF-RF model revealed the highest area under curve (0.812) and accuracy (0.7542) in validation group. The top 10 variables of it included age, seven textural features, one shape feature and one first-order feature, in which eight were high-dimensional features. Conclusions RF-RF model showed the best predictive performance for cervical lymph node metastasis. And the importance features selected by it highlighted the unique role of higher-dimensional statistical methods for radiomics analysis.
Collapse
Affiliation(s)
- Hui Zhu
- Department of Ultrasound, the Second Affiliated Hospital of Wenzhou Medical University, Wenzhou, Zhejiang, China
| | - Bing Yu
- Department of Radiotherapy Center, The 1st Affiliated Hospital of Wenzhou Medical University, Wenzhou, Zhejiang, China
| | - Yanyan Li
- Department of Ultrasound, the Second Affiliated Hospital of Wenzhou Medical University, Wenzhou, Zhejiang, China
| | - Yuhua Zhang
- Department of Ultrasound, the Second Affiliated Hospital of Wenzhou Medical University, Wenzhou, Zhejiang, China
| | - Juebin Jin
- Department of Medical Engineering, The 1st Affiliated Hospital of Wenzhou Medical University, Wenzhou, Zhejiang, China
| | - Yao Ai
- Department of Radiotherapy Center, The 1st Affiliated Hospital of Wenzhou Medical University, Wenzhou, Zhejiang, China
| | - Xiance Jin
- Department of Radiotherapy Center, The 1st Affiliated Hospital of Wenzhou Medical University, Wenzhou, Zhejiang, China
| | - Yan Yang
- Department of Ultrasound, the Second Affiliated Hospital of Wenzhou Medical University, Wenzhou, Zhejiang, China
| |
Collapse
|
12
|
Gao X, Ran X, Ding W. The progress of radiomics in thyroid nodules. Front Oncol 2023; 13:1109319. [PMID: 36959790 PMCID: PMC10029726 DOI: 10.3389/fonc.2023.1109319] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/27/2022] [Accepted: 02/03/2023] [Indexed: 03/09/2023] Open
Abstract
Due to the development of Artificial Intelligence (AI), Machine Learning (ML), and the improvement of medical imaging equipment, radiomics has become a popular research in recent years. Radiomics can obtain various quantitative features from medical images, highlighting the invisible image traits and significantly enhancing the ability of medical imaging identification and prediction. The literature indicates that radiomics has a high potential in identifying and predicting thyroid nodules. So in this article, we explain the development, definition, and workflow of radiomics. And then, we summarize the applications of various imaging techniques in identifying benign and malignant thyroid nodules, predicting invasiveness and metastasis of thyroid lymph nodes, forecasting the prognosis of thyroid malignancies, and some new advances in molecular level and deep learning. The shortcomings of this technique are also summarized, and future development prospects are provided.
Collapse
Affiliation(s)
| | - Xuan Ran
- *Correspondence: Wei Ding, ; Xuan Ran,
| | - Wei Ding
- *Correspondence: Wei Ding, ; Xuan Ran,
| |
Collapse
|
13
|
Zheng LL, Ma SY, Zhou L, Yu C, Xu HS, Xu LL, Li SY. Diagnostic performance of artificial intelligence-based computer-aided diagnosis system in longitudinal and transverse ultrasonic views for differentiating thyroid nodules. Front Endocrinol (Lausanne) 2023; 14:1137700. [PMID: 36864838 PMCID: PMC9971597 DOI: 10.3389/fendo.2023.1137700] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/04/2023] [Accepted: 02/03/2023] [Indexed: 02/16/2023] Open
Abstract
OBJECTIVE To evaluate the diagnostic performance of different ultrasound sections of thyroid nodule (TN) using computer-aided diagnosis system based on artificial intelligence (AI-CADS) in predicting thyroid malignancy. MATERIALS AND METHODS This is a retrospective study. From January 2019 to July 2019, patients with preoperative thyroid ultrasound data and postoperative pathological results were enrolled, which were divided into two groups: lower risk group (ACR TI-RADS 1, 2 and 3) and higher risk group (ACR TI-RADS 4 and 5). The malignant risk scores (MRS) of TNs were obtained from longitudinal and transverse sections using AI-CADS. The diagnostic performance of AI-CADS and the consistency of each US characteristic were evaluated between these sections. The receiver operating characteristic (ROC) curve and the Cohen κ-statistic were performed. RESULTS A total of 203 patients (45.61 ± 11.59 years, 163 female) with 221 TNs were enrolled. The area under the ROC curve (AUC) of criterion 3 [0.86 (95%CI: 0.80~0.91)] was lower than criterion 1 [0.94 (95%CI: 0.90~ 0.99)], 2 [0.93 (95%CI: 0.89~0.97)] and 4 [0.94 (95%CI: 0.90, 0.99)] significantly (P<0.001, P=0.01, P<0.001, respectively). In the higher risk group, the MRS of transverse section was higher than longitudinal section (P<0.001), and the agreement of extrathyroidal extension and shape was moderate and fair (κ =0.48, 0.31 respectively). The diagnostic agreement of other ultrasonic features was substantial or almost perfect (κ >0.60). CONCLUSION The diagnostic performance of computer-aided diagnosis system based on artificial intelligence (AI-CADS) in longitudinal and transverse ultrasonic views for differentiating thyroid nodules (TN) was different, which was higher in the transverse section. It was more dependent on the section for the AI-CADS diagnosis of suspected malignant TNs.
Collapse
Affiliation(s)
- Lin-lin Zheng
- Sir Run Run Shaw Hospital, School of Medicine, Zhejiang University, Hangzhou, China
| | - Su-ya Ma
- YinZhou No.2 Hospital, Department of Ultrasound, Ningbo, China
| | - Ling Zhou
- Sir Run Run Shaw Hospital, School of Medicine, Zhejiang University, Hangzhou, China
| | - Cong Yu
- Sir Run Run Shaw Hospital, School of Medicine, Zhejiang University, Hangzhou, China
| | - Hai-shan Xu
- Sir Run Run Shaw Hospital, School of Medicine, Zhejiang University, Hangzhou, China
| | - Li-long Xu
- Sir Run Run Shaw Hospital, School of Medicine, Zhejiang University, Hangzhou, China
| | - Shi-yan Li
- Sir Run Run Shaw Hospital, School of Medicine, Zhejiang University, Hangzhou, China
- *Correspondence: Shi-yan Li,
| |
Collapse
|
14
|
Yu B, Li Y, Yu X, Ai Y, Jin J, Zhang J, Zhang Y, Zhu H, Xie C, Shen M, Yang Y, Jin X. Differentiate Thyroid Follicular Adenoma from Carcinoma with Combined Ultrasound Radiomics Features and Clinical Ultrasound Features. J Digit Imaging 2022; 35:1362-1372. [PMID: 35474555 PMCID: PMC9582092 DOI: 10.1007/s10278-022-00639-2] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/05/2021] [Revised: 03/23/2022] [Accepted: 04/13/2022] [Indexed: 10/18/2022] Open
Abstract
Noninvasive differentiating thyroid follicular adenoma from carcinoma preoperatively is of great clinical value to decrease the risks resulted from excessive surgery for patients with follicular neoplasm. The purpose of this study is to investigate the accuracy of ultrasound radiomics features integrating with ultrasound features in the differentiation between thyroid follicular carcinoma and adenoma. A total of 129 patients diagnosed as thyroid follicular neoplasm with pathologically confirmed follicular adenoma and carcinoma were enrolled and analyzed retrospectively. Radiomics features were extracted from preoperative ultrasound images with manually contoured targets. Ultrasound features and clinical parameters were also obtained from electronic medical records. Radiomics signature, combined model integrating radiomics features, ultrasound features, and clinical parameters were constructed and validated to differentiate the follicular carcinoma from adenoma. A total of 23 optimal features were selected from 449 extracted radiomics features. Clinical and ultrasound parameters of sex (p = 0.003), interior structure (p = 0.035), edge (p = 0.02), platelets (p = 0.007), and creatinine (p = 0.001) were associated with the differentiation between benign and malignant follicular neoplasm. The values of area under curves (AUCs) of the radiomics signature, clinical model, and combined model were 0.772 (95% CI: 0.707-0.838), 0.792 (95% CI: 0.715-0.869), and 0.861 (95% CI: 0.775-0.909), respectively. A final corrected AUC of 0.844 was achieved for the combined model after internal validation. Radiomics features from ultrasound images combined with ultrasound features and clinical factors are feasible to differentiate thyroid follicular carcinoma from adenoma noninvasive before operation to decrease the unnecessary of diagnostic thyroidectomy for patients with benign follicular adenoma.
Collapse
Affiliation(s)
- Bing Yu
- Radiotherapy Center, Wenzhou Medical University First Affiliated Hospital, Wenzhou, 32500, China
| | - Yanyan Li
- Department of Ultrasound Imaging, Wenzhou Medical University Second Affiliated Hospital, Wenzhou, 32500, China
| | - Xiangle Yu
- Wenzhou Medical University, Wenzhou, 325000, Zhejiang, China
| | - Yao Ai
- Radiotherapy Center, Wenzhou Medical University First Affiliated Hospital, Wenzhou, 32500, China
| | - Juebin Jin
- Radiotherapy Center, Wenzhou Medical University First Affiliated Hospital, Wenzhou, 32500, China
| | - Ji Zhang
- Radiotherapy Center, Wenzhou Medical University First Affiliated Hospital, Wenzhou, 32500, China
| | - YuHua Zhang
- Department of Ultrasound Imaging, Wenzhou Medical University Second Affiliated Hospital, Wenzhou, 32500, China
| | - Hui Zhu
- Department of Ultrasound Imaging, Wenzhou Medical University Second Affiliated Hospital, Wenzhou, 32500, China
| | - Congying Xie
- Radiotherapy Center, Wenzhou Medical University First Affiliated Hospital, Wenzhou, 32500, China
- Radiation and Medical Oncology, Wenzhou Medical University Second Affiliated Hospital, Wenzhou, 32500, China
| | - Meixiao Shen
- Wenzhou Medical University, Wenzhou, 325000, Zhejiang, China.
| | - Yan Yang
- Department of Ultrasound Imaging, Wenzhou Medical University Second Affiliated Hospital, Wenzhou, 32500, China.
| | - Xiance Jin
- Radiotherapy Center, Wenzhou Medical University First Affiliated Hospital, Wenzhou, 32500, China.
- School of Basic Medical Science, Wenzhou Medical University, Wenzhou, 325000, China.
| |
Collapse
|
15
|
Zhang X, Lee VCS, Rong J, Lee JC, Song J, Liu F. A multi-channel deep convolutional neural network for multi-classifying thyroid diseases. Comput Biol Med 2022; 148:105961. [PMID: 35985185 DOI: 10.1016/j.compbiomed.2022.105961] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/12/2022] [Revised: 07/28/2022] [Accepted: 08/06/2022] [Indexed: 11/03/2022]
Abstract
BACKGROUND AND OBJECTIVE Thyroid disease instances have been continuously increasing since the 1990s, and thyroid cancer has become the most rapidly rising disease among all the malignancies in recent years. Most existing studies focused on applying deep convolutional neural networks for detecting thyroid cancer. Despite their satisfactory performance on binary classification tasks, limited studies have explored multi-class classification of thyroid disease types; much less is known of the diagnosis of co-existence situation for different types of thyroid diseases. METHOD This study proposed a novel multi-channel convolutional neural network (CNN) architecture to address the multi-class classification task of thyroid disease. The multi-channel CNN merits from computed tomography characteristics to drive a comprehensive diagnostic decision for the overall thyroid gland, emphasizing the disease co-existence circumstance. Moreover, this study also examined alternative strategies to enhance the diagnostic accuracy of CNN models through concatenation of different scales of feature maps. RESULTS Benchmarking experiments demonstrate the improved performance of the proposed multi-channel CNN architecture compared with the standard single-channel CNN architecture. More specifically, the multi-channel CNN achieved an accuracy of 0.909±0.048, precision of 0.944±0.062, recall of 0.896±0.047, specificity of 0.994±0.001, and F1 of 0.917±0.057, in contrast to the single-channel CNN, which obtained 0.902±0.004, 0.892±0.005, 0.909±0.002, 0.993±0.001, 0.898±0.003, respectively. In addition, the proposed model was evaluated in different gender groups; it reached a diagnostic accuracy of 0.908 for the female group and 0.901 for the male group. CONCLUSION Collectively, the results highlight that the proposed multi-channel CNN has excellent generalization and has the potential to be deployed to provide computational decision support in clinical settings.
Collapse
Affiliation(s)
- Xinyu Zhang
- Department of Data Science and AI, Faculty of IT, Monash University, Clayton, Melbourne, VIC 3800, Australia
| | - Vincent C S Lee
- Department of Data Science and AI, Faculty of IT, Monash University, Clayton, Melbourne, VIC 3800, Australia.
| | - Jia Rong
- Department of Data Science and AI, Faculty of IT, Monash University, Clayton, Melbourne, VIC 3800, Australia
| | - James C Lee
- Monash University Endocrine Surgery Unit, Alfred Hospital, Melbourne, VIC 3004, Australia; Department of Surgery, Monash University, Melbourne, VIC 3168, Australia
| | - Jiangning Song
- Biomedicine Discovery Institute and Department of Biochemistry and Molecular Biology, Monash University, Clayton, Melbourne, VIC 3800, Australia
| | - Feng Liu
- West China Hospital of Sichuan University, Chengdu City, Sichuan Province 332001, China
| |
Collapse
|
16
|
Lee JH, Ha EJ, Lee DH, Han M, Park JH, Kim JH. Clinicoradiological Characteristics in the Differential Diagnosis of Follicular-Patterned Lesions of the Thyroid: A Multicenter Cohort Study. Korean J Radiol 2022; 23:763-772. [PMID: 35695317 PMCID: PMC9240300 DOI: 10.3348/kjr.2022.0079] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2022] [Revised: 04/20/2022] [Accepted: 04/26/2022] [Indexed: 11/15/2022] Open
Abstract
OBJECTIVE Preoperative differential diagnosis of follicular-patterned lesions is challenging. This multicenter cohort study investigated the clinicoradiological characteristics relevant to the differential diagnosis of such lesions. MATERIALS AND METHODS From June to September 2015, 4787 thyroid nodules (≥ 1.0 cm) with a final diagnosis of benign follicular nodule (BN, n = 4461), follicular adenoma (FA, n = 136), follicular carcinoma (FC, n = 62), or follicular variant of papillary thyroid carcinoma (FVPTC, n = 128) collected from 26 institutions were analyzed. The clinicoradiological characteristics of the lesions were compared among the different histological types using multivariable logistic regression analyses. The relative importance of the characteristics that distinguished histological types was determined using a random forest algorithm. RESULTS Compared to BN (as the control group), the distinguishing features of follicular-patterned neoplasms (FA, FC, and FVPTC) were patient's age (odds ratio [OR], 0.969 per 1-year increase), lesion diameter (OR, 1.054 per 1-mm increase), presence of solid composition (OR, 2.255), presence of hypoechogenicity (OR, 2.181), and presence of halo (OR, 1.761) (all p < 0.05). Compared to FA (as the control), FC differed with respect to lesion diameter (OR, 1.040 per 1-mm increase) and rim calcifications (OR, 17.054), while FVPTC differed with respect to patient age (OR, 0.966 per 1-year increase), lesion diameter (OR, 0.975 per 1-mm increase), macrocalcifications (OR, 3.647), and non-smooth margins (OR, 2.538) (all p < 0.05). The five important features for the differential diagnosis of follicular-patterned neoplasms (FA, FC, and FVPTC) from BN are maximal lesion diameter, composition, echogenicity, orientation, and patient's age. The most important features distinguishing FC and FVPTC from FA are rim calcifications and macrocalcifications, respectively. CONCLUSION Although follicular-patterned lesions have overlapping clinical and radiological features, the distinguishing features identified in our large clinical cohort may provide valuable information for preoperative distinction between them and decision-making regarding their management.
Collapse
Affiliation(s)
- Jeong Hoon Lee
- Department of Radiology, Ajou University School of Medicine, Suwon, Korea
| | - Eun Ju Ha
- Department of Radiology, Ajou University School of Medicine, Suwon, Korea.
| | - Da Hyun Lee
- Department of Radiology, Ajou University School of Medicine, Suwon, Korea
| | - Miran Han
- Department of Radiology, Ajou University School of Medicine, Suwon, Korea
| | - Jung Hyun Park
- Department of Radiology, Ajou University School of Medicine, Suwon, Korea
| | - Ji-Hoon Kim
- Department of Radiology, Seoul National University Hospital, Seoul National University College of Medicine, Seoul, Korea
| |
Collapse
|
17
|
A comparison of artificial intelligence versus radiologists in the diagnosis of thyroid nodules using ultrasonography: a systematic review and meta-analysis. Eur Arch Otorhinolaryngol 2022; 279:5363-5373. [PMID: 35767056 DOI: 10.1007/s00405-022-07436-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2022] [Accepted: 05/06/2022] [Indexed: 11/03/2022]
Abstract
BACKGROUND Thyroid nodules are common. Ultrasonography (US) is the first investigation for thyroid nodules. Artificial Intelligence (AI) is widely integrated into medical diagnosis to provide additional information. The primary objective of this study was to accumulate the pooled sensitivity and specificity between all available AI and radiologists using thyroid US imaging. The secondary objective was to compare AI's diagnostic performance to that of radiologists. MATERIALS AND METHODS A systematic review meta-analysis. PubMed, Scopus, Web of Science, and Cochrane Library data were searched for studies from inception until June 11, 2020. RESULTS Twenty five studies were included in this meta-analysis. The pooled sensitivity and specificity of AI were 0.86 (95% CI 0.81-0.91) and 0.78 (95% CI 0.73-0.83), respectively. The pooled sensitivity and specificity of radiologists were 0.85 (95% CI 0.80-0.89) and 0.82 (95% CI 0.77-0.86), respectively. The accuracy of AI and radiologists is equivalent in terms of AUC [AI 0.89 (95% CI 0.86-0.92), radiologist 0.91 (95% CI 0.88-0.93)]. The diagnostic odd ratio (DOR) between AI 23.10 (95% CI 14.20-37.58) and radiologists 27.12 (95% CI 17.45-42.16) had no statistically significant difference (P = 0.56). Meta-regression analysis revealed that Deep Learning AI had significantly greater sensitivity and specificity than classic machine learning AI (P < 0.001). CONCLUSION AI demonstrated comparable performance to radiologists in diagnosing benign and malignant thyroid nodules using ultrasonography. Additional research to establish its equivalency should be conducted.
Collapse
|
18
|
Zhang X, Lee VC, Rong J, Lee JC, Liu F. Deep convolutional neural networks in thyroid disease detection: A multi-classification comparison by ultrasonography and computed tomography. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2022; 220:106823. [PMID: 35489145 DOI: 10.1016/j.cmpb.2022.106823] [Citation(s) in RCA: 19] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/03/2021] [Revised: 02/20/2022] [Accepted: 04/18/2022] [Indexed: 06/14/2023]
Abstract
BACKGROUND AND OBJECTIVE As one of the largest endocrine organs in the human body, the thyroid gland regulates daily metabolism. Early detection of thyroid disease leads to reduced mortality rates. The diagnosis of thyroid disease is usually made by radiologists and pathologists, which heavily relies on their experience and expertise. To mitigate human false-positive diagnostic rates, this paper proves that deep learning-driven techniques yield promising performance for automatic detection of thyroid diseases which offers clinicians assistance regarding diagnostic decision-making. METHOD This research study is the first of its kind, which adopts two pre-operative medical image modalities for multi-classifying thyroid disease types (i.e., normal, thyroiditis, cystic, multi-nodular goiter, adenoma, and cancer). Using the current state-of-the-art performing deep convolutional neural network (CNN) architecture, this study builds a thyroid disease diagnostic model for distinguishing among the disease types. RESULTS The model obtains unprecedented performance for both medical image sets, and it reaches an accuracy of 0.972 and 0.942 for ultrasound images and computed tomography (CT) scans correspondingly. CONCLUSION The experimental results illustrate that the selected CNN can be adapted to both image modalities, indicating the feasibility of the deep learning model and emphasizing its further applications in clinics.
Collapse
Affiliation(s)
- Xinyu Zhang
- Department of Data Science and AI, Faculty of IT, Monash University, Wellington Rd, Clayton, Melbourne, VIC 3800, Australia
| | - Vincent Cs Lee
- Department of Data Science and AI, Faculty of IT, Monash University, Wellington Rd, Clayton, Melbourne, VIC 3800, Australia.
| | - Jia Rong
- Department of Data Science and AI, Faculty of IT, Monash University, Wellington Rd, Clayton, Melbourne, VIC 3800, Australia
| | - James C Lee
- Monash University Endocrine Surgery Unit, Alfred Hospital, Melbourne, VIC 3004, Australia; Department of Surgery, Monash University, Melbourne, VIC 3168, Australia
| | - Feng Liu
- West China Hospital of Sichuan University, Chengdu City, Sichuan Province 332001, China
| |
Collapse
|
19
|
Cleere EF, Davey MG, O’Neill S, Corbett M, O’Donnell JP, Hacking S, Keogh IJ, Lowery AJ, Kerin MJ. Radiomic Detection of Malignancy within Thyroid Nodules Using Ultrasonography-A Systematic Review and Meta-Analysis. Diagnostics (Basel) 2022; 12:diagnostics12040794. [PMID: 35453841 PMCID: PMC9027085 DOI: 10.3390/diagnostics12040794] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2022] [Revised: 03/22/2022] [Accepted: 03/22/2022] [Indexed: 02/04/2023] Open
Abstract
Background: Despite investigation, 95% of thyroid nodules are ultimately benign. Radiomics is a field that uses radiological features to inform individualized patient care. We aimed to evaluate the diagnostic utility of radiomics in classifying undetermined thyroid nodules into benign and malignant using ultrasonography (US). Methods: A diagnostic test accuracy systematic review and meta-analysis was performed in accordance with PRISMA guidelines. Sensitivity, specificity, and area under curve (AUC) delineating benign and malignant lesions were recorded. Results: Seventy-five studies including 26,373 patients and 46,175 thyroid nodules met inclusion criteria. Males accounted for 24.6% of patients, while 75.4% of patients were female. Radiomics provided a pooled sensitivity of 0.87 (95% CI: 0.86−0.87) and a pooled specificity of 0.84 (95% CI: 0.84−0.85) for characterizing benign and malignant lesions. Using convolutional neural network (CNN) methods, pooled sensitivity was 0.85 (95% CI: 0.84−0.86) and pooled specificity was 0.82 (95% CI: 0.82−0.83); significantly lower than studies using non-CNN: sensitivity 0.90 (95% CI: 0.89−0.90) and specificity 0.88 (95% CI: 0.87−0.89) (p < 0.05). The diagnostic ability of radiologists and radiomics were comparable for both sensitivity (OR 0.98) and specificity (OR 0.95). Conclusions: Radiomic analysis using US provides a reproducible, reliable evaluation of undetermined thyroid nodules when compared to current best practice.
Collapse
Affiliation(s)
- Eoin F. Cleere
- The Lambe Institute for Translational Research, National University of Ireland, H91 YR71 Galway, Ireland; (M.G.D.); (A.J.L.); (M.J.K.)
- Department of Otolaryngology, Galway University Hospitals, H91 YR71 Galway, Ireland; (M.C.); (I.J.K.)
- Correspondence:
| | - Matthew G. Davey
- The Lambe Institute for Translational Research, National University of Ireland, H91 YR71 Galway, Ireland; (M.G.D.); (A.J.L.); (M.J.K.)
| | - Shane O’Neill
- Department of Breast and Endocrine Surgery, Galway University Hospitals, H91 YR71 Galway, Ireland;
| | - Mel Corbett
- Department of Otolaryngology, Galway University Hospitals, H91 YR71 Galway, Ireland; (M.C.); (I.J.K.)
| | - John P O’Donnell
- Department of Radiology, Galway University Hospitals, H91 YR71 Galway, Ireland;
| | - Sean Hacking
- Department of Pathology and Laboratory Medicine, Warren Alpert Medical School of Brown University, Providence, RI 02903, USA;
| | - Ivan J. Keogh
- Department of Otolaryngology, Galway University Hospitals, H91 YR71 Galway, Ireland; (M.C.); (I.J.K.)
| | - Aoife J. Lowery
- The Lambe Institute for Translational Research, National University of Ireland, H91 YR71 Galway, Ireland; (M.G.D.); (A.J.L.); (M.J.K.)
- Department of Breast and Endocrine Surgery, Galway University Hospitals, H91 YR71 Galway, Ireland;
| | - Michael J. Kerin
- The Lambe Institute for Translational Research, National University of Ireland, H91 YR71 Galway, Ireland; (M.G.D.); (A.J.L.); (M.J.K.)
- Department of Breast and Endocrine Surgery, Galway University Hospitals, H91 YR71 Galway, Ireland;
| |
Collapse
|
20
|
Li W, Song Q, Lan Y, Li J, Zhang Y, Yan L, Li Y, Zhang Y, Luo Y. The Value of Sonography in Distinguishing Follicular Thyroid Carcinoma from Adenoma. Cancer Manag Res 2021; 13:3991-4002. [PMID: 34040440 PMCID: PMC8139727 DOI: 10.2147/cmar.s307166] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/19/2021] [Accepted: 04/22/2021] [Indexed: 12/29/2022] Open
Abstract
Purpose Differentiation between follicular thyroid carcinomas (FTCs) and follicular thyroid adenomas (FTAs) is difficult and the sonographic features of FTC are not yet fully established. The purpose of this study is to explore the sonographic features of FTC and the value of sonography in differentiating FTCs from FTAs. Patients and Methods A total of 28 pathologically proven FTCs and 53 FTAs in 78 patients who were performed thyroid surgery were included in this retrospective study. The sonographic features of each tumor including an interrupted halo, satellite nodule(s) with or without halo ring, local irregularity of margin and cluster of grapes sign were evaluated. A mode image of FTC halo was built up in our study. The frequencies of the sonographic features were compared by chi-square test or Fisher exact test between FTCs and FTAs. The relative risk of malignancy was assessed by logistic regression analysis. Results Logistic regression analysis showed that a thick, irregular and/or interrupted halo with or without satellite nodule(s), hypoechoic or marked hypoechoic echogenicity, a predominantly solid pattern, cluster of grapes sign, micro-or macro-calcifications, rim calcifications correlated with significant increases in relative risk for FTCs (odds ratio 11.48 (1.37-96.56), 6.74 (1.05-43.30), 17.51 (1.78-172.53), 9.55 (1.44-63.46), 9.36 (1.25-70.15) and 17.45 (1.04-292.65), respectively, p<0.05). Two new sonographic features, an interrupted halo and satellite nodule(s) with or without halo ring, can only be found in FTCs. Conclusion An interrupted halo and satellite nodule(s) with or without halo ring are specific sonographic features for FTCs. Sonography could play a role in differentiating follicular thyroid carcinoma from adenoma.
Collapse
Affiliation(s)
- Wen Li
- Department of Ultrasound, Medical School of Chinese PLA, Beijing, People's Republic of China.,Department of Ultrasound, The First Medical Center Chinese PLA General Hospital, Beijing, People's Republic of China
| | - Qing Song
- Department of Ultrasound, The First Medical Center Chinese PLA General Hospital, Beijing, People's Republic of China
| | - Yu Lan
- Department of Ultrasound, The First Medical Center Chinese PLA General Hospital, Beijing, People's Republic of China
| | - Jie Li
- Department of Pathology, The First Medical Center, Chinese PLA General Hospital, Beijing, People's Republic of China
| | - Ying Zhang
- Department of Ultrasound, The First Medical Center Chinese PLA General Hospital, Beijing, People's Republic of China
| | - Lin Yan
- Department of Ultrasound, The First Medical Center Chinese PLA General Hospital, Beijing, People's Republic of China
| | - Yingying Li
- Department of Ultrasound, The First Medical Center Chinese PLA General Hospital, Beijing, People's Republic of China
| | - Yan Zhang
- Department of Ultrasound, The First Medical Center Chinese PLA General Hospital, Beijing, People's Republic of China
| | - Yukun Luo
- Department of Ultrasound, The First Medical Center Chinese PLA General Hospital, Beijing, People's Republic of China
| |
Collapse
|