1
|
Yao J, Wang Y, Lei Z, Wang K, Feng N, Dong F, Zhou J, Li X, Hao X, Shen J, Zhao S, Gao Y, Wang V, Ou D, Li W, Lu Y, Chen L, Yang C, Wang L, Feng B, Zhou Y, Chen C, Yan Y, Wang Z, Ru R, Chen Y, Zhang Y, Liang P, Xu D. Multimodal GPT model for assisting thyroid nodule diagnosis and management. NPJ Digit Med 2025; 8:245. [PMID: 40319170 PMCID: PMC12049458 DOI: 10.1038/s41746-025-01652-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2024] [Accepted: 04/19/2025] [Indexed: 05/07/2025] Open
Abstract
Although using artificial intelligence (AI) to analyze ultrasound images is a promising approach to assessing thyroid nodule risks, traditional AI models lack transparency and interpretability. We developed a multimodal generative pre-trained transformer for thyroid nodules (ThyGPT), aiming to provide a transparent and interpretable AI copilot model for thyroid nodule risk assessment and management. Ultrasound data from 59,406 patients across nine hospitals were retrospectively collected to train and test the model. After training, ThyGPT was found to assist in reducing biopsy rates by more than 40% without increasing missed diagnoses. In addition, it detects errors in ultrasound reports 1,610 times faster than humans. With the assistance of ThyGPT, the area under the curve for radiologists in assessing thyroid nodule risks improved from 0.805 to 0.908 (p < 0.001). As an AI-generated content-enhanced computer-aided diagnosis (AIGC-CAD) model, ThyGPT has the potential to revolutionize how radiologists use such tools.
Collapse
Affiliation(s)
- Jincao Yao
- Department of Diagnostic Ultrasound Imaging & Interventional Therapy, Zhejiang Cancer Hospital, Hangzhou Institute of Medicine (HIM), Chinese Academy of Sciences, Hangzhou, China
- Interventional Medicine and Engineering Research Center, Hangzhou Institute of Medicine (HIM), Chinese Academy of Sciences, Hangzhou, China
- Wenling Medical Big Data and Artificial Intelligence Research Institute, Taizhou, China
- Zhejiang Provincial Research Center for Innovative Technology and Equipment in Interventional Oncology, Zhejiang Cancer Hospital, Hangzhou, China
| | - Yunpeng Wang
- College of Optical Science and Engineering, Zhejiang University, Hangzhou, China
| | - Zhikai Lei
- Department of Ultrasound, Zhejiang Provincial Hospital of Chinese Medicine, Hangzhou, China
| | - Kai Wang
- Department of Ultrasound, The Affiliated Dongyang Hospital of Wenzhou Medical University, Dongyang, China
| | - Na Feng
- Department of Diagnostic Ultrasound Imaging & Interventional Therapy, Zhejiang Cancer Hospital, Hangzhou Institute of Medicine (HIM), Chinese Academy of Sciences, Hangzhou, China
| | - Fajin Dong
- Department of Ultrasound, The Second Clinical Medical College, Jinan University, Shenzhen, China
- Department of Ultrasound, The First Affiliated Hospital, Southern University of Science and Technology, Shenzhen People's Hospital, Shenzhen, China
| | - Jianhua Zhou
- Department of Ultrasound, Sun Yat-sen University Cancer centre, State Key Laboratory of Oncology in South China, Collaborative Innovation centre for Cancer Medicine, Guangzhou, China
| | - Xiaoxian Li
- Department of Ultrasound, Sun Yat-sen University Cancer centre, State Key Laboratory of Oncology in South China, Collaborative Innovation centre for Cancer Medicine, Guangzhou, China
| | - Xiang Hao
- College of Optical Science and Engineering, Zhejiang University, Hangzhou, China
| | - Jiafei Shen
- Department of Diagnostic Ultrasound Imaging & Interventional Therapy, Zhejiang Cancer Hospital, Hangzhou Institute of Medicine (HIM), Chinese Academy of Sciences, Hangzhou, China
- Interventional Medicine and Engineering Research Center, Hangzhou Institute of Medicine (HIM), Chinese Academy of Sciences, Hangzhou, China
| | - Shanshan Zhao
- Department of Ultrasound, Shaoxing People's Hospital (Zhejiang University Shaoxing Hospital), Shaoxing, China
| | - Yuan Gao
- Department of Ultrasound, Shaoxing People's Hospital (Zhejiang University Shaoxing Hospital), Shaoxing, China
| | - Vicky Wang
- Wenling Medical Big Data and Artificial Intelligence Research Institute, Taizhou, China
| | - Di Ou
- Department of Diagnostic Ultrasound Imaging & Interventional Therapy, Zhejiang Cancer Hospital, Hangzhou Institute of Medicine (HIM), Chinese Academy of Sciences, Hangzhou, China
- Interventional Medicine and Engineering Research Center, Hangzhou Institute of Medicine (HIM), Chinese Academy of Sciences, Hangzhou, China
- Wenling Medical Big Data and Artificial Intelligence Research Institute, Taizhou, China
- Department of Ultrasound, Taizhou Cancer Hospital, Taizhou, China
| | - Wei Li
- Department of Diagnostic Ultrasound Imaging & Interventional Therapy, Zhejiang Cancer Hospital, Hangzhou Institute of Medicine (HIM), Chinese Academy of Sciences, Hangzhou, China
| | - Yidan Lu
- Department of Diagnostic Ultrasound Imaging & Interventional Therapy, Zhejiang Cancer Hospital, Hangzhou Institute of Medicine (HIM), Chinese Academy of Sciences, Hangzhou, China
| | - Liyu Chen
- Department of Diagnostic Ultrasound Imaging & Interventional Therapy, Zhejiang Cancer Hospital, Hangzhou Institute of Medicine (HIM), Chinese Academy of Sciences, Hangzhou, China
- Zhejiang Provincial Research Center for Innovative Technology and Equipment in Interventional Oncology, Zhejiang Cancer Hospital, Hangzhou, China
| | - Chen Yang
- Department of Diagnostic Ultrasound Imaging & Interventional Therapy, Zhejiang Cancer Hospital, Hangzhou Institute of Medicine (HIM), Chinese Academy of Sciences, Hangzhou, China
- Zhejiang Provincial Research Center for Innovative Technology and Equipment in Interventional Oncology, Zhejiang Cancer Hospital, Hangzhou, China
| | - Liping Wang
- Department of Diagnostic Ultrasound Imaging & Interventional Therapy, Zhejiang Cancer Hospital, Hangzhou Institute of Medicine (HIM), Chinese Academy of Sciences, Hangzhou, China
| | - Bojian Feng
- Department of Diagnostic Ultrasound Imaging & Interventional Therapy, Zhejiang Cancer Hospital, Hangzhou Institute of Medicine (HIM), Chinese Academy of Sciences, Hangzhou, China
- Wenling Medical Big Data and Artificial Intelligence Research Institute, Taizhou, China
| | - Yahan Zhou
- Wenling Medical Big Data and Artificial Intelligence Research Institute, Taizhou, China
| | - Chen Chen
- Department of Diagnostic Ultrasound Imaging & Interventional Therapy, Zhejiang Cancer Hospital, Hangzhou Institute of Medicine (HIM), Chinese Academy of Sciences, Hangzhou, China
- Interventional Medicine and Engineering Research Center, Hangzhou Institute of Medicine (HIM), Chinese Academy of Sciences, Hangzhou, China
| | - Yuqi Yan
- Department of Diagnostic Ultrasound Imaging & Interventional Therapy, Zhejiang Cancer Hospital, Hangzhou Institute of Medicine (HIM), Chinese Academy of Sciences, Hangzhou, China
- Interventional Medicine and Engineering Research Center, Hangzhou Institute of Medicine (HIM), Chinese Academy of Sciences, Hangzhou, China
| | - Zhengping Wang
- Department of Ultrasound, The Affiliated Dongyang Hospital of Wenzhou Medical University, Dongyang, China
| | - Rongrong Ru
- Affiliated Xiaoshan Hospital, Hangzhou Normal University, Hangzhou, China
| | - Yaqing Chen
- Affiliated Xiaoshan Hospital, Hangzhou Normal University, Hangzhou, China
| | - Yanming Zhang
- Faculty of Applied Sciences, Macao Polytechnic University, Macao, China.
- Key Laboratory of Endocrine Gland Diseases of Zhejiang Province, Hangzhou, China.
- Department of Ultrasound, Zhejiang Provincial People's Hospital (Affiliated People's Hospital, Hangzhou Medical College), Hangzhou, China.
| | - Ping Liang
- Department of Ultrasound, Chinese PLA General Hospital, Chinese PLA Medical School, Beijing, China.
| | - Dong Xu
- Department of Diagnostic Ultrasound Imaging & Interventional Therapy, Zhejiang Cancer Hospital, Hangzhou Institute of Medicine (HIM), Chinese Academy of Sciences, Hangzhou, China.
- Interventional Medicine and Engineering Research Center, Hangzhou Institute of Medicine (HIM), Chinese Academy of Sciences, Hangzhou, China.
- Wenling Medical Big Data and Artificial Intelligence Research Institute, Taizhou, China.
- Zhejiang Provincial Research Center for Innovative Technology and Equipment in Interventional Oncology, Zhejiang Cancer Hospital, Hangzhou, China.
| |
Collapse
|
2
|
Liu Y, Xiang L, Liu FY, Yahya N, Chai JN, Hamid HA, Lu Q, Manan HA. Accuracy of Radiomics in the Identification of Extrathyroidal Extension and BRAF V600E Mutations in Papillary Thyroid Carcinoma: A Systematic Review and Meta-analysis. Acad Radiol 2025; 32:1385-1397. [PMID: 39765435 DOI: 10.1016/j.acra.2024.11.014] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/02/2024] [Revised: 11/04/2024] [Accepted: 11/04/2024] [Indexed: 02/03/2025]
Abstract
RATIONALE AND OBJECTIVES Extrathyroidal extension (ETE) and BRAFV600E mutation in papillary thyroid cancer (PTC) increase mortality and recurrence risk. Preoperative identification presents considerable challenges. Although radiomics has emerged as a potential tool for identifying ETE and BRAFV600E mutation, systematic evidence supporting its effectiveness remains insufficient. Therefore, this paper aims to determine the effectiveness of radiomics in detecting ETE and BRAFV600E mutations in PTC. MATERIALS AND METHODS PubMed, Web of Science, Cochrane, and Embase databases were searched until May 7th, 2024. The Radiomics Quality Score tool assessed bias risk. Subgroup analyses based on radiomics and clinical characteristics were conducted. RESULTS Our systematic review included 19 studies, encompassing 5337 PTC cases. Among these, 12 articles focused on ETE and seven articles focused on BRAFV600E mutations. For the identification of ETE in the validation set, the summarized machine learning (ML) models demonstrated 0.80c-index (95%CI: 0.77-0.83), 0.77 sensitivity (95%CI: 0.72-0.81), and 0.78 specificity (95%CI: 0.73-0.82). Radiomics based on ultrasound demonstrated 0.82c-index (95%CI: 0.78-0.86), 0.77 sensitivity (95%CI: 0.68-0.84), and 0.84 specificity (95%CI: 0.75-0.91). For the identification of BRAFV600E mutations in the validation set, the summarized ML models showed 0.80c-index (95%CI: 0.72-0.87), 0.76 sensitivity (95%CI: 0.67-0.84), and 0.88 specificity (95%CI: 0.77-0.94). ML models based on ultrasound-guided radiomics had 0.81c-index (95%CI: 0.74-0.89), 0.79 sensitivity (95%CI: 0.71-0.86), and 0.87 specificity (95%CI: 0.74-0.94). CONCLUSION Radiomics in identifying ETE and BRAFV600E mutation have high c-index, sensitivity, and specificity, especially images from ultrasound, demonstrating the potential for diagnosing ETE and BRAFV600E mutations in PTC.
Collapse
Affiliation(s)
- Yan Liu
- Department of Radiology and Intervention, Hospital Pakar Kanak-Kanak (UKM Specialist Children's Hospital), Universiti Kebangsaan Malaysia, Jalan Yaacob Latif, Bandar Tun Razak, 56000, Kuala Lumpur, Malaysia (Y.L., F.Y.L., J.N.C., H.A.H., H.A.M.); Department of Ultrasound, Affiliated Hospital of Pan Zhihua University, Panzhihua, 61700, Sichuan Province, China (Y.L., L.X.); Tianfu Jincheng Laboratory, City of Future Medicine, Chengdu 641400, China (Y.L., Q.L.)
| | - Ling Xiang
- Department of Ultrasound, Affiliated Hospital of Pan Zhihua University, Panzhihua, 61700, Sichuan Province, China (Y.L., L.X.)
| | - Fang-Yue Liu
- Department of Radiology and Intervention, Hospital Pakar Kanak-Kanak (UKM Specialist Children's Hospital), Universiti Kebangsaan Malaysia, Jalan Yaacob Latif, Bandar Tun Razak, 56000, Kuala Lumpur, Malaysia (Y.L., F.Y.L., J.N.C., H.A.H., H.A.M.)
| | - Noorazrul Yahya
- Diagnostic Imaging & Radiotherapy Program, Faculty of Health Sciences, School of Diagnostic & Applied Health Sciences, University Kebangsaan Malaysia, Kuala Lumpur 50300, Malaysia (N.Y.)
| | - Jia-Ning Chai
- Department of Radiology and Intervention, Hospital Pakar Kanak-Kanak (UKM Specialist Children's Hospital), Universiti Kebangsaan Malaysia, Jalan Yaacob Latif, Bandar Tun Razak, 56000, Kuala Lumpur, Malaysia (Y.L., F.Y.L., J.N.C., H.A.H., H.A.M.)
| | - Hamzaini Abdul Hamid
- Department of Radiology and Intervention, Hospital Pakar Kanak-Kanak (UKM Specialist Children's Hospital), Universiti Kebangsaan Malaysia, Jalan Yaacob Latif, Bandar Tun Razak, 56000, Kuala Lumpur, Malaysia (Y.L., F.Y.L., J.N.C., H.A.H., H.A.M.)
| | - Qiang Lu
- Tianfu Jincheng Laboratory, City of Future Medicine, Chengdu 641400, China (Y.L., Q.L.); Department of Ultrasound, West China Hospital, Sichuan University, Chengdu 610041, China (Q.L.)
| | - Hanani Abdul Manan
- Department of Radiology and Intervention, Hospital Pakar Kanak-Kanak (UKM Specialist Children's Hospital), Universiti Kebangsaan Malaysia, Jalan Yaacob Latif, Bandar Tun Razak, 56000, Kuala Lumpur, Malaysia (Y.L., F.Y.L., J.N.C., H.A.H., H.A.M.); Makmal Pemprosesan Imej Kefungsian (Functional Image Processing Laboratory), Department of Radiology, Universiti Kebangsaan Malaysia, Jalan Yaacob Latif, Bandar Tun Razak, Kuala Lumpur 56000, Malaysia (H.A.M.).
| |
Collapse
|
3
|
Feng N, Zhao S, Wang K, Chen P, Wang Y, Gao Y, Wang Z, Lu Y, Chen C, Yao J, Lei Z, Xu D. Deep learning model for diagnosis of thyroid nodules with size less than 1 cm: A multicenter, retrospective study. Eur J Radiol Open 2024; 13:100609. [PMID: 39554616 PMCID: PMC11566704 DOI: 10.1016/j.ejro.2024.100609] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2024] [Revised: 10/20/2024] [Accepted: 10/29/2024] [Indexed: 11/19/2024] Open
Abstract
Objective To develop a ultrasound images based dual-channel deep learning model to achieve accurate early diagnosis of thyroid nodules less than 1 cm. Methods A dual-channel deep learning model called thyroid nodule transformer network (TNT-Net) was proposed. The model has two input channels for transverse and longitudinal ultrasound images of thyroid nodules, respectively. A total of 9649 nodules from 8455 patients across five hospitals were retrospectively collected. The data were divided into a training set (8453 nodules, 7369 patients), an internal test set (565 nodules, 512 patients), and an external test set (631 nodules, 574 patients). Results TNT-Net achieved an area under the curve (AUC) of 0.953 (95 % confidence interval (CI): 0.934, 0.969) on the internal test set and 0.941 (95 % CI: 0.921, 0.957) on the external test set, significantly outperforming traditional deep convolutional neural network models and single-channel swin transformer model, whose AUCs ranged from 0.800 (95 % CI: 0.759, 0.837) to 0.856 (95 % CI: 0.819, 0.881). Furthermore, feature heatmap visualization showed that TNT-Net could extract richer and more energetic malignant nodule patterns. Conclusion The proposed TNT-Net model significantly improved the recognition capability for thyroid nodules with size less than 1 cm. This model has the potential to reduce overdiagnosis and overtreatment of such nodules, providing essential support for precise management of thyroid nodules while complementing fine-needle aspiration biopsy.
Collapse
Affiliation(s)
- Na Feng
- Department of Ultrasound, Zhejiang Cancer Hospital, Hangzhou 310022, China
- Hangzhou Institute of Medicine (HIM), Chinese Academy of Sciences, Hangzhou 310000, China
| | - Shanshan Zhao
- Department of Ultrasound, Shaoxing People’s Hospital (Zhejiang University Shaoxing Hospital), Shaoxing 312300, China
| | - Kai Wang
- Department of Ultrasound, The Affiliated Dongyang Hospital of Wenzhou Medical University, Dongyang 322100, China
| | - Peizhe Chen
- College of Optical Science and Engineering, Zhejiang University, Hangzhou, Zhejiang Province, China
| | - Yunpeng Wang
- College of Optical Science and Engineering, Zhejiang University, Hangzhou, Zhejiang Province, China
| | - Yuan Gao
- Department of Ultrasound, Shaoxing People’s Hospital (Zhejiang University Shaoxing Hospital), Shaoxing 312300, China
| | - Zhengping Wang
- Department of Ultrasound, The Affiliated Dongyang Hospital of Wenzhou Medical University, Dongyang 322100, China
| | - Yidan Lu
- Department of Ultrasound, Zhejiang Cancer Hospital, Hangzhou 310022, China
- Hangzhou Institute of Medicine (HIM), Chinese Academy of Sciences, Hangzhou 310000, China
| | - Chen Chen
- Department of Ultrasound, Zhejiang Cancer Hospital, Hangzhou 310022, China
- Hangzhou Institute of Medicine (HIM), Chinese Academy of Sciences, Hangzhou 310000, China
| | - Jincao Yao
- Department of Ultrasound, Zhejiang Cancer Hospital, Hangzhou 310022, China
- Hangzhou Institute of Medicine (HIM), Chinese Academy of Sciences, Hangzhou 310000, China
- Wenling Medical Big Data and Artificial Intelligence Research Institute, Taizhou 310061, China
| | - Zhikai Lei
- The First Affiliated Hospital of Zhejiang Chinese Medical University (Zhejiang Provincial Hospital of Chinese Medicine), Hangzhou 310003, China
| | - Dong Xu
- Department of Ultrasound, Zhejiang Cancer Hospital, Hangzhou 310022, China
- Hangzhou Institute of Medicine (HIM), Chinese Academy of Sciences, Hangzhou 310000, China
- Wenling Medical Big Data and Artificial Intelligence Research Institute, Taizhou 310061, China
- Department of Ultrasound, Taizhou Cancer Hospital, Taizhou 310022, China
| |
Collapse
|
4
|
Zhang S, Liu R, Wang Y, Zhang Y, Li M, Wang Y, Wang S, Ma N, Ren J. Ultrasound-Base Radiomics for Discerning Lymph Node Metastasis in Thyroid Cancer: A Systematic Review and Meta-analysis. Acad Radiol 2024; 31:3118-3130. [PMID: 38555183 DOI: 10.1016/j.acra.2024.03.012] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/14/2023] [Revised: 03/04/2024] [Accepted: 03/11/2024] [Indexed: 04/02/2024]
Abstract
PURPOSE Ultrasound is the imaging modality of choice for preoperative diagnosis of lymph node metastasis (LNM) in thyroid cancer (TC), yet its efficacy remains suboptimal. As radiomics gains traction in tumor diagnosis, its integration with ultrasound for LNM differentiation in TC has emerged, but its diagnostic merit is debated. This study assesses the accuracy of ultrasound-integrated radiomics in preoperatively diagnosing LNM in TC. METHODS Literatures were searched in PubMed, Embase, Cochrane, and Web of Science until July 11, 2023. Quality of the studies was assessed by the radiomics quality score (RQS). A meta-analysis was executed using a bivariate mixed effects model, with a subgroup analysis based on modeling variables (clinical features, radiomics features, or their combination). RESULTS Among 27 articles (16,410 TC patients, 6356 with LNM), the average RQS was 16.5 (SD:5.47). Sensitivity of the models based on clinical features, radiomics features, and radiomics features plus clinical features were 0.64, 0.76 and 0.69. Specificities were 0.77, 0.78 and 0.82. SROC values were 0.76, 0.84 and 0.81. CONCLUSION Ultrasound-based radiomics effectively evaluates LNM in TC preoperatively. Adding clinical features does not notably enhance the model's performance. Some radiomics studies showed high bias, possibly due to the absence of standard application guidelines.
Collapse
Affiliation(s)
- Sijie Zhang
- Department of Sonography, Beijing Hospital, National Center of Gerontology, Institute of Geriatric Medicine, Chinese Academy of Medical Sciences & Peking Union Medical College, Beijing 100005, PR China
| | - Ruijuan Liu
- Department of Sonography, Beijing Hospital, National Center of Gerontology, Institute of Geriatric Medicine, Chinese Academy of Medical Sciences & Peking Union Medical College, Beijing 100005, PR China
| | - Yiyang Wang
- Department of Sonography, Beijing Hospital, National Center of Gerontology, Institute of Geriatric Medicine, Chinese Academy of Medical Sciences, Beijing, PR China
| | - Yuewei Zhang
- Department of Sonography, Beijing Hospital, National Center of Gerontology, Institute of Geriatric Medicine, Chinese Academy of Medical Sciences, Beijing, PR China
| | - Mengpu Li
- Department of Sonography, Beijing Hospital, National Center of Gerontology, Institute of Geriatric Medicine, Chinese Academy of Medical Sciences, Beijing, PR China
| | - Yang Wang
- Department of Sonography, Beijing Hospital, National Center of Gerontology, Institute of Geriatric Medicine, Chinese Academy of Medical Sciences, Beijing, PR China
| | - Siyu Wang
- Department of Sonography, Beijing Hospital, National Center of Gerontology, Institute of Geriatric Medicine, Chinese Academy of Medical Sciences, Beijing, PR China
| | - Na Ma
- Department of Sonography, Beijing Hospital, National Center of Gerontology, Institute of Geriatric Medicine, Chinese Academy of Medical Sciences, Beijing, PR China
| | - Junhong Ren
- Department of Sonography, Beijing Hospital, National Center of Gerontology, Institute of Geriatric Medicine, Chinese Academy of Medical Sciences & Peking Union Medical College, Beijing 100005, PR China; Department of Sonography, Beijing Hospital, National Center of Gerontology, Institute of Geriatric Medicine, Chinese Academy of Medical Sciences, Beijing, PR China.
| |
Collapse
|