Reliability of a computer-aided system in the evaluation of indeterminate ultrasound images of thyroid nodules

Investigating the diagnostic efficiency of a computer-aided diagnosis system for thyroid nodules in the context of Hashimoto's thyroiditis

Objectives

This study aims to investigate the efficacy of a computer-aided diagnosis (CAD) system in distinguishing between benign and malignant thyroid nodules in the context of Hashimoto's thyroiditis (HT) and to evaluate the role of the CAD system in reducing unnecessary biopsies of benign lesions.

Methods

We included a total of 137 nodules from 137 consecutive patients (mean age, 43.5 ± 11.8 years) who were histopathologically diagnosed with HT. The two-dimensional ultrasound images and videos of all thyroid nodules were analyzed by the CAD system and two radiologists with different experiences according to ACR TI-RADS. The diagnostic cutoff values of ACR TI-RADS were divided into two categories (TR4 and TR5), and then the sensitivity, specificity, and area under the receiver operating characteristic curve (AUC) of the CAD system and the junior and senior radiologists were compared in both cases. Moreover, ACR TI-RADS classification was revised according to the results of the CAD system, and the efficacy of recommended fine-needle aspiration (FNA) was evaluated by comparing the unnecessary biopsy rate and the malignant rate of punctured nodules.

Results

The accuracy, sensitivity, specificity, PPV, and NPV of the CAD system were 0.876, 0.905, 0.830, 0.894, and 0.846, respectively. With TR4 as the cutoff value, the AUCs of the CAD system and the junior and senior radiologists were 0.867, 0.628, and 0.722, respectively, and the CAD system had the highest AUC (P < 0.0001). With TR5 as the cutoff value, the AUCs of the CAD system and the junior and senior radiologists were 0.867, 0.654, and 0.812, respectively, and the CAD system had a higher AUC than the junior radiologist (P < 0.0001) but comparable to the senior radiologist (P = 0.0709). With the assistance of the CAD system, the number of TR4 nodules was decreased by both junior and senior radiologists, the malignant rate of punctured nodules increased by 30% and 22%, and the unnecessary biopsies of benign lesions were both reduced by nearly half.

Conclusions

The CAD system based on deep learning can improve the diagnostic performance of radiologists in identifying benign and malignant thyroid nodules in the context of Hashimoto's thyroiditis and can play a role in FNA recommendations to reduce unnecessary biopsy rates.

Systematic review and meta-analysis: diagnostic value of different ultrasound for benign and malignant thyroid nodules

BACKGROUND

Conventional ultrasound and contrast-enhanced ultrasound (CEUS) are commonly used in the diagnosis of benign and malignant thyroid nodules. However, the value of the two methods in the diagnosis of benign and malignant thyroid nodules remains controversial.

METHODS

PubMed, Medline, EBSCO, Science Direct, Cochrane Library, China National Knowledge Infrastructure (CNKI) database and manual journal retrieval were searched from January 2000 to January 2022, to include research on conventional ultrasound or CEUS in the diagnosis of benign and malignant thyroid nodule related clinical studies. Meta-analysis was conducted using RevMan5.3 and Stata Corp to analyze the sensitivity and specificity of conventional ultrasound and CEUS in the diagnosis of benign and malignant thyroid nodules with 95% confidence interval (CI) as indicators. Heterogeneity of the results was evaluated by Q test and I2 in RevMan5.3. Deek's method was used to evaluate publication bias.

RESULTS

A total of 1,378 nodules were included in 11 literatures, including 535 malignant thyroid nodules and 843 benign thyroid nodules. Heterogeneity tests conducted for CEUS diagnostic sensitivity of the 6 included literatures indicated that there was no heterogeneity among the study groups [Q=2.05, degree of freedom (df) =5.00, I2=0.00%, P=0.84]. The combined sensitivity was 0.87, with 95% confidence interval (CI): 0.82 to 0.90. Heterogeneity tests on the diagnostic specificity of CEUS of the six included literatures suggested that there was heterogeneity among the different study groups (Q=14.27, df =5.00, I2=64.96%, P=0.01). The combined specificity was 0.84 (95% CI: 0.78 to 0.89). Heterogeneity tests performed on the sensitivity of five conventional ultrasound diagnosis articles revealed that there was heterogeneity among different study groups (Q=13.62, df =4.00, I2=70.64%, P=0.01). The combined sensitivity was 0.86 (95% CI: 0.78 to 0.92). Heterogeneity tests on the specificity of conventional ultrasound diagnosis in five included literatures indicated that there was heterogeneity among different study groups (Q=16.94, df =4.00, I2=76.39%, P=0.00). The combined specificity was 0.84 (95% CI: 0.75 to 0.90). There was no bias in the included literature.

DISCUSSION

The sensitivity of CEUS in the diagnosis of benign and malignant thyroid nodules was slightly higher than that of conventional ultrasound, which provides a reference for the clinical diagnosis of benign and malignant thyroid nodules.