Validating and Comparing C-TIRADS, K-TIRADS and ACR-TIRADS in Stratifying the Malignancy Risk of Thyroid Nodules

Publicly Funded Molecular Testing of Indeterminate Thyroid Nodules: Canada's Experience

CONTEXT

Indeterminate thyroid nodules (ITNs) lead to diagnostic surgeries in many countries. The use of molecular testing (MT) is endorsed by several guidelines, but costs are limitative, especially in public health care systems like in Canada.

OBJECTIVES

The primary objective of this work was to evaluate the clinical value of ThyroSeq v3 (TSv3) using benign call rate (BCR) in a real-world practice. The secondary objective was to assess the cost-effectiveness of MT.

METHODS

This multicentric prospective study was conducted in 5 academic centers in Quebec, Canada. A total of 500 consecutive patients with Bethesda III (on 2 consecutive cytopathologies) or IV and TIRADS 3 or 4 nodules measuring 1 to 4 cm were included. MT was performed between November 2021 and November 2022. Patients with a positive TSv3 were referred for surgery. Patients with a negative TSv3 were planned for follow-up by ultrasonography for a minimum of 2 years. The BCR, corresponding to the proportion of ITNs with negative TSv3 results, was assessed.

RESULTS

A total of 500 patients underwent TSv3 testing, with a BCR of 72.6% (95% CI, 68.5%-76.5%; P < .001). Ultimately, 99.7% of patients with a negative result avoided surgery. The positive predictive value of TSv3 was 68.2% (95% CI, 58.5%-76.9%). The cost-benefit analysis identified that the implementation of MT would yield a cost savings of $6.1 million over the next 10 years.

CONCLUSION

The use of MT (TSv3) in a well-selected population with ITNs led to a BCR of 72.6%. It is cost-effective and prevents unnecessary surgeries in a public health care setting.

The Horizon of Thyroid Imaging Reporting and Data System in the Diagnostic Performance of Thyroid Nodules: Clinical Application and Future Perspectives

The widespread occurrence of thyroid nodules and the typically slow progression of thyroid cancer have led to the development of the thyroid imaging reporting and data system (TI-RADS). The primary objectives behind the development of TI-RADS were to minimize unnecessary biopsies of non-cancerous nodules, enhance the overall precision of diagnosis and establish a uniform risk-stratification framework based on the lexicon to notify healthcare professionals of nodules that require a biopsy. The identification and precise diagnosis of thyroid nodules have led to improved clinical practice examination reports within the general population. TI-RADS is a risk-stratification system related to thyroid lesions and based on ultrasound characteristics and is similar to the structure of the breast imaging reporting and data system. There are various versions of TI-RADS, with some being widely used and adequately validated, while others lacking thorough evaluation. TI-RADS uses a numerical scoring system for characteristics, and its categories are determined by the cumulative score of a thyroid nodule, indicating the likelihood of it being benign or malignant. In this article, the various TI-RADS systems were examined as a successful method for producing precise and comprehensive documentation, with a particular emphasis on their functionality, similarities, distinctions and potential future developments.

Correlation analysis between BRAFV600E mutation and ultrasonic and clinical features of papillary thyroid cancer

Purpose

The study investigates the value of the BRAFV600E mutation in determining the aggressiveness of papillary thyroid cancer (PTC) and its correlation with ultrasound features.

Methods

The study selected 176 patients with BRAFV600E mutation and 80 without the mutation who underwent surgery at Guangxi Medical University Cancer Hospital. Clinical and pathological data were collected, focusing on BRAFV600E mutations and associated ultrasonic features. Correlation analysis, as well as univariate and multivariate logistic regression analysis, were conducted to identify independent risk factors for BRAFV600E mutation. The results were verified using a nomogram model.

Results

The analysis results indicate that the BRAFV600E mutation correlates with tumor size, nodule size, taller-than-wide shape, margin, and shape of papillary thyroid cancer. The receiver operating characteristic curve was used to analyze the diagnostic effect of these features on BRAFV600E mutation. The results showed that nodule size had the most significant area under the curve (AUC = 0.665). Univariate and multivariate logistic regression analyses revealed that taller-than-wide shape ≥1, ill-defined margin, irregular shape, nodule size (≤1.40 cm), TT4 (>98.67 nmol/L), and FT3 (<4.14 pmol/L) were independent risk factors for BRAFV600E mutation. While considering all these factors in the nomogram, the Concordance index (C-index) remained high at 0.764. This suggests that the model has a good predictive effect.

Conclusion

Ultrasound features including nodule size, taller-than-wide shape ≥1, ill-defined margins, irregular shape, higher TT4 levels, and lower FT3 levels were associated with papillary thyroid cancer aggressiveness and BRAFV600E mutation.

Diagnostic value of CEUS combined with C-TIRADS for indeterminate FNA cytological thyroid nodules

OBJECTIVES

To investigate the diagnostic value of CEUS combined with C-TIRADS for indeterminate FNA cytological thyroid nodules.

METHODS

The clinical data, ultrasonic images, C-TIRADS categories and CEUS images of 192 patients with indeterminate FNA cytological thyroid nodules confirmed by the surgical pathology were analyzed retrospectively. The diagnostic efficacy of CEUS, C-TIRADS and CEUS-TIRADS were calculated.

RESULTS

The AUCs of CEUS, C-TIRADS and CEUS-TIRADS were 0.905 (95% CI: 0.862∼0.949), 0.881 (95% CI: 0.825∼0.938) and 0.954 (95% CI: 0.922∼0.986), respectively. The sensitivity, specificity, PPV, NPV, accuracy, LR- and LR+ were 84.7% (116/137), 85.5% (47/55), 93.5% (116/124), 69.1% (47/68), 84.9% (163/192), 0.179, 5.82 and 84.7% (116/137), 83.6% (46/55), 92.8% (116/125), 68.7% (46/67), 84.4% (162/192), 0.183, 5.17, 92.7% (127/137), 89.1% (49/55), 95.5% (127/133), 83.1% (49/59), 91.7% (176/192), 0.082, and 8.50, respectively. Compared with CEUS and C-TIRADS, CEUS-TIRADS had improved the AUC, sensitivity and accuracy (all P < 0.05).

CONCLUSIONS

CEUS and C-TIRADS had high diagnostic values in indeterminate FNA cytological thyroid nodules. CEUS-TIRADS improved AUC, diagnostic sensitivity and accuracy, and helped to distinguish indeterminate FNA cytological nodules.

Comparison of diagnostic performance of two ultrasound risk stratification systems for thyroid nodules: a systematic review and meta-analysis

OBJECTIVES

To assume the ideal cut-off values and diagnostic performance of two thyroid imaging reporting and data systems published by the Korean Thyroid Association/Korean Society of Thyroid Radiology (Korean TI-RADS) and the American Thyroid Association (ATA TI-RADS).

METHODS

Eighteen studies with 25,422 patients from PubMed, SCOPUS, Embase, Web of Science, and Cochrane Library databases up to August 2022. True and false positive and negative values with characteristics were extracted.

RESULTS

The highest area under the receiver operating characteristic curve (AUC) was 0.893 and 0.887 for Korean and ATA TI-RADS. High suspicion was judged as the best cut-off value with the highest AUC based on optimal sensitivity and specificity. In determining the risk of malignant thyroid nodules, high suspicion in Korean and ATA TI-RADS showed sensitivity as 71.3% and 73.5%, specificity as 7.9% and 86.4%, diagnostic odds ratios as 20.0289 and 20.9076, AUC as 0.893 and 0.887. There was no significant difference when directly comparing the diagnostic accuracy of both TI-RADS.

CONCLUSION

The two risk stratification systems had good diagnostic performance with high AUC and no significant differences. The ideal cut-off can depend on the medical condition or thyroid nodules, because the changes of cut-off point may reciprocally alter sensitivity and specificity.

Diagnostic efficiency among Eu-/C-/ACR-TIRADS and S-Detect for thyroid nodules: a systematic review and network meta-analysis

Background

The performance in evaluating thyroid nodules on ultrasound varies across different risk stratification systems, leading to inconsistency and uncertainty regarding diagnostic sensitivity, specificity, and accuracy.

Objective

Comparing diagnostic performance of detecting thyroid cancer among distinct ultrasound risk stratification systems proposed in the last five years.

Evidence acquisition

Systematic search was conducted on PubMed, EMBASE, and Web of Science databases to find relevant research up to December 8, 2022, whose study contents contained elucidation of diagnostic performance of any one of the above ultrasound risk stratification systems (European Thyroid Imaging Reporting and Data System[Eu-TIRADS]; American College of Radiology TIRADS [ACR TIRADS]; Chinese version of TIRADS [C-TIRADS]; Computer-aided diagnosis system based on deep learning [S-Detect]). Based on golden diagnostic standard in histopathology and cytology, single meta-analysis was performed to obtain the optimal cut-off value for each system, and then network meta-analysis was conducted on the best risk stratification category in each system.

Evidence synthesis

This network meta-analysis included 88 studies with a total of 59,304 nodules. The most accurate risk category thresholds were TR5 for Eu-TIRADS, TR5 for ACR TIRADS, TR4b and above for C-TIRADS, and possible malignancy for S-Detect. At the best thresholds, sensitivity of these systems ranged from 68% to 82% and specificity ranged from 71% to 81%. It identified the highest sensitivity for C-TIRADS TR4b and the highest specificity for ACR TIRADS TR5. However, sensitivity for ACR TIRADS TR5 was the lowest. The diagnostic odds ratio (DOR) and area under curve (AUC) were ranked first in C-TIRADS.

Conclusion

Among four ultrasound risk stratification options, this systemic review preliminarily proved that C-TIRADS possessed favorable diagnostic performance for thyroid nodules.

Systematic review registration

https://www.crd.york.ac.uk/prospero, CRD42022382818.

Computer-interpretable guidelines: electronic tools to enhance the utility of thyroid nodule clinical practice guidelines and risk stratification tools

Clinicians seeking guidance for evaluating and managing thyroid nodules currently have several resources. The principal ones are narrative clinical guidelines and clinical risk calculators. This paper will review the strengths and weaknesses of both. The paper will introduce a concept of computer interpretable guideline, a novel way of transforming narrative guidelines in to a clinical decision support tool that can provide patient specific recommendations at the point of care. The paper then describes an experience of developing an interactive web based computer interpretable guideline for thyroid nodule management, called Thyroid Nodule Management App (TNAPP). The advantages of this approach and the potential barriers for widespread adaptation are discussed.

The possibilities of ultrasound imaging in the diagnosis of follicular neoplasia of the thyroid gland

Thyroid cancer is the most common cancer of the endocrine system. The diagnosis of thyroid cancer has taken a step forward due to the introduction of fine-needle biopsy of the thyroid gland with subsequent evaluation of cytological material using the Bethesda system. One category of this classification traditionally remains a gray area of diagnosis. The detection of a follicular tumor in the cytological material (category IV according to Bethesda) does not allow one to reliably classify the neoplasia as benign or malignant and requires surgical intervention. The traditional informative and widely used method for diagnosing thyroid tumors is ultrasound. However, the sensitivity and specificity of the method varies over a wide range. This review analyzes the literature on the possibilities of ultrasound diagnostics in assessing the malignant potential of follicular tumors of the thyroid gland.

Diagnostic Performance of Six Ultrasound Risk Stratification Systems for Thyroid Nodules: A Systematic Review and Network Meta-Analysis

BACKGROUND. Risk stratification systems for evaluating thyroid nodules on ultrasound use varying approaches to classify levels of suspicion for malignancy, leading to variable performance. OBJECTIVE. The purpose of this study was to perform a network meta-analysis comparing six risk stratification systems used to evaluate thyroid nodules on ultrasound in terms of their diagnostic performance for the detection of thyroid cancer. EVIDENCE ACQUISITION. Five bibliometric databases were searched for studies published through August 31, 2022, that compared at least two of six ultrasound risk stratification systems (the American Association of Clinical Endocrinologists, American College of Endocrinology, and Associazione Medici Endocrinologi [AACE/ACE/AME] system; American College of Radiology Thyroid Imaging Reporting and Data System [ACR TI-RADS]; the American Thyroid Association [ATA] risk stratification system; European Thyroid Association Thyroid Imaging Reporting and Data System [EU-TIRADS]; the Korean Thyroid Imaging Reporting and Data System [K-TIRADS] endorsed by the Korean Thyroid Association and the Korean Society of Thyroid Radiology; and the Thyroid Imaging Reporting and Data System developed by Kwak et al. [Kwak TIRADS]) in terms of their diagnostic performance for the detection of thyroid cancer, with cytologic or histologic evaluation used as a reference standard. The studies' risk of bias was evaluated using the Newcastle-Ottawa Scale. A meta-analysis of each system was performed to identify the risk category threshold that had the highest accuracy as well as the highest sensitivity and specificity at this threshold. Network meta-analysis was used to perform hierarchic ranking and identify the systems having the highest sensitivities and specificities at each system's most accurate threshold. EVIDENCE SYNTHESIS. The analysis included 39 studies with 49,661 patients. All studies were of fair (n = 17) or good (n = 22) quality. The most accurate risk category thresholds were class 3 (high risk) for the AACE/ACE/AME system, TR5 (highly suspicious) for ACR TI-RADS, EU-TIRADS 5 (high risk) for EU-TIRADS, 4c (moderate concern but not classic for malignancy) for Kwak TIRADS, K-TIRADS 5 (high suspicion) for K-TIRADS, and high suspicion for the ATA system. At these thresholds, the systems had sensitivity of 64-77% and specificity of 82-90%. Network meta-analysis identified the highest sensitivity and highest specificity for ACR TI-RADS, followed by K-TIRADS. CONCLUSION. Of six risk stratification systems, ACR TI-RADS had the highest diagnostic performance for the detection of thyroid nodules on ultrasound. CLINICAL IMPACT. This network meta-analysis can inform decisions regarding implementation of the risk stratification systems and can aid future system updates.

Diagnostic Performance of Various Ultrasound Risk Stratification Systems for Benign and Malignant Thyroid Nodules: A Meta-Analysis

BACKGROUND

To evaluate the diagnostic performance of ultrasound risk-stratification systems for the discrimination of benign and malignant thyroid nodules and to determine the optimal cutoff values of individual risk-stratification systems.

METHODS

PubMed, Embase, SCOPUS, Web of Science, and Cochrane library databases were searched up to August 2022. Sensitivity and specificity data were collected along with the characteristics of each study related to ultrasound risk stratification systems.

RESULTS

Sixty-seven studies involving 76,512 thyroid nodules were included in this research. The sensitivity, specificity, diagnostic odds ratios, and area under the curves by K-TIRADS (4), ACR-TIRADS (TR5), ATA (high suspicion), EU-TIRADS (5), and Kwak-TIRADS (4b) for malignancy risk stratification of thyroid nodules were 92.5%, 63.5%, 69.8%, 70.6%, and 95.8%, respectively; 62.8%, 89.6%, 87.2%, 83.9%, and 63.8%, respectively; 20.7111, 16.8442, 15.7398, 12.2986, and 38.0578, respectively; and 0.792, 0.882, 0.859, 0.843, and 0.929, respectively.

CONCLUSION

All ultrasound-based risk-stratification systems had good diagnostic performance. Although this study determined the best cutoff values in individual risk-stratification systems based on statistical assessment, clinicians could adjust or alter cutoff values based on the clinical purpose of the ultrasound and the reciprocal changes in sensitivity and specificity.

A new discriminant strategy combined with four TIRADS screening procedures increases ultrasound diagnostic accuracy-focusing on "wrong diagnostic" thyroid nodules

OBJECTIVE

To utilize the discrepancies of different TIRADS, including ACR-TIRADS, Kwak-TIRADS, C-TIRADS, and EU-TIRADS, to explore methods for improving ultrasound diagnostic accuracy.

METHODS

In total, 795 nodules with cytological or surgical pathology were included. All nodules were screened by the four TIRADS according to their diagnostic concordance (Screening procedures, SP). Discriminant strategy (DS) derived from predictor variables was combined with SP to construct the evaluation method (SP+DS). The diagnostic performance of the SP+DS method alone and its derivational methods and two-TIRADS combined tests was evaluated.

RESULTS

A total of 86.8% (269/310) malignant nodules and 93.6% (365/390) benign cases diagnosed by the four TIRADS simultaneously were pathologically confirmed, while 12.0% (95/795) nodules could not be consistently diagnosed by them. The criteria of DS were that iso- or hyper-echogenicity nodules should be considered benign, while hypo- or marked hypo-echogenicity nodules malignant. For 95 inconsistently diagnosed nodules screened by at least two TIRADS, DS performed best with an accuracy of 79.0%, followed by Kwak-TIRADS (72.6%). In the overall sample, the sensitivity and AUC were highest for the SP+DS method compared to the four TIRADS (91.3%, 0.895). Combining ACR-TIRADS and Kwak-TIRADS via parallel test resulted in significant improvements in the sensitivity and AUC compared to ACR-TIRADS (89.2% vs. 81.4%, 0.889 vs. 0.863). Combining C-TIRADS and DS in serial resulted in the highest AUC (0.887), followed by Kwak-TIRADS (0.884), while EU-TIRADS was the lowest (0.879).

CONCLUSIONS

For undetermined or suspected thyroid nodules, two-TIRADS combined tests can be used to improve diagnostic accuracy. Otherwise, considering the inconsistent diagnosis of two TIRADS may require attention to the echo characteristics to differentiate between benign and malignant nodules.

KEY POINTS

• The discrepancies in the diagnostic performance of different TIRADS arise from their performance on inconsistently diagnosed nodules. • ACR-TIRADS improves sensitivity via combining with Kwak-TIRADS in parallel (from 81.4 to 89.2%), while C-TIRADS increases specificity via combining with EU-TIRADS in serial (from 80.9 to 85.7%). • If the diagnostic findings of two TIRADS are inconsistent, echo characteristics will be helpful for the differentiation of benign and malignant nodules with an accuracy of 79.0%.

Diagnostic Performance of ACR and Kwak TI-RADS for Benign and Malignant Thyroid Nodules: An Update Systematic Review and Meta-Analysis

(1) Background: To determine the optimal cut-off values of two risk stratification systems to discriminate malignant thyroid nodules and to compare the diagnostic performance; (2) Methods: True and false positive and negative data were collected, and methodological quality was assessed for forty-six studies involving 39,085 patients; (3) Results: The highest area under the receiver operating characteristic (ROC) curve (AUC) of ACR and Kwak TI-RADS were 0.875 and 0.884. Based on the optimal sensitivity and specificity, the highest accuracy values of ROC curves or diagnostic odds ratios (DOR) were taken as the cut-off values for TR4 (moderate suspicious) and 4B. The sensitivity, specificity, DOR, and AUC by ACR (TR4) and Kwak TI-RADS (4B) for malignancy risk stratification of thyroid nodules were 94.3% and 96.4%; 52.2% and 53.7%; 17.5185 and 31.8051; 0.786 and 0.884, respectively. There were no significant differences in diagnostic accuracy in any of the direction comparisons of the two systems; (4) Conclusions: ACR and Kwak TI-RADS had good diagnostic performances (AUCs > 85%). Although we determined the best cut-off values in individual risk stratification systems based on statistical assessment, clinicians can adjust the optimal cut-off value according to the clinical purpose of the ultrasonography because raising or lowering cut-points leads to reciprocal changes in sensitivity and specificity.