Comparison and preliminary discussion of the reasons for the differences in diagnostic performance and unnecessary FNA biopsies between the ACR TIRADS and 2015 ATA guidelines

Comparison of ultrasound risk stratification systems for pediatric thyroid nodules

Background

There is currently insufficient data to validate adult-based US risk stratification systems (RSSs) for the identification of malignant thyroid nodules in a pediatric population.

Methods

From October 2016 and May 2023, 173 thyroid nodules of pediatric patients (age ≤ 18 years) with definitive pathology results and ultrasound (US) examination within 1 month before surgery or fine-needle aspiration (FNA) biopsy in our institution were enrolled in this study. The clinical and US characteristics of these nodules were retrospectively reviewed and categorized according to the ACR-TIRADS, C-TIRADS, and ATA guidelines. The diagnostic performance of US-based FNA criteria (original and simulating) of the three guidelines in thyroid cancer detection was estimated.

Results

The three RSSs had similar AUC according to the categories(0.849-0.852, all P > 0.05). When combined with the original FNA criteria of the three RSSs to manage the nodules, the FNA rate of ACR-TIRADS and C-TIRADS were significantly less than ATA guidelines (53.18% vs. 64.63%, P < 0.05, and 52.60% vs. 64.63%, P < 0.05). The missed malignancy rate (MMR) and unnecessary FNA rate (UFR) of ATA guidelines (50.00%, 35.85%) was highest among the three RSSs, followed by the C-TIRADS (37.80%, 19.57%) and the ACR-TIRADS (37.04%, 19.57%). When nodules < 1 cm with the highest category in each RSS biopsied, that is when using the simulating FNA thresholds, the MMR was reduced overall (all P < 0.001), without a change in the UFR (all P > 0.05). All the three RSSs showed a substantial improvement in accuracy and malignant detection rate (all P < 0.05).

Conclusion

The ACR-TIRADS, C-TIRADS, and ATA guidelines showed high missed malignancy rates when using their original recommended FNA criteria. When nodules < 1 cm with the highest category in each RSS biopsied, the missed malignancy rate of each RSS was decreased. Decreasing the FNA thresholds for highly suspicious malignant nodules may therefore be an effective means of managing malignant thyroid nodules in pediatric patients.

Diagnostic efficiency among Eu-/C-/ACR-TIRADS and S-Detect for thyroid nodules: a systematic review and network meta-analysis

Background

The performance in evaluating thyroid nodules on ultrasound varies across different risk stratification systems, leading to inconsistency and uncertainty regarding diagnostic sensitivity, specificity, and accuracy.

Objective

Comparing diagnostic performance of detecting thyroid cancer among distinct ultrasound risk stratification systems proposed in the last five years.

Evidence acquisition

Systematic search was conducted on PubMed, EMBASE, and Web of Science databases to find relevant research up to December 8, 2022, whose study contents contained elucidation of diagnostic performance of any one of the above ultrasound risk stratification systems (European Thyroid Imaging Reporting and Data System[Eu-TIRADS]; American College of Radiology TIRADS [ACR TIRADS]; Chinese version of TIRADS [C-TIRADS]; Computer-aided diagnosis system based on deep learning [S-Detect]). Based on golden diagnostic standard in histopathology and cytology, single meta-analysis was performed to obtain the optimal cut-off value for each system, and then network meta-analysis was conducted on the best risk stratification category in each system.

Evidence synthesis

This network meta-analysis included 88 studies with a total of 59,304 nodules. The most accurate risk category thresholds were TR5 for Eu-TIRADS, TR5 for ACR TIRADS, TR4b and above for C-TIRADS, and possible malignancy for S-Detect. At the best thresholds, sensitivity of these systems ranged from 68% to 82% and specificity ranged from 71% to 81%. It identified the highest sensitivity for C-TIRADS TR4b and the highest specificity for ACR TIRADS TR5. However, sensitivity for ACR TIRADS TR5 was the lowest. The diagnostic odds ratio (DOR) and area under curve (AUC) were ranked first in C-TIRADS.

Conclusion

Among four ultrasound risk stratification options, this systemic review preliminarily proved that C-TIRADS possessed favorable diagnostic performance for thyroid nodules.

Systematic review registration

https://www.crd.york.ac.uk/prospero, CRD42022382818.

Diagnostic Performance of Six Ultrasound Risk Stratification Systems for Thyroid Nodules: A Systematic Review and Network Meta-Analysis

BACKGROUND. Risk stratification systems for evaluating thyroid nodules on ultrasound use varying approaches to classify levels of suspicion for malignancy, leading to variable performance. OBJECTIVE. The purpose of this study was to perform a network meta-analysis comparing six risk stratification systems used to evaluate thyroid nodules on ultrasound in terms of their diagnostic performance for the detection of thyroid cancer. EVIDENCE ACQUISITION. Five bibliometric databases were searched for studies published through August 31, 2022, that compared at least two of six ultrasound risk stratification systems (the American Association of Clinical Endocrinologists, American College of Endocrinology, and Associazione Medici Endocrinologi [AACE/ACE/AME] system; American College of Radiology Thyroid Imaging Reporting and Data System [ACR TI-RADS]; the American Thyroid Association [ATA] risk stratification system; European Thyroid Association Thyroid Imaging Reporting and Data System [EU-TIRADS]; the Korean Thyroid Imaging Reporting and Data System [K-TIRADS] endorsed by the Korean Thyroid Association and the Korean Society of Thyroid Radiology; and the Thyroid Imaging Reporting and Data System developed by Kwak et al. [Kwak TIRADS]) in terms of their diagnostic performance for the detection of thyroid cancer, with cytologic or histologic evaluation used as a reference standard. The studies' risk of bias was evaluated using the Newcastle-Ottawa Scale. A meta-analysis of each system was performed to identify the risk category threshold that had the highest accuracy as well as the highest sensitivity and specificity at this threshold. Network meta-analysis was used to perform hierarchic ranking and identify the systems having the highest sensitivities and specificities at each system's most accurate threshold. EVIDENCE SYNTHESIS. The analysis included 39 studies with 49,661 patients. All studies were of fair (n = 17) or good (n = 22) quality. The most accurate risk category thresholds were class 3 (high risk) for the AACE/ACE/AME system, TR5 (highly suspicious) for ACR TI-RADS, EU-TIRADS 5 (high risk) for EU-TIRADS, 4c (moderate concern but not classic for malignancy) for Kwak TIRADS, K-TIRADS 5 (high suspicion) for K-TIRADS, and high suspicion for the ATA system. At these thresholds, the systems had sensitivity of 64-77% and specificity of 82-90%. Network meta-analysis identified the highest sensitivity and highest specificity for ACR TI-RADS, followed by K-TIRADS. CONCLUSION. Of six risk stratification systems, ACR TI-RADS had the highest diagnostic performance for the detection of thyroid nodules on ultrasound. CLINICAL IMPACT. This network meta-analysis can inform decisions regarding implementation of the risk stratification systems and can aid future system updates.

Inter-Rater Reliability of Thyroid Ultrasound Risk Criteria: A Systematic Review and Meta-Analysis

OBJECTIVE

The most commonly employed diagnostic criteria for identifying thyroid nodules include Thyroid Imaging and Reporting Data System (TI-RADS) and American Thyroid Association (ATA) guidelines. The purpose of this systematic review and meta-analysis is to determine the inter-rater reliability of thyroid ultrasound criteria.

METHODS

We performed a library search of MEDLINE (Ovid), EMBASE (Ovid), and Web of Science for full-text articles published from January 2005 to June 2022. We included full-text primary research articles that used TI-RADS and/or ATA guidelines to evaluate thyroid nodules in adults. These included studies must have calculated inter-rater reliability using any validated metric. The Quality Appraisal for Reliability Studies (QAREL) was used to assess study quality. We planned for a random-effects meta-analysis, in addition to covariate and publication bias analyses. This study was performed in accordance with Preferred Reporting Items for a Systematic Review and Meta-analysis guidelines and registered prior to conduction (International prospective register of systematic reviews-PROSPERO: CRD42021275072).

RESULTS

Of the 951 articles identified via the database search, 35 met eligibility criteria. All studies were observational. The most commonly utilized criteria were ACR Thyroid Imaging and Reporting Data System (TI-RADS) and/or ATA criteria, while the majority of studies employed Κ statistics. For ACR TI-RADS, the pooled Κ was 0.51 (95% confidence interval [CI]: 0.42, 0.57; n = 7) while for ATA, the pooled Κ was 0.52 (95% CI: 0.37, 0.67; n = 3). Due to the small number of studies, covariate or publication bias analyses were not performed.

CONCLUSION

Ultrasound criteria demonstrate moderate inter-rater reliability, but these findings are impacted by poor study quality and a lack of standardization. Laryngoscope, 133:485-493, 2023.

Comparison of Various Ultrasound-Based Malignant Risk Stratification Systems on an Occasion for Assessing Thyroid Nodules in Hashimoto's Thyroiditis

Purpose

To compare the diagnostic performance and unnecessary ultrasound-guided fine-needle aspiration (US-FNA) biopsy rate of the 2015 American Thyroid Association (ATA), 2016 Korean Society of Thyroid Radiology (KSThR), and 2017 American College of Radiology (ACR) guidelines for patients with and without Hashimoto's thyroiditis (HT).

Patients and Methods

This retrospective study included 716 nodules from 696 consecutive patients, which were classified using the categories defined by the three guidelines: ATA, KSThR, and ACR. The malignancy risk in each category was calculated and the diagnostic performance and unnecessary fine-needle aspiration (FNA) rates of the three guidelines were compared.

Results

In total, 426 malignant and 290 benign nodules were identified. Patients with malignant nodules had lower total thyroxine levels and higher thyroid-stimulating hormone, thyroid peroxidase antibody, and thyroglobulin antibody levels than those without malignant nodules (all P<0.01). The margin difference was significant in non-HT patients (P<0.01), but comparable in HT patients (P=0.55). The calculated malignancy risks of high and intermediate suspicion nodules in the ATA and KSThR guidelines and moderately suspicious nodules in the ACR guidelines were significantly lower in non-HT patients compared with HT patients (P<0.05). The ACR guidelines showed the lowest sensitivity, highest specificity, and lowest unnecessary FNA rates in patients with and without HT. Compared to non-HT patients, HT patients had significantly lower unnecessary FNA rates (P<0.01).

Conclusion

HT was associated with a higher malignancy rate of thyroid nodules with intermediate suspicion according to the ATA, KSThR, and ACR guidelines. The three guidelines, especially ACR, were likely to be more effective and could allow a greater reduction in the percentage of benign nodules biopsied in patients with HT.

Diagnostic Performance of Various Ultrasound Risk Stratification Systems for Benign and Malignant Thyroid Nodules: A Meta-Analysis

BACKGROUND

To evaluate the diagnostic performance of ultrasound risk-stratification systems for the discrimination of benign and malignant thyroid nodules and to determine the optimal cutoff values of individual risk-stratification systems.

METHODS

PubMed, Embase, SCOPUS, Web of Science, and Cochrane library databases were searched up to August 2022. Sensitivity and specificity data were collected along with the characteristics of each study related to ultrasound risk stratification systems.

RESULTS

Sixty-seven studies involving 76,512 thyroid nodules were included in this research. The sensitivity, specificity, diagnostic odds ratios, and area under the curves by K-TIRADS (4), ACR-TIRADS (TR5), ATA (high suspicion), EU-TIRADS (5), and Kwak-TIRADS (4b) for malignancy risk stratification of thyroid nodules were 92.5%, 63.5%, 69.8%, 70.6%, and 95.8%, respectively; 62.8%, 89.6%, 87.2%, 83.9%, and 63.8%, respectively; 20.7111, 16.8442, 15.7398, 12.2986, and 38.0578, respectively; and 0.792, 0.882, 0.859, 0.843, and 0.929, respectively.

CONCLUSION

All ultrasound-based risk-stratification systems had good diagnostic performance. Although this study determined the best cutoff values in individual risk-stratification systems based on statistical assessment, clinicians could adjust or alter cutoff values based on the clinical purpose of the ultrasound and the reciprocal changes in sensitivity and specificity.

Evaluation of the Performance of ACR TI-RADS Also Considering Those Nodules with No Indication of FNAC: A Single-Center Experience

BACKGROUND

Several US risk stratification score systems (RSSs) have been developed to standardize a thyroid nodule risk of malignancy. It is still a matter of debate which RSS is the most reliable. The purpose of this study is to evaluate: (1) the concordance between the American College of Radiology TI-RADS (ACR TI-RADS) and fine needle aspiration cytology (FNAC), (2) the cancer rate in the ACR TI-RADS categories, (3) the characteristics of nodules evaluated by FNAC even if not formally indicated according to ACR TI-RADS ('not indicated FNACs").

METHODS

From January 2021 to September 2022, patients attending the Endocrinology Unit of the CTO Hospital of Rome for evaluation of thyroid nodules were included.

RESULTS

830 nodules had negative cytology, belonging to TIR2 and TIR1C. One hundred and thirteen nodules were determined to be suspicious for or consistent with malignancy belonging to TIR3B/TIR4/TIR5. Of this last group, 94% were classified as TR4/TR5 nodules. In total, 87/113 underwent surgery. Among these, 73 had histologically proven cancer, 14 turned out to be benign. "Not indicated FNACs" was 623. Among these, 42 cancers were present.

CONCLUSIONS

This study confirmed the diagnostic power of ACR TI-RADS. In addition, these data suggest revising the ACR TI-RADS indication to FNAC, especially for TR4.

The clinical significance of the American College of Radiology (ACR) Thyroid Imaging Reporting and Data System (TI-RADS) category 5 thyroid nodules: Not as risky as we think?

BACKGROUND

Although the prevalence of thyroid nodules is high, few prove to be malignant. Based on sonographic features, the American College of Radiology Thyroid Imaging Reporting and Data System categorizes malignancy risk of thyroid nodules with associated management recommendations for each category level. Malignancy rates among nodules with a highly suspicious Thyroid Imaging Reporting and Data System category 5 warrant examination in the context of additional risk stratification tools, including cytopathology and molecular testing.

METHODS

All patients who underwent fine-needle aspiration biopsy for Thyroid Imaging Reporting and Data System category 5 nodules from January 2018 to September 2021 in a large integrated academic health system were reviewed. Using the Bethesda System for Reporting Thyroid Cytopathology, categories V and VI were set as malignant. Molecular testing (ThyroSeq version 3; Rye Brook, NY) yielding ≥50% risk of malignancy was deemed positive and correlated with surgical pathology.

RESULTS

A total of 496 Thyroid Imaging Reporting and Data System category 5 nodules were identified. On fine-needle aspiration cytopathology, 61 (12.3%) were malignant. The breakdown included Bethesda System for Reporting Thyroid Cytopathology I, 15 (3%); II, 362 (73%); III, 52 (10.5%); IV, 5 (1%); V, 6 (1.3%); and VI, 55 (11.1%). Of Bethesda System for Reporting Thyroid Cytopathology III/IV nodules with molecular testing (n = 53), 24.5% yielded positive results. In total, 42 (8.5%) nodules underwent surgical resection, most of which were Bethesda System for Reporting Thyroid Cytopathology VI (n = 26, 61.9%). Of excised nodules, 33 (78.6%) nodules were malignant, 6 (14.3%) benign, and 3 (7.1%) noninvasive follicular thyroid neoplasm with papillary-like nuclear features. All Thyroid Imaging Reporting and Data System category 5 nodules with malignant cytology (Bethesda System for Reporting Thyroid Cytopathology V/VI) that underwent surgery were malignant on histopathology. On average, the total Thyroid Imaging Reporting and Data System points were higher in malignant nodules compared with benign (9.3 vs 7.3; P = .015). Moreover, benign nodules more frequently received Thyroid Imaging Reporting and Data System points when the radiologist was unable to determine composition or echogenicity (33% vs 3% among malignant nodules; P = .01).

CONCLUSION

Thyroid Imaging Reporting and Data System category 5 designation in thyroid nodules is associated with a lower risk of malignancy than previously reported. Benign and malignant nodules with Thyroid Imaging Reporting and Data System category 5 designation have discrepancies in certain Thyroid Imaging Reporting and Data System characteristics and individual points assigned, which may offer an opportunity for quality improvement and standardization measures in ultrasound reporting practices.

Diagnostic Performance of ACR and Kwak TI-RADS for Benign and Malignant Thyroid Nodules: An Update Systematic Review and Meta-Analysis

(1) Background: To determine the optimal cut-off values of two risk stratification systems to discriminate malignant thyroid nodules and to compare the diagnostic performance; (2) Methods: True and false positive and negative data were collected, and methodological quality was assessed for forty-six studies involving 39,085 patients; (3) Results: The highest area under the receiver operating characteristic (ROC) curve (AUC) of ACR and Kwak TI-RADS were 0.875 and 0.884. Based on the optimal sensitivity and specificity, the highest accuracy values of ROC curves or diagnostic odds ratios (DOR) were taken as the cut-off values for TR4 (moderate suspicious) and 4B. The sensitivity, specificity, DOR, and AUC by ACR (TR4) and Kwak TI-RADS (4B) for malignancy risk stratification of thyroid nodules were 94.3% and 96.4%; 52.2% and 53.7%; 17.5185 and 31.8051; 0.786 and 0.884, respectively. There were no significant differences in diagnostic accuracy in any of the direction comparisons of the two systems; (4) Conclusions: ACR and Kwak TI-RADS had good diagnostic performances (AUCs > 85%). Although we determined the best cut-off values in individual risk stratification systems based on statistical assessment, clinicians can adjust the optimal cut-off value according to the clinical purpose of the ultrasonography because raising or lowering cut-points leads to reciprocal changes in sensitivity and specificity.

The Efficacy of ACR TI-RADS in the Management of Suspected Thyroid Nodules and Its Correlation With the Bethesda Scoring System

Objective:

Ultrasonography (US) and fine-needle aspiration biopsy (FNAB) play an important role in the diagnosis of thyroid nodules. The primary aim of this study was to evaluate the relationship between American College of Radiology Thyroid Imaging Reporting and Data System (ACR TI-RADS) and the Bethesda system, based on final cytopathology.

Materials and Methods:

The cases that underwent thyroidectomy, due to a nodule, between May 2019 and May 2021 were retrospectively imaged. Of those cases, 73 patients were included in the study. The obtained data included ACR TI-RADS and the Bethesda system scores for nodules.

Results:

According to Spearman correlation, a very strong positive relationship was found between the Bethesda scoring system and ACR TI-RADS scores (ρ = 0.832, P < .0001). A 94.4% sensitivity and 65.4% specificity were found in 16 patients with a Bethesda score of 3 and TR3 based on final pathology ( P < .001). And a sensitivity of 77.3% and specificity of 51.5% were found in 17 patients, with a Bethesda score 4 and TR4 ( P < .001). Finally, a sensitivity of 55.6% and specificity of 50.0% were found in 17 patients with a Bethesda score 6 and TR5 ( P < .001).

Conclusion:

The routine use of the ACR TI-RADS classification in thyroid nodules could be useful in preventing unnecessary FNABs. It could be effective in minimizing complications secondary to FNAB and thyroidectomy and reducing costs.

Association of the Implementation of a Standardized Thyroid Ultrasonography Reporting Program With Documentation of Nodule Characteristics

Importance

Although most thyroid nodules are benign, the potential for malignant neoplasms is associated with unnecessary workup in the form of imaging, fine-needle aspiration, and diagnostic surgery. The American College of Radiology Thyroid Imaging Reporting and Data System (ACR TI-RADS) is commonly used to assess the malignant neoplasm risk potential of thyroid nodules imaged by ultrasonography. However, standardized reporting of ACR TI-RADS descriptors is inconsistent.

Objective

To increase the documentation rate of ACR TI-RADS thyroid nodule characteristics to 80% in 18 months.

Design, Setting, and Participants

This prospective interrupted time series quality improvement study was conducted from December 1, 2018, to March 31, 2020, at a tertiary outpatient head and neck clinic among 229 patients who had at least 1 documented thyroid nodule identified on bedside clinic ultrasonography. Data analysis was performed throughout the entire study period because this was a quality improvement study with iterative small cycle changes; final analysis of the data was performed in April 2020.

Main Outcomes and Measures

The primary outcome was the documentation rates of 6 ACR TI-RADS ultrasonographic descriptors. Secondary outcomes included nodule fine-needle aspiration biopsy rate and physician-reported clinic flow efficiency.

Results

A total of 229 patients had at least 1 documented thyroid nodule and were included in the analysis. Size was the most frequently documented nodule characteristic (72 of 74 [97.3%]) at baseline, followed by echogenic foci (31 of 74 [41.9%]), composition (23 of 74 [31.1%]), echogenicity (17 of 74 [23.0%]), margin (6 of 74 [8.1%]), and shape (1 of 74 [1.4%]). After 3 Plan, Do, Study, Act (PDSA) cycles, the final intervention consisted of a standardized ultrasonography reporting form and educational initiatives for surgical trainees. After the third PDSA cycle (n = 36), reporting of nodule size, echogenic foci, and composition increased to 100%. Similarly, reporting of echogenicity (34 of 36 [94.4%]), shape (28 of 36 [77.8%]), and margin (25 of 36 [69.4%]) all increased. This represented a cumulative 90.3% documentation rate (195 of 216), a 56.5% increase from baseline (95% CI, 50.0%-61.9%). The standardized reporting form was used in 83.3% of eligible thyroid ultrasonography cases (30 of 36) after PDSA cycle 3, demonstrating good fidelity of implementation. There were no unintended consequences associated with clinic workflow, as a balancing measure, reported by staff surgeons.

Conclusions and Relevance

This study suggests that implementation of an ACR TI-RADS-based reporting form in conjunction with educational initiatives improved documentation of ultrasonographic thyroid nodule characteristics, potentially allowing for improved bedside risk stratification and communication among clinicians.

The New Era of TIRADSs to Stratify the Risk of Malignancy of Thyroid Nodules: Strengths, Weaknesses and Pitfalls

Simple Summary

The aim of this review is to provide the reader with a comprehensive overview of thyroid imaging and reporting data systems used for thyroid nodules, so as to understand how nodules are scored with all existing systems. Both ultrasound based risk stratification systems and indications for fine-needle aspirations are described. Systems are compared by analyzing their strengths and weaknesses. Studies show satisfactory sensitivities and specificities for the diagnosis of malignancy for all systems, and none of them have shown a real significant advantage over the others in terms of raw diagnostic value. Interobserver agreement is also very similar for all systems, fairly adequate to robust. Dimensional cut-offs for fine-needle aspiration are quite similar and all RSSs seem to reduce effectively the number of unnecessary FNAs. Merging all existing systems in a common international one is desirable.

Abstract

Since 2009, thyroid imaging reporting and data systems (TI-RADS) have been playing an increasing role in the field of thyroid nodules (TN) imaging. Their common aims are to provide sonologists of varied medical specialties and clinicians with an ultrasound (US) based malignancy risk stratification score and to guide decision making of fine-needle aspiration (FNA). Schematically, all TI-RADSs scores can be classified as either pattern-based or point-based approaches. The main strengths of these systems are their ability (i) to homogenize US TN descriptions among operators, (ii) to facilitate and shorten communication on the malignancy risk of TN between sonologists and clinicians, (iii) to provide quantitative ranges of malignancy risk assessment with high sensitivity and negative predictive values, and (iv) to reduce the number of unnecessary FNAs. Their weaknesses are (i) the remaining inter-observer discrepancies and (ii) their insufficient sensitivity for the diagnosis of follicular cancers and follicular variant of papillary cancers. Most common pitfalls are degenerating shrinking nodules and confusion between individual and coalescent nodules. The benefits of all TI-RADSs far outweigh their shortcomings, explaining their rising use, but the necessity to improve and merge the different existing systems remains.

Diagnostic performance rates of the ACR-TIRADS and EU-TIRADS based on histopathological evidence

PURPOSE

In this study, we aimed to assess the effectiveness of malignancy stratification algorithms of the American College of Radiology (ACR) and European Thyroid Association (ETA) in the delineation of thyroid nodules using a database of nodules that were unequivocally diagnosed by means of histopathological examination and meticulously matched with the imaged nodules.

METHODS

A total of 165 patients having 251 thyroid nodules with histopathologically proven definitive diagnoses during a 5-year period were included in this study. All patients had preoperatively undergone ultrasonography (US) examination, and US characteristics of the thyroid nodules were retrospectively analyzed and assigned in compliance with the thyroid imaging reporting and data system categories recommended by the ACR (ACR-TIRADS) and ETA (EU-TIRADS). The diagnostic effectiveness in the delineation of thyroid nodules and unnecessary fine-needle aspiration (FNAB) rates were evaluated.

RESULTS

Overall, 189 nodules (75.30%) were diagnosed as benign, while 62 nodules (24.70%) were reported to be malignant based on histopathological assessment. Sensitivity and specificity rates were 71% and 75% for ACR-TIRADS and 73% and 80% for EU-TIRADS. The area under the curve values were 0.78 and 0.80 for ACR-TIRADS and EU-TIRADS, respectively. The unnecessary FNAB rates were 61% for ACR-TIRADS and 64% for EU-TIRADS as per the recommended criteria of each algorithm.

CONCLUSION

The diagnostic performance of both malignancy stratification systems was signified to be moderate and sufficient in a cohort of nodules with definite histopathological diagnosis. In light of our results, we demonstrated the strengths and weaknesses of the ACR- and EU-TIRADS for physicians who should be familiar with them for optimal management of thyroid nodules.

Validation of TIRADS ACR Risk Assessment of Thyroid Nodules in Comparison to the ATA Guidelines

Objectives:

The prevalence of thyroid nodules in adults, detected by ultrasound (US), is reported as high as 68%. US-guided fine-needle aspiration biopsy (FNAB) is the test of choice used to determine the nature of the nodules. However, not more than 15% are found to be malignant. Reducing the number of unnecessary FNAB while identifying clinically significant malignant nodules is imperative. There are several guidelines suggested for risk stratification of thyroid nodules by US. The aim of our study was to validate and compare Thyroid Imaging Reporting and Data System (TIRADS) American College of Radiology (ACR) and American Thyroid Association (ATA) risk stratification, specifically pertaining to reduction of unnecessary biopsies.

Material and Methods:

The study included 281 nodules in 245 patients who underwent FNAB between May 2018 and June 2019. Statistical analysis was performed only on 235 nodules that according to the TIRADS ACR and/ or ATA guidelines were eligible for FNAB. Data collected included nodule characteristics with corresponding TIRADS and ATA grading and cytological results using Bethesda scoring.

Results:

An agreement was found between the two criteria methods in 58.2% (137/235) of the cases. In 35.3% (83/235), ATA recommended FNAB while TIRADS did not. The specificity for ATA criteria was 7% (15/221) and for TIRADS was 37% (81/221). The sensitivity was 100% (14/14) for ATA and 86% (12/14) for TIRADS.

Conclusion:

Application of ACR TIRADS criteria can reduce the number of US-guided FNAB performed on benign nodules compared to ATA criteria, by 35%, with a cost of only two missed carcinomas that remained on further follow-up.

Ultrasound-Based Indications for Thyroid Fine-Needle Aspiration: Outcome of a TIRADS-Based Approach versus Operators' Expertise

BACKGROUND

Thyroid nodule image reporting and data systems (TIRADS) provide the indications for fine-needle aspiration (FNA) based on a combination of nodule sonographic features and size. We compared the TIRADS-based recommendations for FNA with those based on the personal expertise of qualified US investigators in the diagnosis of thyroid malignancy.

METHODS

Seven highly experienced ultrasound (US) investigators from 4 countries evaluated, online, the US video recordings of 123 histologically verified thyroid nodules. Technical resources provided the operators with a diagnostic approach close to the real-world practice. Altogether, 4,305 TIRADS scores were computed. The combined diagnostic potential of TIRADS (TIRSYS) and the personal recommendations of the investigators (PERS) were compared against 3 possible goals: to recognize all malignant lesions (allCA), nonpapillary plus non-pT1 papillary cancers (nPnT1PCA), or stage II-IV cancers (st2-4CA).

RESULTS

For allCA and nPnT1PCA, TIRSYS had lower sensitivity than PERS (69.8 vs. 87.2 and 83.5 vs. 92.6%, respectively, p <0.01), while in st2-4CA the sensitivities were the same (99.1 vs. 98.6% and TIRSYS vs. PERS, respectively). TIRSYS had a higher specificity than PERS in all 3 types of cancers (p < 0.001). PERS recommended FNA in a similar proportion of lesions smaller or larger than 1 cm (76.9 vs. 82.7%; ns).

CONCLUSIONS

Recommendations for FNA based on the investigators' US expertise demonstrated a better sensitivity for thyroid cancer in the 2 best prognostic groups, while TIRADS methodology showed superior specificity over the full prognostic range of cancers. Thus, personal experience provided more accurate diagnoses of malignancy, missing a lower number of small thyroid cancers, but the TIRADS approach resulted in a similar accuracy for the diagnosis of potentially aggressive lesions while sparing a relevant number of FNAs. Until it is not clearly stated what the goal of the US evaluation is, that is to diagnose all or only clinically relevant thyroid cancers, it cannot be determined whether one diagnostic approach is superior to the other for recommending FNA.

Ultrasound of Thyroid Nodules and the Thyroid Imaging Reporting and Data System

Benign or malignant thyroid nodules are common in adults. Fine needle aspiration biopsy is the gold standard for diagnosis. Most thyroid nodules are benign. Ultrasound imaging is the optimal noninvasive imaging modality to determine which nodules demonstrate malignant features. The American College of Radiology Thyroid Imaging Reporting and Data System committee published a standardized approach to classifying nodules on ultrasound. The ultrasound features in this system are categorized as benign, minimally suspicious, moderately suspicious, or highly suspicious for malignancy. Applying the Thyroid Imaging Reporting and Data System results in a meaningful decrease in the number of thyroid nodules biopsied.

Convolutional Neural Network to Stratify the Malignancy Risk of Thyroid Nodules: Diagnostic Performance Compared with the American College of Radiology Thyroid Imaging Reporting and Data System Implemented by Experienced Radiologists

BACKGROUND AND PURPOSE

Comparison of the diagnostic performance for thyroid cancer on ultrasound between a convolutional neural network and visual assessment by radiologists has been inconsistent. Thus, we aimed to evaluate the diagnostic performance of the convolutional neural network compared with the American College of Radiology Thyroid Imaging Reporting and Data System (TI-RADS) for the diagnosis of thyroid cancer using ultrasound images.

MATERIALS AND METHODS

From March 2019 to September 2019, seven hundred sixty thyroid nodules (≥10 mm) in 757 patients were diagnosed as benign or malignant through fine-needle aspiration, core needle biopsy, or an operation. Experienced radiologists assessed the sonographic descriptors of the nodules, and 1 of 5 American College of Radiology TI-RADS categories was assigned. The convolutional neural network provided malignancy risk percentages for nodules based on sonographic images. Sensitivity, specificity, accuracy, positive predictive value, and negative predictive value were calculated with cutoff values using the Youden index and compared between the convolutional neural network and the American College of Radiology TI-RADS. Areas under the receiver operating characteristic curve were also compared.

RESULTS

Of 760 nodules, 176 (23.2%) were malignant. At an optimal threshold derived from the Youden index, sensitivity and negative predictive values were higher with the convolutional neural network than with the American College of Radiology TI-RADS (81.8% versus 73.9%, P = .009; 94.0% versus 92.2%, P = .046). Specificity, accuracy, and positive predictive values were lower with the convolutional neural network than with the American College of Radiology TI-RADS (86.1% versus 93.7%, P < .001; 85.1% versus 89.1%, P = .003; and 64.0% versus 77.8%, P < .001). The area under the curve of the convolutional neural network was higher than that of the American College of Radiology TI-RADS (0.917 versus 0.891, P = .017).

CONCLUSIONS

The convolutional neural network provided diagnostic performance comparable with that of the American College of Radiology TI-RADS categories assigned by experienced radiologists.

Diagnostic performance of adult-based ATA and ACR-TIRADS ultrasound risk stratification systems in pediatric thyroid nodules: a systematic review and meta-analysis

OBJECTIVES

To evaluate the diagnostic performance of adult-based "American College of Radiology- Thyroid Imaging Reporting And Data System" (ACR-TIRADS) and "American Thyroid Association" (ATA) in the pediatric population.

METHODS

MEDLINE/PubMed, EMBASE, Cochrane Library, and Web of Science databases were searched for articles investigating the diagnostic performance of each stratification system (ACR-TIRADS or ATA) and evaluated them according to three aspects: (a) the risk of malignancy in each category; (b) diagnostic performance using the classic indicators (sensitivity, specificity); and (c) diagnostic performance regarding fine needle aspiration/biopsy recommendation. In addition to pathologic diagnosis, we allowed imaging follow-up as the reference standard for benign nodules.

RESULTS

Eight articles (1036 thyroid nodules) were included. For ACR-TIRADS, the pooled risk of malignancy in category was as follows: category 5 (59.3%); 4 (20.7%); 3 (11.0%); 2 (6.0%), and 1 (5.5%). For nodules of high suspicion of malignancy (category 4 or 5), the pooled sensitivity and specificity were 0.84 and 0.64. For ATA, the pooled risk of malignancy was as follows: category 5 (55.4%); 4 (34.2%); 3 (12.2%); and 2 (7.5%). For nodules of high suspicion of malignancy (category 4 or 5), the pooled sensitivity and specificity were 0.90 and 0.50. For category 5 nodules, the pooled specificity was significantly higher in ACR-TIRADS (p = 0.02). For ACR-TIRADS, the missed malignancy rate was 21.7% and the unnecessary biopsy rate was 62.7%. Information was not sufficient for this calculation with ATA.

CONCLUSIONS

The diagnostic performance of ACR-TIRADS and ATA in the pediatric population was somewhat modest. Large studies are mandatory for further validation and future amendments.

KEY POINTS

• The pooled sensitivity and specificity for highly suspicious nodules (category 4 or 5) for ACR-TIRADS were 0.84 and 0.64, and for ATA were 0.90 and 0.50, respectively. • When applying ACR-TIRADS for children, the pooled missed malignancy rate (21.7%) and unnecessary biopsy rates (62.7%) are still reasonably high. Insufficient information was available to perform these calculations for the ATA system. • Current risk stratification systems, especially ACR-TIRADS, require modification by focusing more on increasing the sensitivity and decreasing the missed malignancy rate. Lowering size cut-off for biopsy would be a reasonable option.

Agreement Between Ti-RADS Classification and Bethesda Cytopathological Findings from Thyroid Nodules in Young Adults

INTRODUCTION

Thyroid nodules are common in young adults. We sought to compare the sonographic characteristics (thyroid imaging reporting and data system [Ti-RADS] classification) with the reported cytological results (Bethesda categories) from thyroid nodules in young recruits and examine the efficiency of our unique multidisciplinary clinic.

MATERIALS AND METHODS

In this retrospective cohort, we identified young recruits (18-25 years) who underwent needle biopsies for asymptomatic thyroid nodule(s), with cytology reports of Bethesda categories II-V, performed in our "Rapid Diagnostic Service" at a large Israeli Defense Forces Medical Corps healthcare facility, between 2013 and 2018. We studied the concordance rates between their Ti-RADS and Bethesda grades, and the preoperative Bethesda grades accuracy versus final pathology results, and the time period needed for their thyroid nodules workup.

RESULTS

A total of 81 patients were included who contributed 91 nodules. A fair agreement was found between the Ti-RADS classifications and the Bethesda grades (Cohen's κ = 0.238) that was more noticeable in males than in females. The agreement rate was 87.5% in males (21 of 24), but only 77.6% in females (59 of 67) [P = .029]. Of the 5 operated benign cases, all had low Ti-RADS, and 2 had low Bethesda. Of the 8 operated malignant cases, 6 had high Ti-RADS, and 5 had high Bethesda. On average, 37.64 days elapsed between the first visit to the ultrasound study, and 24.2 days elapsed until biopsy was performed.

CONCLUSIONS

Despite an overall fair agreement between the sonographic features and cytological findings in young adults, we recommend a more aggressive approach and repeated biopsies despite reported benign pathology, because of a high false-negative rate.

Reducing Unnecessary Biopsy of American College of Radiology Thyroid Imaging Reporting and Data System Category 4 Nodules

OBJECTIVES

To assess the effectiveness of strain elastography (SE), Virtual Touch tissue imaging and quantification (VTIQ; Siemens Medical Solutions, Mountain View, CA) and their combination (SE + VTIQ) in distinguishing benign from malignant American College of Radiology Thyroid Imaging Reporting and Data System category 4 nodules (TR4) to reduce unnecessary biopsy.

METHODS

In this retrospective study, 985 thyroid nodules from 920 patients were initially enrolled and examined with conventional ultrasound, SE, and VTIQ. The sensitivity, specificity, accuracy, positive predictive value, and negative predictive value of SE, VTIQ, and SE + VTIQ were calculated respectively. An area under the receiver operating characteristic curve analysis was applied to evaluate the diagnostic efficiency of SE, VTIQ, and SE + VTIQ in the differentiation of benign and malignant TR4 nodules.

RESULTS

A total of 864 patients with 922 TR4 nodules were enrolled ultimately, as 63 thyroid nodules from 56 patients were excluded because they did not meet the inclusion criteria of this study. The sensitivity, specificity, accuracy, positive predictive value, and negative predictive value of SE, VTIQ, and SE + VTIQ were 72.4% versus 86.3% versus 82.1%, 77.7% versus 80.5% versus 83.5%, 70.6% versus 76.1% versus 80.2%, 73.4% versus 76.3% versus 83.5%, and 75.5% versus 79.7% versus 82.8%, respectively. The areas under the receiver operating characteristic curve for the diagnosis of TR4 nodules by SE, VTIQ, and SE + VTIQ were 0.751, 0.817, and 0.844.

CONCLUSIONS

In spite of a slight decrease in the sensitivity, the application of combining SE and VTIQ techniques can improve the specificity and accuracy of TR4 nodule diagnosis, which can help reduce unnecessary biopsies of TR4 nodules.

Explore the Diagnostic Efficiency of Chinese Thyroid Imaging Reporting and Data Systems by Comparing With the Other Four Systems (ACR TI-RADS, Kwak-TIRADS, KSThR-TIRADS, and EU-TIRADS): A Single-Center Study

PURPOSE

To explore the characteristics of C-TIRADS by comparing it with ACR-TIRADS, Kwak-TIRADS, KSThR-TIRADS and EU-TIRADS.

METHODS

A total of 1096 nodules were collected from 884 patients undergoing thyroidectomy in our center between May 2018 and December 2020. Divided the nodules into two groups: ">10mm" and "≤10mm". Ultrasound characteristics of each nodule were observed and recorded by 2 doctors, then classified based on ACR-TIRADS, Kwak-TIRADS, KSThR-TIRADS, EU-TIRADS, and C-TIRADS.

RESULTS

A total of 682 benign nodules cases (62.23%) and 414 malignant nodules cases (37.77%) were identified. The ICC value of each guideline was:0.937(ACR-TIRADS), 0.858(EU-IRADS), 0.811(Kwak-TIRADS), 0.835(KTA/KSThR-TIRADS) and 0.854(C-TIRADS). The nodule malignancy rates in the groups(Kwak-TIRADS 4B, C-TIRADS 4B、4C) of two sizes were significantly different (all p<0.05). There was no statistical difference in the other grades of two sizes (all p>0.05). Unnecessary biopsy rates were the lowest in C-TIRADS (49.02% p<0.001). Furthermore, Kwak-TIRADS had the highest sensitivity and NPV (89.9%, 91.0%, all p<0.05), while C-TIRADS had the highest specificity and PPV (82.3%, 69.2%, all p<0.05). C-TIRADS and Kwak-TIRADS had the highest accuracy (76.0%, 72.5%, P=0.071). The AUCs of the 5 guidelines were C-TIRADS(0.816, P<0.05), Kwak-TIRADS(0.789, P<0.05) KTA/KSThR-TIRADS and ACR-TIRADS(0.773, 0.763, P=0.305), EU-TIRADS(0.734, P<0.05). The AUCs of the five guidelines were not statistically different between "nodules>10mm" and "nodules ≤ 10mm" (all P>0.05).

CONCLUSIONS

All five guides showed excellent interobserver agreement. C-TIRADS was slightly efficient than Kwak-IRADS, KTA/KSThR-TIRADS and ACR-TIRADS, and had greater advantages than EU-TIRADS. The diagnostic abilities of the five guidelines for "nodules ≤ 10mm" were not inferior to that of "nodules> 10mm". C-TIRADS is simple and easy to implement and can provide effective thyroid tumor risk stratification for thyroid nodule diagnosis, especially in China.

Microwave Ablation of Visible Benign Thyroid Nodules with Different Internal Characteristics: A Comparative Study with Follow-up Results

PURPOSE

To investigate the effects of microwave ablation (MWA) on visible benign thyroid nodules (BTN) with different internal characteristics.

MATERIALS & METHODS

A total of 51 cases with 53 visible BTN were treated by ultrasound-guided percutaneous MWA. The 53 nodules were classified into three categories according to the internal characteristics, which were simple solid, mainly solid and mainly cystic nodules. Ultrasound examinations were performed to evaluate the volume shrinkage rations during follow-up. The thyroid functions and the cervical cosmetic scores were evaluated. The complications were observed during and after ablation.

RESULTS

A total of 53 symptomatic BTN were treated by MWA completely. The average volume of the nodules was 11.68 ± 10.16 ml, the volume reduction rates (VRR) at 1st, 3rd, 6th, 12th, and 18th months after ablation were 0.29 ± 0.27, 0.46 ± 0.25, 0.67 ± 0.19, 0.83 ± 0.10, and 0.92 ± 0.10, respectively. The VRR was significantly different among the three categories of lesions (p < 0.05). The symptoms of all patients were improved. Thyroid function indicators were fluctuated in normal range. There were no serious complications during and after the procedure.

CONCLUSION

MWA of visible BTN is safe and effective, and the short-time ablation effect is significantly different due to the internal characteristics of the nodule.

Comparison of Diagnostic Performance of Five Different Ultrasound TI-RADS Classification Guidelines for Thyroid Nodules

Objectives

We aimed to evaluate and compare the diagnostic performance of five ultrasound thyroid imaging reporting and data system (TI-RADS) classification guidelines for thyroid nodules through a review and meta-analysis.

Methods

We searched for relevant studies before February 2020 in PubMed. Then we pooled the sensitivity, specificity, likelihood ratios, diagnostic odds ratios, and area under the summary receiver operating characteristic curves. And the diagnostic odds ratios were used to compare the performance.

Results

We totally included 19 studies with 4,696 lesions in this research. The pooled sensitivity of American College of Radiology (ACR) guidelines, American Thyroid Association (ATA) guidelines, TI-RADS proposed by Kwak (Kwak TI-RADS), Korean Thyroid Association/Korean Society of Thyroid Radiology (KTA/KSThR) guidelines for malignancy risk and European Thyroid Association (ETA) guidelines is between 0.84 and 0.94. The pooled specificity is 0.68, 0.44, 0.62, 0.47, and 0.61, respectively. And the RDOR is 1.57 (ACR vs ATA), 1.37 (ACR vs ETA), 1.80 (ACR vs Kawk), 1.74 (ARC vs KTA).

Conclusions

The results suggest that five classification guidelines are all effective methods for differential diagnosis of benign and malignant thyroid nodules and ACR guideline is a better choice.

Comparison of diagnostic accuracy of ACR-TIRADS, American Thyroid Association (ATA), and EU-TIRADS guidelines in detecting thyroid malignancy

PURPOSE

This study aims to compare three guidelines according to their diagnostic accuracy in the management of thyroid nodules.

METHODS

A total of 540 patients with 597 thyroid nodules were enrolled in this study. Sonographic images were classified and scored with the American Thyroid Association (ATA-2015), American College of Radiology (ACR), and European Thyroid Association (EU) Thyroid Imaging, Reporting, and Data Systems (ACR-TIRADS and EU-TIRADS) guidelines. Fine-needle aspiration biopsy (FNAB) was performed, and cytopathological results were reported with the Bethesda system. Outcomes of these three classification systems were then correlated with Bethesda results.

RESULTS

FNAB procedures revealed a total of 447 benign and 45 malignant nodules. With guideline dedicated FNAB criteria; 38 malignant nodules could have been diagnosed with ATA-2015, which is followed by 34 nodules with ACR-TIRADS, and 31 nodules with EU-TIRADS. Nonetheless, 301 benign nodules would have been biopsied with ATA-2015, 143 benign nodules with ACR-TIRADS, 222 benign nodules with EU-TIRADS. The accuracy rate was found to be highest with ACR-TIRADS (59.93 %); while 55.20 % with ATA-2015 and 51.25 % with EU-TIRADS. The sensitivity and specificity ratios of these guidelines were as follows; ATA-2015 (82.22, 53.47), ACR-TIRADS (48.89, 60.63), and EU-TIRADS (86.67, 48.99). A total of 23 nodules (3.8 %) could not be classified with ATA-2015.

CONCLUSION

Diagnostic strengths, unnecessary recommended FNAB rates, and categorization capabilities differ among various guidelines. Clinicians and interventional radiologists should keep in mind these features in the management of thyroid nodules.

Unnecessary thyroid nodule biopsy rates under four ultrasound risk stratification systems: a systematic review and meta-analysis

OBJECTIVES

To summarize and compare unnecessary biopsy rates and diagnostic performance in the examination of thyroid nodules according to four representative US-based risk stratification systems.

METHODS

MEDLINE/PubMed and EMBASE databases were searched to identify original articles investigating unnecessary biopsy rates according to at least one of the following guidelines: ACR-TIRADS, ATA, EU-TIRADS, and K-TIRADS. The unnecessary biopsy rates for each risk stratification system were pooled using a random-effects model. Meta-regression analyses were performed to explore heterogeneity. Diagnostic odds ratios (DORs) for the appropriate selection of thyroid nodules for fine-needle aspiration were also pooled using a bivariate random-effects model.

RESULTS

Eight articles including 13,092 thyroid nodules met the eligibility criteria and were included. The pooled unnecessary biopsy rates of ACR-TIRADS, ATA, EU-TIRADS, and K-TIRADS were 25% (95% CI, 22-29%), 51% (95% CI, 44-58%), 38% (95% CI, 16-66%), and 55% (95% CI, 42-67%), respectively. The pooled unnecessary biopsy rate of ACR-TIRADS was significantly lower than that of ATA (p < .001) and K-TIRADS (p < .001), and also lower than that of EU-TIRADS, but not reaching statistical significance (p = .087). The pooled DORs of ACR-TIRADS, ATA, and K-TIRADS were 5.9 (95% CI, 3.6-9.6), 6.3 (95% CI, 4.5-8.8), and 4.5 (95% CI, 1.7-11.6), respectively, with the differences not being statistically significant.

CONCLUSIONS

ACR-TIRADS showed a lower unnecessary biopsy rate than the other risk stratification systems albeit DOR was comparable between ACR-TIRADS, ATA, and K-TIRADS. Future revisions of each system should be made by referring to ACR-TIRADS to reduce unnecessary biopsy rates.

KEY POINTS

• The pooled unnecessary biopsy rates of ACR-TIRADS, ATA, EU-TIRADS, and K-TIRADS were 25% (95% CI, 22-29%), 51% (95% CI, 44-58%), 38% (95% CI, 16-66%), and 55% (95% CI, 42-67%), respectively. • The pooled unnecessary biopsy rate of ACR-TIRADS was significantly lower than that of ATA (p < .001) and K-TIRADS (p < .001). • The pooled DORs of ACR-TIRADS, ATA, and K-TIRADS were 5.9 (95% CI, 3.6-9.6), 6.3 (95% CI, 4.5-8.8), and 4.5 (95% CI, 1.7-11.6), respectively, with the differences not being statistically significant.

Diagnostic Performance of Four Ultrasound Risk Stratification Systems: A Systematic Review and Meta-Analysis

Background: Several ultrasound (US)-based risk stratification systems have been increasingly used for the optimal management of thyroid nodules. However, there are considerable discrepancies across these systems. This study aimed to summarize and compare the category-based diagnostic performance in the detection of thyroid cancer of different US-based risk stratification systems from four societies: the American College of Radiology-Thyroid Imaging Reporting and Data System (ACR-TIRADS), the American Thyroid Association (ATA), the Korean Thyroid Association/Korean Society of Thyroid Radiology (KTA/KSThR; K-TIRADS), and the European Thyroid Association (EU-TIRADS). Methods: MEDLINE/PubMed and EMBASE databases were searched to identify original articles investigating the category-based diagnostic performance according to at least one of the following guidelines: ACR-TIRADS, ATA, K-TIRADS, and EU-TIRADS. Pooled sensitivity and specificity were calculated using a bivariate random-effects model. A subgroup analysis on nodules of 1 cm or larger and a meta-regression analysis to identify factors associated with the diagnostic performance were performed. Results: A total of 29 articles including 33,748 thyroid nodules met the eligibility criteria and were included in the analysis. For ACR-TIRADS, the pooled sensitivity and specificity were, respectively, 66% and 91% for category 5 and 95% and 55% for category 4 or 5. For ATA, the pooled sensitivity and specificity were, respectively, 74% and 88% for category 5 and 91% and 64% for category 4 or 5. For K-TIRADS, the pooled sensitivity and specificity were, respectively, 55% and 95% for category 5 and 89% and 64% for category 4 or 5. For EU-TIRADS, the pooled sensitivity and specificity were, respectively, 82% and 90% for category 5 and 96% and 52% for category 4 or 5. Study location, proportion of female patients and malignant nodules, and study design were associated with study heterogeneity. Conclusions: The overall diagnostic performance of the four US-based risk stratification systems was comparable.

COMPARISON OF DIAGNOSTIC PERFORMANCE BETWEEN THE AMERICAN COLLEGE OF RADIOLOGY THYROID IMAGING REPORTING AND DATA SYSTEM AND AMERICAN THYROID ASSOCIATION GUIDELINES: A SYSTEMATIC REVIEW

Objective: We aimed to compare the diagnostic accuracy of the American College of Radiology Thyroid Imaging Reporting and Data System (ACR TI-RADS) with the American Thyroid Association (ATA) guidelines in risk stratification of thyroid nodules. Methods: We performed a computerized search of Medline, EMBASE, Web of Science, Cochrane Library, and Google Scholar to identify eligible articles published before July 31, 2019. We included studies providing head-to-head comparison between ACR TI-RADS and ATA guidelines, with fine-needle aspiration biopsy cytology results or pathology results as the reference standard. Quality assessment of included studies was conducted using the Quality Assessment of Diagnostic Accuracy Studies-2 tool. Summary estimates of sensitivity and specificity were calculated by bivariate modeling and hierarchical summary receiver operating characteristic modeling. We also performed multiple subgroup analyses and meta-regression. Results: Twelve original articles with 13,000 patients were included, involving a total of 14,867 thyroid nodules. The pooled sensitivity of ACR TI-RADS and ATA guidelines was 0.84 (95% confidence interval [CI], 0.76-0.89) and 0.89 (95% CI, 0.80-0.95), with specificity of 0.67 (95% CI, 0.56-0.76) and 0.46 (95% CI, 0.29-0.63), respectively. There were no significant differences between the two classification criteria in terms of both sensitivity (P = .26) and specificity (P = .05). For five studies providing direct comparison of ACR TI-RADS, ATA guidelines, and Korean TI-RADS, our analyses showed that the Korean TI-RADS yielded the highest sensitivity (0.89; 95% CI, 0.82-0.94), but at the cost of a significant decline in specificity (0.23; 95% CI, 0.17-0.30). Conclusion: Both classification criteria demonstrated favorable sensitivity and moderate specificity in the stratification of thyroid nodules. However, use of ACR TI-RADS could avoid a large number of biopsies at the cost of only a slight decrease in sensitivity. Abbreviations: ACR = American College of Radiology; ATA = American Thyroid Association; FNAB = fine-needle aspiration biopsy; HSROC = hierarchical summary receiver operating characteristic; SROC = summary receiver operating characteristic; TI-RADS = Thyroid Imaging Reporting and Data System; US = ultrasonography.

Is patient age associated with risk of malignancy in a ≥4 cm cytologically benign thyroid nodule?

BACKGROUND

Current data regarding the risk of malignancy in a large thyroid nodule with benign fine-needle aspiration biopsy(FNAB) is conflicting. We investigated the impact of patient age on the risk of malignancy in nodules≥4 cm with benign cytology.

METHODS

We performed a single-institution retrospective review of patients who underwent surgery from 07/2008-08/2019 for a cytologically benign thyroid nodule ≥4 cm. The relationship between malignant histopathology and patient and ultrasound features was assessed with multivariable logistic regression.

RESULTS

Of 474 nodules identified, 25(5.3%) were malignant on final pathology. In patients <55 years old, 21/273(7.7%) nodules were malignant, compared to 4/201(2.0%) in patients ≥55. Patient age ≥55 was independently associated with significantly lower risk of malignancy(OR:0.2,95%CI:0.1-0.7,p = 0.011). Increasing nodule size >4 cm and high-risk ultrasound features were not associated with risk of malignancy(OR:1.0,95%CI:0.7-1.4,p = 0.980, and OR:9.6,95%CI:0.9-107.8,p = 0.066, respectively).

CONCLUSIONS

Patients <55 years old are 3.7-fold more likely to have a falsely benign FNA biopsy in a nodule≥4 cm.

Performance of Five Ultrasound Risk Stratification Systems in Selecting Thyroid Nodules for FNA

CONTEXT

Ultrasound (US) risk stratification systems (RSSs) have been developed to reduce the number of unnecessary fine-needle aspiration procedures (FNA) in patients with thyroid nodules.

OBJECTIVE

We conducted a systematic review and meta-analysis evaluating the ability of the 5 most common US RSSs for the appropriate selection of thyroid nodules for FNA.

DATA SOURCES

This systematic review and meta-analysis was registered on PROSPERO (CRD42019131771). PubMed, CENTRAL, Scopus, and Web of Science were searched until March 2019.

STUDY SELECTION

Original articles reporting data on the performance of AACE/ACE/AME, ACR TI-RADS, ATA, EU-TIRADS, and K-TIRADS were included.

DATA EXTRACTION

The number of nodules classified as true negative, true positive, false negative, and false positive was extracted. Summary operating points were estimated using a random-effects model. Interobserver agreement was also assessed.

DATA SYNTHESIS

Twelve studies evaluating 18 750 thyroid nodules were included. Participants were adult outpatients with thyroid nodules submitted to either FNA or core-needle biopsy or surgery and with available US images. The final diagnosis for malignant nodules was generally based on histology, while cytology was used for benign nodules. Diagnostic odds ratio (DOR) ranged from 2.2 to 4.9. A head-to-head comparison showed a higher relative DOR for ACR-TIRADS versus ATA (P = .002) or K-TIRADS (P = .002), due to a higher relative likelihood ratio for positive results.

CONCLUSIONS

The present meta-analysis found a higher performance of ACR TI-RADS in selecting thyroid nodules for FNA. However, the comparison across the most common US RSSs was limited by the data available. Further studies are needed to confirm this finding.

Accuracy of thyroid imaging reporting and data system category 4 or 5 for diagnosing malignancy: a systematic review and meta-analysis

OBJECTIVES

To determine the accuracies of the American College of Radiology (ACR)-thyroid imaging reporting and data systems (TIRADS), Korean (K)-TIRADS, and European (EU)-TIRADS for diagnosing malignancy in thyroid nodules.

METHODS

Original studies reporting the diagnostic accuracy of TIRADS for determining malignancy on ultrasound were identified in MEDLINE and EMBASE up to June 23, 2019. The meta-analytic summary sensitivity and specificity were obtained for TIRADS category 5 (TR-5) and category 4 or 5 (TR-4/5), using a bivariate random effects model. To explore study heterogeneity, meta-regression analyses were performed.

RESULTS

Of the 34 eligible articles (37,585 nodules), 25 used ACR-TIRADS, 12 used K-TIRADS, and seven used EU-TIRADS. For TR-5, the meta-analytic sensitivity was highest for EU-TIRADS (78% [95% confidence interval, 64-88%]), followed by ACR-TIRADS (70% [61-79%]) and K-TIRADS (64% [58-70%]), although the differences were not significant. K-TIRADS showed the highest meta-analytic specificity (93% [91-95%]), which was similar to ACR-TIRADS (89% [85-92%]) and EU-TIRADS (89% [77-95%]). For TR-4/5, all three TIRADS systems had sensitivities higher than 90%. K-TIRADS had the highest specificity (61% [50-72%]), followed by ACR-TIRADS (49% [43-56%]) and EU-TIRADS (48% [35-62%]), although the differences were not significant. Considerable threshold effects were noted with ACR- and K-TIRADS (p ≤ 0.01), with subject enrollment, country of origin, experience level of reviewer, number of patients, and clarity of blinding in review being the main causes of heterogeneity (p ≤ 0.05).

CONCLUSIONS

There was no significant difference among these three international TIRADS, but the trend toward higher sensitivity with EU-TIRADS and higher specificity with K-TIRADS.

KEY POINTS

• For TIRADS category 5, the meta-analytic sensitivity was highest for the EU-TIRADS, followed by the ACR-TIRADS and the K-TIRADS, although the differences were not significant. • For TIRADS category 5, K-TIRADS showed the highest meta-analytic specificity, which was similar to ACR-TIRADS and EU-TIRADS. • Considerable threshold effects were noted with ACR- and K-TIRADS, with subject enrollment, country of origin, experience level of reviewer, number of patients, and clarity of blinding in review being the main causes of heterogeneity.

Learnability and reproducibility of ACR Thyroid Imaging, Reporting and Data System (TI-RADS) in postgraduate freshmen

PURPOSE

The Thyroid Imaging, Reporting and Data System (TI-RADS) from the American College of Radiology (ACR) has been used since 2017 for the evaluation of thyroid nodules. The purpose of this study is to assess the learnability and reproducibility of TI-RADS in postgraduate freshmen.

METHODS

This was a retrospective study involving 400 nodules with a final diagnosis following ultrasound (US) examination. The nodules were randomized into eight groups (50/group). Three postgraduate freshmen and three experts evaluated the nodules according to ACR TI-RADS without knowledge of the final diagnosis. After evaluating each group, training was carried out based on the inconsistencies of the freshmen/experts. Training was stopped after 200 nodules because the κ value showed almost perfect concordance. Three months later, the 50 nodules of Group 4 (the last evaluated group) were re-evaluated to assess the reproducibility of ACR TI-RADS.

RESULTS

The diagnostic accuracy of the three postgraduate freshmen increased from 60%, 48%, and 46% in Group 1 to 80%, 78%, and 72% in Group 4 (P= 0.029, 0.002, and 0.008), respectively. After training, the diagnostic accuracy of the postgraduate freshmen was close to that of the experts (84%). For the US features, the postgraduate freshmen were consistent with the experts (all κ > 0.6). When re-evaluating Group 4 three months later, the five features had substantial to almost perfect agreement for the same researcher (all κ > 0.7).

CONCLUSION

Based on experts' consensus, ACR TI-RADS can be learned well, and its reproducibility is excellent.

Pattern-based vs. score-based guidelines using ultrasound features have different strengths in risk stratification of thyroid nodules

OBJECTIVE

To evaluate and compare the diagnostic performances between recently published pattern-based and score-based TIRADS according to the experience level of the performer.

METHODS

From July 2013 to January 2019, 8657 thyroid nodules in 8364 patients that had been cytopathologically diagnosed as benign or malignant were included (mean size, 22.0 mm ± 12.1). Thyroid nodules were categorized into US-based final assessment categories and US-FNA indications of five recently published TIRADS. Radiologists performing the US examinations were divided into the experienced vs. inexperienced group. Diagnostic performances and unnecessary biopsy rates were calculated and compared between the five TIRADS, also the experienced vs. inexperienced group.

RESULTS

Of the 8657 thyroid nodules, 6706 (77.5%) were benign and 1951 (22.5%) were malignant. Diagnostic performances for US-based final assessment categories showed higher sensitivity and NPV for EU-TIRADS (92.7% and 96.5%), while Kwak-TIRADS had higher specificity, PPV, accuracy, and AUC (89.6%, 68.0%, 86.5%, and 0.878; all p < 0.05, respectively). Diagnostic performances for US-FNA indications showed higher sensitivity and NPV for KTA/KSThR TIRADS (98.5% and 97.0%), while Kwak-TIRADS had higher specificity, PPV, accuracy, and AUC (70.3%, 46.6%, 74.5%, and 0.797; all p < 0.05, respectively). Unnecessary biopsy rates were the lowest in Kwak-TIRADS for both US categories and US-FNA indications (32.0% and 53.4%, p < 0.001). Similar trends were seen in both the experienced and inexperienced group.

CONCLUSION

The currently published score-based guidelines for thyroid nodules have significantly higher specificity, PPV, accuracy, and AUC and lower unnecessary biopsy rates, whereas pattern-based guidelines have higher sensitivity and NPV, regardless of the level of experience of the performer.

KEY POINTS

• For US-based final assessment categories, EU-TIRADS had higher sensitivity and NPV, while Kwak-TIRADS had higher specificity, PPV, accuracy, and AUC. • For US-FNA indications, KTA/KSThR TIRADS had higher sensitivity and NPV, while Kwak-TIRADS had higher specificity, PPV, accuracy, and AUC. • Similar trends were seen in diagnostic performances for both experienced and inexperienced groups.

Thyroid nodules: diagnostic evaluation based on thyroid cancer risk assessment

Thyroid nodules are extremely common and can be detected by sensitive imaging in more than 60% of the general population. They are often identified in patients without symptoms who are undergoing evaluation for other medical complaints. Indiscriminate evaluation of thyroid nodules with thyroid biopsy could cause a harmful epidemic of diagnoses of thyroid cancer, but inadequate selection of thyroid nodules for biopsy can lead to missed diagnoses of clinically relevant thyroid cancer. Recent clinical guidelines advocate a more conservative approach in the evaluation of thyroid nodules based on risk assessment for thyroid cancer, as determined by clinical and ultrasound features to guide the need for biopsy. Moreover, newer evidence suggests that for patients with indeterminate thyroid biopsy results, a combined assessment including the initial ultrasound risk stratification or other ancillary testing (molecular markers, second opinion on thyroid cytology) can further clarify the risk of thyroid cancer and the management strategies. This review summarizes the clinical importance of adequate evaluation of thyroid nodules, focuses on the clinical evidence for diagnostic tests that can clarify the risk of thyroid cancer, and highlights the importance of considering the patient's values and preferences when deciding on management strategies in the setting of uncertainty about the risk of thyroid cancer.

The Diagnostic Efficiency of Ultrasound Computer-Aided Diagnosis in Differentiating Thyroid Nodules: A Systematic Review and Narrative Synthesis

Computer-aided diagnosis (CAD) techniques have emerged to complement qualitative assessment in the diagnosis of benign and malignant thyroid nodules. The aim of this review was to summarize the current evidence on the diagnostic performance of various ultrasound CAD in characterizing thyroid nodules. PUBMED, EMBASE and Cochrane databases were searched for studies published until August 2019. The Quality Assessment of Studies of Diagnostic Accuracy included in Systematic Review 2 (QUADAS-2) tool was used to assess the methodological quality of the studies. Reported diagnostic performance data were analyzed and discussed. Fourteen studies with 2232 patients and 2675 thyroid nodules met the inclusion criteria. The study quality based on QUADAS-2 assessment was moderate. At best performance, grey scale CAD had a sensitivity of 96.7% while Doppler CAD was 90%. Combined techniques of qualitative grey scale features and Doppler CAD assessment resulted in overall increased sensitivity (92%) and optimal specificity (85.1%). The experience of the CAD user, nodule size and the thyroid malignancy risk stratification system used for interpretation were the main potential factors affecting diagnostic performance outcomes. The diagnostic performance of CAD of thyroid ultrasound is comparable to that of qualitative visual assessment; however, combined techniques have the potential for better optimized diagnostic accuracy.