Molecular testing results as a quality metric for evaluating cytopathologists' utilization of the atypia of undetermined significance category for thyroid nodule fine-needle aspirations

Atypia of undetermined significance and ThyroSeq v3-positive call rates as quality control metrics for cytology laboratory performance

BACKGROUND

The Bethesda System for Reporting Thyroid Cytopathology (TBSRTC) recommends an upper limit of 10% for atypia of undetermined significance (AUS). Recent data suggest that this category might be overused when the rate of cases with molecular positive results is low. As a quality metric, the AUS and positive call rates for this facility's cytology laboratory and each cytopathologist (CP) were calculated.

METHODS

A retrospective analysis of all thyroid cytology cases in a 4.5-year period was performed. Cases were stratified by TBSRTC, and molecular testing results were collected for indeterminate categories. The AUS rate was calculated for each CP and the laboratory. The molecular positive call rate (PCR) was calculated with and without the addition of currently negative to the positive results obtained from the ThyroSeq report.

RESULTS

A total of 7535 cases were classified as nondiagnostic, 7.6%; benign, 69%; AUS, 17.5%; follicular neoplasm/suspicious for follicular neoplasm, 1.4%; suspicious for malignancy, 0.7%; and malignant, 3.8%. The AUS rate for each CP ranged from 9.9% to 36.8%. The overall PCR was 24% (range, 13%-35.6% per CP). When including cases with currently negative results, the PCR increased to 35.5% for the cytology laboratory (range, 13%-42.6% per CP). Comparison analysis indicates a combination of overcalling benign cases and, less frequently, undercalling of higher TBSRTC category cases.

CONCLUSIONS

The AUS rate in the context of PCR is a useful metric to assess cytology laboratory and cytopathologists' performance. Continuous feedback on this metric could help improve the overall quality of reporting thyroid cytology.

Molecular-derived risk of malignancy and the related positive call rate of indeterminate thyroid cytology diagnoses as quality metrics for individual cytopathologists

BACKGROUND

Indeterminate thyroid cytopathology diagnoses represent differing degrees of risk that are corroborated by follow-up studies. However, traditional cytologic-histologic correlation may overestimate the risk of malignancy (ROM) because only a subset of cases undergo resection. Alternatively, some molecular tests provide probability of malignancy data to calculate the molecular-derived risk of malignancy (MDROM) and the positive call rate (PCR). The authors investigated MDROMs and PCRs of indeterminate diagnoses for individual cytopathologists as quality metrics.

METHODS

This study was approved by the Department of Pathology Quality Improvement Program. Thyroid cytopathology diagnoses and ThyroSeq v3 results were retrieved for each cytopathologist for a 2-year period with at least 3 years of follow-up for the atypia of undetermined significance (AUS), follicular neoplasia (FN), and follicular neoplasia, oncocytic-type (ONC) cytopathologic diagnoses. MDROMs and PCRs were compared with reference ROMs and cytologic-histologic correlation outcomes.

RESULTS

The overall MDROMs (and ranges for cytopathologists) for the AUS, FN, and ONC categories were 13.4% (range, 5.8%-20.8%), 28.1% (range, 22.1%-36.7%), and 27.0% (range, 19.5%-41.5%), respectively, and most individual cytopathologists' MDROMs were within reference ROM ranges. However, PCRs more effectively parsed the differences in cytopathologists' ROM performance. Although the overall PCRs were not significantly different across cytopathologists (p = .06), the AUS PCRs were quite different (p = .002). By cytologic-histologic correlation, six of 55 resected cases (10.9%) were falsely negative, and there were no false-positive cases.

CONCLUSIONS

MDROMs and PCRs evaluate concordance with reference ROMs and with one another and provide individual feedback, which potentially facilitates quality improvement.

[Molecular and other ancillary tests proposed by The Bethesda system for reporting thyroid cytopathology 2023]

For the first time the 2023 version of The Bethesda System for Reporting Thyroid Cytology dedicates a whole chapter (chapter 14) to ancillary studies almost exclusively represented by molecular testing. The latest data reported bring some evidence that molecular testing could help to optimize the diagnostic performance of « indeterminate » categories (AUS and NF). Other studies suggest a promising role to guide the management of suspicious of malignancy and malignant categories. Indeed, the recognition of prognostic and predictive biomarkers analyzed on cytological samples, regardless of how it is collected, has progressed thanks to advances in our knowledge of molecular abnormalities of thyroid tumors. The chapter 14 is presented here highlighting the current and emerging roles of « in-house » and commercialized molecular testing as presented by TSBRTC.

Binary subclassification scheme (AUS-Nuclear versus AUS-Other) adequately risk-stratifies thyroid fine needle aspiration specimens classified as Atypia of Undetermined Significance

INTRODUCTION

The Bethesda System for Reporting Thyroid Cytopathology previously described 4 subclasses of atypia within the Atypia of Undetermined Significance (AUS) category: nuclear (AUS-Nuc), architectural (AUS-A), oncocytic (AUS-Onc), and atypia not otherwise specified (AUS-NOS). Accumulating evidence supports a binary AUS subclassification scheme based primarily on the presence of nuclear atypia only. The purpose of this study is to compare the risk stratification of binary versus 4-tier AUS subclassification systems among AUS nodules with molecular and/or histologic follow-up.

MATERIALS AND METHODS

Thyroid aspirates classified as AUS and tested using Afirma (Veracyte, Inc.) between 6/2013 and 7/2021 were included. For resected nodules, histological classification was considered as the final outcome. For unresected nodules, benign Afirma results were considered low-risk outcomes, similar to histologically benign nodules. Suspicious or nondiagnostic Afirma results were considered indeterminate outcomes. The prevalence of outcomes warranting surgery (noninvasive follicular thyroid neoplasm with papillary-like nuclear features [NIFTP] or cancer) was calculated for each AUS subclass.

RESULTS

A total of 559 AUS nodules with Afirma testing were identified. Excluding nodules with indeterminate molecular outcomes, NIFTP/cancer prevalence for AUS-Nuc was 21% (57/266), which was higher than that for AUS-A (6%, 11/188), AUS-Onc (8%, 4/53), and AUS-NOS (0%, 0/9). A binary AUS subclassification scheme based on nuclear atypia showed a significant difference in NIFTP/cancer prevalence (21% versus 6%, P < 0.0001).

CONCLUSIONS

Binary reporting of AUS subclasses based on nuclear atypia distinguishes cases with a higher risk of NIFTP/cancer. There is a low but non-negligible prevalence of NIFTP/cancer in cases without nuclear atypia.

Evaluating local thyroid cytopathology practices by molecular quality metrics: A multi-institutional study on 4651 FNAs with a focus on the role of the interventional cytopathologist

BACKGROUND

The diagnostic accuracy of thyroid fine-needle aspiration (FNA) can be highly influenced by the technical skills of the operator performing the procedure and by interobserver variability in microscopic interpretation. This is particularly true for the indeterminate categories. Recently, molecular testing has been proposed as an ancillary tool for monitoring the performance of different thyroid cytopathology practices. The objective of this multicenter study was to evaluate the quality of different local cytopathology practices by assessing the impact of interventional cytopathologists on FNA adequacy for molecular testing and the variations in mutation rates across different health care centers operating in the Campania region.

METHODS

The study included 4651 thyroid FNA samples diagnosed in different Southern Italian clinical laboratories belonging to the TIRNET (the Tiroide Network). FNA samples were collected by different proceduralists and were classified by local cytopathologists according to The Bethesda System for Reporting Thyroid Cytopathology. FNAs classified as atypia of undetermined significance, follicular neoplasm, suspicious for malignancy, and malignant were centralized for a real-time polymerase chain reaction-based, seven-gene test at the authors' institution.

RESULTS

Centers that employed interventional cytopathologists obtained fewer unsatisfactory FNA samples for molecular testing (11.3%) than centers that employed noncytopathologists (16.7%; p < .05). Furthermore, a significant variation in the mutation rate was observed in FNAs diagnosed by different local cytopathologists; indeterminate categories had the highest percentage of mutation rate variability among centers.

CONCLUSIONS

Interventional cytopathologists obtained higher yields of diagnostic material for molecular testing. Finally, the current results suggest that the variability in mutation rates among different centers may highlight the low reproducibility of microscopic criteria among cytopathologists, particularly for indeterminate cases.

Performance of Afirma genomic sequencing classifier and histopathological outcome in Bethesda category III thyroid nodules: Initial versus repeat fine-needle aspiration

BACKGROUND

There is limited data comparing the performance of Afirma Genomic Sequencing Classifier (GSC) in thyroid nodules carrying an initial versus a repeat diagnosis of atypia of undetermined significance (AUS). This study reported an institutional experience in this regard.

MATERIALS AND METHODS

This retrospective study included consecutive thyroid nodules that had an initial or a repeat AUS diagnosis and had a subsequent GSC diagnostic result (benign or suspicious) from 2017 to 2021. All nodules were followed by surgical intervention or by clinical and/or ultrasound monitoring. GSC's benign call rate (BCR), rate of histology-proven malignancy associated with a suspicious GSC result, and diagnostic parameters of GSC were calculated and compared between the two cohorts (initial versus repeat AUS). Statistical significance was defined with a p-value of <.05 for all analysis.

RESULTS

A total of 202 cases fulfilled inclusion criteria, including 67 and 135 thyroid nodules with an initial and a repeat AUS diagnosis, respectively. BCR was 67% and 66% in initial and repeat AUS cohorts, respectively. Rate of histology-proven malignancy associated with a suspicious GSC result were 22% and 24% in initial and repeat AUS cohorts, respectively. Compared with the repeat AUS cohort, the initial AUS cohort showed slightly lower sensitivity (83% vs. 100%), specificity (70% vs. 73%), PPV (23% vs. 24%), NPV (98% vs. 100%), and diagnostic accuracy (72% vs. 75%). Nevertheless, these differences did not reach statistical significance.

CONCLUSION

GSC demonstrated comparable performance in thyroid nodules with a repeat AUS diagnosis versus nodules with an initial AUS diagnosis.

Use of molecular testing results to analyze the overuse of atypia of undetermined significance in thyroid cytology

INTRODUCTION

The suggested atypia of undetermined significance (AUS) rate for thyroid fine-needle aspiration biopsies is 10% or less. Prompted by a high institutional AUS rate, we examined using molecular testing results (MTR) as a potential quality metric tool to reduce the AUS rate. We correlated MTR with AUS cytologic findings, surgical pathology follow-up, and individual pathologist AUS rates.

MATERIALS AND METHODS

Demographic data, cytologic diagnoses, MTR, and surgical pathology diagnoses were retrospectively obtained. MTR were classified as either positive or negative. AUS rates and MTR proportions were compared among pathologists. The cytomorphologic features of 143 AUS cases were assessed and correlated with MTR.

RESULTS

Between 2017 and 2022, 710 of 3247 thyroid fine-needle aspirations were classified as AUS, with a yearly average rate of 22% (range = 19%-26%). AUS cases included: 331 (47%) with architectural atypia; 204 (29%) with oncocytic (Hürthle cell) atypia; 99 (14%) with combined architectural and cytologic atypia; and 76 (10%) with isolated cytologic atypia. Most AUS cases with molecular testing had negative MTR (360/492, 73%). AUS with cytologic atypia had higher positive MTR risk (logarithm of odds ratio = 1.27, 95% credible interval [0.5-2.04], P = 0.001). The average positive MTR rate by pathologist was 21.5% (range 0%-35%); higher positive MTR rates had better correlation with subsequent neoplastic/malignant histologic diagnoses. The MTR sensitivity for malignant disease was 89% and the negative predictive value was 91%.

CONCLUSIONS

MTR analysis reveals the importance of cytologic atypia as a determinant of malignancy risk in AUS cases. Periodic analysis of MTR data alongside individual pathologist AUS rates can help refine diagnostic criteria and potentially reduce AUS overuse.

Risk stratification of cytologically indeterminate thyroid nodules with nondiagnostic or benign cytology on repeat FNA: Implications for molecular testing and surveillance

BACKGROUND

Evidence guiding the management of cytologically indeterminate thyroid nodules with nondiagnostic (ND) or benign cytology on repeat fine-needle aspiration (FNA) is limited. This study evaluates the utility of molecular testing and estimates the risk of noninvasive follicular thyroid neoplasm with papillary-like nuclear features (NIFTP) and cancer among such nodules.

METHODS

This was a retrospective single-institution review of thyroid nodules from adults that were classified as atypia of undetermined significance (AUS) or follicular neoplasm (FN) on initial FNA and underwent repeat FNA for cytology and Afirma testing (June 2013-July 2021). The association between repeat FNA cytology and RNA yield for Afirma was determined. Histologic outcomes were integrated with Afirma results to define end points for each nodule.

RESULTS

A total of 691 AUS and FN nodules underwent repeat FNA and Afirma testing. Diagnostic Afirma results were obtained in 98% of cases overall and in 91% of nodules with ND cytology on repeat FNA. Using combined molecular and histologic end points, the NIFTP and/or cancer prevalence for nodules with ND cytology on repeat FNA was 9% (95% confidence interval [CI], 0.042-0.182), falling between those nodules classified as benign (5%; 95% CI, 0.029-0.094) and those classified as AUS or FN (18%; 95% CI, 0.140-0.218) on repeat FNA, although not reaching statistical significance from either subgroup (p = .38 and .10, respectively).

CONCLUSIONS

AUS and FN nodules that are ND on repeat FNA have low but nonnegligible risk of NIFTP and/or cancer and may benefit from molecular testing, given the low test failure rate in this subgroup. Conversely, AUS and FN nodules reclassified as benign on repeat FNA have a very low risk of NIFTP and/or cancer and are unlikely to benefit from molecular testing.

Leveraging thoughtful quality metric selection for individual and system improvements: the atypical category and use of dashboards

Quality management is integral to the practice of cytopathology, especially given the heavily manual workflows and expanding ancillary testing requirements inherent to the cytopathology laboratory. Monitoring quality data like turnaround time, specimen unsatisfactory rates, and diagnostic category utilization rates allows for better understanding of performance with opportunities for targeted improvement if there are variations from that which is expected. However, there are costs to quality monitoring including the time and resources needed, and, in already taxed systems, quality management risks being viewed as just another box to check. While there are mandated quality metrics that must be collected by cytology laboratories, thoughtful selection of key performance indicators can be of tremendous benefit in helping to better understand complex laboratory processes and directing improvement endeavors where needed. The following short communication is a discussion on quality management in the cytopathology laboratory from 3 Cytopathology Quality Management Directors. The discussion focuses on monitoring the atypical reporting category with an emphasis on how trending and visualizing quality metrics can provide laboratories with key data.

All in for patient safety: a team approach to quality improvement in our laboratories

Patient safety and quality improvement initiatives are integral parts of every cytopathology laboratory. The need to revisit our approaches to patient safety are essential in light of the expanding test menu, ancillary studies, comprehensive diagnostic reports, and emergence of new technologies for augmenting cytologic diagnosis. Our interview with Drs. Yael Heher, Adam Seegmiller, and Paul VanderLaan explores recent developments that have shaped their perspectives in patient safety, test usage, and laboratory quality. The practical strategies presented provide tools for enhanced patient safety and improved outcomes in a new era of ancillary and molecular testing and standardized reporting in the cytopathology laboratory.