Fultz PJ, Jacobs CV, Hall WJ, Gottlieb R, Rubens D, Totterman SM, Meyers S, Angel C, Del Priore G, Warshal DP, Zou KH, Shapiro DE. Ovarian cancer: comparison of observer performance for four methods of interpreting CT scans.
Radiology 1999;
212:401-10. [PMID:
10429697 DOI:
10.1148/radiology.212.2.r99au19401]
[Citation(s) in RCA: 20] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
PURPOSE
To assess the effects of four interpretative methods on observers' mean sensitivity and specificity by using computed tomography (CT) of ovarian carcinoma as a model.
MATERIALS AND METHODS
CT scans in 98 patients with ovarian carcinoma and 49 women who were disease free were retrospectively reviewed by four experienced blinded radiologists to compare single-observer reading, single-observer reading with an anatomic checklist, paired-observer reading (simultaneous double reading), and replicated reading (combination of two independent readings). Confidence level scoring was used to identify three possible disease forms in each patient: extranodal tumor, lymphadenopathy, and ascites. Patient conditions were then categorized as abnormal or normal.
RESULTS
There were no significant improvements in sensitivity or specificity for classification of patient conditions as abnormal or normal when comparing single-observer interpretation with single-observer interpretation with a checklist or paired-observer interpretation. Although there was no significant improvement in the mean sensitivity (93% vs 94%) by using the replicated reading method, there was a statistically significant improvement in mean specificity (85% vs 79%) for the replicated readings compared with single-observer interpretations (P < .05).
CONCLUSION
Diagnostic aids such as checklists and paired simultaneous readings did not lead to an improved mean observer performance for experienced readers. However, an increase in the mean specificity occurred with replicated readings.
Collapse