Smid LM, van Velthoven MEJ, Wong KT, Martinez-Ciriano JP, Vermeer KA. Intra- and Intergrader Agreement for Detection of OCT Angiographic Characteristics Associated With Type 3 Neovascularization.
Transl Vis Sci Technol 2021;
10:16. [PMID:
33510955 PMCID:
PMC7804578 DOI:
10.1167/tvst.10.1.16]
[Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2020] [Accepted: 11/18/2020] [Indexed: 11/25/2022] Open
Abstract
Purpose
To examine the intra- and intergrader agreement on morphologic characteristics of type 3 neovascularization on optical coherence tomography angiography (OCT-A).
Methods
OCT-A images of 22 eyes from 21 patients with a new-onset, treatment-naive type 3 neovascularization were included in this cross-sectional retrospective agreement study. Each image was graded three times by two independent medical retina specialists to assess intra- and intergrader agreement. The graders scored the presence or absence of the following vascular and structural features: intraretinal neovascularization (IRN), subretinal neovascularization, sub-retinal pigment epithelium (RPE) neovascularization (SRPEN), retinal choroidal anastomosis (RCA), intraretinal cysts, subretinal fluid, and pigment epithelial detachment. Agreement was analyzed for each feature using Gwet's AC1, к statistics, and percentage of agreement.
Results
The best agreement (AC1) was found for intraretinal neovascularization (withingrader1: 0.94; withingrader2: 0.93 and between: 1.00) and intraretinal cysts (withingrader1, 1.00; withingrader2, 0.97 and between, 1.00). The poorest intragrader agreements were observed for SRPEN (withingrader1, 0.54 and withingrader2, 0.36) and RCA (withingrader1, 0.45 and withingrader2, 0.52), and the poorest intergrader agreement was found for SRPEN, RCA, and pigment epithelial detachment (0.18, 0.37, and 0.15, respectively).
Conclusions
Although the agreement values were high for intraretinal features, considerable grader variability was found for the vascular and structural features in the deeper retina or under the RPE. Clinicians should be careful to base therapeutic decisions on qualitative OCT-A assessment, because even well-trained specialists show a considerable grader variation in their subjective evaluation.
Translational Relevance
The clinical value of OCT-A imaging largely depends on the agreement of subjective evaluations by ophthalmologists.
Collapse