1
|
Wu Z, Schmitz-Valckenberg S, Blodi BA, Holz FG, Jaffe GJ, Liakopoulos S, Sadda SR, Bonse M, Brown T, Choong J, Clifton B, Corradetti G, Corvi F, Dieu AC, Dooling V, Pak JW, Saßmannshausen M, Skalak C, Thiele S, Guymer RH. Reticular Pseudodrusen: Interreader Agreement of Evaluation on OCT Imaging in Age-Related Macular Degeneration. Ophthalmol Sci 2023; 3:100325. [PMID: 37292179 PMCID: PMC10244688 DOI: 10.1016/j.xops.2023.100325] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/23/2022] [Revised: 04/12/2023] [Accepted: 04/13/2023] [Indexed: 06/10/2023]
Abstract
Purpose To determine the interreader agreement for reticular pseudodrusen (RPD) assessment on combined infrared reflectance (IR) and OCT imaging in the early stages of age-related macular degeneration across a range of different criteria to define their presence. Design Interreader agreement study. Participants Twelve readers from 6 reading centers. Methods All readers evaluated 100 eyes from individuals with bilateral large drusen for the following: (1) the presence of RPD across a range of different criteria and (2) the number of Stage 2 or 3 RPD lesions (from 0 to ≥ 5 lesions) on an entire OCT volume scan and on a selected OCT B-scan. Supportive information was available from the corresponding IR image. Main Outcome Measures Interreader agreement, as assessed by Gwet's first-order agreement coefficient (AC1). Results When evaluating an entire OCT volume scan, there was substantial interreader agreement for the presence of any RPD, any or ≥ 5 Stage 2 or 3 lesions, and ≥ 5 definite lesions on en face IR images corresponding to Stage 2 or 3 lesions (AC1 = 0.60-0.72). On selected OCT B-scans, there was also moderate-to-substantial agreement for the presence of any RPD, any or ≥ 5 Stage 2 or 3 lesions (AC1 = 0.58-0.65) and increasing levels of agreement with increasing RPD stage (AC1 = 0.08, 0.56, 0.78, and 0.99 for the presence of any Stage 1, 2, 3, and 4 lesions, respectively). There was substantial agreement regarding the number of Stage 2 or 3 lesions on an entire OCT volume scan (AC1 = 0.68), but only fair agreement for this evaluation on selected B-scans (AC1 = 0.30). Conclusions There was generally substantial or near-substantial-but not near-perfect-agreement for assessing the presence of RPD on entire OCT volume scans or selected B-scans across a range of differing RPD criteria. These findings underscore how interreader variability would likely contribute to the variability of findings related to the clinical associations of RPD. The low levels of agreement for assessing RPD number on OCT B-scans underscore the likely challenges of quantifying RPD extent with manual grading. Financial Disclosures Proprietary or commercial disclosure may be found after the references.
Collapse
Affiliation(s)
- Zhichao Wu
- Centre for Eye Research Australia, Royal Victorian Eye and Ear Hospital, East Melbourne, Australia
- Ophthalmology, Department of Surgery, The University of Melbourne, Melbourne, Australia
| | - Steffen Schmitz-Valckenberg
- Department of Ophthalmology and GRADE Reading Center, University of Bonn, Bonn, Germany
- Utah Retinal Reading Center (UREAD) John A. Moran Eye Center, University of Utah, Salt Lake City, Utah
| | - Barbara A. Blodi
- Department of Ophthalmology and Visual Sciences, Wisconsin Reading Center (WRC), University of Wisconsin School of Medicine and Public Health, Madison, Wisconsin
| | - Frank G. Holz
- Department of Ophthalmology and GRADE Reading Center, University of Bonn, Bonn, Germany
| | - Glenn J. Jaffe
- Department of Ophthalmology, Duke University, Durham, North Carolina
| | - Sandra Liakopoulos
- Cologne Image Reading Center and Laboratory (CIRCL) and Department of Ophthalmology, University of Cologne, Faculty of Medicine and University Hospital Cologne, Cologne, Germany
- Department of Ophthalmology, Goethe-University Frankfurt, Germany
| | - Srinivas R. Sadda
- Doheny Imaging Reading Center (DIRC) and Doheny Eye Institute, David Geffen School of Medicine, University of California, Los Angeles, California
| | - Mari Bonse
- Cologne Image Reading Center and Laboratory (CIRCL) and Department of Ophthalmology, University of Cologne, Faculty of Medicine and University Hospital Cologne, Cologne, Germany
| | - Tyler Brown
- Utah Retinal Reading Center (UREAD) John A. Moran Eye Center, University of Utah, Salt Lake City, Utah
| | - John Choong
- Department of Ophthalmology, Duke University, Durham, North Carolina
| | - Bailey Clifton
- Utah Retinal Reading Center (UREAD) John A. Moran Eye Center, University of Utah, Salt Lake City, Utah
| | - Giulia Corradetti
- Doheny Imaging Reading Center (DIRC) and Doheny Eye Institute, David Geffen School of Medicine, University of California, Los Angeles, California
| | - Federico Corvi
- Doheny Imaging Reading Center (DIRC) and Doheny Eye Institute, David Geffen School of Medicine, University of California, Los Angeles, California
| | - Andrew C. Dieu
- Department of Ophthalmology and Visual Sciences, Wisconsin Reading Center (WRC), University of Wisconsin School of Medicine and Public Health, Madison, Wisconsin
| | - Vivienne Dooling
- Cologne Image Reading Center and Laboratory (CIRCL) and Department of Ophthalmology, University of Cologne, Faculty of Medicine and University Hospital Cologne, Cologne, Germany
| | - Jeong W. Pak
- Department of Ophthalmology and Visual Sciences, Wisconsin Reading Center (WRC), University of Wisconsin School of Medicine and Public Health, Madison, Wisconsin
| | | | - Cindy Skalak
- Department of Ophthalmology, Duke University, Durham, North Carolina
| | - Sarah Thiele
- Department of Ophthalmology and GRADE Reading Center, University of Bonn, Bonn, Germany
| | - Robyn H. Guymer
- Centre for Eye Research Australia, Royal Victorian Eye and Ear Hospital, East Melbourne, Australia
- Ophthalmology, Department of Surgery, The University of Melbourne, Melbourne, Australia
| |
Collapse
|