Comparison of clinician judgment with digitized image analysis in the detection of induced optic disk change in monkey eyes

The non-human primate experimental glaucoma model

The purpose of this report is to summarize the current strengths and weaknesses of the non-human primate (NHP) experimental glaucoma (EG) model through sections devoted to its history, methods, important findings, alternative optic neuropathy models and future directions. NHP EG has become well established for studying human glaucoma in part because the NHP optic nerve head (ONH) shares a close anatomic association with the human ONH and because it provides the only means of systematically studying the very earliest visual system responses to chronic intraocular pressure (IOP) elevation, i.e. the conversion from ocular hypertension to glaucomatous damage. However, NHPs are impractical for studies that require large animal numbers, demonstrate spontaneous glaucoma only rarely, do not currently provide a model of the neuropathy at normal levels of IOP, and cannot easily be genetically manipulated, except through tissue-specific, viral vectors. The goal of this summary is to direct NHP EG and non-NHP EG investigators to the previous, current and future accomplishment of clinically relevant knowledge in this model.

Technical Note: grading the vertical cup:disc ratio and the effect of scaling

PURPOSE

To evaluate the effect of scaling on sensitivity to change for grading the vertical cup:disc ratio (CDR).

METHODS

Vertical CDR was assessed by six observers (three ophthalmologists and three optometrists) on 43 stereo disc photographs. Repeated observations were made for both 0.1 and 0.05 interval scales. Paired differences were calculated for all observers and each observer separately. Mean and standard deviation of differences and agreement statistics were used to compare scales.

RESULTS

Five observers demonstrated a reduction in the spread of differences (mean difference 0.19 to 0.15) and all observers demonstrated a reduction in concordance using the finer scale (mean concordance 54% to 39%).

CONCLUSION

The use of a finer scale reduces test-retest variability and increases sensitivity to change when estimating the vertical CDR. Use of this scale does not require any additional resource and it may be easily implemented in routine clinical practice.

Diagnosing glaucoma progression: current practice and promising technologies

PURPOSE OF REVIEW

An update on recent work is provided that has broadened our understanding of the evaluation of visual function and structure, and their use in evaluating glaucoma progression.

RECENT FINDINGS

The challenge of determining visual-field progression and the implications of long-term fluctuation are reviewed and data to support the magnitude of the fluctuation are cited. The use of confirmatory testing can limit the over diagnosis of glaucoma progression. Focusing visual-field testing on the locations of present scotomas or using frequency doubling technology may provide new approaches to assessing visual function. New standardized techniques to interpret visual fields, including neural networks, unsupervised machine learning and pointwise linear regression, may provide more quantitative means for visual-field interpretation. These techniques, along with structural evaluation of the optic nerve and nerve fiber layer, are essential in glaucoma management. Optic-nerve-head photography is still a mainstay in evaluating glaucoma progression, although many technologies including scanning laser tomography, scanning laser polarimetry and optical coherence tomography offer more quantitative means to follow structural change. These modalities, in different ways, show promise in providing additional information regarding the stability of glaucoma.

SUMMARY

Identifying the functional visual component as well as structural changes is essential in evaluating glaucoma progression. New techniques of testing and evaluating visual fields, the optic-nerve head, and the retinal nerve fiber layer offer exciting opportunities to more accurately identify glaucoma progression, and are likely to become more central as imaging devices and software support develop further.

Reproducibility of evaluation of optic disc change for glaucoma with stereo optic disc photographs

PURPOSE

To determine the reproducibility of the assessment for glaucomatous change in serial optic disc stereo-slides.

DESIGN

Masked interobserver variability study.

PARTICIPANTS

Serial optic disc stereo-slides from 40 patients.

METHODS

Three independent ophthalmologists evaluated for change a set of two serial 20 degrees optic disc color stereo-slides of 40 patients. This test set was not from European Glaucoma Prevention Study (EGPS) patients. Each observer performed two evaluations at least 30 days apart and was masked from the temporal sequence of the slides and his or her previous evaluation. Each patient was graded as changed or stable by two-out-of-three agreement. A kappa statistic was used to calculate the intra- and interobserver reproducibility as well as the assignment reproducibility (first consensus versus second consensus). The same procedure was followed to test the reproducibility when another experienced ophthalmologist was added to one of the three reading centers.

MAIN OUTCOME MEASURES

Reproducibility in evaluating glaucomatous optic disc change.

RESULTS

The intraobserver reproducibility (95% confidence interval [CI]) in the evaluation of change ranged between 0.79 (0.45-1.14) and 1.00 (0.69-1.31). The interobserver reproducibility (95% CI) in the evaluation of change ranged between 0.45 (0.15-0.75) and 0.75 (0.44-1.06). The assignment reproducibility (first consensus versus second consensus in the evaluation of change) between the senior EGPS readers was 0.94 (0.63-1.25). The assignment reproducibility when another experienced ophthalmologist replaced one of the readers was 0.94 (0.63-1.25).

CONCLUSIONS

The assignment reproducibility of three expert readers looking for glaucomatous change in serial optic disc stereo-slides was excellent. It remained so when one of the three experts was replaced by another experienced reader.

Reliability of the disk damage likelihood scale

PURPOSE

To report the reliability of the glaucoma disk damage likelihood scale (DDLS) in comparison to the Armaly cup/disk ratio by determining the interobserver and intraobserver agreement for optic disk stereo photographs and the interobserver agreement for in vivo patient measurements of the optic disk.

DESIGN

Observational case series.

METHODS

Optic disk photographs: 48 stereo pairs of optic nerve photographs were selected from patients with a spectrum of glaucomatous visual field loss. Two masked observers graded the optic disk photographs three times according to the DDLS and Armaly cup/disk ratio. Interobserver and intraobserver agreements were calculated using the test-retest method. Patient measurements: three observers performed in vivo patient measurements on 34 eyes of glaucoma clinic patients and made a single determination of the DDLS stage and Armaly cup/disk ratio, based on the indirect biomicroscopic examination. Level of interobserver agreement was tabulated.

RESULTS

Optic disk photographs: interobserver and intraobserver agreement for the vertical DDLS measurement was greater than for two determinations (clinical impression and measured) of the vertical Armaly cup/disk ratio (interobserver: 85% vs 68% and 74%, respectively; intraobserver grader 1: 97% vs 89% and 80%, grader 2: 99% vs 95% and 89%, respectively). In vivo patient measurements: the interobserver agreement for the DDLS and Armaly cup/disk ratio was similar (70.1% vs 67.6%, respectively).

CONCLUSIONS

For the stereo optic disk photographs, the inter- and intra-observer agreement for the DDLS is greater than the Armaly cup/disk ratio. For the in vivo patient measurements, the level of agreement for the DDLS and the Armaly cup/disk ratio is similar.

Identification of progressive glaucomatous visual field loss

In normal individuals, visual field measures are not perfectly repeatable and individual test locations exhibit both short- and long-term sensitivity variations. This physiologic variability is greatly increased in glaucoma and confounds detection of real progressive loss in visual function. Distinguishing progressive glaucomatous visual field loss from test variability therefore represents a complex task. Procedures used for detection of glaucomatous visual field progression may be broadly grouped into four categories: 1) clinical judgment, which consists of simple subjective observation of sequential visual field test results; 2) defect classification systems, whereby specific criteria are used to stratify field loss by discrete score and define progression as score change over time, such as the Advanced Glaucoma Intervention Study scoring system; 3) trend analyses, which follow test parameters sequentially over time to determine the magnitude and significance of patterns within the data, for example linear regression; and 4) event analyses, which identify single events of significant change relative to a reference examination. All of these methods demonstrate distinct benefits and drawbacks, making each useful in specific circumstances, although no single method appears universally ideal. At the present time the best method of detection of progression may be to rely upon confirmation of change at successive examinations and also by correlation of visual field changes with other clinical observations. Alternative analysis methods may become available in the near future to help identify cases of progressive loss.

Change detection in regional and volumetric disc parameters using longitudinal confocal scanning laser tomography

PURPOSE

To develop a clinically specific strategy for optic nerve head (ONH) surface change detection within longitudinally acquired confocal scanning laser tomographic (CSLT) images.

DESIGN

Experimental study.

PARTICIPANTS AND/OR CONTROLS

Twelve monkeys, each with one glaucomatous and one contralateral normal eye.

MAIN OUTCOME MEASURES

Detection of ONH surface change within the CSLT images of each monkey's glaucomatous eye.

METHODS

Six 10 and six 15 CSLT images and four stereo optic disc photographs were obtained from both eyes of 12 monkeys on 3 separate days (imaging sessions) and then every 2 weeks after laser to one eye (study eye) to elevate intraocular pressure. For each set of 10 and 15 images per eye (and for each of the 7-25 imaging sessions per monkey), 37 CSLT parameters were calculated. Univariate change required an individual parameter to change in excess of its analysis of variance-determined minimum detectable change (MDC) value. Multivariate change required groups of three parameters, considered together, to demonstrate significant change as determined by a multivariate analysis of variance. The rate of false-positive change detection for each individual parameter and for a group of three-parameter combinations was determined using both a one-in-a-row strategy (change at a single session) and a two-in-a-row strategy (change at two successive sessions) within the postlaser images of the 12 unchanging contralateral normal eyes. Change detection within the study eye images was then assessed for only those individual parameters and three-parameter combinations that were clinically specific (i.e., showed less than 10% false-positive change detection in the normal eyes).

RESULTS

A total of 36 prelaser (three per monkey) imaging sessions and 158 postlaser (4-22/monkey) imaging sessions was performed. Clinically specific change detection (low rate of false positives) was achieved only with the two-in-a-row strategy. Overall, multivariate ONH surface change detection performed best; the best-performing three-parameter combination detected only 8 change events (4 onset and 4 progression) in 139 imaging sessions within the postlaser imaging sessions of the contralateral normal eyes and a total of 47 change events (11 onset and 36 progression) within the postlaser imaging sessions of the 12 study eyes. Counterintuitive (anterior) change occurred in most parameters within the late postlaser imaging sessions of the study eyes followed to end-stage damage.

CONCLUSIONS

Clinically specific detection of the onset and progression of glaucomatous ONH surface change is possible within longitudinally acquired CSLT images.

Comparison between laser scanning tomography and computerised image analysis of the optic disc

AIMS

To study the interchangeability of the measurements of the optic disc topography obtained by one computerised image analyser and one confocal laser tomographic scanner.

METHODS

One eye of 28 patients with glaucoma or glaucoma suspects was studied. All cases had simultaneous stereoscopic disc photographs taken with the fundus camera Topcon TRC-SS and optic disc examination with the Heidelberg retina tomograph (HRT) during the same visit. The optic disc photographs were digitised and analysed with the Topcon ImageNet (TI) system. Three variables of the optic disc topography provided by the TI and the HRT were compared--cup volume (CV), rim area (RA), and cup area to disc area ratio (CA/DA).

RESULTS

The mean values of CV and RA provided by the TI (0.52 (SD 0.32) mm3 and 1.58 (0.39) mm2, respectively) were greater (p < 0.01) than the mean values of CV and RA determined by the HRT (0.32 (0.25) mm3, and 1.33 (0.47) mm2, respectively). The mean value of CA/DA provided by the TI (0.42 (0.14)) and the HRT (0.42 (0.18)) was similar (p = 0.93). Correlation coefficients between measurements obtained by the two methods ranged from 0.53 to 0.73.

CONCLUSION

There was a significant discrepancy in the measurements of rim area and cup volume of the optic disc obtained by a computerised image analyser and a laser scanning tomograph.

Measurement of optic disc compliance by digitized image analysis in the normal monkey eye

PURPOSE

To characterize the compliance of the normal monkey optic disc under conditions of induced short-term fluctuations in intraocular pressure (IOP).

METHODS

In 10 monkeys, one eye was compliance tested on three separate days followed by a single test of the contralateral eye (40 compliance tests). In a testing session, the optic disc was imaged at 2 and 47 minutes (baseline time point) after IOP was lowered to 10 mmHg; then at 2, 17, 32, and 47 minutes after IOP was elevated to 45 mmHg; then at 2, 47, and, in some cases, 92 minutes after IOP was lowered back to 10 mmHg. Eight digitized images were analyzed at each time point, yielding two parameters to characterize the position of the disc: the Mean Position of the Disc (MPD) and the Change from MPDBaseline (the value of MPD at a given time point minus the value for MPD at the baseline time point of that testing session). Analysis of variance (ANOVA) testing was used to evaluate the overall effect of IOP on both parameters while taking into account the effects of variability due to different monkeys and repetitions of the test as well as differences between the two eyes of an individual monkey. With the addition of data from 11 compliance tests performed on eight additional monkeys, the overall results were calculated in terms of the mean Change from MPDBaseline at each time point for a total of 51 compliance testing sessions.

RESULTS

The mean Change from MPDBaseline was -28 microns (95% confidence interval, -23 to -33 microns) 47 minutes after elevation of IOP. The disc surface returned to its baseline position 92 minutes after IOP was lowered back to 10 mmHg. Elevation of IOP within a compliance test had a significant effect on the position of the optic disc surface (P = 0.0002, ANOVA), as characterized by the parameter Change from MPDBaseline. Neither the difference in the amount of movement between the two eyes of an individual monkey nor the variability within the three repetitions of the test in a given eye was statistically significant.

CONCLUSION

Small, reversible (elastic) posterior deformations of the optic disc surface follow acute elevations of IOP in the normal monkey eye. Detection of acute IOP-induced deformations of the optic disc surface may represent a means by which to mechanically test the deeper load-bearing tissues of the optic nerve head.