Diagnostic accuracy of Heidelberg Retina Tomograph III classifications in a Turkish primary open-angle glaucoma population

Evaluation of subjects with a moderate cup to disc ratio using optical coherence tomography and Heidelberg retina tomograph 3: impact of the disc area

Aim:

The aim was to evaluate subjects with a moderate cup to disc ratio using optical coherence tomograph (OCT) and Heidelberg retina tomograph (HRT) 3.

Settings and Design:

We included 80 patients with early glaucoma and 80 nonglaucomatous subjects with moderate cup/disc ratio (range of 0.5–0.8) to this cross-sectional study.

Subjects and Methods:

We compared results of color-coded algorithms of HRT 3 (Moorfields regression analysis [MRA] and Glaucoma probability score [GPS]) and OCT. All outputs are classified into three categories: Within normal limits (WNLs), borderline and outside normal limits (ONLs). Diagnostic accuracies of algorithms were determined using the highest sensitivity criteria.

Results:

The sensitivities of global MRA, GPS and OCT were 0.75, 0.925 and 0.725, respectively, in average disc area group and 0.85, 1.0 and 0.425, respectively, in large disc area group. The specificities of global MRA, GPS and OCT were 0.55, 0.15 and 0.85, respectively, in average disc area group and 0.425, 0.025 and 0.80, respectively, in large disc area group. Area under receiver operating characteristic curve (AUROC) of global MRA, GPS and OCT were 0.667, 0.617 and 0.792, respectively, in average disc area group and 0.746, 0.576 and 0.627, respectively, in large disc area group. AUROC of global MRA and OCT combination in the average and large disc area groups were 0.828 and 0.825, respectively.

Conclusions:

In contrast to GPS and OCT algorithms, diagnostic performance of MRA algorithm increased in large disc area group. Combining MRA and OCT algorithms produced satisfactory diagnostic performance in subjects with an average and large disc area.

Predictive Value of HRT Stereometric Parameters and Blue-on-Yellow Perimetry Global Indices in Glaucoma-suspected Subjects

OBJECTIVE

To determine subtle changes of Heidelberg retina tomography (HRT) stereometric parameters and blue-on-yellow (B/Y) perimetry global indices for the early diagnosis of glaucoma in suspected subjects.

PATIENTS AND METHODS

Cross-sectional data on 174 eyes of 87 subjects from a larger cohort, attending the Glaucoma Department of the "G. Gennimatas" General Hospital of Athens from January 2004 to February 2014, were used in the study. Subjects were assigned to 3 groups: (a) "normals" not requiring treatment throughout the study (group 1), (b) suspects who developed glaucoma and required treatment during the study (group 2), and (c) patients with incipient glaucoma (group 3). Specific HRT and B/Y perimetry variables were compared among the 3 groups.

RESULTS

Significant differences were established for the following HRT parameters: "reference height" differed significantly between groups 1 and 2 and groups 1 and 3; "cup shape measure" differed significantly between groups 1 and 2 and groups 2 and 3. B/Y perimetry global index "mean deviation" significantly distinguished group 2 from groups 1 and 3.

CONCLUSIONS

The results of the present study suggest the predictive value of the HRT stereometric parameters "reference height" and "cup shape measure" and of the B/Y perimetry global index "mean deviation" in glaucoma-suspected subjects; further corroboration through longitudinal studies is warranted.

Optic nerve head and fibre layer imaging for diagnosing glaucoma

BACKGROUND

The diagnosis of glaucoma is traditionally based on the finding of optic nerve head (ONH) damage assessed subjectively by ophthalmoscopy or photography or by corresponding damage to the visual field assessed by automated perimetry, or both. Diagnostic assessments are usually required when ophthalmologists or primary eye care professionals find elevated intraocular pressure (IOP) or a suspect appearance of the ONH. Imaging tests such as confocal scanning laser ophthalmoscopy (HRT), optical coherence tomography (OCT) and scanning laser polarimetry (SLP, as used by the GDx instrument), provide an objective measure of the structural changes of retinal nerve fibre layer (RNFL) thickness and ONH parameters occurring in glaucoma.

OBJECTIVES

To determine the diagnostic accuracy of HRT, OCT and GDx for diagnosing manifest glaucoma by detecting ONH and RNFL damage.

SEARCH METHODS

We searched several databases for this review. The most recent searches were on 19 February 2015.

SELECTION CRITERIA

We included prospective and retrospective cohort studies and case-control studies that evaluated the accuracy of OCT, HRT or the GDx for diagnosing glaucoma. We excluded population-based screening studies, since we planned to consider studies on self-referred people or participants in whom a risk factor for glaucoma had already been identified in primary care, such as elevated IOP or a family history of glaucoma. We only considered recent commercial versions of the tests: spectral domain OCT, HRT III and GDx VCC or ECC.

DATA COLLECTION AND ANALYSIS

We adopted standard Cochrane methods. We fitted a hierarchical summary ROC (HSROC) model using the METADAS macro in SAS software. After studies were selected, we decided to use 2 x 2 data at 0.95 specificity or closer in meta-analyses, since this was the most commonly-reported level.

MAIN RESULTS

We included 106 studies in this review, which analysed 16,260 eyes (8353 cases, 7907 controls) in total. Forty studies (5574 participants) assessed GDx, 18 studies (3550 participants) HRT, and 63 (9390 participants) OCT, with 12 of these studies comparing two or three tests. Regarding study quality, a case-control design in 103 studies raised concerns as it can overestimate accuracy and reduce the applicability of the results to daily practice. Twenty-four studies were sponsored by the manufacturer, and in 15 the potential conflict of interest was unclear.Comparisons made within each test were more reliable than those between tests, as they were mostly based on direct comparisons within each study.The Nerve Fibre Indicator yielded the highest accuracy (estimate, 95% confidence interval (CI)) among GDx parameters (sensitivity: 0.67, 0.55 to 0.77; specificity: 0.94, 0.92 to 0.95). For HRT measures, the Vertical Cup/Disc (C/D) ratio (sensitivity: 0.72, 0.60 to 0.68; specificity: 0.94, 0.92 to 0.95) was no different from other parameters. With OCT, the accuracy of average RNFL retinal thickness was similar to the inferior sector (0.72, 0.65 to 0.77; specificity: 0.93, 0.92 to 0.95) and, in different studies, to the vertical C/D ratio.Comparing the parameters with the highest diagnostic odds ratio (DOR) for each device in a single HSROC model, the performance of GDx, HRT and OCT was remarkably similar. At a sensitivity of 0.70 and a high specificity close to 0.95 as in most of these studies, in 1000 people referred by primary eye care, of whom 200 have manifest glaucoma, such as in those who have already undergone some functional or anatomic testing by optometrists, the best measures of GDx, HRT and OCT would miss about 60 cases out of the 200 patients with glaucoma, and would incorrectly refer 50 out of 800 patients without glaucoma. If prevalence were 5%, e.g. such as in people referred only because of family history of glaucoma, the corresponding figures would be 15 patients missed out of 50 with manifest glaucoma, avoiding referral of about 890 out of 950 non-glaucomatous people.Heterogeneity investigations found that sensitivity estimate was higher for studies with more severe glaucoma, expressed as worse average mean deviation (MD): 0.79 (0.74 to 0.83) for MD < -6 db versus 0.64 (0.60 to 0.69) for MD ≥ -6 db, at a similar summary specificity (0.93, 95% CI 0.92 to 0.94 and, respectively, 0.94; 95% CI 0.93 to 0.95; P < 0.0001 for the difference in relative DOR).

AUTHORS' CONCLUSIONS

The accuracy of imaging tests for detecting manifest glaucoma was variable across studies, but overall similar for different devices. Accuracy may have been overestimated due to the case-control design, which is a serious limitation of the current evidence base.We recommend that further diagnostic accuracy studies are carried out on patients selected consecutively at a defined step of the clinical pathway, providing a description of risk factors leading to referral and bearing in mind the consequences of false positives and false negatives in the setting in which the diagnostic question is made. Future research should report accuracy for each threshold of these continuous measures, or publish raw data.

HRT for the Diagnosis and Detection of Glaucoma Progression

Confocal scanning laser ophthalmoscopy through the Heidelberg Retina Tomograph (HRT) provides a rapid, safe, noncontact, and noninvasive imaging of the optic disc in three-dimensions, and provides precise detailed information about the optic disc beyond that which the clinical exam can measure. The HRT I was developed for research purposes only and was not used clinically. The HRT II was developed to be user-friendly, more rapid, and was used as an adjunct to clinical examination in the detection and progression of glaucoma. One of the main pitfalls of the HRT II was that it was operator-dependent. The HRT III was developed to be operator-independent. Initially the Moorsfield Regression Analysis provided the analysis of the stereometric optic disc parameters. The Glaucoma Probability Score, given its ease of use, operator-independence, and rapidity of use, soon gained popularity. Numerous studies have compared these two methods of analysis, with the conclusion that the Glaucoma Probability Score provides a higher sensitivity and a lower specificity than the Moorsfield Regression Analysis, which may indicate that it has potential as a screening test for glaucoma. However, there is no consensus on the use of the Glaucoma Probability Score as a screening test for glaucoma. While HRT data may be useful as a clinical adjunct in the screening and diagnosis of glaucoma, it should ultimately only be used to support clinical examination.

[Correlating cup-to-disc ratios measured by HRT-III, SD-OCT and the new color imaging Laguna ONhE procedure]

OBJECTIVE

To examine correlations between cup-to-disc (C/D) ratios determined by the new Laguna ONhE (optic nerve hemoglobin) color imaging procedure, spectral domain optical coherence tomography (OCT), confocal scanning laser tomography using Heidelberg retina tomography (HRT), and examining retinal images.

METHODS

C/D ratio measurements were made on 154 eyes of 154 subjects (52 healthy controls, 36 with ocular hypertension and 66 with primary open-angle glaucoma) using the Laguna ONhE, HRT-III (Heidelberg Engineering) and OCT Spectralis (Heidelberg Engineering) instruments and photographs of the optic disc were examined by a blinded observer (experienced glaucoma specialist).

RESULTS

Global intraclass correlation coefficients (ICC) were: 0.379 (95% CI: 0.233-0.508) for Laguna ONhE-HRT, 0.621 (95% CI: 0.513-0.709) for Laguna ONhE-OCT, and 0.558 (95% CI: 0.398-0.678) for the Laguna ONhE-observer, indicating significant agreement in each case (P<.001). The highest ICC was recorded for OCT- observer (0.715; 95% CI: 0.605-0.795).

CONCLUSIONS

C/D ratios measured using the Laguna ONhE procedure correlated well with OCT measurements and retinography measurements made by an experienced observer. Best correlation was observed for OCT versus observer measurements. Agreement was good between the Laguna ONhE, OCT and observer measurements, and was somewhat lower between HRT and the remaining procedures.

Glaucoma diagnostics

This thesis addresses several aspects of glaucoma diagnostics from both a clinical and a screening perspective. New instruments for diagnosing glaucoma have been developed over the past years, but little information is available regarding their performance as screening methods and their usefulness in ordinary clinical practice. PURPOSE OF THE RESEARCH UNDERLYING THIS THESIS:  The objectives of this research were as follows: to compare the accuracy of results of analysis of the optic nerve head (ONH) achieved by computerized imaging using the Heidelberg Retina Tomograph (HRT) and by subjective assessment performed by physicians with different degrees of experience of glaucoma (paper III); to evaluate the effect of a continuous medical education (CME) lecture on subjective assessment of the ONH for diagnosis of glaucoma (paper II); to investigate subjective assessment of perimetric test results by physicians with varying knowledge of glaucoma with a trained artificial neural network (ANN) and to compare the certainty of the classifications (paper IV); and to compare the diagnostic performance of time-domain Stratus optical coherence tomography (OCT) with that of spectral-domain Cirrus OCT (paper I), frequency doubling technology (FDT) screening perimetry and scanning laser polarimetry with the GDx variable corneal compensator (VCC) in a random population-based sample and in patients with glaucoma of varying disease severity.

METHODS AND RESULTS

  In evaluation of the ONH, use of the HRT statistical tools, Moorfields regression analysis (MRA) and the Glaucoma Probability Score (GPS) was compared with subjective assessment performed by 45 physicians. Optic nerve head images and photographs from 138 healthy and 97 glaucoma subjects were included. The sensitivity of MRA was higher (87-94%) than that of the average physician (62-82%), considerably greater than that of ophthalmologists with subspecialties other than glaucoma (53-77%) and non-significantly better than that of glaucoma experts (72-88%). Sensitivity achieved by GPS (79-93%) was also greater than that of the average physician. MRA correctly classified all eyes with advanced glaucomatous visual field defects, a result that was not achieved by GPS or even by the glaucoma experts. In eyes with small discs, MRA sensitivity (88%) was comparable with that of glaucoma experts (85%) and much better than that of GPS (50%). Also, the group comprising all physicians provided specificity (75-92%) similar to that of both MRA (69 - 86%) and GPS (72-94%) (Andersson et al. 2011a). A 1-hr CME lecture on ONH assessment led to a significant improvement in sensitivity (from 70% to 80%) and a significant decrease in uncertain assessments (from 22% to 13%), whereas specificity remained unchanged (68%) (Andersson et al. 2011b). A rise in sensitivity was seen in all subgroups of physicians, including glaucoma experts. Thirty physicians assessing standard automated perimetry (SAP) test results as Humphrey Field Analyzer single-field analysis printouts with full StatPac information from 99 patients with glaucoma and 66 healthy subjects were compared with a trained ANN regarding diagnostic performance. ANN reached significantly higher sensitivity (93%) than the average physician (83%), whereas specificity was similar for these two groups (91% and 90%, respectively). Diagnostic accuracy was similar among the different groups of physicians and seemingly rather independent of experience. Sensitivity ranged from 82% in the subgroup of other subspecialists to 87% in the glaucoma expert group, and specificity ranged from 88% among general ophthalmologists to 91% for glaucoma experts. The ANN attained certainty of classification that was in parity with that provided by the glaucoma experts and did not make any completely incorrect classifications of the visual fields (i.e. erroneous classifications were in the borderline zone) (Andersson et al. 2012). From a population-based randomly selected sample (n=308) of older subjects (aged ≥ 50 years) living in southern Sweden, 170 subjects underwent a comprehensive examination that included Stratus OCT, Cirrus OCT, an FDT screening programme and the GDx VCC. The same test protocol was applied to 138 randomized clinical patients with different stages of glaucoma. In the population-based sample, both Stratus and Cirrus OCT showed high diagnostic accuracy with area under the receiver-operating curve (aROC) values close to 1.0 (Bengtsson et al. 2012). Both OCT instruments correctly classified all of the clinical glaucoma patients with advanced disease. FDT screening showed high sensitivity (91%) but erroneously gave normal test results for some eyes with advanced disease. GDx VCC had lower sensitivity (73-92%) and also led to a large proportion of examinations with an atypical retardation pattern that is known to affect the diagnostic efficiency of this instrument.

CONCLUSIONS

  The HRT MRA performed better than most physicians and was consistent with the glaucoma experts. These results suggest that MRA can be a valuable tool for diagnosing glaucoma in ordinary practice, particularly when only a few glaucoma experts are available. Even though MRA provided 100% sensitivity in eyes with advanced glaucoma, it probably does not offer sufficient specificity to make it suitable as a screening method. Continuing medical education on ONH analysis had a small, but positive effect on diagnostic accuracy for glaucoma. An ANN trained to classify visual fields seemed to perform at least as well as most of the participating physicians, whose performances were remarkably similar regardless of their level of experience. This indicates that available tools for interpreting SAP findings are helpful in assessments of visual field test results. However, SAP is associated with learning effects (Heijl et al. 1989) that may entail low specificity for untrained subjects, and hence, it is not an ideal screening method for glaucoma. By comparison, the screening test of FDT is rapid and easy, but it is probably less suitable for screening purpose, because some eyes with advanced glaucoma were missed in this investigation. GDx VCC images for a relatively large number of eyes could not be analysed and is thus not appropriate for screening. The OCT instruments offer both high sensitivity and high specificity, and all eyes with advanced disease were correctly classified as glaucomatous in this evaluation. However, these instruments are still expensive and require special operator skills. Additional development to obtain OCT instrument that is more compact, easier to use and less expensive might render such tomography suitable as a screening tool for glaucoma.

Factors affecting the sensitivity and specificity of the Heidelberg Retina Tomograph parameters to glaucomatous progression in disc photographs

PURPOSE

To evaluate the factors affecting the sensitivity and specificity of the stereometric optic nerve head (ONH) parameters of the Heidelberg Retina Tomograph (HRT) to glaucomatous progression in stereoscopic ONH photographs.

METHODS

The factors affecting the sensitivity and specificity of the vertical cup : disc ratio, the cup : disc area ratio, the cup volume, the rim area and a linear discriminant function to progression were analysed. These parameters were the best indicators of progression in a retrospective study of 476 eyes. The reference standard for progression was the masked evaluation of stereoscopic ONH photographs.

RESULTS

The factors having the most significant effect on the sensitivity and specificity of the stereometric ONH parameters were the reference height difference and the mean topography standard deviation (TSD), indicating image quality. Also, the change in the TSD and age showed consistent, but variably significant, influence on all parameters tested. The sensitivity and specificity improved when there was little change in the reference height, the image quality was good and stable, and the patients were younger. The sensitivity and specificity of the vertical cup : disc ratio was improved by a large disc area and high baseline cup : disc area ratio. The rim area showed a better sensitivity and specificity for progression with a small disc area and low baseline cup : disc area ratio.

CONCLUSION

The factors affecting the sensitivity and specificity of the stereometric ONH parameters to glaucomatous progression in disc photographs are essentially the same as those affecting the measurement variability of the HRT.

Optic disc classification by the Heidelberg Retina Tomograph and by physicians with varying experience of glaucoma

Purpose

To compare the diagnostic accuracy of the Heidelberg Retina Tomograph's (HRT) Moorfields regression analysis (MRA) and glaucoma probability score (GPS) with that of subjective grading of optic disc photographs performed by ophthalmologists with varying experience of glaucoma and by ophthalmology residents.

Methods

Digitized disc photographs and HRT images from 97 glaucoma patients with visual field defects and 138 healthy individuals were classified as either within normal limits (WNL), borderline (BL), or outside normal limits (ONL). Sensitivity and specificity were compared for MRA, GPS, and the physicians. Analyses were also made according to disc size and for advanced visual field loss.

Results

Forty-five physicians participated. When BL results were regarded as normal, sensitivity was significantly higher (P<5%) for both MRA and GPS compared with the average physician, 87%, 79%, and 62%, respectively. Specificity ranged from 86% for MRA to 97% for general ophthalmologists, but the differences were not significant. In eyes with small discs, sensitivity was 75% for MRA, 60% for the average doctor, and 25% for GPS; in eyes with large discs, sensitivity was 100% for both GPS and MRA, but only 68% for physicians.

Conclusion

Our results suggest that sensitivity of MRA is superior to that of the average physician, but not that of glaucoma experts. MRA correctly classified all eyes with advanced glaucoma and showed the best sensitivity in eyes with small optic discs.