Diagnostic accuracy research in glaucoma is still incompletely reported: An application of Standards for Reporting of Diagnostic Accuracy Studies (STARD) 2015

Publications on the diagnostic accuracy of dermatopathology tests: A cross-sectional quality analysis

BACKGROUND

Ancillary diagnostic tests are frequent in dermatopathology practice. Publications on their accuracy influence their utilization. The transparency and completeness of these publications are unknown.

METHODS

We performed a cross-sectional study on diagnostic accuracy studies in dermatopathology published between 2020 and 2022 for compliance with Standards for Reporting of Diagnostic Accuracy Studies (STARD) and the Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2).

RESULTS

14.67 ± 3.02 STARD items were reported in 62 publications (range, 9.5-23.5 out of the recommended total of 30). More items were reported in high-impact factor journals (16.01 vs. 13.32, p = 0.0002) and journals that endorsed STARD in their author instructions (17.22 vs. 14.11, p = 0.0039). Less than 10% of publications reported quantifiable hypotheses, sample size calculations, flow diagrams, or study registrations. The risk of bias by our analysis of QUADAS-2 criteria was high or uncertain for index test interpretation (36/62, 58%) and patient selection (44/62, 71%).

CONCLUSIONS

Publications on dermatopathology tests are exploratory studies without prespecified hypotheses or study designs. They do not meet the criteria for transparent reporting. We suggest that medical journal leadership should consider updating their instructions with more explicit guidance on recommended manuscript elements.

Has the STARD statement improved the quality of reporting of diagnostic accuracy studies published in European Radiology?

OBJECTIVES

To investigate whether encouraging authors to follow the Standards for Reporting Diagnostic Accuracy (STARD) guidelines improves the quality of reporting of diagnostic accuracy studies.

METHODS

In mid-2017, European Radiology started encouraging its authors to follow the STARD guidelines. Our MEDLINE search identified 114 diagnostic accuracy studies published in European Radiology in 2015 and 2019. The quality of reporting was evaluated by two independent reviewers using the revised STARD statement. Item 11 was excluded because a meaningful decision about adherence was not possible. Student's t test for independent samples was used to analyze differences in the mean number of reported STARD items between studies published in 2015 and in 2019. In addition, we calculated differences related to the study design, data collection, and citation rate.

RESULTS

The mean total number of reported STARD items for all 114 diagnostic accuracy studies analyzed was 15.9 ± 2.6 (54.8%) of 29 items (range 9.5-22.5). The quality of reporting of diagnostic accuracy studies was significantly better in 2019 (mean ± standard deviation (SD), 16.3 ± 2.7) than in 2015 (mean ± SD, 15.1 ± 2.3; p < 0.02). No significant differences in the reported STARD items were identified in relation to study design (p = 0.13), data collection (p = 0.87), and citation rate (p = 0.09).

CONCLUSION

The quality of reporting of diagnostic accuracy studies according to the STARD statement was moderate with a slight improvement since European Radiology started to recommend its authors to follow the STARD guidelines.

KEY POINTS

• The quality of reporting of diagnostic accuracy studies was moderate with a mean total number of reported STARD items of 15.9 ± 2.6. • The adherence to STARD was significantly better in 2019 than in 2015 (16.3 ± 2.7 vs. 15.1 ± 2.3; p = 0.016). • No significant differences in the reported STARD items were identified in relation to study design (p = 0.13), data collection (p = 0.87), and citation rate (p = 0.09).

Establishing the minimal clinically important difference of the EQ-5D-3L in older adults with a history of falls

PURPOSE

Establish the minimal clinically important difference (MCID) of a health-related quality of life (HRQoL) measure-the EuroQol EQ-5 Dimensions-3 Level (EQ-5D-3L)-in older adults with a history of falls.

METHODS

This study is a secondary analysis of 255 complete cases who were enrolled in a 12-month randomized controlled trial (NCT01029171; NCT00323596); participants were randomized to the Otago Exercise Program (OEP; n = 126/172; Age:81.2 ± 6.2 years; 60.3% Female) or control (CON; n = 129/172; Age:81.7 ± 5.7 years; 70.5% Female). Participants completed the EQ-5D-3L and Visual Analogue Scale (VAS) at baseline and 1-year. The VAS was associated with HRQoL and was the health status anchor (VAS minimal improvement = 7 to 17, maximal improvement ≥ 18, minimal decline =  - 7 to - 17, maximal decline ≤  - 18 points). We used four distinct approaches to estimate MCID ranges: (1) anchor-based change differences of the EQ-5D-3L (1-year minus baseline); (2) anchor-based beta coefficients from ordinary least squares regressions (OLS); (3) anchor-based receiver operating characteristic (ROC), and 4) distribution-based standard deviation and standardized effect size of 0.5.

RESULTS

EQ-5D-3L MCID ranges for minimal improvements (OEP = 0.028 to 0.059; CON = 0.007 to 0.051), maximal improvements (OEP = 0.059 to 0.090; CON = 0.051 to 0.090), minimal declines (OEP =  - 0.029 to - 0.105; CON =  - 0.015 to - 0.051), and maximal declines (OEP =  - 0.018 to - 0.072; CON =  - 0.018 to - 0.082) were established using change difference, OLS, and distribution-based methods. The ROC area under the curve was poor, thus, it was not used to estimate the MCID.

CONCLUSIONS

Our results will assist in the interpretation of changes in HRQoL, as measured by the EQ-5D-3L, in older adults with a history of falls.

Accuracy of optical coherence tomography for diagnosing glaucoma: an overview of systematic reviews

AIMS

To assess the diagnostic accuracy (DTA) of optical coherence tomography (OCT) for detecting glaucoma by systematically searching and appraising systematic reviews (SRs) on this issue.

METHODS

We searched a database of SRs in eyes and vision maintained by the Cochrane Eyes and Vision United States on the DTA of OCT for detecting glaucoma. Two authors working independently screened the records, abstracted data and assessed the risk of bias using the Risk of Bias in Systematic Reviews checklist. We extracted quantitative DTA estimates as well as qualitative statements on their relevance to practice.

RESULTS

We included four SRs published between 2015 and 2018. These SRs included between 17 and 113 studies on OCT for glaucoma diagnosis. Two reviews were at low risk of bias and the other two had two to four domains at high or unclear risk of bias with concerns on applicability. The two reliable SRs reported the accuracy of average retinal nerve fibre layer (RNFL) thickness and found a sensitivity of 0.69 (0.63 to 0.73) and 0.78 (0.74 to 0.83) and a specificity of 0.94 (0.93 to 0.95) and 0.93 (0.92 to 0.95) in 57 and 50 studies, respectively. Only one review included a clear specification of the clinical pathway. Both reviews highlighted the limitations of primary DTA studies on this topic.

CONCLUSIONS

The quality of published DTA reviews on OCT for diagnosing glaucoma was mixed. Two reliable SRs found moderate sensitivity at high specificity for average RNFL thickness in diagnosing manifest glaucoma. Our overview suggests that the methodological quality of both primary and secondary DTA research on glaucoma is in need of improvement.

Compliance With Standards for STARD 2015 Reporting Recommendations in Pathology

OBJECTIVES

Lack of experimental reproducibility has led to growing interest in guidelines to enhance completeness and transparency in research reporting. This retrospective survey sought to determine compliance with Standards for Reporting of Diagnostic Accuracy Studies (STARD) 2015 statement in the recent pathology scientific literature.

METHODS

Two raters independently scored 171 pathology diagnostic accuracy studies for compliance with 34 STARD items and subcomponents. Overall adherence was calculated as a proportion after excluding nonapplicable items.

RESULTS

After excluding nonapplicable items, there was 50% overall adherence to STARD reporting recommendations. In total, 15.44 ± 3.59 items were reported per article (range, 4-28 out of maximum possible of 34). There was substantial heterogeneity in individual item reporting, with greater than 75% reporting in eight of 34 items and less than 25% reporting in 11 of 34 items. Less than 10% of articles reported hypotheses, subgroup analyses for confounding, sample size calculations, subject flow diagrams, study registrations, and links to full study protocols. Significantly more items were reported in articles from journals that endorsed STARD (16.14 vs 14.84, P = .0175).

CONCLUSIONS

These findings demonstrate incomplete reporting of essential items in pathology diagnostic accuracy studies. More vigorous enforcement of reporting checklists might improve adherence to minimum reporting standards.

Reporting Quality of Diagnostic Accuracy Studies in Laboratory Medicine: Adherence to Standards for Reporting of Diagnostic Accuracy Studies (STARD) 2015

Background

Poor reporting quality in diagnostic accuracy studies hampers an adequate judgment of the validity of the study. The Standards for Reporting of Diagnostic Accuracy Studies (STARD) statement was published to improve the reporting quality of diagnostic accuracy studies. This study aimed to evaluate the adherence of diagnostic accuracy studies published in Annals of Laboratory Medicine (ALM) to STARD 2015 and to identify directions for improvement in the reporting quality of these studies.

Methods

Two independent authors assessed articles published in ALM between 2012–2018 for compliance with 30 STARD 2015 checklist items to identify all eligible diagnostic accuracy studies published during this period. We included 66 diagnostic accuracy studies. A total of the fulfilled STARD items were calculated, and adherence was analyzed on an individual-item basis.

Results

The overall mean±SD number of STARD items reported for the included studies was 11.2±2.7. Only five (7.6%) studies adhered to more than 50% of the 30 items. No study satisfied more than 80% of the items. Large variability in adherence to reporting standards was detected across items, ranging from 0% to 100%.

Conclusions

Adherence to STARD 2015 is suboptimal among diagnostic accuracy studies published in ALM. Our study emphasizes the necessity of adherence to STARD to improve the reporting quality of future diagnostic accuracy studies to be published in ALM.

Emergency Ultrasound Literature and Adherence to Standards for Reporting of Diagnostic Accuracy Criteria

BACKGROUND

Given the wide usage of emergency point-of-care ultrasound (EUS) among emergency physicians (EPs), rigorous study surrounding its accuracy is essential. The Standards for Reporting of Diagnostic Accuracy (STARD) criteria were established to ensure robust reporting methodology for diagnostic studies. Adherence to the STARD criteria among EUS diagnostic studies has yet to be reported.

OBJECTIVES

Our objective was to evaluate a body of EUS literature shortly after STARD publication for its baseline adherence to the STARD criteria.

METHODS

EUS studies in 5 emergency medicine journals from 2005-2010 were evaluated for their adherence to the STARD criteria. Manuscripts were selected for inclusion if they reported original research and described the use of 1 of 10 diagnostic ultrasound modalities designated as "core emergency ultrasound applications" in the 2008 American College of Emergency Physicians Ultrasound Guidelines. Literature search identified 307 studies; of these, 45 met inclusion criteria for review.

RESULTS

The median STARD score was 15 (interquartile range [IQR] 12-17), representing 60% of the 25 total STARD criteria. The median STARD score among articles that reported diagnostic accuracy was significantly higher than those that did not report accuracy (17 [IQR 15-19] vs. 11 [IQR 9-13], respectively; p < 0.0001). Seventy-one percent of articles met ≥50% of the STARD criteria (56-84%) and 4% met >80% of the STARD criteria.

CONCLUSIONS

Significant opportunities exist to improve methodological reporting of EUS research. Increased adherence to the STARD criteria among diagnostic EUS studies will improve reporting and improve our ability to compare outcomes.

Differential Effects of Aging in the Macular Retinal Layers, Neuroretinal Rim, and Peripapillary Retinal Nerve Fiber Layer

PURPOSE

We determined the differential aging effects of the inner 6 layers of the macula in contrast to the minimum neuroretinal rim width (MRW) and peripapillary retinal nerve fiber layer (RNFL) thickness.

DESIGN

Cross-sectional, multicenter study.

PARTICIPANTS

An approximately equal number of white subjects with a normal ocular and visual field examination in each decade group from 20 to 90 years.

METHODS

OCT of the macula, optic nerve head, and peripapillary retina.

MAIN OUTCOME MEASURES

Sectoral measurements of the inner 6 layers of the macula; age-related decline of each of these layers; strength of the associations with age of the macular parameters, MRW, and peripapillary RNFL thickness; and association between ganglion cell layer (GCL) thickness and MRW and peripapillary RNFL thickness.

RESULTS

The study sample comprised 1 eye of 246 subjects with a median (range) age of 52.9 (19.8-87.3) years. Of the 6 layers, there was a statistically significant decline with age of only the GCL, inner plexiform layer, and inner nuclear layer thickness with rates of -0.11 μm/year, -0.07 μm/year, and -0.03 μm/year, respectively. These rates corresponded to 2.82%, 2.10%, and 0.78% loss per decade, respectively, and were generally uniform across sectors. The rate of loss of MRW and peripapillary RNFL thickness was -1.22 μm/year and -0.20 μm/year, corresponding to 3.75% and 2.03% loss per decade. However, the association of GCL thickness change with age (R² = 0.28) was approximately twice that of MRW and RNFL thickness (R² = 0.14 for each).

CONCLUSIONS

In concordance with histopathologic studies showing age-related loss of retinal ganglion cell axons, we showed a significant decline in GCL thickness, as well as MRW and peripapillary RNFL thickness. The stronger relationship between aging and GCL thickness compared with the rim or peripapillary RNFL may indicate that GCL thickness could be better suited to measure progression of structural glaucomatous loss.

A systematic review shows no performance benefit of machine learning over logistic regression for clinical prediction models

OBJECTIVES

The objective of this study was to compare performance of logistic regression (LR) with machine learning (ML) for clinical prediction modeling in the literature.

STUDY DESIGN AND SETTING

We conducted a Medline literature search (1/2016 to 8/2017) and extracted comparisons between LR and ML models for binary outcomes.

RESULTS

We included 71 of 927 studies. The median sample size was 1,250 (range 72-3,994,872), with 19 predictors considered (range 5-563) and eight events per predictor (range 0.3-6,697). The most common ML methods were classification trees, random forests, artificial neural networks, and support vector machines. In 48 (68%) studies, we observed potential bias in the validation procedures. Sixty-four (90%) studies used the area under the receiver operating characteristic curve (AUC) to assess discrimination. Calibration was not addressed in 56 (79%) studies. We identified 282 comparisons between an LR and ML model (AUC range, 0.52-0.99). For 145 comparisons at low risk of bias, the difference in logit(AUC) between LR and ML was 0.00 (95% confidence interval, -0.18 to 0.18). For 137 comparisons at high risk of bias, logit(AUC) was 0.34 (0.20-0.47) higher for ML.

CONCLUSION

We found no evidence of superior performance of ML over LR. Improvements in methodology and reporting are needed for studies that compare modeling algorithms.

New Technologies for Glaucoma Detection

This review describes some of the most recent advances in the development and application of new technologies for detecting and managing glaucoma, including imaging, visual function testing, and tonometry. The widespread availability of mobile technology in the developing world is improving health care delivery, for example, with smartphones and mobile applications that allow patient data to be assessed remotely by health care providers.