A double-blinded study for quantifiable assessment of the diagnostic accuracy of AI tool "ADVEN-i" in identifying diseased fundus images including diabetic retinopathy on a retrospective data

PURPOSE

To quantifiably assess the diagnostic accuracy of Adven-I, a proprietary artificial intelligence (AI)-driven diagnostic system that automatically detects diseases from fundus images. The purpose is to quantify the performance of Adven-i in differentiating a nonreferable (within normal limits) image from a referable (diseased fundus) image and further segregating diabetic retinopathy (DR) from the rest of the abnormalities (non-DR) encompassing the wide spectrum of abnormal pathologies. The assessment is carried out in comparison to manual reading as the reference gold standard. Adven-i is the only AI system classifying retinal abnormalities into DR and non-DR classes separately, apart from predicting nonreferable fundus, while most existing systems classify fundus images into referable and nonreferable DR.

METHODS

The double-blinded study was conducted on retrospective data collected over the course of a year in the ophthalmology outpatient department (OPD) at a top Tier II eyecare hospital in Chandigarh, India. Three vitreoretina specialists who were blinded to one another read the images. The ground-truth was generated on the basis of majority agreement among the readers. An arbitrator's decision was regarded final if all three readers disagreed.

RESULTS

2261 fundus images were analyzed by Adven-i. The sensitivity and specificity of Adven-i in diagnosing images with abnormalities were 95.12% and 85.77%, respectively, and for segregating DR from rest of the retinal abnormalities were 91.87% and 85.12%, respectively.

CONCLUSIONS AND RELEVANCE

Adven-i shows definite promise in automated screening for early diagnosis of referable fundus images including DR. Adven-i can be adopted to scale for mass screening in resource-limited settings.

Acceptability of artificial intelligence-based retina screening in general population

Purpose:

A deep learning system (DLS) using artificial intelligence (AI) is emerging as a very promising technology in the future of healthcare diagnostics. While the concept of telehealth is emerging in every field of medicine, AI assistance in diagnosis can become a great tool for successful screening in telemedicine and teleophthalmology. The aim of our study was to assess the acceptability of AI-based retina screening.

Methods:

This was a prospective non-randomized study performed in the outpatient department of a tertiary eye care hospital. Patients older than 18 years who came for a regular eye check-up or a routine retina screening were recruited in the study. Fundus images of the posterior pole were captured on fundus on a phone camera (REMIDIO™, India) with a built-in AI software (Netra.AI) that can identify normal versus abnormal retina. The patients were then given an 8-point questionnaire to assess their acceptance and willingness toward AI-based screening. We recruited 104 participants.

Results:

We found that 90.4% were willing for an AI-based fundus screening; 96.2% were satisfied with AI-based screening. Patients with diabetes (P = 0.03) and the male population (P = 0.029) were more satisfied with the AI-based screening. The majority (i.e., 97.1%) felt that AI-based screening gave them a better understanding of their eye condition and 37.5% felt that AI-based retina screening prior to a doctor’s visit can help in routine screening

Conclusion:

Considering the current COVID-19 pandemic situation across the globe, this study highlights the importance of AI-based telescreening and positive patient approach toward this technology.