Automated Diagnosis of Plus Disease in Retinopathy of Prematurity Using Deep Convolutional Neural Networks

Imaging in Retinopathy of Prematurity

Retinopathy of prematurity (ROP) is a leading cause of preventable childhood blindness worldwide. Barriers to ROP screening and difficulties with subsequent evaluation and management include poor access to care, lack of physicians trained in ROP, and issues with objective documentation. Digital retinal imaging can help address these barriers and improve our knowledge of the pathophysiology of the disease. Advancements in technology have led to new, non-mydriatic and mydriatic cameras with wider fields of view as well as devices that can simultaneously incorporate fluorescein angiography, optical coherence tomography (OCT), and OCT angiography. Image analysis in ROP is also being employed through smartphones and computer-based software. Telemedicine programs in the United States and worldwide have utilized imaging to extend ROP screening to infants in remote areas and have shown that digital retinal imaging can be reliable, accurate, and cost-effective. In addition, tele-education programs are also using digital retinal images to increase the number of healthcare providers trained in ROP. Although indirect ophthalmoscopy is still an important skill for screening, digital retinal imaging holds promise for more widespread screening and management of ROP.

Artificial intelligence and deep learning in ophthalmology

Artificial intelligence (AI) based on deep learning (DL) has sparked tremendous global interest in recent years. DL has been widely adopted in image recognition, speech recognition and natural language processing, but is only beginning to impact on healthcare. In ophthalmology, DL has been applied to fundus photographs, optical coherence tomography and visual fields, achieving robust classification performance in the detection of diabetic retinopathy and retinopathy of prematurity, the glaucoma-like disc, macular oedema and age-related macular degeneration. DL in ocular imaging may be used in conjunction with telemedicine as a possible solution to screen, diagnose and monitor major eye diseases for patients in primary care and community settings. Nonetheless, there are also potential challenges with DL application in ophthalmology, including clinical and technical challenges, explainability of the algorithm results, medicolegal issues, and physician and patient acceptance of the AI 'black-box' algorithms. DL could potentially revolutionise how ophthalmology is practised in the future. This review provides a summary of the state-of-the-art DL systems described for ophthalmic applications, potential challenges in clinical deployment and the path forward.

Automated Fundus Image Quality Assessment in Retinopathy of Prematurity Using Deep Convolutional Neural Networks

PURPOSE

Accurate image-based ophthalmic diagnosis relies on fundus image clarity. This has important implications for the quality of ophthalmic diagnoses and for emerging methods such as telemedicine and computer-based image analysis. The purpose of this study was to implement a deep convolutional neural network (CNN) for automated assessment of fundus image quality in retinopathy of prematurity (ROP).

DESIGN

Experimental study.

PARTICIPANTS

Retinal fundus images were collected from preterm infants during routine ROP screenings.

METHODS

Six thousand one hundred thirty-nine retinal fundus images were collected from 9 academic institutions. Each image was graded for quality (acceptable quality [AQ], possibly acceptable quality [PAQ], or not acceptable quality [NAQ]) by 3 independent experts. Quality was defined as the ability to assess an image confidently for the presence of ROP. Of the 6139 images, NAQ, PAQ, and AQ images represented 5.6%, 43.6%, and 50.8% of the image set, respectively. Because of low representation of NAQ images in the data set, images labeled NAQ were grouped into the PAQ category, and a binary CNN classifier was trained using 5-fold cross-validation on 4000 images. A test set of 2109 images was held out for final model evaluation. Additionally, 30 images were ranked from worst to best quality by 6 experts via pairwise comparisons, and the CNN's ability to rank quality, regardless of quality classification, was assessed.

MAIN OUTCOME MEASURES

The CNN performance was evaluated using area under the receiver operating characteristic curve (AUC). A Spearman's rank correlation was calculated to evaluate the overall ability of the CNN to rank images from worst to best quality as compared with experts.

RESULTS

The mean AUC for 5-fold cross-validation was 0.958 (standard deviation, 0.005) for the diagnosis of AQ versus PAQ images. The AUC was 0.965 for the test set. The Spearman's rank correlation coefficient on the set of 30 images was 0.90 as compared with the overall expert consensus ranking.

CONCLUSIONS

This model accurately assessed retinal fundus image quality in a comparable manner with that of experts. This fully automated model has potential for application in clinical settings, telemedicine, and computer-based image analysis in ROP and for generalizability to other ophthalmic diseases.

High-performance medicine: the convergence of human and artificial intelligence

The use of artificial intelligence, and the deep-learning subtype in particular, has been enabled by the use of labeled big data, along with markedly enhanced computing power and cloud storage, across all sectors. In medicine, this is beginning to have an impact at three levels: for clinicians, predominantly via rapid, accurate image interpretation; for health systems, by improving workflow and the potential for reducing medical errors; and for patients, by enabling them to process their own data to promote health. The current limitations, including bias, privacy and security, and lack of transparency, along with the future directions of these applications will be discussed in this article. Over time, marked improvements in accuracy, productivity, and workflow will likely be actualized, but whether that will be used to improve the patient-doctor relationship or facilitate its erosion remains to be seen.

Evaluation of a deep learning image assessment system for detecting severe retinopathy of prematurity

BACKGROUND

Prior work has demonstrated the near-perfect accuracy of a deep learning retinal image analysis system for diagnosing plus disease in retinopathy of prematurity (ROP). Here we assess the screening potential of this scoring system by determining its ability to detect all components of ROP diagnosis.

METHODS

Clinical examination and fundus photography were performed at seven participating centres. A deep learning system was trained to detect plus disease, generating a quantitative assessment of retinal vascular abnormality (the i-ROP plus score) on a 1-9 scale. Overall ROP disease category was established using a consensus reference standard diagnosis combining clinical and image-based diagnosis. Experts then ranked ordered a second data set of 100 posterior images according to overall ROP severity.

RESULTS

4861 examinations from 870 infants were analysed. 155 examinations (3%) had a reference standard diagnosis of type 1 ROP. The i-ROP deep learning (DL) vascular severity score had an area under the receiver operating curve of 0.960 for detecting type 1 ROP. Establishing a threshold i-ROP DL score of 3 conferred 94% sensitivity, 79% specificity, 13% positive predictive value and 99.7% negative predictive value for type 1 ROP. There was strong correlation between expert rank ordering of overall ROP severity and the i-ROP DL vascular severity score (Spearman correlation coefficient=0.93; p<0.0001).

CONCLUSION

The i-ROP DL system accurately identifies diagnostic categories and overall disease severity in an automated fashion, after being trained only on posterior pole vascular morphology. These data provide proof of concept that a deep learning screening platform could improve objectivity of ROP diagnosis and accessibility of screening.

Automated retinopathy of prematurity screening using deep neural networks

BACKGROUND

Retinopathy of prematurity (ROP) is the leading cause of childhood blindness worldwide. Automated ROP detection system is urgent and it appears to be a safe, reliable, and cost-effective complement to human experts.

METHODS

An automated ROP detection system called DeepROP was developed by using Deep Neural Networks (DNNs). ROP detection was divided into ROP identification and grading tasks. Two specific DNN models, i.e., Id-Net and Gr-Net, were designed for identification and grading tasks, respectively. To develop the DNNs, large-scale datasets of retinal fundus images were constructed by labeling the images of ROP screenings by clinical ophthalmologists.

FINDINGS

On the test dataset, the Id-Net achieved a sensitivity of 96.62%(95%CI, 92.29%-98.89%) and a specificity of 99.32% (95%CI, 96.29%-9.98%) for ROP identification while the Gr-Net attained sensitivity and specificity values of 88.46% (95%CI, 96.29%-99.98%) and 92.31% (95%CI, 81.46%-97.86%), respectively, on the ROP grading task. On another 552 cases, the developed DNNs outperformed some human experts. In a clinical setting, the sensitivity and specificity values of DeepROP for ROP identification were 84.91% (95%CI, 76.65%-91.12%) and 96.90% (95%CI, 95.49%-97.96%), respectively, whereas the corresponding measures for ROP grading were 93.33%(95%CI, 68.05%-99.83%) and 73.63%(95%CI, 68.05%-99.83%), respectively.

INTERPRETATION

We constructed large-scale ROP datasets with adequate clinical labels and proposed novel DNN models. The DNN models can directly learn ROP features from big data. The developed DeepROP is potential to be an efficient and effective system for automated ROP screening. FUND: National Natural Science Foundation of China under Grant 61432012 and U1435213.

Plus Disease in Retinopathy of Prematurity: More Than Meets the ICROP?

Retinopathy of prematurity (ROP), a vasoproliferative retinal disease affecting premature infants, is a leading cause of childhood blindness throughout the world. Plus disease, defined as venous dilatation and arteriolar tortuosity within the posterior retinal vessels greater than or equal to that of a standard published photograph, is the most critical finding in identifying treatment-requiring ROP. Despite an internationally accepted definition of plus disease, there is significant variability in diagnostic process and outcome, producing variable levels of reported intra- and interexpert agreement. Several potential explanations for poor agreement have been proposed, including attention to undefined vascular features such as venous tortuosity, focus on narrower or wider field of view, unfamiliarity with digital images, the magnification and apparent severity of the standard photograph, and cut-off point differences among experts as to the level of tortuosity and dilation sufficient for "plus disease" along a continuum. Moreover, differences in diagnostic consistency among groups of experts separated both geographically and chronologically have been reported. These findings have implications for clinical care, research, and education, and highlight the need for a more precise definition of plus disease and objective diagnostic methods for ROP.