Information fusion for diabetic retinopathy CAD in digital color fundus photographs

Transparency in Artificial Intelligence Reporting in Ophthalmology-A Scoping Review

Topic

This scoping review summarizes artificial intelligence (AI) reporting in ophthalmology literature in respect to model development and validation. We characterize the state of transparency in reporting of studies prospectively validating models for disease classification.

Clinical Relevance

Understanding what elements authors currently describe regarding their AI models may aid in the future standardization of reporting. This review highlights the need for transparency to facilitate the critical appraisal of models prior to clinical implementation, to minimize bias and inappropriate use. Transparent reporting can improve effective and equitable use in clinical settings.

Methods

Eligible articles (as of January 2022) from PubMed, Embase, Web of Science, and CINAHL were independently screened by 2 reviewers. All observational and clinical trial studies evaluating the performance of an AI model for disease classification of ophthalmic conditions were included. Studies were evaluated for reporting of parameters derived from reporting guidelines (CONSORT-AI, MI-CLAIM) and our previously published editorial on model cards. The reporting of these factors, which included basic model and dataset details (source, demographics), and prospective validation outcomes, were summarized.

Results

Thirty-seven prospective validation studies were included in the scoping review. Eleven additional associated training and/or retrospective validation studies were included if this information could not be determined from the primary articles. These 37 studies validated 27 unique AI models; multiple studies evaluated the same algorithms (EyeArt, IDx-DR, and Medios AI). Details of model development were variably reported; 18 of 27 models described training dataset annotation and 10 of 27 studies reported training data distribution. Demographic information of training data was rarely reported; 7 of the 27 unique models reported age and gender and only 2 reported race and/or ethnicity. At the level of prospective clinical validation, age and gender of populations was more consistently reported (29 and 28 of 37 studies, respectively), but only 9 studies reported race and/or ethnicity data. Scope of use was difficult to discern for the majority of models. Fifteen studies did not state or imply primary users.

Conclusion

Our scoping review demonstrates variable reporting of information related to both model development and validation. The intention of our study was not to assess the quality of the factors we examined, but to characterize what information is, and is not, regularly reported. Our results suggest the need for greater transparency in the reporting of information necessary to determine the appropriateness and fairness of these tools prior to clinical use.

Financial Disclosures

Proprietary or commercial disclosure may be found in the Footnotes and Disclosures at the end of this article.

Use of psychoacoustic spectrum warping, decision template fusion, and neighborhood component analysis in newborn cry diagnostic systems

Dealing with newborns' health is a delicate matter since they cannot express needs, and crying does not reflect their condition. Although newborn cries have been studied for various purposes, there is no prior research on distinguishing a certain pathology from other pathologies so far. Here, an unsophisticated framework is proposed for the study of septic newborns amid a collective of other pathologies. The cry was analyzed with music inspired and speech processing inspired features. Furthermore, neighborhood component analysis (NCA) feature selection was employed with two goals: (i) Exploring how the elements of each feature set contributed to classification outcome; (ii) investigating to what extent the feature space could be compacted. The attained results showed success of both experiments introduced in this study, with 88.66% for the decision template fusion (DTF) technique and a consistent enhancement in comparison to all feature sets in terms of accuracy and 86.22% for the NCA feature selection method by drastically downsizing the feature space from 86 elements to only 6 elements. The achieved results showed great potential for identifying a certain pathology from other pathologies that may have similar effects on the cry patterns as well as proving the success of the proposed framework.

Anomaly segmentation in retinal images with poisson-blending data augmentation

Diabetic retinopathy (DR) is one of the most important complications of diabetes. Accurate segmentation of DR lesions is of great importance for the early diagnosis of DR. However, simultaneous segmentation of multi-type DR lesions is technically challenging because of 1) the lack of pixel-level annotations and 2) the large diversity between different types of DR lesions. In this study, first, we propose a novel Poisson-blending data augmentation (PBDA) algorithm to generate synthetic images, which can be easily utilized to expand the existing training data for lesion segmentation. We perform extensive experiments to recognize the important attributes in the PBDA algorithm. We show that position constraints are of great importance and that the synthesis density of one type of lesion has a joint influence on the segmentation of other types of lesions. Second, we propose a convolutional neural network architecture, named DSR-U-Net++ (i.e., DC-SC residual U-Net++), for the simultaneous segmentation of multi-type DR lesions. Ablation studies showed that the mean area under precision recall curve (AUPR) for all four types of lesions increased by >5% with PBDA. The proposed DSR-U-Net++ with PBDA outperformed the state-of-the-art methods by 1.7%-9.9% on the Indian Diabetic Retinopathy Image Dataset (IDRiD) and 67.3% on the e-ophtha dataset with respect to mean AUPR. The developed method would be an efficient tool to generate large-scale task-specific training data for other medical anomaly segmentation tasks.

Cost-effectiveness of Artificial Intelligence as a Decision-Support System Applied to the Detection and Grading of Melanoma, Dental Caries, and Diabetic Retinopathy

OBJECTIVE

To assess the cost-effectiveness of artificial intelligence (AI) for supporting clinicians in detecting and grading diseases in dermatology, dentistry, and ophthalmology.

IMPORTANCE

AI has been referred to as a facilitator for more precise, personalized, and safer health care, and AI algorithms have been reported to have diagnostic accuracies at or above the average physician in dermatology, dentistry, and ophthalmology.

DESIGN, SETTING, AND PARTICIPANTS

This economic evaluation analyzed data from 3 Markov models used in previous cost-effectiveness studies that were adapted to compare AI vs standard of care to detect melanoma on skin photographs, dental caries on radiographs, and diabetic retinopathy on retina fundus imaging. The general US and German population aged 50 and 12 years, respectively, as well as individuals with diabetes in Brazil aged 40 years were modeled over their lifetime. Monte Carlo microsimulations and sensitivity analyses were used to capture lifetime efficacy and costs. An annual cycle length was chosen. Data were analyzed between February 2021 and August 2021.

EXPOSURE

AI vs standard of care.

MAIN OUTCOMES AND MEASURES

Association of AI with tooth retention-years for dentistry and quality-adjusted life-years (QALYs) for individuals in dermatology and ophthalmology; diagnostic costs.

RESULTS

In 1000 microsimulations with 1000 random samples, AI as a diagnostic-support system showed limited cost-savings and gains in tooth retention-years and QALYs. In dermatology, AI showed mean costs of $750 (95% CI, $608-$970) and was associated with 86.5 QALYs (95% CI, 84.9-87.9 QALYs), while the control showed higher costs $759 (95% CI, $618-$970) with similar QALY outcome. In dentistry, AI accumulated costs of €320 (95% CI, €299-€341) (purchasing power parity [PPP] conversion, $429 [95% CI, $400-$458]) with 62.4 years per tooth retention (95% CI, 60.7-65.1 years). The control was associated with higher cost, €342 (95% CI, €318-€368) (PPP, $458; 95% CI, $426-$493) and fewer tooth retention-years (60.9 years; 95% CI, 60.5-63.1 years). In ophthalmology, AI accrued costs of R $1321 (95% CI, R $1283-R $1364) (PPP, $559; 95% CI, $543-$577) at 8.4 QALYs (95% CI, 8.0-8.7 QALYs), while the control was less expensive (R $1260; 95% CI, R $1222-R $1303) (PPP, $533; 95% CI, $517-$551) and associated with similar QALYs. Dominance in favor of AI was dependent on small differences in the fee paid for the service and the treatment assumed after diagnosis. The fee paid for AI was a factor in patient preferences in cost-effectiveness between strategies.

CONCLUSIONS AND RELEVANCE

The findings of this study suggest that marginal improvements in diagnostic accuracy when using AI may translate into a marginal improvement in outcomes. The current evidence supporting AI as decision support from a cost-effectiveness perspective is limited; AI should be evaluated on a case-specific basis to capture not only differences in costs and payment mechanisms but also treatment after diagnosis.

Optimal Feature Selection for Diagnosing Diabetic Retinopathy Using FireFly Migration Operator-Based Monarch Butterfly Optimization

In recent years, diabetic retinopathy (DR) needs to be focused with the intention of developing accurate and effective approaches by accomplishing the existing challenges in the traditional models. With this objective, this paper aims to introduce an effective diagnosis system by utilizing retinal fundus images. The implementation of this diagnosis model incorporates 4 stages like (i) preprocessing, (ii) blood vessel segmentation, (iii) feature extraction, as well as (iv) classification. Originally, the median filter as well as contrast limited adaptive histogram equalization (CLAHE) help to preprocess the image. Moreover, the Fuzzy C Mean (FCM) thresholding is applied for blood vessel segmentation, which generates stochastic clustering of pixels to obtain enhanced threshold values. Further, feature extraction is accomplished by utilizing gray-level run-length matrix (GLRM), local, and morphological transformation-based features. Furthermore, a deep learning (DL) model known as convolutional neural network (CNN) is employed for the diagnosis or classification purpose. As a main novelty, this paper introduces an optimal feature selection as well as classification model. Further, the feature selection is done optimally by FireFly Migration Operator-based Monarch Butterfly Optimization (FM-MBO) which hybridized of the monarch butterfly optimization (MBO) and fire fly (FF) algorithms as the entire adopted extracted features attain higher feature length. Moreover, the proposed FM-MBO algorithm helps for optimizing the count of CNN's convolutional neurons to further improve the performance accuracy. At the end, the enhanced outcomes of the adopted diagnostic scheme are validated via a valuable comparative examination in terms of significant performance measures.

Decision fusion in healthcare and medicine: a narrative review

OBJECTIVE

To provide an overview of the decision fusion (DF) technique and describe the applications of the technique in healthcare and medicine at prevention, diagnosis, treatment and administrative levels.

BACKGROUND

The rapid development of technology over the past 20 years has led to an explosion in data growth in various industries, like healthcare. Big data analysis within the healthcare systems is essential for arriving to a value-based decision over a period of time. Diversity and uncertainty in big data analytics have made it impossible to analyze data by using conventional data mining techniques and thus alternative solutions are required. DF is a form of data fusion techniques that could increase the accuracy of diagnosis and facilitate interpretation, summarization and sharing of information.

METHODS

We conducted a review of articles published between January 1980 and December 2020 from various databases such as Google Scholar, IEEE, PubMed, Science Direct, Scopus and web of science using the keywords decision fusion (DF), information fusion, healthcare, medicine and big data. A total of 141 articles were included in this narrative review.

CONCLUSIONS

Given the importance of big data analysis in reducing costs and improving the quality of healthcare; along with the potential role of DF in big data analysis, it is recommended to know the full potential of this technique including the advantages, challenges and applications of the technique before its use. Future studies should focus on describing the methodology and types of data used for its applications within the healthcare sector.

Classification of diabetic retinopathy using unlabeled data and knowledge distillation

Over the last decade, advances in Machine Learning and Artificial Intelligence have highlighted their potential as a diagnostic tool in the healthcare domain. Despite the widespread availability of medical images, their usefulness is severely hampered by a lack of access to labeled data. For example, while Convolutional Neural Networks (CNNs) have emerged as an essential analytical tool in image processing, their impact is curtailed by training limitations due to insufficient labeled data availability. Transfer Learning enables models developed for one task to be reused for a second task. Knowledge distillation enables transferring knowledge from a pre-trained model to another. However, it suffers from limitations, and the two models' constraints need to be architecturally similar. Knowledge distillation addresses some of the shortcomings of transfer learning by generalizing a complex model to a lighter model. However, some parts of the knowledge may not be distilled by knowledge distillation sufficiently. In this paper, a novel knowledge distillation approach using transfer learning is proposed. The proposed approach transfers the complete knowledge of a model to a new smaller one. Unlabeled data are used in an unsupervised manner to transfer the new smaller model's maximum amount of knowledge. The proposed method can be beneficial in medical image analysis, where labeled data are typically scarce. The proposed approach is evaluated in classifying images for diagnosing Diabetic Retinopathy on two publicly available datasets, including Messidor and EyePACS. Simulation results demonstrate that the approach effectively transfers knowledge from a complex model to a lighter one. Furthermore, experimental results illustrate that different small models' performance is improved significantly using unlabeled data and knowledge distillation.

Deep learning-based detection and stage grading for optimising diagnosis of diabetic retinopathy

AIMS

To establish an automated method for identifying referable diabetic retinopathy (DR), defined as moderate nonproliferative DR and above, using deep learning-based lesion detection and stage grading.

MATERIALS AND METHODS

A set of 12,252 eligible fundus images of diabetic patients were manually annotated by 45 licenced ophthalmologists and were randomly split into training, validation, and internal test sets (ratio of 7:1:2). Another set of 565 eligible consecutive clinical fundus images was established as an external test set. For automated referable DR identification, four deep learning models were programmed based on whether two factors were included: DR-related lesions and DR stages. Sensitivity, specificity and the area under the receiver operating characteristic curve (AUC) were reported for referable DR identification, while precision and recall were reported for lesion detection.

RESULTS

Adding lesion information to the five-stage grading model improved the AUC (0.943 vs. 0.938), sensitivity (90.6% vs. 90.5%) and specificity (80.7% vs. 78.5%) of the model for identifying referable DR in the internal test set. Adding stage information to the lesion-based model increased the AUC (0.943 vs. 0.936) and sensitivity (90.6% vs. 76.7%) of the model for identifying referable DR in the internal test set. Similar trends were also seen in the external test set. DR lesion types with high precision results were preretinal haemorrhage, hard exudate, vitreous haemorrhage, neovascularisation, cotton wool spots and fibrous proliferation.

CONCLUSIONS

The herein described automated model employed DR lesions and stage information to identify referable DR and displayed better diagnostic value than models built without this information.

A survey on medical image analysis in diabetic retinopathy

Diabetic Retinopathy (DR) represents a highly-prevalent complication of diabetes in which individuals suffer from damage to the blood vessels in the retina. The disease manifests itself through lesion presence, starting with microaneurysms, at the nonproliferative stage before being characterized by neovascularization in the proliferative stage. Retinal specialists strive to detect DR early so that the disease can be treated before substantial, irreversible vision loss occurs. The level of DR severity indicates the extent of treatment necessary - vision loss may be preventable by effective diabetes management in mild (early) stages, rather than subjecting the patient to invasive laser surgery. Using artificial intelligence (AI), highly accurate and efficient systems can be developed to help assist medical professionals in screening and diagnosing DR earlier and without the full resources that are available in specialty clinics. In particular, deep learning facilitates diagnosis earlier and with higher sensitivity and specificity. Such systems make decisions based on minimally handcrafted features and pave the way for personalized therapies. Thus, this survey provides a comprehensive description of the current technology used in each step of DR diagnosis. First, it begins with an introduction to the disease and the current technologies and resources available in this space. It proceeds to discuss the frameworks that different teams have used to detect and classify DR. Ultimately, we conclude that deep learning systems offer revolutionary potential to DR identification and prevention of vision loss.

Application of deep learning image assessment software VeriSee™ for diabetic retinopathy screening

PURPOSE

To develop a deep learning image assessment software VeriSee™ and to validate its accuracy in grading the severity of diabetic retinopathy (DR).

METHODS

Diabetic patients who underwent single-field, nonmydriatic, 45-degree color retinal fundus photography at National Taiwan University Hospital between July 2007 and June 2017 were retrospectively recruited. A total of 7524 judgeable color fundus images were collected and were graded for the severity of DR by ophthalmologists. Among these pictures, 5649 along with another 31,612 color fundus images from the EyePACS dataset were used for model training of VeriSee™. The other 1875 images were used for validation and were graded for the severity of DR by VeriSee™, ophthalmologists, and internal physicians. Area under the receiver operating characteristic curve (AUC) for VeriSee™, and the sensitivities and specificities for VeriSee™, ophthalmologists, and internal physicians in diagnosing DR were calculated.

RESULTS

The AUCs for VeriSee™ in diagnosing any DR, referable DR and proliferative diabetic retinopathy (PDR) were 0.955, 0.955 and 0.984, respectively. VeriSee™ had better sensitivities in diagnosing any DR and PDR (92.2% and 90.9%, respectively) than internal physicians (64.3% and 20.6%, respectively) (P < 0.001 for both). VeriSee™ also had better sensitivities in diagnosing any DR and referable DR (92.2% and 89.2%, respectively) than ophthalmologists (86.9% and 71.1%, respectively) (P < 0.001 for both), while ophthalmologists had better specificities.

CONCLUSION

VeriSee™ had good sensitivity and specificity in grading the severity of DR from color fundus images. It may offer clinical assistance to non-ophthalmologists in DR screening with nonmydriatic retinal fundus photography.

IDRiD: Diabetic Retinopathy - Segmentation and Grading Challenge

Diabetic Retinopathy (DR) is the most common cause of avoidable vision loss, predominantly affecting the working-age population across the globe. Screening for DR, coupled with timely consultation and treatment, is a globally trusted policy to avoid vision loss. However, implementation of DR screening programs is challenging due to the scarcity of medical professionals able to screen a growing global diabetic population at risk for DR. Computer-aided disease diagnosis in retinal image analysis could provide a sustainable approach for such large-scale screening effort. The recent scientific advances in computing capacity and machine learning approaches provide an avenue for biomedical scientists to reach this goal. Aiming to advance the state-of-the-art in automatic DR diagnosis, a grand challenge on "Diabetic Retinopathy - Segmentation and Grading" was organized in conjunction with the IEEE International Symposium on Biomedical Imaging (ISBI - 2018). In this paper, we report the set-up and results of this challenge that is primarily based on Indian Diabetic Retinopathy Image Dataset (IDRiD). There were three principal sub-challenges: lesion segmentation, disease severity grading, and localization of retinal landmarks and segmentation. These multiple tasks in this challenge allow to test the generalizability of algorithms, and this is what makes it different from existing ones. It received a positive response from the scientific community with 148 submissions from 495 registrations effectively entered in this challenge. This paper outlines the challenge, its organization, the dataset used, evaluation methods and results of top-performing participating solutions. The top-performing approaches utilized a blend of clinical information, data augmentation, and an ensemble of models. These findings have the potential to enable new developments in retinal image analysis and image-based DR screening in particular.

A review on computer-aided recent developments for automatic detection of diabetic retinopathy

Diabetic retinopathy is a serious microvascular disorder that might result in loss of vision and blindness. It seriously damages the retinal blood vessels and reduces the light-sensitive inner layer of the eye. Due to the manual inspection of retinal fundus images on diabetic retinopathy to detect the morphological abnormalities in Microaneurysms (MAs), Exudates (EXs), Haemorrhages (HMs), and Inter retinal microvascular abnormalities (IRMA) is very difficult and time consuming process. In order to avoid this, the regular follow-up screening process, and early automatic Diabetic Retinopathy detection are necessary. This paper discusses various methods of analysing automatic retinopathy detection and classification of different grading based on the severity levels. In addition, retinal blood vessel detection techniques are also discussed for the ultimate detection and diagnostic procedure of proliferative diabetic retinopathy. Furthermore, the paper elaborately discussed the systematic review accessed by authors on various publicly available databases collected from different medical sources. In the survey, meta-analysis of several methods for diabetic feature extraction, segmentation and various types of classifiers have been used to evaluate the system performance metrics for the diagnosis of DR. This survey will be helpful for the technical persons and researchers who want to focus on enhancing the diagnosis of a system that would be more powerful in real life.

Diabetic retinopathy techniques in retinal images: A review

The diabetic retinopathy is the main reason of vision loss in people. Medical experts recognize some clinical, geometrical and haemodynamic features of diabetic retinopathy. These features include the blood vessel area, exudates, microaneurysm, hemorrhages and neovascularization, etc. In Computer Aided Diagnosis (CAD) systems, these features are detected in fundus images using computer vision techniques. In this paper, we review the methods of low, middle and high level vision for automatic detection and classification of diabetic retinopathy.We give a detailed review of 79 algorithms for detecting different features of diabetic retinopathy during the last eight years.

Deep Learning-Based Algorithms in Screening of Diabetic Retinopathy: A Systematic Review of Diagnostic Performance

TOPIC

Diagnostic performance of deep learning-based algorithms in screening patients with diabetes for diabetic retinopathy (DR). The algorithms were compared with the current gold standard of classification by human specialists.

CLINICAL RELEVANCE

Because DR is a common cause of visual impairment, screening is indicated to avoid irreversible vision loss. Automated DR classification using deep learning may be a suitable new screening tool that could improve diagnostic performance and reduce manpower.

METHODS

For this systematic review, we aimed to identify studies that incorporated the use of deep learning in classifying full-scale DR in retinal fundus images of patients with diabetes. The studies had to provide a DR grading scale, a human grader as a reference standard, and a deep learning performance score. A systematic search on April 5, 2018, through MEDLINE and Embase yielded 304 publications. To identify potentially missed publications, the reference lists of the final included studies were manually screened, yielding no additional publications. The Quality Assessment of Diagnostic Accuracy Studies 2 tool was used for risk of bias and applicability assessment.

RESULTS

By using objective selection, we included 11 diagnostic accuracy studies that validated the performance of their deep learning method using a new group of patients or retrospective datasets. Eight studies reported sensitivity and specificity of 80.28% to 100.0% and 84.0% to 99.0%, respectively. Two studies report accuracies of 78.7% and 81.0%. One study provides an area under the receiver operating curve of 0.955. In addition to diagnostic performance, one study also reported on patient satisfaction, showing that 78% of patients preferred an automated deep learning model over manual human grading.

CONCLUSIONS

Advantages of implementing deep learning-based algorithms in DR screening include reduction in manpower, cost of screening, and issues relating to intragrader and intergrader variability. However, limitations that may hinder such an implementation particularly revolve around ethical concerns regarding lack of trust in the diagnostic accuracy of computers. Considering both strengths and limitations, as well as the high performance of deep learning-based algorithms, automated DR classification using deep learning could be feasible in a real-world screening scenario.

Pivotal trial of an autonomous AI-based diagnostic system for detection of diabetic retinopathy in primary care offices

Artificial Intelligence (AI) has long promised to increase healthcare affordability, quality and accessibility but FDA, until recently, had never authorized an autonomous AI diagnostic system. This pivotal trial of an AI system to detect diabetic retinopathy (DR) in people with diabetes enrolled 900 subjects, with no history of DR at primary care clinics, by comparing to Wisconsin Fundus Photograph Reading Center (FPRC) widefield stereoscopic photography and macular Optical Coherence Tomography (OCT), by FPRC certified photographers, and FPRC grading of Early Treatment Diabetic Retinopathy Study Severity Scale (ETDRS) and Diabetic Macular Edema (DME). More than mild DR (mtmDR) was defined as ETDRS level 35 or higher, and/or DME, in at least one eye. AI system operators underwent a standardized training protocol before study start. Median age was 59 years (range, 22–84 years); among participants, 47.5% of participants were male; 16.1% were Hispanic, 83.3% not Hispanic; 28.6% African American and 63.4% were not; 198 (23.8%) had mtmDR. The AI system exceeded all pre-specified superiority endpoints at sensitivity of 87.2% (95% CI, 81.8–91.2%) (>85%), specificity of 90.7% (95% CI, 88.3–92.7%) (>82.5%), and imageability rate of 96.1% (95% CI, 94.6–97.3%), demonstrating AI’s ability to bring specialty-level diagnostics to primary care settings. Based on these results, FDA authorized the system for use by health care providers to detect more than mild DR and diabetic macular edema, making it, the first FDA authorized autonomous AI diagnostic system in any field of medicine, with the potential to help prevent vision loss in thousands of people with diabetes annually. ClinicalTrials.gov NCT02963441

A Random Forest classifier-based approach in the detection of abnormalities in the retina

Classification of abnormalities from medical images using computer-based approaches is of growing interest in medical imaging. Timely detection of abnormalities due to diabetic retinopathy and age-related macular degeneration is required in order to prevent the prognosis of the disease. Computer-aided systems using machine learning are becoming interesting to ophthalmologists and researchers. We present here one such technique, the Random Forest classifier, to aid medical practitioners in accurate diagnosis of the diseases. A computer-aided diagnosis system is proposed for detecting retina abnormalities, which combines K means-based segmentation of the retina image, after due preprocessing, followed by machine learning techniques, using several low level and statistical features. Abnormalities in the retina that are classified are caused by age-related macular degeneration and diabetic retinopathy. Performance measures used in the analysis are accuracy, sensitivity, specificity, F-measure, and Mathew correlation coefficient. A comparison with another machine learning technique, the Naïve Bayes classifier shows that the classification achieved by Random Forest classifier is 93.58% and it outperforms Naïve Bayes classifier which yields an accuracy of 83.63%. Graphical abstract Random Forest classifier for abnormality detection in retina images.

Automated Screening for Diabetic Retinopathy - A Systematic Review

PURPOSE

Worldwide ophthalmologists are challenged by the rapid rise in the prevalence of diabetes. Diabetic retinopathy (DR) is the most common complication in diabetes, and possible consequences range from mild visual impairment to blindness. Repetitive screening for DR is cost-effective, but it is also a costly and strenuous affair. Several studies have examined the application of automated image analysis to solve this problem. Large populations are needed to assess the efficacy of such programs, and a standardized and rigorous methodology is important to give an indication of system performance in actual clinical settings.

METHODS

In a systematic review, we aimed to identify studies with methodology and design that are similar or replicate actual screening scenarios. A total of 1,231 publications were identified through PubMed, Cochrane Library, and Embase searches. Three manual search strategies were carried out to identify publications missed in the primary search. Four levels of screening identified 7 studies applicable for inclusion.

RESULTS

Seven studies were included. The detection of DR had high sensitivities (87.0-95.2%) but lower specificities (49.6-68.8%). False-negative results were related to mild DR with a low risk of progression within 1 year. Several studies reported missed cases of diabetic macular edema. A meta-analysis was not conducted as studies were not suitable for direct comparison or statistical analysis.

CONCLUSION

The study demonstrates that despite limited specificity, automated retinal image analysis may potentially be valuable in different DR screening scenarios with a relatively high sensitivity and a substantial workload reduction.

Automated retinal health diagnosis using pyramid histogram of visual words and Fisher vector techniques

Untreated age-related macular degeneration (AMD), diabetic retinopathy (DR), and glaucoma may lead to irreversible vision loss. Hence, it is essential to have regular eye screening to detect these eye diseases at an early stage and to offer treatment where appropriate. One of the simplest, non-invasive and cost-effective techniques to screen the eyes is by using fundus photo imaging. But, the manual evaluation of fundus images is tedious and challenging. Further, the diagnosis made by ophthalmologists may be subjective. Therefore, an objective and novel algorithm using the pyramid histogram of visual words (PHOW) and Fisher vectors is proposed for the classification of fundus images into their respective eye conditions (normal, AMD, DR, and glaucoma). The proposed algorithm extracts features which are represented as words. These features are built and encoded into a Fisher vector for classification using random forest classifier. This proposed algorithm is validated with both blindfold and ten-fold cross-validation techniques. An accuracy of 90.06% is achieved with the blindfold method, and highest accuracy of 96.79% is obtained with ten-fold cross-validation. The highest classification performance of our system shows the potential of deploying it in polyclinics to assist healthcare professionals in their initial diagnosis of the eye. Our developed system can reduce the workload of ophthalmologists significantly.

Evolutionary Computing Enriched Computer-Aided Diagnosis System for Diabetic Retinopathy: A Survey

Complications caused due to diabetes mellitus result in significant microvasculature that eventually causes diabetic retinopathy (DR) that keeps on increasing with time, and eventually causes complete vision loss. Identifying subtle variations in morphological changes in retinal blood vessels, optic disk, exudates, microaneurysms, hemorrhage, etc., is complicated and requires a robust computer-aided diagnosis (CAD) system so as to enable earlier and efficient DR diagnosis practices. In the majority of the existing CAD systems, functional enhancements have been realized time and again to ensure accurate and efficient diagnosis of DR. In this survey paper, a number of existing literature presenting DR CAD systems are discussed and analyzed. Both traditional and varoius evolutionary approaches, including genetic algorithm, particle swarm optimization, ant colony optimization, bee colony optimization, etc., based DR CAD have also been studied and their respective efficiencies have been discussed. Our survey revealed that evolutionary computing methods can play a vital role for optimizing DR-CAD functional components, such as proprocessing by enhancing filters coefficient, segmentation by enriching clustering, feature extraction, feature selection, and dimensional reduction, as well as classification.

Detecting retinal microaneurysms and hemorrhages with robustness to the presence of blood vessels

BACKGROUND AND OBJECTIVES

Diabetic Retinopathy is the leading cause of blindness in developed countries in the age group 20-74 years. It is characterized by lesions on the retina and this paper focuses on detecting two of these lesions, Microaneurysms and Hemorrhages, which are also known as red lesions. This paper attempts to deal with two problems in detecting red lesions from retinal fundus images: (1) false detections on blood vessels; and (2) different size of red lesions.

METHODS

To deal with false detections on blood vessels, novel filters have been proposed which can distinguish between red lesions and blood vessels. This distinction is based on the fact that vessels are elongated while red lesions are usually circular blob-like structures. The second problem of the different size of lesions is dealt with by applying the proposed filters on patches of different sizes instead of filtering the full image. These patches are obtained by dividing the original image using a grid whose size determines the patch size. Different grid sizes were used and lesion detection results for these grid sizes were combined using Multiple Kernel Learning.

RESULTS

Experiments on a dataset of 143 images showed that proposed filters detected Microaneurysms and Hemorrhages successfully even when these lesions were close to blood vessels. In addition, using Multiple Kernel Learning improved the results when compared to using a grid of one size only. The areas under receiver operating characteristic curve were found to be 0.97 and 0.92 for Microaneurysms and Hemorrhages respectively which are better than the existing related works.

CONCLUSIONS

Proposed filters are robust to the presence of blood vessels and surpass related works in detecting red lesions from retinal fundus images. Improved lesion detection using the proposed approach can help in automatic detection of Diabetic Retinopathy.

Automatic differentiation of color fundus images containing drusen or exudates using a contextual spatial pyramid approach

We developed an automatic system to identify and differentiate color fundus images containing no lesions, drusen or exudates. Drusen and exudates are lesions with a bright appearance, associated with age-related macular degeneration and diabetic retinopathy, respectively. The system consists of three lesion detectors operating at pixel-level, combining their outputs using spatial pooling and classification with a random forest classifier. System performance was compared with ratings of two independent human observers using human-expert annotations as reference. Kappa agreements of 0.89, 0.97 and 0.92 and accuracies of 0.93, 0.98 and 0.95 were obtained for the system and observers, respectively.

Automatic detection of referral patients due to retinal pathologies through data mining

With the increased prevalence of retinal pathologies, automating the detection of these pathologies is becoming more and more relevant. In the past few years, many algorithms have been developed for the automated detection of a specific pathology, typically diabetic retinopathy, using eye fundus photography. No matter how good these algorithms are, we believe many clinicians would not use automatic detection tools focusing on a single pathology and ignoring any other pathology present in the patient's retinas. To solve this issue, an algorithm for characterizing the appearance of abnormal retinas, as well as the appearance of the normal ones, is presented. This algorithm does not focus on individual images: it considers examination records consisting of multiple photographs of each retina, together with contextual information about the patient. Specifically, it relies on data mining in order to learn diagnosis rules from characterizations of fundus examination records. The main novelty is that the content of examination records (images and context) is characterized at multiple levels of spatial and lexical granularity: 1) spatial flexibility is ensured by an adaptive decomposition of composite retinal images into a cascade of regions, 2) lexical granularity is ensured by an adaptive decomposition of the feature space into a cascade of visual words. This multigranular representation allows for great flexibility in automatically characterizing normality and abnormality: it is possible to generate diagnosis rules whose precision and generalization ability can be traded off depending on data availability. A variation on usual data mining algorithms, originally designed to mine static data, is proposed so that contextual and visual data at adaptive granularity levels can be mined. This framework was evaluated in e-ophtha, a dataset of 25,702 examination records from the OPHDIAT screening network, as well as in the publicly-available Messidor dataset. It was successfully applied to the detection of patients that should be referred to an ophthalmologist and also to the specific detection of several pathologies.

Automated retinal image analysis for diabetic retinopathy in telemedicine

There will be an estimated 552 million persons with diabetes globally by the year 2030. Over half of these individuals will develop diabetic retinopathy, representing a nearly insurmountable burden for providing diabetes eye care. Telemedicine programmes have the capability to distribute quality eye care to virtually any location and address the lack of access to ophthalmic services. In most programmes, there is currently a heavy reliance on specially trained retinal image graders, a resource in short supply worldwide. These factors necessitate an image grading automation process to increase the speed of retinal image evaluation while maintaining accuracy and cost effectiveness. Several automatic retinal image analysis systems designed for use in telemedicine have recently become commercially available. Such systems have the potential to substantially improve the manner by which diabetes eye care is delivered by providing automated real-time evaluation to expedite diagnosis and referral if required. Furthermore, integration with electronic medical records may allow a more accurate prognostication for individual patients and may provide predictive modelling of medical risk factors based on broad population data.

A survey on computer aided diagnosis for ocular diseases

Background

Computer Aided Diagnosis (CAD), which can automate the detection process for ocular diseases, has attracted extensive attention from clinicians and researchers alike. It not only alleviates the burden on the clinicians by providing objective opinion with valuable insights, but also offers early detection and easy access for patients.

Method

We review ocular CAD methodologies for various data types. For each data type, we investigate the databases and the algorithms to detect different ocular diseases. Their advantages and shortcomings are analyzed and discussed.

Result

We have studied three types of data (i.e., clinical, genetic and imaging) that have been commonly used in existing methods for CAD. The recent developments in methods used in CAD of ocular diseases (such as Diabetic Retinopathy, Glaucoma, Age-related Macular Degeneration and Pathological Myopia) are investigated and summarized comprehensively.

Conclusion

While CAD for ocular diseases has shown considerable progress over the past years, the clinical importance of fully automatic CAD systems which are able to embed clinical knowledge and integrate heterogeneous data sources still show great potential for future breakthrough.

Computer-aided diagnosis of proliferative diabetic retinopathy via modeling of the major temporal arcade in retinal fundus images

Monitoring the openness of the major temporal arcade (MTA) and how it changes over time could facilitate diagnosis and treatment of proliferative diabetic retinopathy (PDR). We present methods for user-guided semiautomated modeling and measurement of the openness of the MTA based on Gabor filters for the detection of retinal vessels, morphological image processing, and a form of the generalized Hough transform for the detection of parabolas. The methods, implemented via a graphical user interface, were tested with retinal fundus images of 11 normal individuals and 11 patients with PDR in the present pilot study on potential clinical application. A method of arcade angle measurement was used for comparative analysis. The results using the openness parameters of single- and dual-parabolic models as well as the arcade angle measurements indicate areas under the receiver operating characteristics of A z = 0.87, 0.82, and 0.80, respectively. The proposed methods are expected to facilitate quantitative analysis of the architecture of the MTA, as well as assist in detection and diagnosis of PDR.

Quality evaluation of digital fundus images through combined measures

The evaluation of image quality is an important step before an automatic analysis of retinal images. Several conditions can impair the acquisition of a good image, and minimum image quality requirements should be present to ensure that an automatic or semiautomatic system provides an accurate diagnosis. A method to classify fundus images as low or good quality is presented. The method starts with the detection of regions of uneven illumination and evaluates if the segmented noise masks affect a clinically relevant area (around the macula). Afterwards, focus is evaluated through a fuzzy classifier. An input vector is created extracting three focus features. The system was validated in a large dataset (1454 fundus images), obtained from an online database and an eye clinic and compared with the ratings of three observers. The system performance was close to optimal with an area under the receiver operating characteristic curve of 0.9943.

Computer-aided diagnosis of diabetic retinopathy: a review

Diabetes mellitus may cause alterations in the retinal microvasculature leading to diabetic retinopathy. Unchecked, advanced diabetic retinopathy may lead to blindness. It can be tedious and time consuming to decipher subtle morphological changes in optic disk, microaneurysms, hemorrhage, blood vessels, macula, and exudates through manual inspection of fundus images. A computer aided diagnosis system can significantly reduce the burden on the ophthalmologists and may alleviate the inter and intra observer variability. This review discusses the available methods of various retinal feature extractions and automated analysis.

Computer-aided diagnosis of proliferative diabetic retinopathy

Monitoring the openness of the major temporal arcade (MTA) and how it changes over time could facilitate improved diagnosis and timely treatment of proliferative diabetic retinopathy (PDR). We present methods for user-guided modeling and measurement of the openness of the MTA based on a form of the generalized Hough transform for the detection of parabolas, and to compare it with a method of arcade angle measurement. The methods, implemented via a graphical user interface, were tested with retinal fundus images of 10 normal individuals and 15 patients with PDR. The results using the openness parameters of single- and dual-parabolic models as well as the arcade angle measurements indicate areas under the receiver operating characteristics of A(z)= 0.94, 0.87, and 0.84, respectively. The proposed methods should facilitate improved quantitative analysis of the architecture of the MTA, as well as assist in detection, diagnosis, and improved treatment of PDR.

Validation of tablet-based evaluation of color fundus images

PURPOSE

To compare diabetic retinopathy (DR) referral recommendations made by viewing fundus images using a tablet computer with those made using a standard desktop display.

METHODS

A tablet computer (iPad) and a desktop computer with a high-definition color display were compared. For each platform, 2 retinal specialists independently rated 1,200 color fundus images from patients at risk for DR using an annotation program Truthseeker. The specialists determined whether each image had referable DR and also how urgently each patient should be referred for medical examination. Graders viewed and rated the randomly presented images independently and were masked to their ratings on the alternative platform. Tablet-based and desktop display-based referral ratings were compared using cross-platform intraobserver kappa as the primary outcome measure. Additionally, interobserver kappa, sensitivity, specificity, and area under the receiver operating characteristic were determined.

RESULTS

A high level of cross-platform intraobserver agreement was found for the DR referral ratings between the platforms (κ = 0.778) and for the 2 graders (κ = 0.812). Interobserver agreement was similar for the 2 platforms (κ = 0.544 and κ = 0.625 for tablet and desktop, respectively). The tablet-based ratings achieved a sensitivity of 0.848, a specificity of 0.987, and an area under the receiver operating characteristic of 0.950 compared with desktop display-based ratings.

CONCLUSION

In this pilot study, tablet-based rating of color fundus images for subjects at risk for DR was consistent with desktop display-based rating. These results indicate that tablet computers can be reliably used for clinical evaluation of fundus images for DR.

Exudate-based diabetic macular edema detection in fundus images using publicly available datasets

Diabetic macular edema (DME) is a common vision threatening complication of diabetic retinopathy. In a large scale screening environment DME can be assessed by detecting exudates (a type of bright lesions) in fundus images. In this work, we introduce a new methodology for diagnosis of DME using a novel set of features based on colour, wavelet decomposition and automatic lesion segmentation. These features are employed to train a classifier able to automatically diagnose DME through the presence of exudation. We present a new publicly available dataset with ground-truth data containing 169 patients from various ethnic groups and levels of DME. This and other two publicly available datasets are employed to evaluate our algorithm. We are able to achieve diagnosis performance comparable to retina experts on the MESSIDOR (an independently labelled dataset with 1200 images) with cross-dataset testing (e.g., the classifier was trained on an independent dataset and tested on MESSIDOR). Our algorithm obtained an AUC between 0.88 and 0.94 depending on the dataset/features used. Additionally, it does not need ground truth at lesion level to reject false positives and is computationally efficient, as it generates a diagnosis on an average of 4.4s (9.3s, considering the optic nerve localisation) per image on an 2.6 GHz platform with an unoptimised Matlab implementation.

Automated measurement of the arteriolar-to-venular width ratio in digital color fundus photographs

A decreased ratio of the width of retinal arteries to veins [arteriolar-to-venular diameter ratio (AVR)], is well established as predictive of cerebral atrophy, stroke and other cardiovascular events in adults. Tortuous and dilated arteries and veins, as well as decreased AVR are also markers for plus disease in retinopathy of prematurity. This work presents an automated method to estimate the AVR in retinal color images by detecting the location of the optic disc, determining an appropriate region of interest (ROI), classifying vessels as arteries or veins, estimating vessel widths, and calculating the AVR. After vessel segmentation and vessel width determination, the optic disc is located and the system eliminates all vessels outside the AVR measurement ROI. A skeletonization operation is applied to the remaining vessels after which vessel crossings and bifurcation points are removed, leaving a set of vessel segments consisting of only vessel centerline pixels. Features are extracted from each centerline pixel in order to assign these a soft label indicating the likelihood that the pixel is part of a vein. As all centerline pixels in a connected vessel segment should be the same type, the median soft label is assigned to each centerline pixel in the segment. Next, artery vein pairs are matched using an iterative algorithm, and the widths of the vessels are used to calculate the AVR. We trained and tested the algorithm on a set of 65 high resolution digital color fundus photographs using a reference standard that indicates for each major vessel in the image whether it is an artery or vein. We compared the AVR values produced by our system with those determined by a semi-automated reference system. We obtained a mean unsigned error of 0.06 (SD 0.04) in 40 images with a mean AVR of 0.67. A second observer using the semi-automated system obtained the same mean unsigned error of 0.06 (SD 0.05) on the set of images with a mean AVR of 0.66. The testing data and reference standard used in this study has been made publicly available.

Digital ocular fundus imaging: a review

Ocular fundus imaging plays a key role in monitoring the health status of the human eye. Currently, a large number of imaging modalities allow the assessment and/or quantification of ocular changes from a healthy status. This review focuses on the main digital fundus imaging modality, color fundus photography, with a brief overview of complementary techniques, such as fluorescein angiography. While focusing on two-dimensional color fundus photography, the authors address the evolution from nondigital to digital imaging and its impact on diagnosis. They also compare several studies performed along the transitional path of this technology. Retinal image processing and analysis, automated disease detection and identification of the stage of diabetic retinopathy (DR) are addressed as well. The authors emphasize the problems of image segmentation, focusing on the major landmark structures of the ocular fundus: the vascular network, optic disk and the fovea. Several proposed approaches for the automatic detection of signs of disease onset and progression, such as microaneurysms, are surveyed. A thorough comparison is conducted among different studies with regard to the number of eyes/subjects, imaging modality, fundus camera used, field of view and image resolution to identify the large variation in characteristics from one study to another. Similarly, the main features of the proposed classifications and algorithms for the automatic detection of DR are compared, thereby addressing computer-aided diagnosis and computer-aided detection for use in screening programs.

Automatic detection of diabetic retinopathy and age-related macular degeneration in digital fundus images

PURPOSE

To describe and evaluate the performance of an algorithm that automatically classifies images with pathologic features commonly found in diabetic retinopathy (DR) and age-related macular degeneration (AMD).

METHODS

Retinal digital photographs (N = 2247) of three fields of view (FOV) were obtained of the eyes of 822 patients at two centers: The Retina Institute of South Texas (RIST, San Antonio, TX) and The University of Texas Health Science Center San Antonio (UTHSCSA). Ground truth was provided for the presence of pathologic conditions, including microaneurysms, hemorrhages, exudates, neovascularization in the optic disc and elsewhere, drusen, abnormal pigmentation, and geographic atrophy. The algorithm was used to report on the presence or absence of disease. A detection threshold was applied to obtain different values of sensitivity and specificity with respect to ground truth and to construct a receiver operating characteristic (ROC) curve.

RESULTS

The system achieved an average area under the ROC curve (AUC) of 0.89 for detection of DR and of 0.92 for detection of sight-threatening DR (STDR). With a fixed specificity of 0.50, the system's sensitivity ranged from 0.92 for all DR cases to 1.00 for clinically significant macular edema (CSME).

CONCLUSIONS

A computer-aided algorithm was trained to detect different types of pathologic retinal conditions. The cases of hard exudates within 1 disc diameter (DD) of the fovea (surrogate for CSME) were detected with very high accuracy (sensitivity = 1, specificity = 0.50), whereas mild nonproliferative DR was the most challenging condition (sensitivity = 0.92, specificity = 0.50). The algorithm was also tested on images with signs of AMD, achieving a performance of AUC of 0.84 (sensitivity = 0.94, specificity = 0.50).

Optimal filter framework for automated, instantaneous detection of lesions in retinal images

Automated detection of lesions in retinal images is a crucial step towards efficient early detection, or screening, of large at-risk populations. In particular, the detection of microaneurysms, usually the first sign of diabetic retinopathy (DR), and the detection of drusen, the hallmark of age-related macular degeneration (AMD), are of primary importance. In spite of substantial progress made, detection algorithms still produce 1) false positives-target lesions are mixed up with other normal or abnormal structures in the eye, and 2) false negatives-the large variability in the appearance of the lesions causes a subset of these target lesions to be missed. We propose a general framework for detecting and characterizing target lesions almost instantaneously. This framework relies on a feature space automatically derived from a set of reference image samples representing target lesions, including atypical target lesions, and those eye structures that are similar looking but are not target lesions. The reference image samples are obtained either from an expert- or a data-driven approach. Factor analysis is used to derive the filters generating this feature space from reference samples. Previously unseen image samples are then classified in this feature space. We tested this approach by training it to detect microaneurysms. On a set of images from 2739 patients including 67 with referable DR, DR detection area under the receiver-operating characteristic curve (AUC) was comparable (AUC=0.927) to our previously published red lesion detection algorithm (AUC=0.929). We also tested the approach on the detection of AMD, by training it to differentiate drusen from Stargardt's disease lesions, and achieved an AUC=0.850 on a set of 300 manually detected drusen and 300 manually detected flecks. The entire image processing sequence takes less than a second on a standard PC compared to minutes in our previous approach, allowing instantaneous detection. Free-response receiver-operating characteristic analysis showed the superiority of this approach over a framework where false positives and the atypical lesions are not explicitly modeled. A greater performance was achieved by the expert-driven approach for DR detection, where the designer had sound expert knowledge. However, for both problems, a comparable performance was obtained for both expert- and data-driven approaches. This indicates that annotation of a limited number of lesions suffices for building a detection system for any type of lesion in retinal images, if no expert-knowledge is available. We are studying whether the optimal filter framework also generalizes to the detection of any structure in other domains.