1
|
Pu L, Beale O, Meng X. Geometric Self-Supervised Learning: A Novel AI Approach Towards Quantitative and Explainable Diabetic Retinopathy Detection. Bioengineering (Basel) 2025; 12:157. [PMID: 40001677 PMCID: PMC11852169 DOI: 10.3390/bioengineering12020157] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/26/2024] [Revised: 01/30/2025] [Accepted: 02/03/2025] [Indexed: 02/27/2025] Open
Abstract
BACKGROUND Diabetic retinopathy (DR) is the leading cause of blindness among working-age adults. Early detection is crucial to reducing DR-related vision loss risk but is fraught with challenges. Manual detection is labor-intensive and often misses tiny DR lesions, necessitating automated detection. OBJECTIVE We aimed to develop and validate an annotation-free deep learning strategy for the automatic detection of exudates and bleeding spots on color fundus photography (CFP) images and ultrawide field (UWF) retinal images. MATERIALS AND METHODS Three cohorts were created: two CFP cohorts (Kaggle-CFP and E-Ophtha) and one UWF cohort. Kaggle-CFP was used for algorithm development, while E-Ophtha, with manually annotated DR-related lesions, served as the independent test set. For additional independent testing, 50 DR-positive cases from both the Kaggle-CFP and UWF cohorts were manually outlined for bleeding and exudate spots. The remaining cases were used for algorithm training. A multiscale contrast-based shape descriptor transformed DR-verified retinal images into contrast fields. High-contrast regions were identified, and local image patches from abnormal and normal areas were extracted to train a U-Net model. Model performance was evaluated using sensitivity and false positive rates based on manual annotations in the independent test sets. RESULTS Our trained model on the independent CFP cohort achieved high sensitivities for detecting and segmenting DR lesions: microaneurysms (91.5%, 9.04 false positives per image), hemorrhages (92.6%, 2.26 false positives per image), hard exudates (92.3%, 7.72 false positives per image), and soft exudates (90.7%, 0.18 false positives per image). For UWF images, the model's performance varied by lesion size. Bleeding detection sensitivity increased with lesion size, from 41.9% (6.48 false positives per image) for the smallest spots to 93.4% (5.80 false positives per image) for the largest. Exudate detection showed high sensitivity across all sizes, ranging from 86.9% (24.94 false positives per image) to 96.2% (6.40 false positives per image), though false positive rates were higher for smaller lesions. CONCLUSIONS Our experiments demonstrate the feasibility of training a deep learning neural network for detecting and segmenting DR-related lesions without relying on their manual annotations.
Collapse
Affiliation(s)
- Lucas Pu
- Department of Radiology, University of Pittsburgh School of Medicine, Pittsburgh, PA 15260, USA;
| | - Oliver Beale
- Department of Ophthalmology, University of Pittsburgh School of Medicine, Pittsburgh, PA 15213, USA;
| | - Xin Meng
- Department of Radiology, University of Pittsburgh School of Medicine, Pittsburgh, PA 15260, USA;
| |
Collapse
|
2
|
Wang VY, Lo MT, Chen TC, Huang CH, Huang A, Wang PC. A deep learning-based ADRPPA algorithm for the prediction of diabetic retinopathy progression. Sci Rep 2024; 14:31772. [PMID: 39738461 PMCID: PMC11686301 DOI: 10.1038/s41598-024-82884-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2024] [Accepted: 12/10/2024] [Indexed: 01/02/2025] Open
Abstract
As an alternative to assessments performed by human experts, artificial intelligence (AI) is currently being used for screening fundus images and monitoring diabetic retinopathy (DR). Although AI models can provide quasi-clinician diagnoses, they rarely offer new insights to assist clinicians in predicting disease prognosis and treatment response. Using longitudinal retinal imaging data, we developed and validated a predictive model for DR progression: AI-driven Diabetic Retinopathy Progression Prediction Algorithm (ADRPPA). In this retrospective study, we analyzed paired retinal fundus images of the same eye captured at ≥ 1-year intervals. The analysis was performed using the EyePACS dataset. By analyzing 12,768 images from 6384 eyes (2 images/eye, taken 733 ± 353 days apart), each annotated with DR severity grades, we trained the neural network ResNeXt to automatically determine DR severity. EyePACS data corresponding to 5108 (80%), 639 (10%), and 637 (10%) eyes were used for model training, validation, and testing, respectively. We further used an independent e-ophtha dataset comprising 148 images annotated with microaneurysms, 118 (75%) and 30 (25%) of which were used for training and validation, respectively. This dataset was used to train the neural network Mask Region-based Convolutional Neural Network (Mask-RCNN) for quantifying microaneurysms. The DR and microaneurysm scores from the first nonreferable DR (NRDR) image of each eye were used to predict progression to referable DR (RDR) in the second image. The area under the receiver operating characteristic curve values indicating our model's performance in diagnosing RDR were 0.963, 0.970, 0.968, and 0.971 for the trained ResNeXt models with input image resolutions of 256 × 256, 512 × 512, 768 × 768, and 1024 × 1024 pixels, respectively. In the validation of the Mask-RCNN model trained on the e-ophtha dataset resized to 1600 pixels in height, the recall, precision, and F1-score values for detecting individual microaneurysms were 0.786, 0.615, and 0.690, respectively. The best model combination for predicting NRDR-to-RDR progression included the 768-pixel ResNeXt and 1600-pixel Mask-RCNN models; this combination achieved recall, precision, and F1-scores of 0.338 (95% confidence interval [CI]: 0.228-0.451), 0.561 (95% CI: 0.405-0.714), and 0.422 (95% CI: 0.299-0.532), respectively. Thus, deep learning models can be trained on longitudinal retinal imaging data to predict NRDR-to-RDR progression. Furthermore, DR and microaneurysm scores generated from low- and high-resolution fundus images, respectively, can help identify patients at a high risk of NRDR, facilitating timely treatment.
Collapse
Affiliation(s)
- Victoria Y Wang
- Department of Ophthalmology, Keck School of Medicine, USC Roski Eye Institute, University of Southern California, Los Angeles, CA, USA
| | - Men-Tzung Lo
- Department of Biomedical Sciences and Engineering, National Central University, Research Center Building 3, Room 404, 300 Zhongda Rd, Zhong-Li, Taoyuan, Taiwan
| | - Ta-Ching Chen
- Department of Ophthalmology, National Taiwan University Hospital, Taipei, Taiwan
- Center of Frontier Medicine, National Taiwan University Hospital, Taipei, Taiwan
| | - Chu-Hsuan Huang
- Department of Ophthalmology, Cathay General Hospital, Taipei, Taiwan
| | - Adam Huang
- Department of Biomedical Sciences and Engineering, National Central University, Research Center Building 3, Room 404, 300 Zhongda Rd, Zhong-Li, Taoyuan, Taiwan.
| | - Pa-Chun Wang
- Department of Medical Research, Cathay General Hospital, 280 Jen-Ai Rd. Sec.4 106, Taipei, Taiwan.
- Fu-Jen Catholic University School of Medicine, New Taipei City, Taiwan.
- Department of Medical Research, China Medical University Hospital, Taichung, Taiwan.
| |
Collapse
|
3
|
Li J, Ma Q, Yao M, Jiang Q, Wang Z, Yan B. Segmentation of retinal microaneurysms in fluorescein fundus angiography images by a novel three-step model. Front Med (Lausanne) 2024; 11:1372091. [PMID: 38962734 PMCID: PMC11220251 DOI: 10.3389/fmed.2024.1372091] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2024] [Accepted: 05/21/2024] [Indexed: 07/05/2024] Open
Abstract
Introduction Microaneurysms serve as early signs of diabetic retinopathy, and their accurate detection is critical for effective treatment. Due to their low contrast and similarity to retinal vessels, distinguishing microaneurysms from background noise and retinal vessels in fluorescein fundus angiography (FFA) images poses a significant challenge. Methods We present a model for automatic detection of microaneurysms. FFA images were pre-processed using Top-hat transformation, Gray-stretching, and Gaussian filter techniques to eliminate noise. The candidate microaneurysms were coarsely segmented using an improved matched filter algorithm. Real microaneurysms were segmented by a morphological strategy. To evaluate the segmentation performance, our proposed model was compared against other models, including Otsu's method, Region Growing, Global Threshold, Matched Filter, Fuzzy c-means, and K-means, using both self-constructed and publicly available datasets. Performance metrics such as accuracy, sensitivity, specificity, positive predictive value, and intersection-over-union were calculated. Results The proposed model outperforms other models in terms of accuracy, sensitivity, specificity, positive predictive value, and intersection-over-union. The segmentation results obtained with our model closely align with benchmark standard. Our model demonstrates significant advantages for microaneurysm segmentation in FFA images and holds promise for clinical application in the diagnosis of diabetic retinopathy. Conclusion The proposed model offers a robust and accurate approach to microaneurysm detection, outperforming existing methods and demonstrating potential for clinical application in the effective treatment of diabetic retinopathy.
Collapse
Affiliation(s)
- Jing Li
- Eye Institute and Department of Ophthalmology, Eye and ENT Hospital, State Key Laboratory of Medical Neurobiology, Fudan University, Shanghai, China
- College of Information Science, Shanghai Ocean University, Shanghai, China
| | - Qian Ma
- Department of Ophthalmology, General Hospital of Ningxia Medical University, Ningxia, China
| | - Mudi Yao
- Department of Ophthalmology and Optometry, The Affiliated Eye Hospital, Nanjing Medical University, Nanjing, China
- Department of Ophthalmology, Shanghai General Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Qin Jiang
- Department of Ophthalmology and Optometry, The Affiliated Eye Hospital, Nanjing Medical University, Nanjing, China
| | - Zhenhua Wang
- College of Information Science, Shanghai Ocean University, Shanghai, China
| | - Biao Yan
- Eye Institute and Department of Ophthalmology, Eye and ENT Hospital, State Key Laboratory of Medical Neurobiology, Fudan University, Shanghai, China
- Department of Ophthalmology, Shanghai General Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| |
Collapse
|
4
|
Russo C, Bria A, Marrocco C. GravityNet for end-to-end small lesion detection. Artif Intell Med 2024; 150:102842. [PMID: 38553147 DOI: 10.1016/j.artmed.2024.102842] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2023] [Revised: 03/01/2024] [Accepted: 03/11/2024] [Indexed: 04/02/2024]
Abstract
This paper introduces a novel one-stage end-to-end detector specifically designed to detect small lesions in medical images. Precise localization of small lesions presents challenges due to their appearance and the diverse contextual backgrounds in which they are found. To address this, our approach introduces a new type of pixel-based anchor that dynamically moves towards the targeted lesion for detection. We refer to this new architecture as GravityNet, and the novel anchors as gravity points since they appear to be "attracted" by the lesions. We conducted experiments on two well-established medical problems involving small lesions to evaluate the performance of the proposed approach: microcalcifications detection in digital mammograms and microaneurysms detection in digital fundus images. Our method demonstrates promising results in effectively detecting small lesions in these medical imaging tasks.
Collapse
Affiliation(s)
- Ciro Russo
- Department of Electrical and Information Engineering, University of Cassino and L.M., Via G. Di Biasio 43, 03043 Cassino (FR), Italy.
| | - Alessandro Bria
- Department of Electrical and Information Engineering, University of Cassino and L.M., Via G. Di Biasio 43, 03043 Cassino (FR), Italy.
| | - Claudio Marrocco
- Department of Electrical and Information Engineering, University of Cassino and L.M., Via G. Di Biasio 43, 03043 Cassino (FR), Italy.
| |
Collapse
|
5
|
Steffi S, Sam Emmanuel WR. Resilient back-propagation machine learning-based classification on fundus images for retinal microaneurysm detection. Int Ophthalmol 2024; 44:91. [PMID: 38367192 DOI: 10.1007/s10792-024-02982-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2023] [Accepted: 10/29/2023] [Indexed: 02/19/2024]
Abstract
BACKGROUND The timely diagnosis of medical conditions, particularly diabetic retinopathy, relies on the identification of retinal microaneurysms. However, the commonly used retinography method poses a challenge due to the diminutive dimensions and limited differentiation of microaneurysms in images. PROBLEM STATEMENT Automated identification of microaneurysms becomes crucial, necessitating the use of comprehensive ad-hoc processing techniques. Although fluorescein angiography enhances detectability, its invasiveness limits its suitability for routine preventative screening. OBJECTIVE This study proposes a novel approach for detecting retinal microaneurysms using a fundus scan, leveraging circular reference-based shape features (CR-SF) and radial gradient-based texture features (RG-TF). METHODOLOGY The proposed technique involves extracting CR-SF and RG-TF for each candidate microaneurysm, employing a robust back-propagation machine learning method for training. During testing, extracted features from test images are compared with training features to categorize microaneurysm presence. RESULTS The experimental assessment utilized four datasets (MESSIDOR, Diaretdb1, e-ophtha-MA, and ROC), employing various measures. The proposed approach demonstrated high accuracy (98.01%), sensitivity (98.74%), specificity (97.12%), and area under the curve (91.72%). CONCLUSION The presented approach showcases a successful method for detecting retinal microaneurysms using a fundus scan, providing promising accuracy and sensitivity. This non-invasive technique holds potential for effective screening in diabetic retinopathy and other related medical conditions.
Collapse
Affiliation(s)
- S Steffi
- Department of Computer Science, Nesamony Memorial Christian College Affiliated to Manonmaniam Sundaranar University, Abishekapatti, Tirunelveli, Tamil Nadu, 627012, India.
| | - W R Sam Emmanuel
- Department of PG Computer Science, Nesamony Memorial Christian College Affiliated to Manonmaniam Sundaranar University, Abishekapatti, Tirunelveli, Tamil Nadu, 627012, India
| |
Collapse
|
6
|
Cantone M, Marrocco C, Tortorella F, Bria A. Learnable DoG convolutional filters for microcalcification detection. Artif Intell Med 2023; 143:102629. [PMID: 37673567 DOI: 10.1016/j.artmed.2023.102629] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2022] [Revised: 06/13/2023] [Accepted: 07/17/2023] [Indexed: 09/08/2023]
Abstract
Difference of Gaussians (DoG) convolutional filters are one of the earliest image processing methods employed for detecting microcalcifications on mammogram images before machine and deep learning methods became widespread. DoG is a blob enhancement filter that consists in subtracting one Gaussian-smoothed version of an image from another less Gaussian-smoothed version of the same image. Smoothing with a Gaussian kernel suppresses high-frequency spatial information, thus DoG can be regarded as a band-pass filter. However, due to their small size and overimposed breast tissue, microcalcifications vary greatly in contrast-to-noise ratio and sharpness. This makes it difficult to find a single DoG configuration that enhances all microcalcifications. In this work, we propose a convolutional network, named DoG-MCNet, where the first layer automatically learns a bank of DoG filters parameterized by their associated standard deviations. We experimentally show that when employed for microcalcification detection, our DoG layer acts as a learnable bank of band-pass preprocessing filters and improves detection performance by 4.86% AUFROC over baseline MCNet and 1.53% AUFROC over state-of-the-art multicontext ensemble of CNNs.
Collapse
Affiliation(s)
- Marco Cantone
- Department of Electrical and Information Engineering, University of Cassino and Southern Latium, Cassino, FR 03043, Italy.
| | - Claudio Marrocco
- Department of Electrical and Information Engineering, University of Cassino and Southern Latium, Cassino, FR 03043, Italy.
| | - Francesco Tortorella
- Department of Information and Electrical Engineering and Applied Mathematics, University of Salerno, Fisciano, SA 84084, Italy.
| | - Alessandro Bria
- Department of Electrical and Information Engineering, University of Cassino and Southern Latium, Cassino, FR 03043, Italy.
| |
Collapse
|
7
|
Zhang X, Ma Y, Gong Q, Yao J. Automatic detection of microaneurysms in fundus images based on multiple preprocessing fusion to extract features. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2023.104879] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/03/2023]
|
8
|
Bai Y, Zhang X, Wang C, Gu H, Zhao M, Shi F. Microaneurysms detection in retinal fundus images based on shape constraint with region-context features. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2023.104903] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/28/2023]
|
9
|
Mohan NJ, Murugan R, Goel T, Tanveer M, Roy P. An efficient microaneurysms detection approach in retinal fundus images. INT J MACH LEARN CYB 2023. [DOI: 10.1007/s13042-022-01696-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/19/2023]
|
10
|
Zhang X, Peng Z, Meng M, Wu J, Han Y, Zhang Y, Yang J, Zhao Q. ID-NET: Inception deconvolutional neural network for multi-class classification in retinal fundus image. J MECH MED BIOL 2022. [DOI: 10.1142/s0219519422400292] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
|
11
|
Detection of microaneurysms in color fundus images based on local Fourier transform. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2022.103648] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022]
|
12
|
Derwin DJ, Shan BP, Singh OJ. Hybrid multi-kernel SVM algorithm for detection of microaneurysm in color fundus images. Med Biol Eng Comput 2022; 60:1377-1390. [PMID: 35325369 DOI: 10.1007/s11517-022-02534-y] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/13/2021] [Accepted: 02/04/2022] [Indexed: 10/18/2022]
Abstract
Diabetic retinopathy (DR) is a chronic disease that may cause vision loss in diabetic patients. Microaneurysms which are characterized by small red spots on the retina due to fluid or blood leakage from the weak capillary wall often occur during the early stage of DR, making screening at this stage is essential. In this paper, an automatic screening system for early detection of DR in retinal images is developed using a combined shape and texture features. Due to minimum number of hand-crafted features, the computational burden is much reduced. The proposed hybrid multi-kernel support vector machine classifier is constructed by learning a kernel model formed as a combination of the base kernels. This approach outperforms the recent deep learning techniques in terms of the evaluation metrics. The efficiency of the proposed scheme is experimentally validated on three public datasets - Retinopathy Online Challenge, DIARETdB1, MESSIDOR, and AGAR300 (developed for this study). Studies reveal that the proposed model produced the best results of 0.503 in ROC dataset, 0.481 in DIARETdB1, and 0.464 in the MESSIDOR dataset in terms of FROC score. The AGAR300 database outperforms the existing MA detection algorithm in terms of FROC, AUC, F1 score, precision, sensitivity, and specificity which guarantees the robustness of this system.
Collapse
Affiliation(s)
- D Jeba Derwin
- SRM TRP Engineering College, Tiruchirappalli, Tamil Nadu, India.
| | | | - O Jeba Singh
- Arunachala College of Engineering for Women, Kanyakumari, Tamil Nadu, India
| |
Collapse
|
13
|
Du J, Zou B, Ouyang P, Zhao R. Retinal microaneurysm detection based on transformation splicing and multi-context ensemble learning. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2022.103536] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/02/2023]
|
14
|
Latha D, Bell TB, Sheela CJJ. Red lesion in fundus image with hexagonal pattern feature and two-level segmentation. MULTIMEDIA TOOLS AND APPLICATIONS 2022; 81:26143-26161. [PMID: 35368859 PMCID: PMC8959564 DOI: 10.1007/s11042-022-12667-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/26/2021] [Revised: 12/16/2021] [Accepted: 02/21/2022] [Indexed: 06/14/2023]
Abstract
Red lesion identification at its early stage is very essential for the treatment of diabetic retinopathy to prevent loss of vision. This work proposes a red lesion detection algorithm that uses Hexagonal pattern-based features with two-level segmentation that can detect hemorrhage and microaneurysms in the fundus image. The proposed scheme initially pre-processes the fundus image followed by a two-level segmentation. The level 1 segmentation eliminates the background whereas the level 2 segmentation eliminates the blood vessels that introduce more false positives. A hexagonal pattern-based feature is extracted from the red lesion candidates which can highly differentiate the lesion from non-lesion regions. The hexagonal pattern features are then trained using the recurrent neural network and are classified to eliminate the false negatives. For the evaluation of the proposed red lesion algorithm, the datasets namely ROC challenge, e-ophtha, DiaretDB1, and Messidor are used with the metrics such as Accuracy, Recall, Precision, F1 score, Specificity, and AUC. The scheme provides an average Accuracy, Recall (Sensitivity), Precision, F1 score, Specificity, and AUC of 95.48%, 84.54%, 97.3%, 90.47%, 86.81% and 93.43% respectively.
Collapse
Affiliation(s)
- D. Latha
- Department of PG Computer Science, Nesamony Memorial Christian College, Marthandam, India
| | - T. Beula Bell
- Department of Computer Applications, Nesamony Memorial Christian College, Marthandam, India
| | - C. Jaspin Jeba Sheela
- Department of PG Computer Science, Nesamony Memorial Christian College, Marthandam, India
| |
Collapse
|
15
|
MicroNet: microaneurysm detection in retinal fundus images using convolutional neural network. Soft comput 2022. [DOI: 10.1007/s00500-022-06752-2] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
|
16
|
Local Structure Awareness-Based Retinal Microaneurysm Detection with Multi-Feature Combination. Biomedicines 2022; 10:biomedicines10010124. [PMID: 35052803 PMCID: PMC8773350 DOI: 10.3390/biomedicines10010124] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/10/2021] [Revised: 12/31/2021] [Accepted: 01/03/2022] [Indexed: 01/02/2023] Open
Abstract
Retinal microaneurysm (MA) is the initial symptom of diabetic retinopathy (DR). The automatic detection of MA is helpful to assist doctors in diagnosis and treatment. Previous algorithms focused on the features of the target itself; however, the local structural features of the target and background are also worth exploring. To achieve MA detection, an efficient local structure awareness-based retinal MA detection with the multi-feature combination (LSAMFC) is proposed in this paper. We propose a novel local structure feature called a ring gradient descriptor (RGD) to describe the structural differences between an object and its surrounding area. Then, a combination of RGD with the salience and texture features is used by a Gradient Boosting Decision Tree (GBDT) for candidate classification. We evaluate our algorithm on two public datasets, i.e., the e-ophtha MA dataset and retinopathy online challenge (ROC) dataset. The experimental results show that the performance of the trained model significantly improved after combining traditional features with RGD, and the area under the receiver operating characteristic curve (AUC) values in the test results of the datasets e-ophtha MA and ROC increased from 0.9615 to 0.9751 and from 0.9066 to 0.9409, respectively.
Collapse
|
17
|
Sun S, Cao Z, Liao D, Lv R. A Magnified Adaptive Feature Pyramid Network for automatic microaneurysms detection. Comput Biol Med 2021; 139:105000. [PMID: 34741905 DOI: 10.1016/j.compbiomed.2021.105000] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2021] [Revised: 10/27/2021] [Accepted: 10/27/2021] [Indexed: 10/19/2022]
Abstract
Diabetic retinopathy (DR), as an important complication of diabetes, is the primary cause of blindness in adults. Automatic DR detection poses a challenge which is crucial for early DR screening. Currently, the vast majority of DR is diagnosed through fundus images, where the microaneurysm (MA) has been widely used as the most distinguishable marker. Research works on automatic DR detection have traditionally utilized manually designed operators, while a few recent researchers have explored deep learning techniques for this topic. But due to issues such as the extremely small size of microaneurysms, low resolution of fundus pictures, and insufficient imaging depth, the DR detection problem is quite challenging and remains unsolved. To address these issues, this research proposes a new deep learning model (Magnified Adaptive Feature Pyramid Network, MAFP-Net) for DR detection, which conducts super-resolution on low quality fundus images and integrates an improved feature pyramid structure while utilizing a standard two-stage detection network as the backbone. Our proposed detection model needs no pre-segmented patches to train the CNN network. When tested on the E-ophtha-MA dataset, the sensitivity value of our method reached as high as 83.5% at false positives per image (FPI) of 8 and the F1 value achieved 0.676, exceeding all those of the state-of-the-art algorithms as well as the human performance of experienced physicians. Similar results were achieved on another public dataset of IDRiD.
Collapse
Affiliation(s)
- Song Sun
- Molecular and Neuroimaging Engineering Research Center of Ministry of Education, School of Life Science and Technology, Xidian University, Xi'an, 710071, China
| | - Zhicheng Cao
- Molecular and Neuroimaging Engineering Research Center of Ministry of Education, School of Life Science and Technology, Xidian University, Xi'an, 710071, China
| | - Dingying Liao
- Health Science Center, Xi'an Jiaotong University, Xi'an, 710061, China
| | - Ruichan Lv
- Molecular and Neuroimaging Engineering Research Center of Ministry of Education, School of Life Science and Technology, Xidian University, Xi'an, 710071, China.
| |
Collapse
|
18
|
Xia H, Lan Y, Song S, Li H. A multi-scale segmentation-to-classification network for tiny microaneurysm detection in fundus images. Knowl Based Syst 2021. [DOI: 10.1016/j.knosys.2021.107140] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
|
19
|
A review of diabetic retinopathy: Datasets, approaches, evaluation metrics and future trends. JOURNAL OF KING SAUD UNIVERSITY - COMPUTER AND INFORMATION SCIENCES 2021. [DOI: 10.1016/j.jksuci.2021.06.006] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/28/2023]
|
20
|
Liao Y, Xia H, Song S, Li H. Microaneurysm detection in fundus images based on a novel end-to-end convolutional neural network. Biocybern Biomed Eng 2021. [DOI: 10.1016/j.bbe.2021.04.005] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
21
|
Li T, Bo W, Hu C, Kang H, Liu H, Wang K, Fu H. Applications of deep learning in fundus images: A review. Med Image Anal 2021; 69:101971. [PMID: 33524824 DOI: 10.1016/j.media.2021.101971] [Citation(s) in RCA: 99] [Impact Index Per Article: 24.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2020] [Accepted: 01/12/2021] [Indexed: 02/06/2023]
Abstract
The use of fundus images for the early screening of eye diseases is of great clinical importance. Due to its powerful performance, deep learning is becoming more and more popular in related applications, such as lesion segmentation, biomarkers segmentation, disease diagnosis and image synthesis. Therefore, it is very necessary to summarize the recent developments in deep learning for fundus images with a review paper. In this review, we introduce 143 application papers with a carefully designed hierarchy. Moreover, 33 publicly available datasets are presented. Summaries and analyses are provided for each task. Finally, limitations common to all tasks are revealed and possible solutions are given. We will also release and regularly update the state-of-the-art results and newly-released datasets at https://github.com/nkicsl/Fundus_Review to adapt to the rapid development of this field.
Collapse
Affiliation(s)
- Tao Li
- College of Computer Science, Nankai University, Tianjin 300350, China
| | - Wang Bo
- College of Computer Science, Nankai University, Tianjin 300350, China
| | - Chunyu Hu
- College of Computer Science, Nankai University, Tianjin 300350, China
| | - Hong Kang
- College of Computer Science, Nankai University, Tianjin 300350, China
| | - Hanruo Liu
- Beijing Tongren Hospital, Capital Medical University, Address, Beijing 100730 China
| | - Kai Wang
- College of Computer Science, Nankai University, Tianjin 300350, China.
| | - Huazhu Fu
- Inception Institute of Artificial Intelligence (IIAI), Abu Dhabi, UAE
| |
Collapse
|
22
|
Du J, Zou B, Chen C, Xu Z, Liu Q. Automatic microaneurysm detection in fundus image based on local cross-section transformation and multi-feature fusion. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2020; 196:105687. [PMID: 32835957 DOI: 10.1016/j.cmpb.2020.105687] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/14/2020] [Accepted: 07/30/2020] [Indexed: 06/11/2023]
Abstract
BACKGROUND AND OBJECTIVE Retinal microaneurysm (MA) is one of the earliest clinical signs of diabetic retinopathy(DR). Its detection is essential for controlling DR and preventing vision loss. However, the spatial scale of MA is extremely small and the contrast to surrounding background is subtle, which make MA detection challenging. The purpose of this work is to automatically detect MAs from fundus images. METHODS Our MA detector involves two stages: MA candidate extraction and classification. In MA candidate extraction stage, local minimum region extraction and block filtering are used to exploit the regions where MA may exist. In this way, most of irrelavent background regions are discarded , which subsequently facilitates the training of MA classifier. In the second stage, multiple features are extracted to train the MA classifier. To distinguish MA from vascular regions, we propose a series of descriptors according to the cross-section profile of MA. Specially, as MAs are small and their contrast to surroundings is subtle, we propose local cross-section transformation (LCT) to amplify the difference between the MA and confusing structures. Finally, an under-sampling boosting-based classifier (RUSBoost) is trained to determine whether the candidate is an MA. RESULTS The proposed method is evaluated on three public available databases i.e. e-ophtha-MA, DiaretDB1 and ROC training set. It achieves high sensitivities for low false positive rates on the three databases. Using the FROC metric, the final scores are 0.516, 0.402 and 0.293 respectively, which are comparable to existing state-of-the-art methods. CONCLUSIONS The proposed local cross-section transformation enhances the discrimination of descriptors by amplifying difference between MAs and confusing structures, which facilitates the classification and improves the detection performances. With the powerful descriptors, our method achieves state-of-the-art performances on three public datasets consistently.
Collapse
Affiliation(s)
- Jingyu Du
- School of Computer Science and Engineering, Central South University, China; Hunan Province Engineering Technology Research Center of Computer Vision and Intelligent Medical Treatment China
| | - Beiji Zou
- School of Computer Science and Engineering, Central South University, China; Hunan Province Engineering Technology Research Center of Computer Vision and Intelligent Medical Treatment China; Mobile Health Ministry of Education-China Mobile Joint Laboratory, China
| | - Changlong Chen
- School of Computer Science and Engineering, Central South University, China; Hunan Province Engineering Technology Research Center of Computer Vision and Intelligent Medical Treatment China
| | - Ziwen Xu
- School of Computer Science and Engineering, Central South University, China; Hunan Province Engineering Technology Research Center of Computer Vision and Intelligent Medical Treatment China
| | - Qing Liu
- School of Computer Science and Engineering, Central South University, China.
| |
Collapse
|
23
|
Melo T, Mendonça AM, Campilho A. Microaneurysm detection in color eye fundus images for diabetic retinopathy screening. Comput Biol Med 2020; 126:103995. [PMID: 33007620 DOI: 10.1016/j.compbiomed.2020.103995] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2020] [Revised: 09/07/2020] [Accepted: 09/07/2020] [Indexed: 02/01/2023]
Abstract
Diabetic retinopathy (DR) is a diabetes complication, which in extreme situations may lead to blindness. Since the first stages are often asymptomatic, regular eye examinations are required for an early diagnosis. As microaneurysms (MAs) are one of the first signs of DR, several automated methods have been proposed for their detection in order to reduce the ophthalmologists' workload. Although local convergence filters (LCFs) have already been applied for feature extraction, their potential as MA enhancement operators was not explored yet. In this work, we propose a sliding band filter for MA enhancement aiming at obtaining a set of initial MA candidates. Then, a combination of the filter responses with color, contrast and shape information is used by an ensemble of classifiers for final candidate classification. Finally, for each eye fundus image, a score is computed from the confidence values assigned to the MAs detected in the image. The performance of the proposed methodology was evaluated in four datasets. At the lesion level, sensitivities of 64% and 81% were achieved for an average of 8 false positives per image (FPIs) in e-ophtha MA and SCREEN-DR, respectively. In the last dataset, an AUC of 0.83 was also obtained for DR detection.
Collapse
Affiliation(s)
- Tânia Melo
- Institute for Systems and Computer Engineering, Technology and Science, Campus da Faculdade de Engenharia da Universidade Do Porto, Rua Dr. Roberto Frias, 4200-465, Porto, Portugal; Faculty of Engineering of the University of Porto, Rua Dr. Roberto Frias, S/n 4200-465, Porto, Portugal.
| | - Ana Maria Mendonça
- Institute for Systems and Computer Engineering, Technology and Science, Campus da Faculdade de Engenharia da Universidade Do Porto, Rua Dr. Roberto Frias, 4200-465, Porto, Portugal; Faculty of Engineering of the University of Porto, Rua Dr. Roberto Frias, S/n 4200-465, Porto, Portugal
| | - Aurélio Campilho
- Institute for Systems and Computer Engineering, Technology and Science, Campus da Faculdade de Engenharia da Universidade Do Porto, Rua Dr. Roberto Frias, 4200-465, Porto, Portugal; Faculty of Engineering of the University of Porto, Rua Dr. Roberto Frias, S/n 4200-465, Porto, Portugal
| |
Collapse
|
24
|
Jadhav AS, Patil PB, Biradar S. Analysis on diagnosing diabetic retinopathy by segmenting blood vessels, optic disc and retinal abnormalities. J Med Eng Technol 2020; 44:299-316. [PMID: 32729345 DOI: 10.1080/03091902.2020.1791986] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/11/2023]
Abstract
The main intention of mass screening programmes for Diabetic Retinopathy (DR) is to detect and diagnose the disorder earlier than it leads to vision loss. Automated analysis of retinal images has the likelihood to improve the efficacy of screening programmes when compared over the manual image analysis. This article plans to develop a framework for the detection of DR from the retinal fundus images using three evaluations based on optic disc, blood vessels and retinal abnormalities. Initially, the pre-processing steps like green channel conversion and Contrast Limited Adaptive Histogram Equalisation is done. Further, the segmentation procedure starts with optic disc segmentation by open-close watershed transform, blood vessel segmentation by grey level thresholding and abnormality segmentation (hard exudates, haemorrhages, Microaneurysm and soft exudates) by top hat transform and Gabor filtering mechanisms. From the three segmented images, the feature like local binary pattern, texture energy measurement, Shanon's and Kapur's entropy are extracted, which is subjected to optimal feature selection process using the new hybrid optimisation algorithm termed as Trial-based Bypass Improved Dragonfly Algorithm (TB - DA). These features are given to hybrid machine learning algorithm with the combination of NN and DBN. As a modification, the same hybrid TB - DA is used to enhance the training of hybrid classifier, which outputs the categorisation as normal, mild, moderate or severe images based on three components.
Collapse
Affiliation(s)
- Ambaji S Jadhav
- Department of Electrical and Electronics, B.L.D.E.A's V.P. Dr. P.G. Halakatti College of Engineering & Technology (Affiliated to Visvesvaraya Technological University, Belagavi), Vijayapur, India
| | - Pushpa B Patil
- Department of Computer Science & Engineering, B.L.D.E.A's V.P. Dr. P.G. Halakatti College of Engineering & Technology (Affiliated to Visvesvaraya Technological University, Belagavi), Vijayapur, India
| | - Sunil Biradar
- Department of Ophthalmology, Shri B.M. Patil Medical College Hospital and Research Center, Vijayapur, India
| |
Collapse
|
25
|
Rajan SP. Recognition of Cardiovascular Diseases through Retinal Images Using Optic Cup to Optic Disc Ratio. PATTERN RECOGNITION AND IMAGE ANALYSIS 2020. [DOI: 10.1134/s105466182002011x] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
|
26
|
Stolte S, Fang R. A survey on medical image analysis in diabetic retinopathy. Med Image Anal 2020; 64:101742. [PMID: 32540699 DOI: 10.1016/j.media.2020.101742] [Citation(s) in RCA: 37] [Impact Index Per Article: 7.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2019] [Revised: 02/03/2020] [Accepted: 05/28/2020] [Indexed: 01/12/2023]
Abstract
Diabetic Retinopathy (DR) represents a highly-prevalent complication of diabetes in which individuals suffer from damage to the blood vessels in the retina. The disease manifests itself through lesion presence, starting with microaneurysms, at the nonproliferative stage before being characterized by neovascularization in the proliferative stage. Retinal specialists strive to detect DR early so that the disease can be treated before substantial, irreversible vision loss occurs. The level of DR severity indicates the extent of treatment necessary - vision loss may be preventable by effective diabetes management in mild (early) stages, rather than subjecting the patient to invasive laser surgery. Using artificial intelligence (AI), highly accurate and efficient systems can be developed to help assist medical professionals in screening and diagnosing DR earlier and without the full resources that are available in specialty clinics. In particular, deep learning facilitates diagnosis earlier and with higher sensitivity and specificity. Such systems make decisions based on minimally handcrafted features and pave the way for personalized therapies. Thus, this survey provides a comprehensive description of the current technology used in each step of DR diagnosis. First, it begins with an introduction to the disease and the current technologies and resources available in this space. It proceeds to discuss the frameworks that different teams have used to detect and classify DR. Ultimately, we conclude that deep learning systems offer revolutionary potential to DR identification and prevention of vision loss.
Collapse
Affiliation(s)
- Skylar Stolte
- J. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida, 1275 Center Drive, Biomedical Sciences Building JG56 P.O. Box 116131 Gainesville, FL 32611-6131, USA.
| | - Ruogu Fang
- J. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida, 1275 Center Drive, Biomedical Sciences Building JG56 P.O. Box 116131 Gainesville, FL 32611-6131, USA.
| |
Collapse
|
27
|
Addressing class imbalance in deep learning for small lesion detection on medical images. Comput Biol Med 2020; 120:103735. [DOI: 10.1016/j.compbiomed.2020.103735] [Citation(s) in RCA: 36] [Impact Index Per Article: 7.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/12/2020] [Revised: 03/24/2020] [Accepted: 03/26/2020] [Indexed: 01/21/2023]
|
28
|
Long S, Chen J, Hu A, Liu H, Chen Z, Zheng D. Microaneurysms detection in color fundus images using machine learning based on directional local contrast. Biomed Eng Online 2020; 19:21. [PMID: 32295576 PMCID: PMC7161183 DOI: 10.1186/s12938-020-00766-3] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2020] [Accepted: 04/06/2020] [Indexed: 02/07/2023] Open
Abstract
Background As one of the major
complications of diabetes, diabetic retinopathy (DR) is a leading
cause of visual impairment and blindness due to delayed diagnosis
and intervention. Microaneurysms appear as the earliest symptom of
DR. Accurate and reliable detection of microaneurysms in color
fundus images has great importance for DR screening. Methods A microaneurysms' detection method
using machine learning based on directional local contrast (DLC) is
proposed for the early diagnosis of DR. First, blood vessels were
enhanced and segmented using improved enhancement function based on
analyzing eigenvalues of Hessian matrix. Next, with blood vessels
excluded, microaneurysm candidate regions were obtained using shape
characteristics and connected components analysis. After image
segmented to patches, the features of each microaneurysm candidate
patch were extracted, and each candidate patch was classified into
microaneurysm or non-microaneurysm. The main contributions of our
study are (1) making use of directional local contrast in
microaneurysms' detection for the first time, which does make sense
for better microaneurysms' classification. (2) Applying three
different machine learning techniques for classification and
comparing their performance for microaneurysms' detection. The
proposed algorithm was trained and tested on e-ophtha MA database,
and further tested on another independent DIARETDB1 database.
Results of microaneurysms' detection on the two databases were
evaluated on lesion level and compared with existing algorithms. Results The proposed method has achieved better performance compared with existing algorithms on accuracy and computation time. On e-ophtha MA and DIARETDB1 databases, the area under curve (AUC) of receiver operating characteristic (ROC) curve was 0.87 and 0.86, respectively. The free-response ROC (FROC) score on the two databases was 0.374 and 0.210, respectively. The computation time per image with resolution of 2544×1969, 1400×960 and 1500×1152 is 29 s, 3 s and 2.6 s, respectively. Conclusions The proposed method
using machine learning based on directional local contrast of image
patches can effectively detect microaneurysms in color fundus images
and provide an effective scientific basis for early clinical DR
diagnosis.
Collapse
Affiliation(s)
- Shengchun Long
- College of Computer Science and Technology, Zhejiang University of Technology, Hangzhou, 310023, China
| | - Jiali Chen
- College of Computer Science and Technology, Zhejiang University of Technology, Hangzhou, 310023, China.
| | - Ante Hu
- College of Computer Science and Technology, Zhejiang University of Technology, Hangzhou, 310023, China
| | - Haipeng Liu
- Research Center of Intelligent Healthcare, Faculty of Health and Life Science, Coventry University, Coventry, CV1 5RW, UK
| | - Zhiqing Chen
- Eye Center, The second Affiliated Hospital of Zhejiang University School of Medicine, Hangzhou, 310009, China
| | - Dingchang Zheng
- Research Center of Intelligent Healthcare, Faculty of Health and Life Science, Coventry University, Coventry, CV1 5RW, UK
| |
Collapse
|
29
|
Jeba Derwin D, Tamil Selvi S, Jeba Singh O, Priestly Shan B. A novel automated system of discriminating Microaneurysms in fundus images. Biomed Signal Process Control 2020. [DOI: 10.1016/j.bspc.2019.101839] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/29/2022]
|
30
|
Yan Q, Zhao Y, Zheng Y, Liu Y, Zhou K, Frangi A, Liu J. Automated retinal lesion detection via image saliency analysis. Med Phys 2019; 46:4531-4544. [PMID: 31381173 DOI: 10.1002/mp.13746] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2019] [Revised: 07/11/2019] [Accepted: 07/22/2019] [Indexed: 01/02/2023] Open
Abstract
BACKGROUND AND OBJECTIVE The detection of abnormalities such as lesions or leakage from retinal images is an important health informatics task for automated early diagnosis of diabetic and malarial retinopathy or other eye diseases, in order to prevent blindness and common systematic conditions. In this work, we propose a novel retinal lesion detection method by adapting the concepts of saliency. METHODS Retinal images are first segmented as superpixels, two new saliency feature representations: uniqueness and compactness, are then derived to represent the superpixels. The pixel level saliency is then estimated from these superpixel saliency values via a bilateral filter. These extracted saliency features form a matrix for low-rank analysis to achieve saliency detection. The precise contour of a lesion is finally extracted from the generated saliency map after removing confounding structures such as blood vessels, the optic disk, and the fovea. The main novelty of this method is that it is an effective tool for detecting different abnormalities at the pixel level from different modalities of retinal images, without the need to tune parameters. RESULTS To evaluate its effectiveness, we have applied our method to seven public datasets of diabetic and malarial retinopathy with four different types of lesions: exudate, hemorrhage, microaneurysms, and leakage. The evaluation was undertaken at the pixel level, lesion level, or image level according to ground truth availability in these datasets. CONCLUSIONS The experimental results show that the proposed method outperforms existing state-of-the-art ones in applicability, effectiveness, and accuracy.
Collapse
Affiliation(s)
- Qifeng Yan
- University of Chinese Academy of Sciences, Beijing, 100049, China.,Cixi Institute of Biomedical Engineering, Ningbo Institute of Materials Technology and Engineering, Chinese Academy of Sciences, Cixi, 315399, China
| | - Yitian Zhao
- Cixi Institute of Biomedical Engineering, Ningbo Institute of Materials Technology and Engineering, Chinese Academy of Sciences, Cixi, 315399, China
| | - Yalin Zheng
- Cixi Institute of Biomedical Engineering, Ningbo Institute of Materials Technology and Engineering, Chinese Academy of Sciences, Cixi, 315399, China.,Department of Eye and Vision Science, University of Liverpool, Liverpool, L7 8TX, UK
| | - Yonghuai Liu
- Department of Computer Science, Edge Hill University, Ormskirk, L39 4QP, UK
| | - Kang Zhou
- Cixi Institute of Biomedical Engineering, Ningbo Institute of Materials Technology and Engineering, Chinese Academy of Sciences, Cixi, 315399, China.,School of Information Science and Technology, ShanghaiTech University, Shanghai, 201210, China
| | - Alejandro Frangi
- Cixi Institute of Biomedical Engineering, Ningbo Institute of Materials Technology and Engineering, Chinese Academy of Sciences, Cixi, 315399, China.,School of Computing, University of Leeds, Leeds, S2 9JT, UK
| | - Jiang Liu
- Cixi Institute of Biomedical Engineering, Ningbo Institute of Materials Technology and Engineering, Chinese Academy of Sciences, Cixi, 315399, China.,Department of Computer Science and Engineering, Southern University of Science and Technology, Shenzhen, 518055, China
| |
Collapse
|
31
|
Diabetic complication prediction using a similarity-enhanced latent Dirichlet allocation model. Inf Sci (N Y) 2019. [DOI: 10.1016/j.ins.2019.05.037] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/27/2022]
|
32
|
Playout C, Duval R, Cheriet F. A Novel Weakly Supervised Multitask Architecture for Retinal Lesions Segmentation on Fundus Images. IEEE TRANSACTIONS ON MEDICAL IMAGING 2019; 38:2434-2444. [PMID: 30908197 DOI: 10.1109/tmi.2019.2906319] [Citation(s) in RCA: 32] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
Obtaining the complete segmentation map of retinal lesions is the first step toward an automated diagnosis tool for retinopathy that is interpretable in its decision-making. However, the limited availability of ground truth lesion detection maps at a pixel level restricts the ability of deep segmentation neural networks to generalize over large databases. In this paper, we propose a novel approach for training a convolutional multi-task architecture with supervised learning and reinforcing it with weakly supervised learning. The architecture is simultaneously trained for three tasks: segmentation of red lesions and of bright lesions, those two tasks done concurrently with lesion detection. In addition, we propose and discuss the advantages of a new preprocessing method that guarantees the color consistency between the raw image and its enhanced version. Our complete system produces segmentations of both red and bright lesions. The method is validated at the pixel level and per-image using four databases and a cross-validation strategy. When evaluated on the task of screening for the presence or absence of lesions on the Messidor image set, the proposed method achieves an area under the ROC curve of 0.839, comparable with the state-of-the-art.
Collapse
|
33
|
Li Q, Fan S, Chen C. An Intelligent Segmentation and Diagnosis Method for Diabetic Retinopathy Based on Improved U-NET Network. J Med Syst 2019; 43:304. [PMID: 31407110 DOI: 10.1007/s10916-019-1432-0] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2019] [Accepted: 07/29/2019] [Indexed: 11/26/2022]
Abstract
Due to insufficient samples, the generalization performance of deep network is insufficient. In order to solve this problem, an improved U-net based image automatic segmentation and diagnosis algorithm was proposed, in which the max-pooling operation in original U-net model was replaced by the convolution operation to keep more feature information. Firstly, the regions of 128×128 were extracted from all slices of the patients as data samples. Secondly, the patient samples were divided into training sample set and testing sample set, and data augmentation was performed on the training samples. Finally, all the training samples were adopted to train the model. Compared with Fully Convolutional Network (FCN) model and max-pooling based U-net model, DSC and CR coefficients of the proposed method achieve the best results, while PM coefficient is 2.55 percentage lower than the maximum value in the two comparison models, and Average Symmetric Surface Distance is slightly higher than the minimum value of the two comparison models by 0.004. The experimental results show that the proposed model can achieve good segmentation and diagnosis results.
Collapse
Affiliation(s)
- Qianjin Li
- The Affiliated Hospital of Weifang Medical University, Shandong, 261031, Weifang, China
| | - Shanshan Fan
- The Affiliated Hospital of Weifang Medical University, Shandong, 261031, Weifang, China
| | - Changsheng Chen
- The Affiliated Hospital of Weifang Medical University, Shandong, 261031, Weifang, China.
| |
Collapse
|
34
|
Eftekhari N, Pourreza HR, Masoudi M, Ghiasi-Shirazi K, Saeedi E. Microaneurysm detection in fundus images using a two-step convolutional neural network. Biomed Eng Online 2019; 18:67. [PMID: 31142335 PMCID: PMC6542103 DOI: 10.1186/s12938-019-0675-9] [Citation(s) in RCA: 46] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2018] [Accepted: 04/30/2019] [Indexed: 11/29/2022] Open
Abstract
Background and objectives Diabetic retinopathy (DR) is the leading cause of blindness worldwide, and therefore its early detection is important in order to reduce disease-related eye injuries. DR is diagnosed by inspecting fundus images. Since microaneurysms (MA) are one of the main symptoms of the disease, distinguishing this complication within the fundus images facilitates early DR detection. In this paper, an automatic analysis of retinal images using convolutional neural network (CNN) is presented. Methods Our method incorporates a novel technique utilizing a two-stage process with two online datasets which results in accurate detection while solving the imbalance data problem and decreasing training time in comparison with previous studies. We have implemented our proposed CNNs using the Keras library. Results In order to evaluate our proposed method, an experiment was conducted on two standard publicly available datasets, i.e., Retinopathy Online Challenge dataset and E-Ophtha-MA dataset. Our results demonstrated a promising sensitivity value of about 0.8 for an average of >6 false positives per image, which is competitive with state of the art approaches. Conclusion Our method indicates significant improvement in MA-detection using retinal fundus images for monitoring diabetic retinopathy.
Collapse
Affiliation(s)
- Noushin Eftekhari
- Machine Vision Lab., Computer Engineering Department, Faculty of Engineering, Ferdowsi University of Mashhad (FUM), Azadi Sqr., Mashhad, Iran
| | - Hamid-Reza Pourreza
- Machine Vision Lab., Computer Engineering Department, Faculty of Engineering, Ferdowsi University of Mashhad (FUM), Azadi Sqr., Mashhad, Iran.
| | - Mojtaba Masoudi
- Machine Vision Lab., Computer Engineering Department, Faculty of Engineering, Ferdowsi University of Mashhad (FUM), Azadi Sqr., Mashhad, Iran
| | - Kamaledin Ghiasi-Shirazi
- Machine Vision Lab., Computer Engineering Department, Faculty of Engineering, Ferdowsi University of Mashhad (FUM), Azadi Sqr., Mashhad, Iran
| | - Ehsan Saeedi
- Machine Vision Lab., Computer Engineering Department, Faculty of Engineering, Ferdowsi University of Mashhad (FUM), Azadi Sqr., Mashhad, Iran
| |
Collapse
|
35
|
Kaur J, Mittal D. Estimation of severity level of non-proliferative diabetic retinopathy for clinical aid. Biocybern Biomed Eng 2018. [DOI: 10.1016/j.bbe.2018.05.006] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022]
|