1
|
Farahat Z, Zrira N, Souissi N, Benamar S, Belmekki M, Ngote MN, Megdiche K. Application of Deep Learning Methods in a Moroccan Ophthalmic Center: Analysis and Discussion. Diagnostics (Basel) 2023; 13:diagnostics13101694. [PMID: 37238179 DOI: 10.3390/diagnostics13101694] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2023] [Revised: 03/17/2023] [Accepted: 03/20/2023] [Indexed: 05/28/2023] Open
Abstract
Diabetic retinopathy (DR) remains one of the world's frequent eye illnesses, leading to vision loss among working-aged individuals. Hemorrhages and exudates are examples of signs of DR. However, artificial intelligence (AI), particularly deep learning (DL), is poised to impact nearly every aspect of human life and gradually transform medical practice. Insight into the condition of the retina is becoming more accessible thanks to major advancements in diagnostic technology. AI approaches can be used to assess lots of morphological datasets derived from digital images in a rapid and noninvasive manner. Computer-aided diagnosis tools for automatic detection of DR early-stage signs will ease the pressure on clinicians. In this work, we apply two methods to the color fundus images taken on-site at the Cheikh Zaïd Foundation's Ophthalmic Center in Rabat to detect both exudates and hemorrhages. First, we apply the U-Net method to segment exudates and hemorrhages into red and green colors, respectively. Second, the You Look Only Once Version 5 (YOLOv5) method identifies the presence of hemorrhages and exudates in an image and predicts a probability for each bounding box. The segmentation proposed method obtained a specificity of 85%, a sensitivity of 85%, and a Dice score of 85%. The detection software successfully detected 100% of diabetic retinopathy signs, the expert doctor detected 99% of DR signs, and the resident doctor detected 84%.
Collapse
Affiliation(s)
- Zineb Farahat
- LISTD Laboratory, Ecole Nationale Supérieure des Mines de Rabat, Rabat 10000, Morocco
- Cheikh Zaïd Foundation Medical Simulation Center, Rabat 10000, Morocco
| | - Nabila Zrira
- LISTD Laboratory, Ecole Nationale Supérieure des Mines de Rabat, Rabat 10000, Morocco
| | - Nissrine Souissi
- LISTD Laboratory, Ecole Nationale Supérieure des Mines de Rabat, Rabat 10000, Morocco
| | - Safia Benamar
- Cheikh Zaïd Ophthalmic Center, Cheikh Zaïd International University Hospital, Rabat 10000, Morocco
- Institut Supérieur d'Ingénierie et Technologies de Santé/Faculté de Médecine Abulcasis, Université Internationale Abulcasis des Sciences de la Santé, Rabat 10000, Morocco
| | - Mohammed Belmekki
- Cheikh Zaïd Ophthalmic Center, Cheikh Zaïd International University Hospital, Rabat 10000, Morocco
- Institut Supérieur d'Ingénierie et Technologies de Santé/Faculté de Médecine Abulcasis, Université Internationale Abulcasis des Sciences de la Santé, Rabat 10000, Morocco
| | - Mohamed Nabil Ngote
- LISTD Laboratory, Ecole Nationale Supérieure des Mines de Rabat, Rabat 10000, Morocco
- Institut Supérieur d'Ingénierie et Technologies de Santé/Faculté de Médecine Abulcasis, Université Internationale Abulcasis des Sciences de la Santé, Rabat 10000, Morocco
| | - Kawtar Megdiche
- Cheikh Zaïd Foundation Medical Simulation Center, Rabat 10000, Morocco
| |
Collapse
|
2
|
Liu M, Wang Z, Li H, Wu P, Alsaadi FE, Zeng N. AA-WGAN: Attention augmented Wasserstein generative adversarial network with application to fundus retinal vessel segmentation. Comput Biol Med 2023; 158:106874. [PMID: 37019013 DOI: 10.1016/j.compbiomed.2023.106874] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/03/2023] [Revised: 03/15/2023] [Accepted: 03/30/2023] [Indexed: 04/03/2023]
Abstract
In this paper, a novel attention augmented Wasserstein generative adversarial network (AA-WGAN) is proposed for fundus retinal vessel segmentation, where a U-shaped network with attention augmented convolution and squeeze-excitation module is designed to serve as the generator. In particular, the complex vascular structures make some tiny vessels hard to segment, while the proposed AA-WGAN can effectively handle such imperfect data property, which is competent in capturing the dependency among pixels in the whole image to highlight the regions of interests via the applied attention augmented convolution. By applying the squeeze-excitation module, the generator is able to pay attention to the important channels of the feature maps, and the useless information can be suppressed as well. In addition, gradient penalty method is adopted in the WGAN backbone to alleviate the phenomenon of generating large amounts of repeated images due to excessive concentration on accuracy. The proposed model is comprehensively evaluated on three datasets DRIVE, STARE, and CHASE_DB1, and the results show that the proposed AA-WGAN is a competitive vessel segmentation model as compared with several other advanced models, which obtains the accuracy of 96.51%, 97.19% and 96.94% on each dataset, respectively. The effectiveness of the applied important components is validated by ablation study, which also endows the proposed AA-WGAN with considerable generalization ability.
Collapse
|
3
|
Ye Y, Pan C, Wu Y, Wang S, Xia Y. MFI-Net: Multiscale Feature Interaction Network for Retinal Vessel Segmentation. IEEE J Biomed Health Inform 2022; 26:4551-4562. [PMID: 35696471 DOI: 10.1109/jbhi.2022.3182471] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Segmentation of retinal vessels on fundus images plays a critical role in the diagnosis of micro-vascular and ophthalmological diseases. Although being extensively studied, this task remains challenging due to many factors including the highly variable vessel width and poor vessel-background contrast. In this paper, we propose a multiscale feature interaction network (MFI-Net) for retinal vessel segmentation, which is a U-shaped convolutional neural network equipped with the pyramid squeeze-and-excitation (PSE) module, coarse-to-fine (C2F) module, deep supervision, and feature fusion. We extend the SE operator to multiscale features, resulting in the PSE module, which uses the channel attention learned at multiple scales to enhance multiscale features and enables the network to handle the vessels with variable width. We further design the C2F module to generate and re-process the residual feature maps, aiming to preserve more vessel details during the decoding process. The proposed MFI-Net has been evaluated against several public models on the DRIVE, STARE, CHASE_DB1, and HRF datasets. Our results suggest that both PSE and C2F modules are effective in improving the accuracy of MFI-Net, and also indicate that our model has superior segmentation performance and generalization ability over existing models on four public datasets.
Collapse
|
4
|
Liang L, Feng J, Zhou L, Yin J, Sheng X. U-shaped Retinal Vessel Segmentation Based on Adaptive Aggregation of Feature Information. Interdiscip Sci 2022; 14:623-637. [PMID: 35486313 DOI: 10.1007/s12539-022-00519-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2021] [Revised: 04/03/2022] [Accepted: 04/05/2022] [Indexed: 06/14/2023]
Abstract
Detection and analysis of retinal blood vessels contribute to the clinical diagnosis of many ophthalmic diseases. In this paper, aiming on achieving more accurate segmentation of retinal vessels and enhance the ability of the algorithm to identify microvessels, we propose a U-shaped network based on adaptive aggregation of feature information. The introduced feature selection module, which could strengthen feature transmission and selectively emphasize feature information. To effectively capture the characteristics of vessels at different scales, generate richer and denser context information, and DenseASPP is embedded at the bottom of the network. Meanwhile, we propose an adaptive aggregation module to aggregate the semantic information in each layer of the encoder part and transmit it to subsequent layers, which is beneficial to the spatial reconstruction of retinal vessels. A joint loss function is also introduced to facilitate network training. The proposed network is evaluated on three public datasets. The sensitivity, accuracy, and area under curve(AUC) are 83.48%/83.16/85.86, 95.67%/96.67%/96.52%, and 98.11%/98.69%/98.60% on DRIVE, STARE and CHASE_DB1, respectively. In order to achieve more accurate retinal blood vessel segmentation and improve the ability of the algorithm to identify microvessels. We propose a U-shaped network based on adaptive aggregation of feature information. The introduction of the adaptive aggregation module aggregates the semantic information of each level of the encoder part, which improves the robustness of the model to segment blood vessels.
Collapse
Affiliation(s)
- Liming Liang
- School of Electrical Engineering and Automation, Jiangxi University of Science and Technology, Ganzhou, 341000, Jiangxi, China.
| | - Jun Feng
- School of Electrical Engineering and Automation, Jiangxi University of Science and Technology, Ganzhou, 341000, Jiangxi, China
| | - Longsong Zhou
- School of Electrical Engineering and Automation, Jiangxi University of Science and Technology, Ganzhou, 341000, Jiangxi, China
| | - Jiang Yin
- School of Electrical Engineering and Automation, Jiangxi University of Science and Technology, Ganzhou, 341000, Jiangxi, China
| | - Xiaoqi Sheng
- School of Computer Science and Engineering, South China University of Technology, Guangzhou, 511400, Guangdong, China.
| |
Collapse
|
5
|
Hao Y, Xie H, Qiu R. Construction and application of color fundus image segmentation algorithm based on Multi-Scale local combined global enhancement. Pak J Med Sci 2021; 37:1595-1599. [PMID: 34712289 PMCID: PMC8520383 DOI: 10.12669/pjms.37.6-wit.4848] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/03/2021] [Revised: 06/08/2021] [Accepted: 07/05/2021] [Indexed: 11/15/2022] Open
Abstract
Objective Aiming at the problem of low accuracy in extracting small blood vessels from existing retinal blood vessel images, a retinal blood vessel segmentation method based on a combination of a multi-scale linear detector and local and global enhancement is proposed. Methods The multi-scale line detector is studied, and it is divided into two parts: small scale and large scale. The small scale is used to detect the locally enhanced image and the large scale is used to detect the globally enhanced image. Fusion the response functions at different scales to get the final retinal vascular structure. Results Experiments on two databases STARE and DRIVE, show that the average vascular accuracy rates obtained by the algorithm reach 96.62% and 96.45%, and the average true positive rates reach 75.52% and 83.07%, respectively. Conclusion The segmentation accuracy is high, and better blood vessel segmentation results can be obtained.
Collapse
Affiliation(s)
- Yanjie Hao
- Yanjie Hao, Associate Chief Physician, Department of Ophthalmology, Jiaozhou Central Hospital of Qingdao, Qingdao, 266300, Shandong, China
| | - Hongbo Xie
- Hongbo Xie, Attending Physician, Department of Ophthalmology, Qingdao Women's and Children's Hospital, Qingdao, 266000, Shandong, China
| | - Rong Qiu
- Rong Qiu, Associate Chief Physician, Department of Ophthalmology, Zhucheng People's Hospital, Zhucheng, Shandong, China
| |
Collapse
|