201
|
Noh KJ, Park SJ, Lee S. Scale-space approximated convolutional neural networks for retinal vessel segmentation. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2019; 178:237-246. [PMID: 31416552 DOI: 10.1016/j.cmpb.2019.06.030] [Citation(s) in RCA: 24] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/20/2019] [Revised: 06/15/2019] [Accepted: 06/28/2019] [Indexed: 06/10/2023]
Abstract
BACKGROUND AND OBJECTIVE Retinal fundus images are widely used to diagnose retinal diseases and can potentially be used for early diagnosis and prevention of chronic vascular diseases and diabetes. While various automatic retinal vessel segmentation methods using deep learning have been proposed, they are mostly based on common CNN structures developed for other tasks such as classification. METHODS We present a novel and simple multi-scale convolutional neural network (CNN) structure for retinal vessel segmentation. We first provide a theoretical analysis of existing multi-scale structures based on signal processing. In previous structures, multi-scale representations are achieved through downsampling by subsampling and decimation. By incorporating scale-space theory, we propose a simple yet effective multi-scale structure for CNNs using upsampling, which we term scale-space approximated CNN (SSANet). Based on further analysis of the effects of the SSA structure within a CNN, we also incorporate residual blocks, resulting in a multi-scale CNN that outperforms current state-of-the-art methods. RESULTS Quantitative evaluations are presented as the area-under-curve (AUC) of the receiver operating characteristic (ROC) curve and the precision-recall curve, as well as accuracy, for four publicly available datasets, namely DRIVE, STARE, CHASE_DB1, and HRF. For the CHASE_DB1 set, the SSANet achieves state-of-the-art AUC value of 0.9916 for the ROC curve. An ablative analysis is presented to analyze the contribution of different components of the SSANet to the performance improvement. CONCLUSIONS The proposed retinal SSANet achieves state-of-the-art or comparable accuracy across publicly available datasets, especially improving segmentation for thin vessels, vessel junctions, and central vessel reflexes.
Collapse
Affiliation(s)
- Kyoung Jin Noh
- Department of Ophthalmology, Seoul National University College of Medicine, Seoul National University Bundang Hospital, Seongnam, Gyeonggi-do 13620, South Korea
| | - Sang Jun Park
- Department of Ophthalmology, Seoul National University College of Medicine, Seoul National University Bundang Hospital, Seongnam, Gyeonggi-do 13620, South Korea.
| | - Soochahn Lee
- School of Electrical Engineering, Kookmin University, Seongbuk-gu, Seoul 02707, South Korea.
| |
Collapse
|
202
|
|
203
|
Tang P, Liang Q, Yan X, Zhang D, Coppola G, Sun W. Multi-proportion channel ensemble model for retinal vessel segmentation. Comput Biol Med 2019; 111:103352. [DOI: 10.1016/j.compbiomed.2019.103352] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/08/2019] [Revised: 07/07/2019] [Accepted: 07/07/2019] [Indexed: 10/26/2022]
|
204
|
|
205
|
Shi K, Schellenberger S, Michler F, Steigleder T, Malessa A, Lurz F, Ostgathe C, Weigel R, Koelpin A. Automatic Signal Quality Index Determination of Radar-Recorded Heart Sound Signals Using Ensemble Classification. IEEE Trans Biomed Eng 2019; 67:773-785. [PMID: 31180834 DOI: 10.1109/tbme.2019.2921071] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
OBJECTIVE Radar technology promises to be a touchless and thereby burden-free method for continuous heart sound monitoring, which can be used to detect cardiovascular diseases. However, the first and most crucial step is to differentiate between high- and low-quality segments in a recording to assess their suitability for a subsequent automated analysis. This paper gives a comprehensive study on this task and first addresses the specific characteristics of radar-recorded heart sound signals. METHODS To gather heart sound signals recorded from radar, a bistatic radar system was built and installed at the university hospital. Under medical supervision, heart sound data were recorded from 30 healthy test subjects. The signals were segmented and labeled as high- or low-quality by a medical expert. Different state-of-the-art pattern classification algorithms were evaluated for the task of automated signal quality determination and the most promising one was optimized and evaluated using leave-one-subject-out cross validation. RESULTS The proposed classifier is able to achieve an accuracy of up to 96.36% and demonstrates a superior classification performance compared with the state-of-the-art classifier with a maximum accuracy of 76.00%. CONCLUSION This paper introduces an ensemble classifier that is able to perform automated signal quality determination of radar-recorded heart sound signals with a high accuracy. SIGNIFICANCE Besides achieving a higher performance compared with state-of-the-art classifiers, this study is the first one to deal with the quality determination of heart sounds that are recorded by radar systems. The proposed method enables contactless and continuous heart sound monitoring for the detection of cardiovascular diseases.
Collapse
|
206
|
Son J, Park SJ, Jung KH. Towards Accurate Segmentation of Retinal Vessels and the Optic Disc in Fundoscopic Images with Generative Adversarial Networks. J Digit Imaging 2019; 32:499-512. [PMID: 30291477 PMCID: PMC6499859 DOI: 10.1007/s10278-018-0126-3] [Citation(s) in RCA: 71] [Impact Index Per Article: 11.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/28/2022] Open
Abstract
Automatic segmentation of the retinal vasculature and the optic disc is a crucial task for accurate geometric analysis and reliable automated diagnosis. In recent years, Convolutional Neural Networks (CNN) have shown outstanding performance compared to the conventional approaches in the segmentation tasks. In this paper, we experimentally measure the performance gain for Generative Adversarial Networks (GAN) framework when applied to the segmentation tasks. We show that GAN achieves statistically significant improvement in area under the receiver operating characteristic (AU-ROC) and area under the precision and recall curve (AU-PR) on two public datasets (DRIVE, STARE) by segmenting fine vessels. Also, we found a model that surpassed the current state-of-the-art method by 0.2 - 1.0% in AU-ROC and 0.8 - 1.2% in AU-PR and 0.5 - 0.7% in dice coefficient. In contrast, significant improvements were not observed in the optic disc segmentation task on DRIONS-DB, RIM-ONE (r3) and Drishti-GS datasets in AU-ROC and AU-PR.
Collapse
Affiliation(s)
- Jaemin Son
- VUNO Inc., 6F, 507, Gangnam-daero, Seocho-gu, Seoul, Republic of Korea
| | - Sang Jun Park
- Department of Ophthalmology, Seoul National University College of Medicine, Seoul National University Bundang Hospital, Seongnam, Republic of Korea
| | - Kyu-Hwan Jung
- VUNO Inc., 6F, 507, Gangnam-daero, Seocho-gu, Seoul, Republic of Korea
| |
Collapse
|
207
|
Das PK, Meher S, Panda R, Abraham A. A Review of Automated Methods for the Detection of Sickle Cell Disease. IEEE Rev Biomed Eng 2019; 13:309-324. [PMID: 31107662 DOI: 10.1109/rbme.2019.2917780] [Citation(s) in RCA: 22] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
Detection of sickle cell disease is a crucial job in medical image analysis. It emphasizes elaborate analysis of proper disease diagnosis after accurate detection followed by a classification of irregularities, which plays a vital role in the sickle cell disease diagnosis, treatment planning, and treatment outcome evaluation. Proper segmentation of complex cell clusters makes sickle cell detection more accurate and robust. Cell morphology has a key role in the detection of the sickle cell because the shapes of the normal blood cell and sickle cell differ significantly. This review emphasizes state-of-the-art methods and recent advances in detection, segmentation, and classification of sickle cell disease. We discuss key challenges encountered during the segmentation of overlapping blood cells. Moreover, standard validation measures that have been employed to yield performance analysis of various methods are also discussed. The methodologies and experiments in this review will be useful to further research and work in this area.
Collapse
|
208
|
Awasthi N, Prabhakar KR, Kalva SK, Pramanik M, Babu RV, Yalavarthy PK. PA-Fuse: deep supervised approach for the fusion of photoacoustic images with distinct reconstruction characteristics. BIOMEDICAL OPTICS EXPRESS 2019; 10:2227-2243. [PMID: 31149371 PMCID: PMC6524595 DOI: 10.1364/boe.10.002227] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/11/2019] [Revised: 03/15/2019] [Accepted: 03/20/2019] [Indexed: 05/11/2023]
Abstract
The methods available for solving the inverse problem of photoacoustic tomography promote only one feature-either being smooth or sharp-in the resultant image. The fusion of photoacoustic images reconstructed from distinct methods improves the individually reconstructed images, with the guided filter based approach being state-of-the-art, which requires that implicit regularization parameters are chosen. In this work, a deep fusion method based on convolutional neural networks has been proposed as an alternative to the guided filter based approach. It has the combined benefit of using less data for training without the need for the careful choice of any parameters and is a fully data-driven approach. The proposed deep fusion approach outperformed the contemporary fusion method, which was proved using experimental, numerical phantoms and in-vivo studies. The improvement obtained in the reconstructed images was as high as 95.49% in root mean square error and 7.77 dB in signal to noise ratio (SNR) in comparison to the guided filter approach. Also, it was demonstrated that the proposed deep fuse approach, trained on only blood vessel type images at measurement data SNR being 40 dB, was able to provide a generalization that can work across various noise levels in the measurement data, experimental set-ups as well as imaging objects.
Collapse
Affiliation(s)
- Navchetan Awasthi
- Indian Institute of Science, Department of Computational and Data Sciences, Bangalore,
India
| | - K. Ram Prabhakar
- Indian Institute of Science, Department of Computational and Data Sciences, Bangalore,
India
| | - Sandeep Kumar Kalva
- Nanyang Technological University, School of Chemical and Biomedical Engineering, 637459,
Singapore
| | - Manojit Pramanik
- Nanyang Technological University, School of Chemical and Biomedical Engineering, 637459,
Singapore
| | - R. Venkatesh Babu
- Indian Institute of Science, Department of Computational and Data Sciences, Bangalore,
India
| | | |
Collapse
|
209
|
Li Q, Zheng M, Li F, Wang J, Geng Y, Jiang H. Retinal image segmentation using double‐scale non‐linear thresholding on vessel support regions. CAAI TRANSACTIONS ON INTELLIGENCE TECHNOLOGY 2019. [DOI: 10.1049/trit.2017.0013] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022] Open
Affiliation(s)
- Qingyong Li
- Beijing Key Lab of Transportation Data Analysis and MiningBeijing Jiaotong UniversityBeijing100044People's Republic of China
| | - Min Zheng
- Beijing Key Lab of Transportation Data Analysis and MiningBeijing Jiaotong UniversityBeijing100044People's Republic of China
| | - Feng Li
- Beijing Key Lab of Transportation Data Analysis and MiningBeijing Jiaotong UniversityBeijing100044People's Republic of China
| | - Jianzhu Wang
- Beijing Key Lab of Transportation Data Analysis and MiningBeijing Jiaotong UniversityBeijing100044People's Republic of China
| | - Yangli‐ao Geng
- Beijing Key Lab of Transportation Data Analysis and MiningBeijing Jiaotong UniversityBeijing100044People's Republic of China
| | - Haibo Jiang
- Department of OphthalmologyXiangya Hospital, Central South UniversityChangsha410083People's Republic of China
| |
Collapse
|
210
|
Dash J, Bhoi N. Retinal Blood Vessel Extraction From Fundus Images Using Improved Otsu Method. INTERNATIONAL JOURNAL OF E-HEALTH AND MEDICAL COMMUNICATIONS 2019. [DOI: 10.4018/ijehmc.2019040102] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
In the present time, the identification of blood vessels is a basic task for diagnosis of various eye abnormalities. So, this article offers an instinctive approach for identification of blood vessels in ophthalmoscope images. This approach includes three different phases: pre-processing, vessel extraction and post-processing for getting a final vessel segmentation outcome. In the presented method, formerly log transformation and contrast limited adaptive histogram equalization are used for the enhancement of retinal images. The enhanced image is then filtered using a morphological opening operation and subsequently the optic disk is removed. The second phase includes the application of the improved Otsu method on the pre-processed image for the identification of blood vessels. Lastly, the resultant vessel-segmented image is obtained by using the morphological cleaning operation. The proposed method is fast, time efficient, and gives consistent accuracy for all retinal images. It is more robust and easier to implement compared to other traditional methods. The performance of the presented method is evaluated using ten different mathematical measures. It achieves average sensitivity, specificity and accuracy of 0.710, 0.982 and 0.956 for the digital retinal images for vessel extraction (DRIVE) database, 0.738, 0.982 and 0.954 for the structure analysis of the retina (STARE) database and 0.737, 0.964 and 0.949 for the child heart and health study in England (CHASE_DB1) database. The presented method also performs better in segmenting thin vessels by giving average accuracies of 0.964, 0.954 and 0.965 for DRIVE, STARE and CHASE_DB1 databases respectively.
Collapse
Affiliation(s)
| | - Nilamani Bhoi
- Veer Surendra Sai University of Technology, Odisha, India
| |
Collapse
|
211
|
Guo S, Wang K, Kang H, Zhang Y, Gao Y, Li T. BTS-DSN: Deeply supervised neural network with short connections for retinal vessel segmentation. Int J Med Inform 2019; 126:105-113. [PMID: 31029251 DOI: 10.1016/j.ijmedinf.2019.03.015] [Citation(s) in RCA: 57] [Impact Index Per Article: 9.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2018] [Revised: 01/31/2019] [Accepted: 03/25/2019] [Indexed: 11/26/2022]
Abstract
BACKGROUND AND OBJECTIVE The condition of vessel of the human eye is an important factor for the diagnosis of ophthalmological diseases. Vessel segmentation in fundus images is a challenging task due to complex vessel structure, the presence of similar structures such as microaneurysms and hemorrhages, micro-vessel with only one to several pixels wide, and requirements for finer results. METHODS In this paper, we present a multi-scale deeply supervised network with short connections (BTS-DSN) for vessel segmentation. We used short connections to transfer semantic information between side-output layers. Bottom-top short connections pass low level semantic information to high level for refining results in high-level side-outputs, and top-bottom short connection passes much structural information to low level for reducing noises in low-level side-outputs. In addition, we employ cross-training to show that our model is suitable for real world fundus images. RESULTS The proposed BTS-DSN has been verified on DRIVE, STARE and CHASE_DB1 datasets, and showed competitive performance over other state-of-the-art methods. Specially, with patch level input, the network achieved 0.7891/0.8212 sensitivity, 0.9804/0.9843 specificity, 0.9806/0.9859 AUC, and 0.8249/0.8421 F1-score on DRIVE and STARE, respectively. Moreover, our model behaves better than other methods in cross-training experiments. CONCLUSIONS BTS-DSN achieves competitive performance in vessel segmentation task on three public datasets. It is suitable for vessel segmentation. The source code of our method is available at: https://github.com/guomugong/BTS-DSN.
Collapse
Affiliation(s)
- Song Guo
- Nankai University, Tianjin, China
| | - Kai Wang
- Nankai University, Tianjin, China; KLMDASR, Tianjin, China
| | - Hong Kang
- Nankai University, Tianjin, China; Beijing Shanggong Medical Technology Co. Ltd, China
| | - Yujun Zhang
- Institute of Computing Technology, Chinese Academy, China
| | | | - Tao Li
- Nankai University, Tianjin, China.
| |
Collapse
|
212
|
Land Subsidence Susceptibility Mapping Using Bayesian, Functional, and Meta-Ensemble Machine Learning Models. APPLIED SCIENCES-BASEL 2019. [DOI: 10.3390/app9061248] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
To effectively prevent land subsidence over abandoned coal mines, it is necessary to quantitatively identify vulnerable areas. In this study, we evaluated the performance of predictive Bayesian, functional, and meta-ensemble machine learning models in generating land subsidence susceptibility (LSS) maps. All models were trained using half of a land subsidence inventory, and validated using the other half of the dataset. The model performance was evaluated by comparing the area under the receiver operating characteristic (ROC) curve of the resulting LSS map for each model. Among all models tested, the logit boost, which is a meta-ensemble machine leaning model, generated LSS maps with the highest accuracy (91.44%), i.e., higher than that of the other Bayesian and functional machine learning models, including the Bayes net (86.42%), naïve Bayes (85.39%), logistic (88.92%), and multilayer perceptron models (86.76%). The LSS maps produced in this study can be used to mitigate subsidence risk for people and important facilities within the study area, and as a foundation for further studies in other regions.
Collapse
|
213
|
Wang W, Wang W, Hu Z. Segmenting retinal vessels with revised top-bottom-hat transformation and flattening of minimum circumscribed ellipse. Med Biol Eng Comput 2019; 57:1481-1496. [DOI: 10.1007/s11517-019-01967-2] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2018] [Accepted: 02/23/2019] [Indexed: 11/29/2022]
|
214
|
Zhang J, Bekkers E, Chen D, Berendschot TTJM, Schouten J, Pluim JPW, Shi Y, Dashtbozorg B, Romeny BMTH. Reconnection of Interrupted Curvilinear Structures via Cortically Inspired Completion for Ophthalmologic Images. IEEE Trans Biomed Eng 2019; 65:1151-1165. [PMID: 29683430 DOI: 10.1109/tbme.2017.2787025] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
OBJECTIVE In this paper, we propose a robust, efficient, and automatic reconnection algorithm for bridging interrupted curvilinear skeletons in ophthalmologic images. METHODS This method employs the contour completion process, i.e., mathematical modeling of the direction process in the roto-translation group to achieve line propagation/completion. The completion process can be used to reconstruct interrupted curves by considering their local consistency. An explicit scheme with finite-difference approximation is used to construct the three-dimensional (3-D) completion kernel, where we choose the Gamma distribution for time integration. To process structures in , the orientation score framework is exploited to lift the 2-D curvilinear segments into the 3-D space. The propagation and reconnection of interrupted segments are achieved by convolving the completion kernel with orientation scores via iterative group convolutions. To overcome the problem of incorrect skeletonization of 2-D structures at junctions, a 3-D segment-wise thinning technique is proposed to process each segment separately in orientation scores. RESULTS Validations on 4 datasets with different image modalities show that our method achieves an average success rate of in reconnecting gaps of sizes from to , including challenging junction structures. CONCLUSION The reconnection approach can be a useful and reliable technique for bridging complex curvilinear interruptions. SIGNIFICANCE The presented method is a critical work to obtain more complete curvilinear structures in ophthalmologic images. It provides better topological and geometric connectivities for further analysis.
Collapse
|
215
|
Hashemzadeh M, Adlpour Azar B. Retinal blood vessel extraction employing effective image features and combination of supervised and unsupervised machine learning methods. Artif Intell Med 2019; 95:1-15. [PMID: 30904129 DOI: 10.1016/j.artmed.2019.03.001] [Citation(s) in RCA: 28] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2018] [Revised: 12/08/2018] [Accepted: 03/01/2019] [Indexed: 11/30/2022]
Abstract
In medicine, retinal vessel analysis of fundus images is a prominent task for the screening and diagnosis of various ophthalmological and cardiovascular diseases. In this research, a method is proposed for extracting the retinal blood vessels employing a set of effective image features and combination of supervised and unsupervised machine learning techniques. Further to the common features used in extracting blood vessels, three strong features having a significant influence on the accuracy of the vessel extraction are utilized. The selected combination of the different types of individually efficient features results in a rich local information with better discrimination for vessel and non-vessel pixels. The proposed method first extracts the thick and clear vessels in an unsupervised manner, and then, it extracts the thin vessels in a supervised way. The goal of the combination of the supervised and unsupervised methods is to deal with the problem of intra-class high variance of image features calculated from various vessel pixels. The proposed method is evaluated on three publicly available databases DRIVE, STARE and CHASE_DB1. The obtained results (DRIVE: Acc = 0.9531, AUC = 0.9752; STARE: Acc = 0.9691, AUC = 0.9853; CHASE_DB1: Acc = 0.9623, AUC = 0.9789) demonstrate the better performance of the proposed method compared to the state-of-the-art methods.
Collapse
Affiliation(s)
- Mahdi Hashemzadeh
- Faculty of Information Technology and Computer Engineering, Azarbaijan Shahid Madani University, Tabriz-Azarshahr Road, 5375171379, Tabriz, Iran.
| | - Baharak Adlpour Azar
- Department of Computer Engineering, Tabriz Branch, Azad University, Tabriz, Iran.
| |
Collapse
|
216
|
Girard F, Kavalec C, Cheriet F. Joint segmentation and classification of retinal arteries/veins from fundus images. Artif Intell Med 2019; 94:96-109. [DOI: 10.1016/j.artmed.2019.02.004] [Citation(s) in RCA: 48] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/30/2017] [Revised: 08/09/2018] [Accepted: 02/17/2019] [Indexed: 11/17/2022]
|
217
|
Badgujar R, Deore P. Hybrid Nature Inspired SMO-GBM Classifier for Exudate Classification on Fundus Retinal Images. Ing Rech Biomed 2019. [DOI: 10.1016/j.irbm.2019.02.003] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|
218
|
Leopold HA, Orchard J, Zelek JS, Lakshminarayanan V. PixelBNN: Augmenting the PixelCNN with Batch Normalization and the Presentation of a Fast Architecture for Retinal Vessel Segmentation. J Imaging 2019; 5:jimaging5020026. [PMID: 34460474 PMCID: PMC8320904 DOI: 10.3390/jimaging5020026] [Citation(s) in RCA: 21] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2018] [Revised: 01/05/2019] [Accepted: 01/24/2019] [Indexed: 01/06/2023] Open
Abstract
Analysis of retinal fundus images is essential for eye-care physicians in the diagnosis, care and treatment of patients. Accurate fundus and/or retinal vessel maps give rise to longitudinal studies able to utilize multimedia image registration and disease/condition status measurements, as well as applications in surgery preparation and biometrics. The segmentation of retinal morphology has numerous applications in assessing ophthalmologic and cardiovascular disease pathologies. Computer-aided segmentation of the vasculature has proven to be a challenge, mainly due to inconsistencies such as noise and variations in hue and brightness that can greatly reduce the quality of fundus images. The goal of this work is to collate different key performance indicators (KPIs) and state-of-the-art methods applied to this task, frame computational efficiency–performance trade-offs under varying degrees of information loss using common datasets, and introduce PixelBNN, a highly efficient deep method for automating the segmentation of fundus morphologies. The model was trained, tested and cross tested on the DRIVE, STARE and CHASE_DB1 retinal vessel segmentation datasets. Performance was evaluated using G-mean, Mathews Correlation Coefficient and F1-score, with the main success measure being computation speed. The network was 8.5× faster than the current state-of-the-art at test time and performed comparatively well, considering a 5× to 19× reduction in information from resizing images during preprocessing.
Collapse
Affiliation(s)
- Henry A. Leopold
- Department of Systems Design Engineering, University of Waterloo, Waterloo, ON N2L 3G1, Canada
- Correspondence:
| | - Jeff Orchard
- David R. Cheriton School of Computer Science, University of Waterloo, Waterloo, ON N2L 3G1, Canada
| | - John S. Zelek
- Department of Systems Design Engineering, University of Waterloo, Waterloo, ON N2L 3G1, Canada
| | | |
Collapse
|
219
|
Akbar S, Sharif M, Akram MU, Saba T, Mahmood T, Kolivand M. Automated techniques for blood vessels segmentation through fundus retinal images: A review. Microsc Res Tech 2019; 82:153-170. [DOI: 10.1002/jemt.23172] [Citation(s) in RCA: 33] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/21/2018] [Revised: 09/26/2018] [Accepted: 10/17/2018] [Indexed: 11/09/2022]
Affiliation(s)
- Shahzad Akbar
- Department of Computer ScienceCOMSATS University Islamabad, Wah Campus Wah Pakistan
| | - Muhammad Sharif
- Department of Computer ScienceCOMSATS University Islamabad, Wah Campus Wah Pakistan
| | - Muhammad Usman Akram
- Department of Computer EngineeringCollege of E&ME, National University of Sciences and Technology Islamabad Pakistan
| | - Tanzila Saba
- College of Computer and Information SciencesPrince Sultan University Riyadh Saudi Arabia
| | - Toqeer Mahmood
- Department of Computer ScienceUniversity of Engineering and Technology Taxila Pakistan
| | | |
Collapse
|
220
|
Vessel-Net: Retinal Vessel Segmentation Under Multi-path Supervision. LECTURE NOTES IN COMPUTER SCIENCE 2019. [DOI: 10.1007/978-3-030-32239-7_30] [Citation(s) in RCA: 48] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/03/2022]
|
221
|
Alom MZ, Yakopcic C, Hasan M, Taha TM, Asari VK. Recurrent residual U-Net for medical image segmentation. J Med Imaging (Bellingham) 2019; 6:014006. [PMID: 30944843 PMCID: PMC6435980 DOI: 10.1117/1.jmi.6.1.014006] [Citation(s) in RCA: 230] [Impact Index Per Article: 38.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2018] [Accepted: 03/05/2019] [Indexed: 12/12/2022] Open
Abstract
Deep learning (DL)-based semantic segmentation methods have been providing state-of-the-art performance in the past few years. More specifically, these techniques have been successfully applied in medical image classification, segmentation, and detection tasks. One DL technique, U-Net, has become one of the most popular for these applications. We propose a recurrent U-Net model and a recurrent residual U-Net model, which are named RU-Net and R2U-Net, respectively. The proposed models utilize the power of U-Net, residual networks, and recurrent convolutional neural networks. There are several advantages to using these proposed architectures for segmentation tasks. First, a residual unit helps when training deep architectures. Second, feature accumulation with recurrent residual convolutional layers ensures better feature representation for segmentation tasks. Third, it allows us to design better U-Net architectures with the same number of network parameters with better performance for medical image segmentation. The proposed models are tested on three benchmark datasets, such as blood vessel segmentation in retinal images, skin cancer segmentation, and lung lesion segmentation. The experimental results show superior performance on segmentation tasks compared to equivalent models, including a variant of a fully connected convolutional neural network called SegNet, U-Net, and residual U-Net.
Collapse
Affiliation(s)
- Md Zahangir Alom
- University of Dayton, Department of Electrical and Computer Engineering, Dayton, Ohio, United States
| | - Chris Yakopcic
- University of Dayton, Department of Electrical and Computer Engineering, Dayton, Ohio, United States
| | | | - Tarek M. Taha
- University of Dayton, Department of Electrical and Computer Engineering, Dayton, Ohio, United States
| | - Vijayan K. Asari
- University of Dayton, Department of Electrical and Computer Engineering, Dayton, Ohio, United States
| |
Collapse
|
222
|
Deep Vesselness Measure from Scale-Space Analysis of Hessian Matrix Eigenvalues. PATTERN RECOGNITION AND IMAGE ANALYSIS 2019. [DOI: 10.1007/978-3-030-31321-0_41] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
|
223
|
Fan Z, Lu J, Wei C, Huang H, Cai X, Chen X. A Hierarchical Image Matting Model for Blood Vessel Segmentation in Fundus Images. IEEE TRANSACTIONS ON IMAGE PROCESSING : A PUBLICATION OF THE IEEE SIGNAL PROCESSING SOCIETY 2018; 28:2367-2377. [PMID: 30571623 DOI: 10.1109/tip.2018.2885495] [Citation(s) in RCA: 37] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
In this paper, a hierarchical image matting model is proposed to extract blood vessels from fundus images. More specifically, a hierarchical strategy is integrated into the image matting model for blood vessel segmentation. Normally the matting models require a user specified trimap, which separates the input image into three regions: the foreground, background and unknown regions. However, creating a user specified trimap is laborious for vessel segmentation tasks. In this paper, we propose a method that first generates trimap automatically by utilizing region features of blood vessels, then applies a hierarchical image matting model to extract the vessel pixels from the unknown regions. The proposed method has low calculation time and outperforms many other state-of-art supervised and unsupervised methods. It achieves a vessel segmentation accuracy of 96.0%, 95.7% and 95.1% in an average time of 10.72s, 15.74s and 50.71s on images from three publicly available fundus image datasets DRIVE, STARE, and CHASE DB1, respectively.
Collapse
|
224
|
Badawi SA, Fraz MM. Optimizing the trainable B-COSFIRE filter for retinal blood vessel segmentation. PeerJ 2018; 6:e5855. [PMID: 30479888 PMCID: PMC6238769 DOI: 10.7717/peerj.5855] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2018] [Accepted: 09/28/2018] [Indexed: 11/20/2022] Open
Abstract
Segmentation of the retinal blood vessels using filtering techniques is a widely used step in the development of an automated system for diagnostic retinal image analysis. This paper optimized the blood vessel segmentation, by extending the trainable B-COSFIRE filter via identification of more optimal parameters. The filter parameters are introduced using an optimization procedure to three public datasets (STARE, DRIVE, and CHASE-DB1). The suggested approach considers analyzing thresholding parameters selection followed by application of background artifacts removal techniques. The approach results are better than the other state of the art methods used for vessel segmentation. ANOVA analysis technique is also used to identify the most significant parameters that are impacting the performance results (p-value ¡ 0.05). The proposed enhancement has improved the vessel segmentation accuracy in DRIVE, STARE and CHASE-DB1 to 95.47, 95.30 and 95.30, respectively.
Collapse
Affiliation(s)
- Sufian A. Badawi
- School of Electrical Engineering and Computer Science, National University of Sciences and Technology, Islamabad, Pakistan
| | - Muhammad Moazam Fraz
- School of Electrical Engineering and Computer Science, National University of Sciences and Technology, Islamabad, Pakistan
| |
Collapse
|
225
|
A Coarse-to-Fine Fully Convolutional Neural Network for Fundus Vessel Segmentation. Symmetry (Basel) 2018. [DOI: 10.3390/sym10110607] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022] Open
Abstract
Fundus vessel analysis is a significant tool for evaluating the development of retinal diseases such as diabetic retinopathy and hypertension in clinical practice. Hence, automatic fundus vessel segmentation is essential and valuable for medical diagnosis in ophthalmopathy and will allow identification and extraction of relevant symmetric and asymmetric patterns. Further, due to the uniqueness of fundus vessel, it can be applied in the field of biometric identification. In this paper, we remold fundus vessel segmentation as a task of pixel-wise classification task, and propose a novel coarse-to-fine fully convolutional neural network (CF-FCN) to extract vessels from fundus images. Our CF-FCN is aimed at making full use of the original data information and making up for the coarse output of the neural network by harnessing the space relationship between pixels in fundus images. Accompanying with necessary pre-processing and post-processing operations, the efficacy and efficiency of our CF-FCN is corroborated through our experiments on DRIVE, STARE, HRF and CHASE DB1 datasets. It achieves sensitivity of 0.7941, specificity of 0.9870, accuracy of 0.9634 and Area Under Receiver Operating Characteristic Curve (AUC) of 0.9787 on DRIVE datasets, which surpasses the state-of-the-art approaches.
Collapse
|
226
|
Zhang J, Dashtbozorg B, Huang F, Tan T, ter Haar Romeny BM. A fully automated pipeline of extracting biomarkers to quantify vascular changes in retina-related diseases. COMPUTER METHODS IN BIOMECHANICS AND BIOMEDICAL ENGINEERING-IMAGING AND VISUALIZATION 2018. [DOI: 10.1080/21681163.2018.1519851] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/28/2022]
Affiliation(s)
- Jiong Zhang
- Department of Biomedical Engineering, Eindhoven University of Technology, Eindhoven, the Netherlands
| | - Behdad Dashtbozorg
- Department of Biomedical Engineering, Eindhoven University of Technology, Eindhoven, the Netherlands
| | - Fan Huang
- Department of Biomedical Engineering, Eindhoven University of Technology, Eindhoven, the Netherlands
| | - Tao Tan
- Department of Biomedical Engineering, Eindhoven University of Technology, Eindhoven, the Netherlands
| | - B. M. ter Haar Romeny
- Department of Biomedical Engineering, Eindhoven University of Technology, Eindhoven, the Netherlands
| |
Collapse
|
227
|
Khan KB, Khaliq AA, Jalil A, Iftikhar MA, Ullah N, Aziz MW, Ullah K, Shahid M. A review of retinal blood vessels extraction techniques: challenges, taxonomy, and future trends. Pattern Anal Appl 2018. [DOI: 10.1007/s10044-018-0754-8] [Citation(s) in RCA: 39] [Impact Index Per Article: 5.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/04/2023]
|
228
|
Yan Z, Yang X, Cheng KT. A Three-Stage Deep Learning Model for Accurate Retinal Vessel Segmentation. IEEE J Biomed Health Inform 2018; 23:1427-1436. [PMID: 30281503 DOI: 10.1109/jbhi.2018.2872813] [Citation(s) in RCA: 127] [Impact Index Per Article: 18.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Automatic retinal vessel segmentation is a fundamental step in the diagnosis of eye-related diseases, in which both thick vessels and thin vessels are important features for symptom detection. All existing deep learning models attempt to segment both types of vessels simultaneously by using a unified pixel-wise loss that treats all vessel pixels with equal importance. Due to the highly imbalanced ratio between thick vessels and thin vessels (namely the majority of vessel pixels belong to thick vessels), the pixel-wise loss would be dominantly guided by thick vessels and relatively little influence comes from thin vessels, often leading to low segmentation accuracy for thin vessels. To address the imbalance problem, in this paper, we explore to segment thick vessels and thin vessels separately by proposing a three-stage deep learning model. The vessel segmentation task is divided into three stages, namely thick vessel segmentation, thin vessel segmentation, and vessel fusion. As better discriminative features could be learned for separate segmentation of thick vessels and thin vessels, this process minimizes the negative influence caused by their highly imbalanced ratio. The final vessel fusion stage refines the results by further identifying nonvessel pixels and improving the overall vessel thickness consistency. The experiments on public datasets DRIVE, STARE, and CHASE_DB1 clearly demonstrate that the proposed three-stage deep learning model outperforms the current state-of-the-art vessel segmentation methods.
Collapse
|
229
|
Jiang Z, Zhang H, Wang Y, Ko SB. Retinal blood vessel segmentation using fully convolutional network with transfer learning. Comput Med Imaging Graph 2018; 68:1-15. [DOI: 10.1016/j.compmedimag.2018.04.005] [Citation(s) in RCA: 103] [Impact Index Per Article: 14.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2017] [Revised: 04/10/2018] [Accepted: 04/13/2018] [Indexed: 11/25/2022]
|
230
|
Ashour AS, Hawas AR, Guo Y. Comparative study of multiclass classification methods on light microscopic images for hepatic schistosomiasis fibrosis diagnosis. Health Inf Sci Syst 2018; 6:7. [PMID: 30151186 DOI: 10.1007/s13755-018-0047-z] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2018] [Accepted: 08/07/2018] [Indexed: 01/26/2023] Open
Abstract
Hepatic schistosomiasis is a prolonged disease resulting mainly from the solvable egg antigen of schistosomiasis infection due to the host's granulomatous cell-mediated immune. Irreversible fibrosis results from the progress of the schistosomal hepatopathy. Sensitive diagnosis of this disease is based on the investigation of the microscopy images, liver tissues, and egg identification. Early diagnosis of schistosomiasis at its initial infection stage is vital to avoid egg-induced irreparable pathological reactions. Typically, there are several classification approaches that can be used for liver fibrosis staging. However, it is unclear which approaches can achieve high accuracy for analyzing and intelligently classifying the liver microscopic images. Consequently, this work aims to study the performance of the different machine learning classifiers for accurate fibrosis level staging of granuloma, namely cellular, fibrocellular and fibrotic granulomas as well as the normal samples. The classifiers include a multi-layer perceptron neural network, a decision tree, discriminant analysis, support vector machine (SVM), nearest neighbor, and the ensemble of classifiers. The statistical features of the microscopic images are extracted from the different fibrosis levels of granuloma, namely cellular, fibrocellular and fibrotic granulomas as well as the normal samples. The results established that the maximum achieved classification accuracies of value 90% were achieved using the subspace discriminant ensemble, the quadratic SVM, the linear SVM, or the linear discriminant classifiers. However, the linear discriminant classifier can be considered the superior classifier as it realized the best area under the curve of value 0.96 during the classification of the cellular granuloma as well as the fibro-cellular granuloma fibrosis levels.
Collapse
Affiliation(s)
- Amira S Ashour
- 1Department of Electronics and Electrical Communication Engineering, Faculty of Engineering, Tanta University, Tanta, Egypt
| | - Ahmed Refaat Hawas
- 1Department of Electronics and Electrical Communication Engineering, Faculty of Engineering, Tanta University, Tanta, Egypt
| | - Yanhui Guo
- 2Department of Computer Science, University of Illinois at Springfield, Springfield, IL USA
| |
Collapse
|
231
|
An Intelligent Model for Blood Vessel Segmentation in Diagnosing DR Using CNN. J Med Syst 2018; 42:175. [DOI: 10.1007/s10916-018-1030-6] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2018] [Accepted: 08/03/2018] [Indexed: 10/28/2022]
|
232
|
Srinidhi CL, Aparna P, Rajan J. A visual attention guided unsupervised feature learning for robust vessel delineation in retinal images. Biomed Signal Process Control 2018. [DOI: 10.1016/j.bspc.2018.04.016] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
|
233
|
Badgujar R, Deore P. MBO-SVM-based exudate classification in fundus retinal images of diabetic patients. COMPUTER METHODS IN BIOMECHANICS AND BIOMEDICAL ENGINEERING: IMAGING & VISUALIZATION 2018. [DOI: 10.1080/21681163.2018.1487338] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/28/2022]
Affiliation(s)
- Ravindra Badgujar
- Department of Electronics & Telecommunication Engineering, R C Patel Institute of Technology, Shirpur, India
| | - Pramod Deore
- Department of Electronics & Telecommunication Engineering, R C Patel Institute of Technology, Shirpur, India
| |
Collapse
|
234
|
Moccia S, De Momi E, El Hadji S, Mattos LS. Blood vessel segmentation algorithms - Review of methods, datasets and evaluation metrics. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2018; 158:71-91. [PMID: 29544791 DOI: 10.1016/j.cmpb.2018.02.001] [Citation(s) in RCA: 244] [Impact Index Per Article: 34.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/03/2017] [Revised: 12/23/2017] [Accepted: 02/02/2018] [Indexed: 05/09/2023]
Abstract
BACKGROUND Blood vessel segmentation is a topic of high interest in medical image analysis since the analysis of vessels is crucial for diagnosis, treatment planning and execution, and evaluation of clinical outcomes in different fields, including laryngology, neurosurgery and ophthalmology. Automatic or semi-automatic vessel segmentation can support clinicians in performing these tasks. Different medical imaging techniques are currently used in clinical practice and an appropriate choice of the segmentation algorithm is mandatory to deal with the adopted imaging technique characteristics (e.g. resolution, noise and vessel contrast). OBJECTIVE This paper aims at reviewing the most recent and innovative blood vessel segmentation algorithms. Among the algorithms and approaches considered, we deeply investigated the most novel blood vessel segmentation including machine learning, deformable model, and tracking-based approaches. METHODS This paper analyzes more than 100 articles focused on blood vessel segmentation methods. For each analyzed approach, summary tables are presented reporting imaging technique used, anatomical region and performance measures employed. Benefits and disadvantages of each method are highlighted. DISCUSSION Despite the constant progress and efforts addressed in the field, several issues still need to be overcome. A relevant limitation consists in the segmentation of pathological vessels. Unfortunately, not consistent research effort has been addressed to this issue yet. Research is needed since some of the main assumptions made for healthy vessels (such as linearity and circular cross-section) do not hold in pathological tissues, which on the other hand require new vessel model formulations. Moreover, image intensity drops, noise and low contrast still represent an important obstacle for the achievement of a high-quality enhancement. This is particularly true for optical imaging, where the image quality is usually lower in terms of noise and contrast with respect to magnetic resonance and computer tomography angiography. CONCLUSION No single segmentation approach is suitable for all the different anatomical region or imaging modalities, thus the primary goal of this review was to provide an up to date source of information about the state of the art of the vessel segmentation algorithms so that the most suitable methods can be chosen according to the specific task.
Collapse
Affiliation(s)
- Sara Moccia
- Department of Electronics, Information and Bioengineering, Politecnico di Milano, Milan, Italy; Department of Advanced Robotics, Istituto Italiano di Tecnologia, Genoa, Italy.
| | - Elena De Momi
- Department of Electronics, Information and Bioengineering, Politecnico di Milano, Milan, Italy
| | - Sara El Hadji
- Department of Electronics, Information and Bioengineering, Politecnico di Milano, Milan, Italy.
| | - Leonardo S Mattos
- Department of Advanced Robotics, Istituto Italiano di Tecnologia, Genoa, Italy
| |
Collapse
|
235
|
Abstract
Pathological disorders may happen due to small changes in retinal blood vessels which may later turn into blindness. Hence, the accurate segmentation of blood vessels is becoming a challenging task for pathological analysis. This paper offers an unsupervised recursive method for extraction of blood vessels from ophthalmoscope images. First, a vessel-enhanced image is generated with the help of gamma correction and contrast-limited adaptive histogram equalization (CLAHE). Next, the vessels are extracted iteratively by applying an adaptive thresholding technique. At last, a final vessel segmented image is produced by applying a morphological cleaning operation. Evaluations are accompanied on the publicly available digital retinal images for vessel extraction (DRIVE) and Child Heart And Health Study in England (CHASE_DB1) databases using nine different measurements. The proposed method achieves average accuracies of 0.957 and 0.952 on DRIVE and CHASE_DB1 databases respectively.
Collapse
|
236
|
Yan Z, Yang X, Cheng KT. Joint Segment-Level and Pixel-Wise Losses for Deep Learning Based Retinal Vessel Segmentation. IEEE Trans Biomed Eng 2018; 65:1912-1923. [PMID: 29993396 DOI: 10.1109/tbme.2018.2828137] [Citation(s) in RCA: 136] [Impact Index Per Article: 19.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
OBJECTIVE Deep learning based methods for retinal vessel segmentation are usually trained based on pixel-wise losses, which treat all vessel pixels with equal importance in pixel-to-pixel matching between a predicted probability map and the corresponding manually annotated segmentation. However, due to the highly imbalanced pixel ratio between thick and thin vessels in fundus images, a pixel-wise loss would limit deep learning models to learn features for accurate segmentation of thin vessels, which is an important task for clinical diagnosis of eye-related diseases. METHODS In this paper, we propose a new segment-level loss which emphasizes more on the thickness consistency of thin vessels in the training process. By jointly adopting both the segment-level and the pixel-wise losses, the importance between thick and thin vessels in the loss calculation would be more balanced. As a result, more effective features can be learned for vessel segmentation without increasing the overall model complexity. RESULTS Experimental results on public data sets demonstrate that the model trained by the joint losses outperforms the current state-of-the-art methods in both separate-training and cross-training evaluations. CONCLUSION Compared to the pixel-wise loss, utilizing the proposed joint-loss framework is able to learn more distinguishable features for vessel segmentation. In addition, the segment-level loss can bring consistent performance improvement for both deep and shallow network architectures. SIGNIFICANCE The findings from this study of using joint losses can be applied to other deep learning models for performance improvement without significantly changing the network architectures.
Collapse
|
237
|
Asem MM, Oveisi IS, Janbozorgi M. Blood vessel segmentation in modern wide-field retinal images in the presence of additive Gaussian noise. J Med Imaging (Bellingham) 2018. [PMID: 29531969 DOI: 10.1117/1.jmi.5.3.031405] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/14/2022] Open
Abstract
Retinal blood vessels indicate some serious health ramifications, such as cardiovascular disease and stroke. Thanks to modern imaging technology, high-resolution images provide detailed information to help analyze retinal vascular features before symptoms associated with such conditions fully develop. Additionally, these retinal images can be used by ophthalmologists to facilitate diagnosis and the procedures of eye surgery. A fuzzy noise reduction algorithm was employed to enhance color images corrupted by Gaussian noise. The present paper proposes employing a contrast limited adaptive histogram equalization to enhance illumination and increase the contrast of retinal images captured from state-of-the-art cameras. Possessing directional properties, the multistructure elements method can lead to high-performance edge detection. Therefore, multistructure elements-based morphology operators are used to detect high-quality image ridges. Following this detection, the irrelevant ridges, which are not part of the vessel tree, were removed by morphological operators by reconstruction, attempting also to keep the thin vessels preserved. A combined method of connected components analysis (CCA) in conjunction with a thresholding approach was further used to identify the ridges that correspond to vessels. The application of CCA can yield higher efficiency when it is locally applied rather than applied on the whole image. The significance of our work lies in the way in which several methods are effectively combined and the originality of the database employed, making this work unique in the literature. Computer simulation results in wide-field retinal images with up to a 200-deg field of view are a testimony of the efficacy of the proposed approach, with an accuracy of 0.9524.
Collapse
Affiliation(s)
| | - Iman Sheikh Oveisi
- Islamic Azad University, Department of Biomedical Engineering, Science and Research, Tehran, Iran
| | - Mona Janbozorgi
- Washington State University, Department of Medical Sciences, Spokane, Washington, United States
| |
Collapse
|
238
|
Lian C, Zhang J, Liu M, Zong X, Hung SC, Lin W, Shen D. Multi-channel multi-scale fully convolutional network for 3D perivascular spaces segmentation in 7T MR images. Med Image Anal 2018. [PMID: 29518675 DOI: 10.1016/j.media.2018.02.009] [Citation(s) in RCA: 77] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
Abstract
Accurate segmentation of perivascular spaces (PVSs) is an important step for quantitative study of PVS morphology. However, since PVSs are the thin tubular structures with relatively low contrast and also the number of PVSs is often large, it is challenging and time-consuming for manual delineation of PVSs. Although several automatic/semi-automatic methods, especially the traditional learning-based approaches, have been proposed for segmentation of 3D PVSs, their performance often depends on the hand-crafted image features, as well as sophisticated preprocessing operations prior to segmentation (e.g., specially defined regions-of-interest (ROIs)). In this paper, a novel fully convolutional neural network (FCN) with no requirement of any specified hand-crafted features and ROIs is proposed for efficient segmentation of PVSs. Particularly, the original T2-weighted 7T magnetic resonance (MR) images are first filtered via a non-local Haar-transform-based line singularity representation method to enhance the thin tubular structures. Both the original and enhanced MR images are used as multi-channel inputs to complementarily provide detailed image information and enhanced tubular structural information for the localization of PVSs. Multi-scale features are then automatically learned to characterize the spatial associations between PVSs and adjacent brain tissues. Finally, the produced PVS probability maps are recursively loaded into the network as an additional channel of inputs to provide the auxiliary contextual information for further refining the segmentation results. The proposed multi-channel multi-scale FCN has been evaluated on the 7T brain MR images scanned from 20 subjects. The experimental results show its superior performance compared with several state-of-the-art methods.
Collapse
Affiliation(s)
- Chunfeng Lian
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA.
| | - Jun Zhang
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA
| | - Mingxia Liu
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA
| | - Xiaopeng Zong
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA
| | - Sheng-Che Hung
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA
| | - Weili Lin
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA
| | - Dinggang Shen
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA; Department of Brain and Cognitive Engineering, Korea University, Seoul 02841, South Korea.
| |
Collapse
|
239
|
Retinal Vessels Segmentation Techniques and Algorithms: A Survey. APPLIED SCIENCES-BASEL 2018. [DOI: 10.3390/app8020155] [Citation(s) in RCA: 56] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
|
240
|
Zhang Y, Chung ACS. Deep Supervision with Additional Labels for Retinal Vessel Segmentation Task. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION – MICCAI 2018 2018. [DOI: 10.1007/978-3-030-00934-2_10] [Citation(s) in RCA: 54] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/05/2022]
|
241
|
Wu Y, Xia Y, Song Y, Zhang Y, Cai W. Multiscale Network Followed Network Model for Retinal Vessel Segmentation. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION – MICCAI 2018 2018. [DOI: 10.1007/978-3-030-00934-2_14] [Citation(s) in RCA: 70] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/02/2022]
|
242
|
Elbalaoui A, Fakir M, khaddouj T, MERBOUHA A. Automatic Detection of Blood Vessel in Retinal Images Using Vesselness Enhancement Filter and Adaptive Thresholding. Ophthalmology 2018. [DOI: 10.4018/978-1-5225-5195-9.ch002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022] Open
Abstract
Retinal blood vessels detection and measurement of morphological attributes, such as length, width, sinuosity and corners are very much important for the diagnosis and treatment of different ocular diseases including diabetic retinopathy (DR), glaucoma, and hypertension. This paper presents a integration method for blood vessels detection in fundus retinal images. The proposed method consists of two main steps. The first step is pre-processing of retinal image to improve the retinal images by evaluation of several image enhancement techniques. The second step is vessels detection, the vesselness filter is usually used to enhance the blood vessels. The enhancement filter is designed from the adaptive thresholding of the output of the vesselness filter for vessels detection. The algorithms performance is compared and analyzed on three publicly available databases (DRIVE, STARE and CHASE_DB) of retinal images using a number of measures, which include accuracy, sensitivity, and specificity.
Collapse
Affiliation(s)
| | - Mohamed Fakir
- Faculty of Science and Technology, Sultan Moulay Slimane University, Beni Mellal, Morocco
| | | | | |
Collapse
|
243
|
|
244
|
Hassan G, Hassanien AE. A Review of Vessel Segmentation Methodologies and Algorithms. Ophthalmology 2018. [DOI: 10.4018/978-1-5225-5195-9.ch001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022] Open
Abstract
“Prevention is better than cure”, true statement which all of us neglect. One of the most reasons which cause speedy recovery from any diseases is to discover it in advanced stages. From here come the importance of computer systems which preserve time and achieve accurate results in knowing the diseases and its first symptoms .One of these systems is retinal image analysis system which considered as a key role and the first step of Computer Aided Diagnosis Systems (CAD). In addition to monitor the patient health status under different treatment methods to ensure How it effects on the disease.. In this chapter the authors examine most of approaches that are used for vessel segmentation for retinal images, and a review of techniques is presented comparing between their quality and accessibility, analyzing and catgrizing them. This chapter gives a description and highlights the key points and the performance measures of each one.
Collapse
Affiliation(s)
- Gehad Hassan
- Fayoum University, Egypt & Scientific Research Group in Egypt (SRGE), Egypt
| | | |
Collapse
|
245
|
Memari N, Ramli AR, Bin Saripan MI, Mashohor S, Moghbel M. Supervised retinal vessel segmentation from color fundus images based on matched filtering and AdaBoost classifier. PLoS One 2017; 12:e0188939. [PMID: 29228036 PMCID: PMC5724901 DOI: 10.1371/journal.pone.0188939] [Citation(s) in RCA: 34] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2017] [Accepted: 11/15/2017] [Indexed: 11/19/2022] Open
Abstract
The structure and appearance of the blood vessel network in retinal fundus images is an essential part of diagnosing various problems associated with the eyes, such as diabetes and hypertension. In this paper, an automatic retinal vessel segmentation method utilizing matched filter techniques coupled with an AdaBoost classifier is proposed. The fundus image is enhanced using morphological operations, the contrast is increased using contrast limited adaptive histogram equalization (CLAHE) method and the inhomogeneity is corrected using Retinex approach. Then, the blood vessels are enhanced using a combination of B-COSFIRE and Frangi matched filters. From this preprocessed image, different statistical features are computed on a pixel-wise basis and used in an AdaBoost classifier to extract the blood vessel network inside the image. Finally, the segmented images are postprocessed to remove the misclassified pixels and regions. The proposed method was validated using publicly accessible Digital Retinal Images for Vessel Extraction (DRIVE), Structured Analysis of the Retina (STARE) and Child Heart and Health Study in England (CHASE_DB1) datasets commonly used for determining the accuracy of retinal vessel segmentation methods. The accuracy of the proposed segmentation method was comparable to other state of the art methods while being very close to the manual segmentation provided by the second human observer with an average accuracy of 0.972, 0.951 and 0.948 in DRIVE, STARE and CHASE_DB1 datasets, respectively.
Collapse
Affiliation(s)
- Nogol Memari
- Department of Computer & Communication Systems, Faculty of Engineering, University Putra Malaysia, Serdang, Selangor, Malaysia
- * E-mail:
| | - Abd Rahman Ramli
- Department of Computer & Communication Systems, Faculty of Engineering, University Putra Malaysia, Serdang, Selangor, Malaysia
| | - M. Iqbal Bin Saripan
- Department of Computer & Communication Systems, Faculty of Engineering, University Putra Malaysia, Serdang, Selangor, Malaysia
| | - Syamsiah Mashohor
- Department of Computer & Communication Systems, Faculty of Engineering, University Putra Malaysia, Serdang, Selangor, Malaysia
| | - Mehrdad Moghbel
- Department of Computer & Communication Systems, Faculty of Engineering, University Putra Malaysia, Serdang, Selangor, Malaysia
| |
Collapse
|
246
|
|
247
|
Clement M, Poulenard A, Kurtz C, Wendling L. Directional Enlacement Histograms for the Description of Complex Spatial Configurations between Objects. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE 2017; 39:2366-2380. [PMID: 28026752 DOI: 10.1109/tpami.2016.2645151] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
The analysis of spatial relations between objects in digital images plays a crucial role in various application domains related to pattern recognition and computer vision. Classical models for the evaluation of such relations are usually sufficient for the handling of simple objects, but can lead to ambiguous results in more complex situations. In this article, we investigate the modeling of spatial configurations where the objects can be imbricated in each other. We formalize this notion with the term enlacement, from which we also derive the term interlacement, denoting a mutual enlacement of two objects. Our main contribution is the proposition of new relative position descriptors designed to capture the enlacement and interlacement between two-dimensional objects. These descriptors take the form of circular histograms allowing to characterize spatial configurations with directional granularity, and they highlight useful invariance properties for typical image understanding applications. We also show how these descriptors can be used to evaluate different complex spatial relations, such as the surrounding of objects. Experimental results obtained in the different application domains of medical imaging, document image analysis and remote sensing, confirm the genericity of this approach.
Collapse
|
248
|
Guo F, Xiang D, Zou B, Zhu C, Wang S. Retinal Blood Vessel Segmentation Using Extreme Learning Machine. JOURNAL OF ADVANCED COMPUTATIONAL INTELLIGENCE AND INTELLIGENT INFORMATICS 2017. [DOI: 10.20965/jaciii.2017.p1280] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Extreme learning machine (ELM) is an effective machine learning technique that widely used in image processing. In this paper, a new supervised method for segmenting blood vessels in retinal images is proposed based on the ELM classifier. The proposed algorithm first constructs a 7-D feature vector using multi-scale Gabor filter, Hessian matrix and bottom-hat transformation. Then, an ELM classifier is trained on gold standard examples of vessel segmentation images to classify previous unseen images. The algorithm was tested on the publicly available DRIVE database – a digital image database for vessel extraction. Experimental results on both real-captured images and public database images demonstrate that our method shows comparative performance against other methods, which make the proposed algorithm a suitable tool for automated retinal image analysis.
Collapse
|
249
|
Retinal Vessel Segmentation via Structure Tensor Coloring and Anisotropy Enhancement. Symmetry (Basel) 2017. [DOI: 10.3390/sym9110276] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022] Open
|
250
|
Hassan M, Amin M, Murtza I, Khan A, Chaudhry A. Robust Hidden Markov Model based intelligent blood vessel detection of fundus images. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2017; 151:193-201. [PMID: 28947001 DOI: 10.1016/j.cmpb.2017.08.023] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/19/2016] [Revised: 02/27/2017] [Accepted: 08/29/2017] [Indexed: 06/07/2023]
Abstract
In this paper, we consider the challenging problem of detecting retinal vessel networks. Precise detection of retinal vessel networks is vital for accurate eye disease diagnosis. Most of the blood vessel tracking techniques may not properly track vessels in presence of vessels' occlusion. Owing to problem in sensor resolution or acquisition of fundus images, it is possible that some part of vessel may occlude. In this scenario, it becomes a challenging task to accurately trace these vital vessels. For this purpose, we have proposed a new robust and intelligent retinal vessel detection technique on Hidden Markov Model. The proposed model is able to successfully track vessels in the presence of occlusion. The effectiveness of the proposed technique is evaluated on publically available standard DRIVE dataset of the fundus images. The experiments show that the proposed technique not only outperforms the other state of the art methodologies of retinal blood vessels segmentation, but it is also capable of accurate occlusion handling in retinal vessel networks. The proposed technique offers better average classification accuracy, sensitivity, specificity, and area under the curve (AUC) of 95.7%, 81.0%, 97.0%, and 90.0% respectively, which shows the usefulness of the proposed technique.
Collapse
Affiliation(s)
- Mehdi Hassan
- Department of Computer Science, Air University, Sector, E-9, PAF Complex, Islamabad, Pakistan.
| | - Muhammad Amin
- Department of Computer Science, Air University, Sector, E-9, PAF Complex, Islamabad, Pakistan
| | - Iqbal Murtza
- Pattern Recognition Lab, Pakistan Institute of Engineering and Applied Sciences (PIEAS), Nilore 45650, Islamabad, Pakistan
| | - Asifullah Khan
- Pattern Recognition Lab, Pakistan Institute of Engineering and Applied Sciences (PIEAS), Nilore 45650, Islamabad, Pakistan
| | | |
Collapse
|