1
|
Liao J, Zhang T, Shepherd S, Macluskey M, Li C, Huang Z. Semi-supervised assisted multi-task learning for oral optical coherence tomography image segmentation and denoising. BIOMEDICAL OPTICS EXPRESS 2025; 16:1197-1215. [PMID: 40109516 PMCID: PMC11919357 DOI: 10.1364/boe.545377] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/16/2024] [Revised: 12/05/2024] [Accepted: 12/05/2024] [Indexed: 03/22/2025]
Abstract
Optical coherence tomography (OCT) is promising to become an essential imaging tool for non-invasive oral mucosal tissue assessment, but it faces challenges like speckle noise and motion artifacts. In addition, it is difficult to distinguish different layers of oral mucosal tissues from gray level OCT images due to the similarity of optical properties between different layers. We introduce the Efficient Segmentation-Denoising Model (ESDM), a multi-task deep learning framework designed to enhance OCT imaging by reducing scan time from ∼8s to ∼2s and improving oral epithelium layer segmentation. ESDM integrates the local feature extraction capabilities of the convolution layer and the long-term information processing advantages of the transformer, achieving better denoising and segmentation performance compared to existing models. Our evaluation shows that ESDM outperforms state-of-the-art models with a PSNR of 26.272, SSIM of 0.737, mDice of 0.972, and mIoU of 0.948. Ablation studies confirm the effectiveness of our design, such as the feature fusion methods, which enhance performance with minimal model complexity increase. ESDM also presents high accuracy in quantifying oral epithelium thickness, achieving mean absolute errors as low as 5 µm compared to manual measurements. This research shows that ESDM can notably improve OCT imaging and reduce the cost of accurate oral epithermal segmentation, improving diagnostic capabilities in clinical settings.
Collapse
Affiliation(s)
- Jinpeng Liao
- School of Science and Engineering, University of Dundee, DD1 4HN, Scotland, UK
- Healthcare Engineering, School of Physics and Engineering Technology, University of York, UK
| | - Tianyu Zhang
- School of Science and Engineering, University of Dundee, DD1 4HN, Scotland, UK
| | - Simon Shepherd
- School of Dentistry, University of Dundee, Dundee, DD1 4HN, Scotland, UK
| | | | - Chunhui Li
- School of Science and Engineering, University of Dundee, DD1 4HN, Scotland, UK
| | - Zhihong Huang
- Healthcare Engineering, School of Physics and Engineering Technology, University of York, UK
| |
Collapse
|
2
|
Mokhtari A, Maris BM, Fiorini P. A Survey on Optical Coherence Tomography-Technology and Application. Bioengineering (Basel) 2025; 12:65. [PMID: 39851339 PMCID: PMC11761895 DOI: 10.3390/bioengineering12010065] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2024] [Revised: 01/06/2025] [Accepted: 01/09/2025] [Indexed: 01/26/2025] Open
Abstract
This paper reviews the main research on Optical Coherence Tomography (OCT), focusing on the progress and advancements made by researchers over the past three decades in its methods and medical imaging applications. By analyzing existing studies and developments, this review aims to provide a foundation for future research in the field.
Collapse
Affiliation(s)
- Ali Mokhtari
- Department of Computer Science, University of Verona, 37134 Verona, Italy;
| | - Bogdan Mihai Maris
- Department of Engineering for Innovation Medicine, University of Verona, 37134 Verona, Italy;
| | - Paolo Fiorini
- Department of Engineering for Innovation Medicine, University of Verona, 37134 Verona, Italy;
| |
Collapse
|
3
|
Li S, Higashita R, Fu H, Yang B, Liu J. Score Prior Guided Iterative Solver for Speckles Removal in Optical Coherent Tomography Images. IEEE J Biomed Health Inform 2025; 29:248-258. [PMID: 39437277 DOI: 10.1109/jbhi.2024.3480928] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2024]
Abstract
Optical coherence tomography (OCT) is a widely used non-invasive imaging modality for ophthalmic diagnosis. However, the inherent speckle noise becomes the leading cause of OCT image quality, and efficient speckle removal algorithms can improve image readability and benefit automated clinical analysis. As an ill-posed inverse problem, it is of utmost importance for speckle removal to learn suitable priors. In this work, we develop a score prior guided iterative solver (SPIS) with logarithmic space to remove speckles in OCT images. Specifically, we model the posterior distribution of raw OCT images as a data consistency term and transform the speckle removal from a nonlinear into a linear inverse problem in the logarithmic domain. Subsequently, the learned prior distribution through the score function from the diffusion model is utilized as a constraint for the data consistency term into the linear inverse optimization, resulting in an iterative speckle removal procedure that alternates between the score prior predictor and the subsequent non-expansive data consistency corrector. Experimental results on the private and public OCT datasets demonstrate that the proposed SPIS has an excellent performance in speckle removal and out-of-distribution (OOD) generalization. Further downstream automatic analysis on the OCT images verifies that the proposed SPIS can benefit clinical applications.
Collapse
|
4
|
Jovanov L, Philips W. Denoising in optical coherence tomography volumes for improved 3D visualization. OPTICS EXPRESS 2024; 32:10302-10316. [PMID: 38571246 DOI: 10.1364/oe.478957] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/31/2023] [Accepted: 01/14/2024] [Indexed: 04/05/2024]
Abstract
Optical coherence tomography (OCT) has already become one of the most important diagnostic tools in different fields of medicine, as well as in various industrial applications. The most important characteristic of OCT is its high resolution, both in depth and the transverse direction. Together with the information on the tissue density, OCT offers highly precise information on tissue geometry. However, the detectability of small and low-intensity features in OCT scans is limited by the presence of speckle noise. In this paper we present a new volumetric method for noise removal in OCT volumes, which aims at improving the quality of rendered 3D volumes. In order to remove noise uniformly, while preserving important details, the proposed algorithm simultaneously observes the estimated amounts of noise and the sharpness measure, and iteratively enhances the volume until it reaches the required quality. We evaluate the proposed method using four quality measures as well as visually, by evaluating the visualization of OCT volumes on an auto-stereoscopic 3D screen. The results show that the proposed method outperforms reference methods both visually and in terms of objective measures.
Collapse
|
5
|
Jorjandi S, Amini Z, Rabbani H. Super-resolution of Retinal Optical Coherence Tomography Images Using Statistical Modeling. JOURNAL OF MEDICAL SIGNALS & SENSORS 2024; 14:2. [PMID: 38510673 PMCID: PMC10950312 DOI: 10.4103/jmss.jmss_58_22] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2022] [Revised: 01/16/2023] [Accepted: 06/27/2023] [Indexed: 03/22/2024]
Abstract
Background Optical coherence tomography (OCT) imaging has emerged as a promising diagnostic tool, especially in ophthalmology. However, speckle noise and downsampling significantly degrade the quality of OCT images and hinder the development of OCT-assisted diagnostics. In this article, we address the super-resolution (SR) problem of retinal OCT images using a statistical modeling point of view. Methods In the first step, we utilized Weibull mixture model (WMM) as a comprehensive model to establish the specific features of the intensity distribution of retinal OCT data, such as asymmetry and heavy tailed. To fit the WMM to the low-resolution OCT images, expectation-maximization algorithm is used to estimate the parameters of the model. Then, to reduce the existing noise in the data, a combination of Gaussian transform and spatially constraint Gaussian mixture model is applied. Now, to super-resolve OCT images, the expected patch log-likelihood is used which is a patch-based algorithm with multivariate GMM prior assumption. It restores the high-resolution (HR) images with maximum a posteriori (MAP) estimator. Results The proposed method is compared with some well-known super-resolution algorithms visually and numerically. In terms of the mean-to-standard deviation ratio (MSR) and the equivalent number of looks, our method makes a great superiority compared to the other competitors. Conclusion The proposed method is simple and does not require any special preprocessing or measurements. The results illustrate that our method not only significantly suppresses the noise but also successfully reconstructs the image, leading to improved visual quality.
Collapse
Affiliation(s)
- Sahar Jorjandi
- Department of Bioelectrics and Biomedical Engineering, School of Advanced Technologies in Medicine, Isfahan University of Medical Sciences, Isfahan, Iran
- Medical Image and Signal Processing Research Center, School of Advanced Technologies in Medicine, Isfahan University of Medical Sciences, Isfahan, Iran
| | - Zahra Amini
- Medical Image and Signal Processing Research Center, School of Advanced Technologies in Medicine, Isfahan University of Medical Sciences, Isfahan, Iran
- Department of Bioimaging, School of Advanced Technologies in Medicine, Isfahan University of Medical Sciences, Isfahan, Iran
| | - Hossein Rabbani
- Medical Image and Signal Processing Research Center, School of Advanced Technologies in Medicine, Isfahan University of Medical Sciences, Isfahan, Iran
- Department of Bioelectrics and Biomedical Engineering, School of Advanced Technologies in Medicine, Isfahan University of Medical Sciences, Isfahan, Iran
| |
Collapse
|
6
|
Nagib K, Mezgebo B, Fernando N, Kordi B, Sherif SS. Generalized Image Reconstruction in Optical Coherence Tomography Using Redundant and Non-Uniformly-Spaced Samples. SENSORS 2021; 21:s21217057. [PMID: 34770364 PMCID: PMC8587445 DOI: 10.3390/s21217057] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/23/2021] [Revised: 10/10/2021] [Accepted: 10/19/2021] [Indexed: 11/22/2022]
Abstract
In this paper, we use Frame Theory to develop a generalized OCT image reconstruction method using redundant and non-uniformly spaced frequency domain samples that includes using non-redundant and uniformly spaced samples as special cases. We also correct an important theoretical error in the previously reported results related to OCT image reconstruction using the Non-uniform Discrete Fourier Transform (NDFT). Moreover, we describe an efficient method to compute our corrected reconstruction transform, i.e., a scaled NDFT, using the Fast Fourier Transform (FFT). Finally, we demonstrate different advantages of our generalized OCT image reconstruction method by achieving (1) theoretically corrected OCT image reconstruction directly from non-uniformly spaced frequency domain samples; (2) a novel OCT image reconstruction method with a higher signal-to-noise ratio (SNR) using redundant frequency domain samples. Our new image reconstruction method is an improvement of OCT technology, so it could benefit all OCT applications.
Collapse
Affiliation(s)
- Karim Nagib
- Department of Electrical and Computer Engineering, University of Manitoba, Winnipeg, MB R3T 5V6, Canada; (K.N.); (B.M.); (B.K.)
| | - Biniyam Mezgebo
- Department of Electrical and Computer Engineering, University of Manitoba, Winnipeg, MB R3T 5V6, Canada; (K.N.); (B.M.); (B.K.)
| | - Namal Fernando
- Manitoba Hydro High Voltage Test Facility, Manitoba Hydro, Winnipeg, MB R3T 1Y6, Canada;
| | - Behzad Kordi
- Department of Electrical and Computer Engineering, University of Manitoba, Winnipeg, MB R3T 5V6, Canada; (K.N.); (B.M.); (B.K.)
| | - Sherif S. Sherif
- Department of Electrical and Computer Engineering, University of Manitoba, Winnipeg, MB R3T 5V6, Canada; (K.N.); (B.M.); (B.K.)
- Correspondence:
| |
Collapse
|
7
|
Wu M, Chen W, Chen Q, Park H. Noise Reduction for SD-OCT Using a Structure-Preserving Domain Transfer Approach. IEEE J Biomed Health Inform 2021; 25:3460-3472. [PMID: 33822730 DOI: 10.1109/jbhi.2021.3071421] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Spectral-domain optical coherence tomography (SD-OCT) images inevitably suffer from multiplicative speckle noise caused by random interference. This study proposes an unsupervised domain adaptation approach for noise reduction by translating the SD-OCT to the corresponding high-quality enhanced depth imaging (EDI)-OCT. We propose a structure-persevered cycle-consistent generative adversarial network for unpaired image-to-image translation, which can be applied to imbalanced unpaired data, and can effectively preserve retinal details based on a structure-specific cross-domain description. It also imposes smoothness by penalizing the intensity variation of the low reflective region between consecutive slices. Our approach was tested on a local data set that consisted of 268 SD-OCT volumes and two public independent validation datasets including 20 SD-OCT volumes and 17 B-scans, respectively. Experimental results show that our method can effectively suppress noise and maintain the retinal structure, compared with other traditional approaches and deep learning methods in terms of qualitative and quantitative assessments. Our proposed method shows good performance for speckle noise reduction and can assist downstream tasks of OCT analysis.
Collapse
|
8
|
Gómez-Valverde JJ, Sinz C, Rank EA, Chen Z, Santos A, Drexler W, Ledesma-Carbayo MJ. Adaptive compounding speckle-noise-reduction filter for optical coherence tomography images. JOURNAL OF BIOMEDICAL OPTICS 2021; 26:JBO-210051R. [PMID: 34142472 PMCID: PMC8211087 DOI: 10.1117/1.jbo.26.6.065001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/17/2021] [Accepted: 05/24/2021] [Indexed: 06/12/2023]
Abstract
SIGNIFICANCE Speckle noise limits the diagnostic capabilities of optical coherence tomography (OCT) images, causing both a reduction in contrast and a less accurate assessment of the microstructural morphology of the tissue. AIM We present a speckle-noise reduction method for OCT volumes that exploits the advantages of adaptive-noise wavelet thresholding with a wavelet compounding method applied to several frames acquired from consecutive positions. The method takes advantage of the wavelet representation of the speckle statistics, calculated properly from a homogeneous sample or a region of the noisy volume. APPROACH The proposed method was first compared quantitatively with different state-of-the-art approaches by being applied to three different clinical dermatological OCT volumes with three different OCT settings. The method was also applied to a public retinal spectral-domain OCT dataset to demonstrate its applicability to different imaging modalities. RESULTS The results based on four different metrics demonstrate that the proposed method achieved the best performance among the tested techniques in suppressing noise and preserving structural information. CONCLUSIONS The proposed OCT denoising technique has the potential to adapt to different image OCT settings and noise environments and to improve image quality prior to clinical diagnosis based on visual assessment.
Collapse
Affiliation(s)
- Juan J. Gómez-Valverde
- Universidad Politécnica de Madrid, ETSI Telecomunicación, Biomedical Image Technologies Laboratory, Madrid, Spain
- Biomedical Research Center in Bioengineering, Biomaterials and Nanomedicine, Madrid, Spain
| | - Christoph Sinz
- Medical University of Vienna, Department of Dermatology, Vienna, Austria
| | - Elisabet A. Rank
- Medical University of Vienna, Center for Medical Physics and Biomedical Engineering, Vienna, Austria
| | - Zhe Chen
- Medical University of Vienna, Center for Medical Physics and Biomedical Engineering, Vienna, Austria
| | - Andrés Santos
- Universidad Politécnica de Madrid, ETSI Telecomunicación, Biomedical Image Technologies Laboratory, Madrid, Spain
- Biomedical Research Center in Bioengineering, Biomaterials and Nanomedicine, Madrid, Spain
| | - Wolfgang Drexler
- Medical University of Vienna, Center for Medical Physics and Biomedical Engineering, Vienna, Austria
| | - María J. Ledesma-Carbayo
- Universidad Politécnica de Madrid, ETSI Telecomunicación, Biomedical Image Technologies Laboratory, Madrid, Spain
- Biomedical Research Center in Bioengineering, Biomaterials and Nanomedicine, Madrid, Spain
| |
Collapse
|
9
|
Shen Z, Xi M, Tang C, Xu M, Lei Z. Double-path parallel convolutional neural network for removing speckle noise in different types of OCT images. APPLIED OPTICS 2021; 60:4345-4355. [PMID: 34143124 DOI: 10.1364/ao.419871] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/14/2021] [Accepted: 04/30/2021] [Indexed: 06/12/2023]
Abstract
Speckle noises widely exist in optical coherence tomography (OCT) images. We propose an improved double-path parallel convolutional neural network (called DPNet) to reduce speckles. We increase the network width to replace the network depth to extract deeper information from the original OCT images. In addition, we use dilated convolution and residual learning to increase the learning ability of our DPNet. We use 100 pairs of human retinal OCT images as the training dataset. Then we test the DPNet model for denoising speckles on four different types of OCT images, mainly including human retinal OCT images, skin OCT images, colon crypt OCT images, and quail embryo OCT images. We compare the DPNet model with the adaptive complex diffusion method, the curvelet shrinkage method, the shearlet-based total variation method, and the OCTNet method. We qualitatively and quantitatively evaluate these methods in terms of image smoothness, structural information protection, and edge clarity. Our experimental results prove the performance of the DPNet model, and it allows us to batch and quickly process different types of poor-quality OCT images without any parameter fine-tuning under a time-constrained situation.
Collapse
|
10
|
Detection of Neurological and Ophthalmological Pathologies with Optical Coherence Tomography Using Retinal Thickness Measurements: A Bibliometric Study. APPLIED SCIENCES-BASEL 2020. [DOI: 10.3390/app10165477] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
Abstract
We carry out a bibliometric analysis on neurological and ophthalmological pathologies based on retinal nerve fiber layer (RNFL) thickness measured with optical coherence tomography (OCT). Documents were selected from Scopus database. We have applied the most commonly used bibliometric indicators, both for production and dispersion, as Price’s law of scientific literature growth, Lotka’s law, the transient index, and the Bradford model. Finally, the participation index of the different countries and affiliations was calculated. Two-hundred-and-forty-one documents from the period 2000–2019 were retrieved. Scientific production was better adjusted to linear growth (r = 0.88) than exponential (r = 0.87). The duplication time of the documents obtained was 5.6 years. The transience index was 89.62%, which indicates that most of the scientific production is due to very few authors. The signature rate per document was 5.2. Nine journals made up the Bradford core. USA and University of California present the highest production. The most frequently discussed topics on RNFL thinning are glaucoma and neurodegenerative diseases (NDD). The growth of the scientific literature on RNFL thickness was linear, with a very high rate of transience, which indicates low productivity and the presence of numerous authors who sporadically publish on this topic. No evidence of a saturation point was observed. In the last 10 years, there has been an increase in documents relating the decline of RNFL to NDD.
Collapse
|
11
|
Xu M, Tang C, Hao F, Chen M, Lei Z. Texture preservation and speckle reduction in poor optical coherence tomography using the convolutional neural network. Med Image Anal 2020; 64:101727. [DOI: 10.1016/j.media.2020.101727] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2019] [Revised: 05/10/2020] [Accepted: 05/11/2020] [Indexed: 11/25/2022]
|
12
|
Esmaeili M, Dehnavi AM, Hajizadeh F, Rabbani H. Three-dimensional curvelet-based dictionary learning for speckle noise removal of optical coherence tomography. BIOMEDICAL OPTICS EXPRESS 2020; 11:586-608. [PMID: 32133216 PMCID: PMC7041443 DOI: 10.1364/boe.377021] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/06/2019] [Revised: 12/07/2019] [Accepted: 12/07/2019] [Indexed: 05/27/2023]
Abstract
Optical coherence tomography (OCT) is a recently emerging non-invasive diagnostic tool useful in several medical applications such as ophthalmology, cardiology, gastroenterology and dermatology. One of the major problems with OCT pertains to its low contrast due to the presence of multiplicative speckle noise, which limits the signal-to-noise ratio (SNR) and obscures low-intensity and small features. In this paper, we recommend a new method using the 3D curvelet based K-times singular value decomposition (K-SVD) algorithm for speckle noise reduction and contrast enhancement of the intra-retinal layers of 3D Spectral-Domain OCT (3D-SDOCT) images. In order to benefit from the near-optimum properties of curvelet transform (such as good directional selectivity) on top of dictionary learning, we propose a new plan in dictionary learning by using the curvelet atoms as the initial dictionary. For this reason, the curvelet transform of the noisy image is taken and then the noisy coefficients matrix in each scale, rotation and spatial coordinates is passed through the K-SVD denoising algorithm with predefined 3D initial dictionary that is adaptively selected from thresholded coefficients in the same subband of the image. During the denoising of curvelet coefficients, we can also modify them for the purpose of contrast enhancement of intra-retinal layers. We demonstrate the ability of our proposed algorithm in the speckle noise reduction of 17 publicly available 3D OCT data sets, each of which contains 100 B-scans of size 512×1000 with and without neovascular age-related macular degeneration (AMD) images acquired using SDOCT, Bioptigen imaging systems. Experimental results show that an improvement from 1.27 to 7.81 in contrast to noise ratio (CNR), and from 38.09 to 1983.07 in equivalent number of looks (ENL) is achieved, which would outperform existing state-of-the-art OCT despeckling methods.
Collapse
Affiliation(s)
- Mahad Esmaeili
- Department of Bioelectrics and Biomedical
Engineering, Medical Image & Signal Processing Research Center,
School of Advanced Technologies in Medicine, Isfahan University of
Medical Sciences, Isfahan, Iran
- Department of Medical Bioengineering,
Faculty of Advanced Medical Sciences, Tabriz University of Medical
Sciences, Tabriz, Iran
| | - Alireza Mehri Dehnavi
- Department of Bioelectrics and Biomedical
Engineering, Medical Image & Signal Processing Research Center,
School of Advanced Technologies in Medicine, Isfahan University of
Medical Sciences, Isfahan, Iran
| | - Fedra Hajizadeh
- Noor Ophthalmology Research Center, Noor
Eye Hospital, Tehran, Iran
| | - Hosseini Rabbani
- Department of Bioelectrics and Biomedical
Engineering, Medical Image & Signal Processing Research Center,
School of Advanced Technologies in Medicine, Isfahan University of
Medical Sciences, Isfahan, Iran
| |
Collapse
|
13
|
Shi W, Chen C, Jivraj J, Dobashi Y, Gao W, Yang VX. 2D MEMS-based high-speed beam-shifting technique for speckle noise reduction and flow rate measurement in optical coherence tomography. OPTICS EXPRESS 2019; 27:12551-12564. [PMID: 31052795 DOI: 10.1364/oe.27.012551] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/27/2019] [Accepted: 04/01/2019] [Indexed: 06/09/2023]
Abstract
In this manuscript, a two-dimensional (2D) micro-electro-mechanical system (MEMS)-based, high-speed beam-shifting spectral domain optical coherence tomography (MHB-SDOCT) is proposed for speckle noise reduction and absolute flow rate measurement. By combining a zigzag scanning protocol, the frame rates of 45.2 Hz for speckle reduction and 25.6 Hz for flow rate measurement are achieved for in-vivo tissue imaging. Phantom experimental results have shown that by setting the incident beam angle to ϕ = 4.76° (between optical axis of objective lens and beam axis) and rotating the beam about the optical axis in 17 discrete angular positions, 91% of speckle noise in the structural images can be reduced. Furthermore, a precision of 0.0032 µl/s is achieved for flow rate measurement with the same beam angle, using three discrete angular positions around the optical axis. In-vivo experiments on human skin and chicken embryo were also implemented to further verify the performance of speckle noise reduction and flow rate measurement of MHB-SDOCT.
Collapse
|
14
|
Adabi S, Rashedi E, Clayton A, Mohebbi-Kalkhoran H, Chen XW, Conforto S, Nasiriavanaki M. Learnable despeckling framework for optical coherence tomography images. JOURNAL OF BIOMEDICAL OPTICS 2018; 23:1-12. [PMID: 29368458 DOI: 10.1117/1.jbo.23.1.016013] [Citation(s) in RCA: 19] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/25/2017] [Accepted: 01/04/2018] [Indexed: 05/24/2023]
Abstract
Optical coherence tomography (OCT) is a prevalent, interferometric, high-resolution imaging method with broad biomedical applications. Nonetheless, OCT images suffer from an artifact called speckle, which degrades the image quality. Digital filters offer an opportunity for image improvement in clinical OCT devices, where hardware modification to enhance images is expensive. To reduce speckle, a wide variety of digital filters have been proposed; selecting the most appropriate filter for an OCT image/image set is a challenging decision, especially in dermatology applications of OCT where a different variety of tissues are imaged. To tackle this challenge, we propose an expandable learnable despeckling framework, we call LDF. LDF decides which speckle reduction algorithm is most effective on a given image by learning a figure of merit (FOM) as a single quantitative image assessment measure. LDF is learnable, which means when implemented on an OCT machine, each given image/image set is retrained and its performance is improved. Also, LDF is expandable, meaning that any despeckling algorithm can easily be added to it. The architecture of LDF includes two main parts: (i) an autoencoder neural network and (ii) filter classifier. The autoencoder learns the FOM based on several quality assessment measures obtained from the OCT image including signal-to-noise ratio, contrast-to-noise ratio, equivalent number of looks, edge preservation index, and mean structural similarity index. Subsequently, the filter classifier identifies the most efficient filter from the following categories: (a) sliding window filters including median, mean, and symmetric nearest neighborhood, (b) adaptive statistical-based filters including Wiener, homomorphic Lee, and Kuwahara, and (c) edge preserved patch or pixel correlation-based filters including nonlocal mean, total variation, and block matching three-dimensional filtering.
Collapse
Affiliation(s)
- Saba Adabi
- Wayne State University, Department of Biomedical Engineering, Detroit, Michigan, United States
- Roma Tre University, Department of Applied Electronics, Rome, Italy
| | - Elaheh Rashedi
- Wayne State University, Department of Computer Science, Detroit, Michigan, United States
| | - Anne Clayton
- Wayne State University, Department of Biomedical Engineering, Detroit, Michigan, United States
| | - Hamed Mohebbi-Kalkhoran
- Wayne State University, Department of Biomedical Engineering, Detroit, Michigan, United States
| | - Xue-Wen Chen
- Wayne State University, Department of Computer Science, Detroit, Michigan, United States
| | - Silvia Conforto
- Roma Tre University, Department of Applied Electronics, Rome, Italy
| | - Mohammadreza Nasiriavanaki
- Wayne State University, Department of Biomedical Engineering, Detroit, Michigan, United States
- Wayne State University, Department of Neurology, Detroit, Michigan, United States
- Barbara Ann Karmanos Cancer Institute, Detroit, Michigan, United States
| |
Collapse
|
15
|
Adabi S, Fotouhi A, Xu Q, Daveluy S, Mehregan D, Podoleanu A, Nasiriavanaki M. An overview of methods to mitigate artifacts in optical coherence tomography imaging of the skin. Skin Res Technol 2017; 24:265-273. [PMID: 29143429 DOI: 10.1111/srt.12423] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 09/10/2017] [Indexed: 12/19/2022]
Abstract
BACKGROUND Optical coherence tomography (OCT) of skin delivers three-dimensional images of tissue microstructures. Although OCT imaging offers a promising high-resolution modality, OCT images suffer from some artifacts that lead to misinterpretation of tissue structures. Therefore, an overview of methods to mitigate artifacts in OCT imaging of the skin is of paramount importance. Speckle, intensity decay, and blurring are three major artifacts in OCT images. Speckle is due to the low coherent light source used in the configuration of OCT. Intensity decay is a deterioration of light with respect to depth, and blurring is the consequence of deficiencies of optical components. METHOD Two speckle reduction methods (one based on artificial neural network and one based on spatial compounding), an attenuation compensation algorithm (based on Beer-Lambert law) and a deblurring procedure (using deconvolution), are described. Moreover, optical properties extraction algorithm based on extended Huygens-Fresnel (EHF) principle to obtain some additional information from OCT images are discussed. RESULTS In this short overview, we summarize some of the image enhancement algorithms for OCT images which address the abovementioned artifacts. The results showed a significant improvement in the visibility of the clinically relevant features in the images. The quality improvement was evaluated using several numerical assessment measures. CONCLUSION Clinical dermatologists benefit from using these image enhancement algorithms to improve OCT diagnosis and essentially function as a noninvasive optical biopsy.
Collapse
Affiliation(s)
- Saba Adabi
- Engineering Faculty, Department of Biomedical Engineering, Wayne State University, Detroit, MI, USA.,Engineering Faculty, Department of Applied Electronics, Roma Tre University, Rome, Italy
| | - Audrey Fotouhi
- School of Medicine, Wayne State University, Detroit, MI, USA
| | - Qiuyun Xu
- Engineering Faculty, Department of Biomedical Engineering, Wayne State University, Detroit, MI, USA
| | - Steve Daveluy
- School of Medicine, Department of Dermatology, Wayne State University, Detroit, MI, USA.,Barbara Ann Karmanos Cancer Institute, Detroit, MI, USA
| | - Darius Mehregan
- School of Medicine, Department of Dermatology, Wayne State University, Detroit, MI, USA
| | - Adrian Podoleanu
- School of Physical Sciences, Applied Optics Group, University of Kent, Canterbury, Kent, UK
| | - Mohammadreza Nasiriavanaki
- Engineering Faculty, Department of Biomedical Engineering, Wayne State University, Detroit, MI, USA.,School of Medicine, Department of Dermatology, Wayne State University, Detroit, MI, USA.,Barbara Ann Karmanos Cancer Institute, Detroit, MI, USA
| |
Collapse
|
16
|
Wu M, Fan W, Chen Q, Du Z, Li X, Yuan S, Park H. Three-dimensional continuous max flow optimization-based serous retinal detachment segmentation in SD-OCT for central serous chorioretinopathy. BIOMEDICAL OPTICS EXPRESS 2017; 8:4257-4274. [PMID: 28966863 PMCID: PMC5611939 DOI: 10.1364/boe.8.004257] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/21/2017] [Revised: 07/29/2017] [Accepted: 08/22/2017] [Indexed: 05/28/2023]
Abstract
Assessment of serous retinal detachment plays an important role in the diagnosis of central serous chorioretinopathy (CSC). In this paper, we propose an automatic, three-dimensional segmentation method to detect both neurosensory retinal detachment (NRD) and pigment epithelial detachment (PED) in spectral domain optical coherence tomography (SD-OCT) images. The proposed method involves constructing a probability map from training samples using random forest classification. The probability map is constructed from a linear combination of structural texture, intensity, and layer thickness information. Then, a continuous max flow optimization algorithm is applied to the probability map to segment the retinal detachment-associated fluid regions. Experimental results from 37 retinal SD-OCT volumes from cases of CSC demonstrate the proposed method can achieve a true positive volume fraction (TPVF), false positive volume fraction (FPVF), positive predicative value (PPV), and dice similarity coefficient (DSC) of 92.1%, 0.53%, 94.7%, and 93.3%, respectively, for NRD segmentation and 92.5%, 0.14%, 80.9%, and 84.6%, respectively, for PED segmentation. The proposed method can be an automatic tool to evaluate serous retinal detachment and has the potential to improve the clinical evaluation of CSC.
Collapse
Affiliation(s)
- Menglin Wu
- School of Computer Science and Technology, Nanjing Tech University, Nanjing, China
- These authors contributed equally to this manuscript
| | - Wen Fan
- Department of Ophthalmology, First Affiliated Hospital with Nanjing Medical University, Nanjing, China
- These authors contributed equally to this manuscript
| | - Qiang Chen
- School of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing, China
| | - Zhenlong Du
- School of Computer Science and Technology, Nanjing Tech University, Nanjing, China
| | - Xiaoli Li
- School of Computer Science and Technology, Nanjing Tech University, Nanjing, China
| | - Songtao Yuan
- Department of Ophthalmology, First Affiliated Hospital with Nanjing Medical University, Nanjing, China
| | - Hyunjin Park
- School of Electronic and Electrical Engineering, Sungkyunkwan University, South Korea
- Center for Neuroscience Imaging Research, Institute for Basic Science (IBS), South Korea
| |
Collapse
|
17
|
Optical coherence tomography image denoising using Gaussianization transform. JOURNAL OF BIOMEDICAL OPTICS 2017; 22:1-12. [PMID: 28853244 DOI: 10.1117/1.jbo.22.8.086011] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/04/2017] [Accepted: 08/01/2017] [Indexed: 05/22/2023]
Abstract
We demonstrate the power of the Gaussianization transform (GT) for modeling image content by applying GT for optical coherence tomography (OCT) denoising. The proposed method is a developed version of the spatially constrained Gaussian mixture model (SC-GMM) method, which assumes that each cluster of similar patches in an image has a Gaussian distribution. SC-GMM tries to find some clusters of similar patches in the image using a spatially constrained patch clustering and then denoise each cluster by the Wiener filter. Although in this method GMM distribution is assumed for the noisy image, holding this assumption on a dataset is not investigated. We illustrate that making a Gaussian assumption on a noisy dataset has a significant effect on denoising results. For this purpose, a suitable distribution for OCT images is first obtained and then GT is employed to map this original distribution of OCT images to a GMM distribution. Then, this Gaussianized image is used as the input of the SC-GMM algorithm. This method, which is a combination of GT and SC-GMM, remarkably improves the results of OCT denoising compared with earlier version of SC-GMM and even produces better visual and numerical results than the state-of-the art works in this field. Indeed, the main advantage of the proposed OCT despeckling method is texture preservation, which is important for main image processing tasks like OCT inter- and intraretinal layer analysis. Thus, to prove the efficacy of the proposed method for this analysis, an improvement in the segmentation of intraretinal layers using the proposed method as a preprocessing step is investigated. Furthermore, the proposed method can achieve the best expert ranking between other contending methods, and the results show the helpfulness and usefulness of the proposed method in clinical applications.
Collapse
|
18
|
Zaki F, Wang Y, Su H, Yuan X, Liu X. Noise adaptive wavelet thresholding for speckle noise removal in optical coherence tomography. BIOMEDICAL OPTICS EXPRESS 2017; 8:2720-2731. [PMID: 28663901 PMCID: PMC5480508 DOI: 10.1364/boe.8.002720] [Citation(s) in RCA: 41] [Impact Index Per Article: 5.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/01/2017] [Revised: 04/21/2017] [Accepted: 04/21/2017] [Indexed: 05/27/2023]
Abstract
Optical coherence tomography (OCT) is based on coherence detection of interferometric signals and hence inevitably suffers from speckle noise. To remove speckle noise in OCT images, wavelet domain thresholding has demonstrated significant advantages in suppressing noise magnitude while preserving image sharpness. However, speckle noise in OCT images has different characteristics in different spatial scales, which has not been considered in previous applications of wavelet domain thresholding. In this study, we demonstrate a noise adaptive wavelet thresholding (NAWT) algorithm that exploits the difference of noise characteristics in different wavelet sub-bands. The algorithm is simple, fast, effective and is closely related to the physical origin of speckle noise in OCT image. Our results demonstrate that NAWT outperforms conventional wavelet thresholding.
Collapse
Affiliation(s)
- Farzana Zaki
- Department of Electrical and Computer Engineering, New Jersey Institute of Technology, Newark, NJ 079102, USA
| | - Yahui Wang
- Department of Electrical and Computer Engineering, New Jersey Institute of Technology, Newark, NJ 079102, USA
| | - Hao Su
- School of Engineering and Applied Sciences, Harvard University, Cambridge, MA 02138, USA
| | - Xin Yuan
- Bell Labs, Nokia, 600 Mountain Avenue, Murray Hill, NJ 07974, USA
| | - Xuan Liu
- Department of Electrical and Computer Engineering, New Jersey Institute of Technology, Newark, NJ 079102, USA
| |
Collapse
|
19
|
Cui D, Bo E, Luo Y, Liu X, Wang X, Chen S, Yu X, Chen S, Shum P, Liu L. Multifiber angular compounding optical coherence tomography for speckle reduction. OPTICS LETTERS 2017; 42:125-128. [PMID: 28059194 DOI: 10.1364/ol.42.000125] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
We report on an integrated fiber optic design to implement multifiber angular compounding optical coherence tomography, which enables angular compounding for speckle reduction. A multi-facet fiber array delivers three light beams to the sample with different incident angles. Back-reflective/back-scattered signals from these channels were simultaneously detected by a three-channel spectrometer. The axial and lateral resolution was measured to be ∼3 and ∼3.5 μm, respectively, in air with ∼100 dB sensitivity. We conducted ex vivo experiments on a rat esophagus to demonstrate a contrast to noise improvement of 1.58.
Collapse
|
20
|
Jesus DA, Iskander DR. Assessment of corneal properties based on statistical modeling of OCT speckle. BIOMEDICAL OPTICS EXPRESS 2017; 8:162-176. [PMID: 28101409 PMCID: PMC5231290 DOI: 10.1364/boe.8.000162] [Citation(s) in RCA: 35] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/30/2016] [Revised: 10/31/2016] [Accepted: 11/02/2016] [Indexed: 05/31/2023]
Abstract
A new approach to assess the properties of the corneal micro-structure in vivo based on the statistical modeling of speckle obtained from Optical Coherence Tomography (OCT) is presented. A number of statistical models were proposed to fit the corneal speckle data obtained from OCT raw image. Short-term changes in corneal properties were studied by inducing corneal swelling whereas age-related changes were observed analyzing data of sixty-five subjects aged between twenty-four and seventy-three years. Generalized Gamma distribution has shown to be the best model, in terms of the Akaike's Information Criterion, to fit the OCT corneal speckle. Its parameters have shown statistically significant differences (Kruskal-Wallis, p < 0.001) for short and age-related corneal changes. In addition, it was observed that age-related changes influence the corneal biomechanical behaviour when corneal swelling is induced. This study shows that Generalized Gamma distribution can be utilized to modeling corneal speckle in OCT in vivo providing complementary quantified information where micro-structure of corneal tissue is of essence.
Collapse
|
21
|
Uddin MS, Halder KK, Tahtali M, Lambert AJ, Pickering MR, Marchese M, Stuart I. Intelligent estimation of noise and blur variances using ANN for the restoration of ultrasound images. APPLIED OPTICS 2016; 55:8905-8915. [PMID: 27828292 DOI: 10.1364/ao.55.008905] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
Ultrasound (US) imaging is a widely used clinical diagnostic tool in medical imaging techniques. It is a comparatively safe, economical, painless, portable, and noninvasive real-time tool compared to the other imaging modalities. However, the image quality of US imaging is severely affected by the presence of speckle noise and blur during the acquisition process. In order to ensure a high-quality clinical diagnosis, US images must be restored by reducing their speckle noise and blur. In general, speckle noise is modeled as a multiplicative noise following a Rayleigh distribution and blur as a Gaussian function. Hereto, we propose an intelligent estimator based on artificial neural networks (ANNs) to estimate the variances of noise and blur, which, in turn, are used to obtain an image without discernible distortions. A set of statistical features computed from the image and its complex wavelet sub-bands are used as input to the ANN. In the proposed method, we solve the inverse Rayleigh function numerically for speckle reduction and use the Richardson-Lucy algorithm for de-blurring. The performance of this method is compared with that of the traditional methods by applying them to a synthetic, physical phantom and clinical data, which confirms better restoration results by the proposed method.
Collapse
|
22
|
Wang T, Ji Z, Sun Q, Chen Q, Yu S, Fan W, Yuan S, Liu Q. Label propagation and higher-order constraint-based segmentation of fluid-associated regions in retinal SD-OCT images. Inf Sci (N Y) 2016. [DOI: 10.1016/j.ins.2016.04.017] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
|
23
|
Optical Coherence Tomographic Elastography Reveals Mesoscale Shear Strain Inhomogeneities in the Annulus Fibrosus. Spine (Phila Pa 1976) 2016; 41:E770-E777. [PMID: 26849796 PMCID: PMC4925193 DOI: 10.1097/brs.0000000000001463] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/01/2023]
Abstract
STUDY DESIGN Basic science study using in vitro tissue testing and imaging to characterize local strains in annulus fibrosus (AF) tissue. OBJECTIVE To characterize mesoscale strain inhomogeneities between lamellar and inter-/translamellar (ITL) matrix compartments during tissue shear loading. SUMMARY OF BACKGROUND DATA The intervertebral disc is characterized by significant heterogeneities in tissue structure and plays a critical role in load distribution and force transmission in the spine. In particular, the AF possesses a lamellar architecture interdigitated by a complex network of extracellular matrix components that form a distinct ITL compartment. Currently, there is not a firm understanding of how the lamellar and ITL matrix coordinately support tissue loading. METHODS AF tissue samples were prepared from frozen porcine lumbar spines and mounted onto custom fixtures of a materials testing system that incorporates optical coherence tomography (OCT) imaging to perform tissue elastography. Tissues were subjected to 20 and 40% nominal shear strain, and OCT images were captured and segmented to identify regions of interest corresponding to lamellar and ITL compartments. Images were analyzed using an optical flow algorithm to quantify local shear strains within each compartment. RESULTS Using histology and OCT, we first verified our ability to visualize and discriminate the ITL matrix from the lamellar matrix in porcine AF tissues. Local AF strains in the ITL compartment (22.0 ± 13.8, 31.1 ± 16.9 at 20% and 40% applied shear, respectively) were significantly higher than corresponding strains in the surrounding lamellar compartment (12.1 ± 5.6, 15.3 ± 5.2) for all tissue samples (P < 0.05). CONCLUSION Results from this study demonstrate that the lamellar and ITL compartments of the AF distribute strain unevenly during tissue loading. Specifically, shear strain is significantly higher in the ITL matrix, suggesting that these regions may be more susceptible to tissue damage and more mechanobiologically active. LEVEL OF EVIDENCE N/A.
Collapse
|
24
|
Yang J, Fan J, Ai D, Wang X, Zheng Y, Tang S, Wang Y. Local statistics and non-local mean filter for speckle noise reduction in medical ultrasound image. Neurocomputing 2016. [DOI: 10.1016/j.neucom.2015.05.140] [Citation(s) in RCA: 69] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
25
|
Shalev R, Gargesha M, Prabhu D, Tanaka K, Rollins AM, Lamouche G, Bisaillon CE, Bezerra HG, Ray S, Wilson DL. Processing to determine optical parameters of atherosclerotic disease from phantom and clinical intravascular optical coherence tomography three-dimensional pullbacks. J Med Imaging (Bellingham) 2016; 3:024501. [PMID: 27213167 DOI: 10.1117/1.jmi.3.2.024501] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/18/2015] [Accepted: 04/11/2016] [Indexed: 11/14/2022] Open
Abstract
Analysis of intravascular optical coherence tomography (IVOCT) data has potential for real-time in vivo plaque classification. We developed a processing pipeline on a three-dimensional local region of support for estimation of optical properties of atherosclerotic plaques from coronary artery, IVOCT pullbacks. Using realistic coronary artery disease phantoms, we determined insignificant differences in mean and standard deviation estimates between our pullback analyses and more conventional processing of stationary acquisitions with frame averaging. There was no effect of tissue depth or oblique imaging on pullback parameter estimates. The method's performance was assessed in comparison with observer-defined standards using clinical pullback data. Values (calcium [Formula: see text], lipid [Formula: see text], and fibrous [Formula: see text]) were consistent with previous measurements obtained by other means. Using optical parameters ([Formula: see text], [Formula: see text], [Formula: see text]), we achieved feature space separation of plaque types and classification accuracy of [Formula: see text]. Despite the rapid [Formula: see text] motion and varying incidence angle in pullbacks, the proposed computational pipeline appears to work as well as a more standard "stationary" approach.
Collapse
Affiliation(s)
- Ronny Shalev
- Case Western Reserve University , Department of Electrical Engineering and Computer Science, Cleveland, Ohio 44106, United States
| | - Madhusudhana Gargesha
- Case Western Reserve University , Department of Biomedical Engineering, Cleveland, Ohio 44106, United States
| | - David Prabhu
- Case Western Reserve University , Department of Biomedical Engineering, Cleveland, Ohio 44106, United States
| | - Kentaro Tanaka
- University Hospitals Case Medical Center , Harrington Heart and Vascular Institute, Imaging Core Laboratory, Cleveland, Ohio 44106, United States
| | - Andrew M Rollins
- Case Western Reserve University , Department of Biomedical Engineering, Cleveland, Ohio 44106, United States
| | - Guy Lamouche
- National Research Council , 75, de Mortagne, Boucherville, Quebec J4B 6Y4, Canada
| | | | - Hiram G Bezerra
- University Hospitals Case Medical Center , Harrington Heart and Vascular Institute, Imaging Core Laboratory, Cleveland, Ohio 44106, United States
| | - Soumya Ray
- Case Western Reserve University , Department of Electrical Engineering and Computer Science, Cleveland, Ohio 44106, United States
| | - David L Wilson
- Case Western Reserve University, Department of Biomedical Engineering, Cleveland, Ohio 44106, United States; Case Western Reserve University, Department of Radiology, Cleveland, Ohio 44106, United States
| |
Collapse
|
26
|
Chen Q, de Sisternes L, Leng T, Rubin DL. Application of improved homogeneity similarity-based denoising in optical coherence tomography retinal images. J Digit Imaging 2016; 28:346-61. [PMID: 25404105 DOI: 10.1007/s10278-014-9742-8] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022] Open
Abstract
Image denoising is a fundamental preprocessing step of image processing in many applications developed for optical coherence tomography (OCT) retinal imaging--a high-resolution modality for evaluating disease in the eye. To make a homogeneity similarity-based image denoising method more suitable for OCT image removal, we improve it by considering the noise and retinal characteristics of OCT images in two respects: (1) median filtering preprocessing is used to make the noise distribution of OCT images more suitable for patch-based methods; (2) a rectangle neighborhood and region restriction are adopted to accommodate the horizontal stretching of retinal structures when observed in OCT images. As a performance measurement of the proposed technique, we tested the method on real and synthetic noisy retinal OCT images and compared the results with other well-known spatial denoising methods, including bilateral filtering, five partial differential equation (PDE)-based methods, and three patch-based methods. Our results indicate that our proposed method seems suitable for retinal OCT imaging denoising, and that, in general, patch-based methods can achieve better visual denoising results than point-based methods in this type of imaging, because the image patch can better represent the structured information in the images than a single pixel. However, the time complexity of the patch-based methods is substantially higher than that of the others.
Collapse
Affiliation(s)
- Qiang Chen
- Department of Radiology, Stanford University, Stanford, CA, 94305, USA,
| | | | | | | |
Collapse
|
27
|
Kang H, Darling CL, Fried D. Enhancement of OCT images with vinyl polysiloxane (VPS). PROCEEDINGS OF SPIE--THE INTERNATIONAL SOCIETY FOR OPTICAL ENGINEERING 2016; 9692. [PMID: 27011417 DOI: 10.1117/12.2218649] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/14/2022]
Abstract
Several studies have shown that optical coherence tomography (OCT) can be used to measure the remaining enamel thickness and detect the location of subsurface lesions hidden under the sound enamel. Moreover studies have shown that high refractive index liquids can be used to improve the visibility of subsurface lesions in OCT images. In this study, we demonstrate that vinyl polysiloxane (VPS) impression materials which are routinely used in dentistry can be used to enhance the detection of dentinal lesions on tooth occlusal surfaces. Lesion presence was confirmed with polarized light microscopy and microradiography.
Collapse
Affiliation(s)
- Hobin Kang
- University of California, San Francisco, San Francisco, CA 94143-0758
| | - Cynthia L Darling
- University of California, San Francisco, San Francisco, CA 94143-0758
| | - Daniel Fried
- University of California, San Francisco, San Francisco, CA 94143-0758
| |
Collapse
|
28
|
Kafieh R, Rabbani H, Selesnick I. Three dimensional data-driven multi scale atomic representation of optical coherence tomography. IEEE TRANSACTIONS ON MEDICAL IMAGING 2015; 34:1042-62. [PMID: 25934998 DOI: 10.1109/tmi.2014.2374354] [Citation(s) in RCA: 66] [Impact Index Per Article: 6.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/25/2023]
Abstract
In this paper, we discuss about applications of different methods for decomposing a signal over elementary waveforms chosen in a family called a dictionary (atomic representations) in optical coherence tomography (OCT). If the representation is learned from the data, a nonparametric dictionary is defined with three fundamental properties of being data-driven, applicability on 3D, and working in multi-scale, which make it appropriate for processing of OCT images. We discuss about application of such representations including complex wavelet based K-SVD, and diffusion wavelets on OCT data. We introduce complex wavelet based K-SVD to take advantage of adaptability in dictionary learning methods to improve the performance of simple dual tree complex wavelets in speckle reduction of OCT datasets in 2D and 3D. The algorithm is evaluated on 144 randomly selected slices from twelve 3D OCTs taken by Topcon 3D OCT-1000 and Cirrus Zeiss Meditec. Improvement of contrast to noise ratio (CNR) (from 0.9 to 11.91 and from 3.09 to 88.9, respectively) is achieved. Furthermore, two approaches are proposed for image segmentation using diffusion. The first method is designing a competition between extended basis functions at each level and the second approach is defining a new distance for each level and clustering based on such distances. A combined algorithm, based on these two methods is then proposed for segmentation of retinal OCTs, which is able to localize 12 boundaries with unsigned border positioning error of 9.22 ±3.05 μm, on a test set of 20 slices selected from 13 3D OCTs.
Collapse
|
29
|
Kang H, Darling CL, Tom H, Fried D. Enhanced detection of dentinal lesions in OCT images using the RKT transformation. PROCEEDINGS OF SPIE--THE INTERNATIONAL SOCIETY FOR OPTICAL ENGINEERING 2015; 9306. [PMID: 25914493 DOI: 10.1117/12.2083654] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/14/2022]
Abstract
Several studies have shown that optical coherence tomography (OCT) can be used to measure the remaining enamel thickness and detect the location of subsurface lesions hidden under the sound enamel. The purpose of this study was to develop algorithms to enhance the visibility of subsurface structures such as hidden occlusal lesions and the dentinal-enamel junction. Extracted teeth with natural occlusal lesions were imaged with OCT with and without added high index fluids. A Rotating Kernel Transformation (RKT) nonlinear image processing filter was applied to PS-OCT images to enhance the visibility of the subsurface lesions under the sound enamel. The filter significantly increased (P<0.05) the visibility of the subsurface lesions.
Collapse
Affiliation(s)
- Hobin Kang
- University of California, San Francisco, San Francisco, CA 94143-0758
| | - Cynthia L Darling
- University of California, San Francisco, San Francisco, CA 94143-0758
| | - Henry Tom
- University of California, San Francisco, San Francisco, CA 94143-0758
| | - Daniel Fried
- University of California, San Francisco, San Francisco, CA 94143-0758
| |
Collapse
|
30
|
Speckle reduction in optical coherence tomography by image registration and matrix completion. ACTA ACUST UNITED AC 2014; 17:162-9. [PMID: 25333114 DOI: 10.1007/978-3-319-10404-1_21] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/19/2023]
Abstract
Speckle noise is problematic in optical coherence tomography (OCT). With the fast scan rate, swept source OCT scans the same position in the retina for multiple times rapidly and computes an average image from the multiple scans for speckle reduction. However, the eye movement poses some challenges. In this paper, we propose a new method for speckle reduction from multiply-scanned OCT slices. The proposed method applies a preliminary speckle reduction on the OCT slices and then registers them using a global alignment followed by a local alignment based on fast iterative diamond search. After that, low rank matrix completion using bilateral random projection is utilized to iteratively estimate the noise and recover the underlying clean image. Experimental results show that the proposed method achieves average contrast to noise ratio 15.65, better than 13.78 by the baseline method used currently in swept source OCT devices. The technology can be embedded into current OCT machines to enhance the image quality for subsequent analysis.
Collapse
|
31
|
Adaptive-weighted bilateral filtering and other pre-processing techniques for optical coherence tomography. Comput Med Imaging Graph 2014; 38:526-39. [PMID: 25034317 DOI: 10.1016/j.compmedimag.2014.06.012] [Citation(s) in RCA: 39] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2013] [Revised: 05/16/2014] [Accepted: 06/13/2014] [Indexed: 11/20/2022]
Abstract
This paper presents novel pre-processing image enhancement algorithms for retinal optical coherence tomography (OCT). These images contain a large amount of speckle causing them to be grainy and of very low contrast. To make these images valuable for clinical interpretation, we propose a novel method to remove speckle, while preserving useful information contained in each retinal layer. The process starts with multi-scale despeckling based on a dual-tree complex wavelet transform (DT-CWT). We further enhance the OCT image through a smoothing process that uses a novel adaptive-weighted bilateral filter (AWBF). This offers the desirable property of preserving texture within the OCT image layers. The enhanced OCT image is then segmented to extract inner retinal layers that contain useful information for eye research. Our layer segmentation technique is also performed in the DT-CWT domain. Finally we describe an OCT/fundus image registration algorithm which is helpful when two modalities are used together for diagnosis and for information fusion.
Collapse
|
32
|
Wu S, Zhu Q, Xie Y. Evaluation of various speckle reduction filters on medical ultrasound images. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2014; 2013:1148-51. [PMID: 24109896 DOI: 10.1109/embc.2013.6609709] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
At present, ultrasound is one of the essential tools for noninvasive medical diagnosis. However, speckle noise is inherent in medical ultrasound images and it is the cause for decreased resolution and contrast-to-noise ratio. Low image quality is an obstacle for effective feature extraction, recognition, analysis, and edge detection; it also affects image interpretation by doctor and the accuracy of computer-assisted diagnostic techniques. Thus, speckle reduction is significant and critical step in pre-processing of ultrasound images. Many speckle reduction techniques have been studied by researchers, but to date there is no comprehensive method that takes all the constraints into consideration. In this paper we discuss seven filters, namely Lee, Frost, Median, Speckle Reduction Anisotropic Diffusion (SRAD), Perona-Malik's Anisotropic Diffusion (PMAD) filter, Speckle Reduction Bilateral Filter (SRBF) and Speckle Reduction filter based on soft thresholding in the Wavelet transform. A comparative study of these filters has been made in terms of preserving the features and edges as well as effectiveness of de-noising.We computed five established evaluation metrics in order to determine which despeckling algorithm is most effective and optimal for real-time implementation. In addition, the experimental results have been demonstrated by filtered images and statistical data table.
Collapse
|
33
|
Du Y, Liu G, Feng G, Chen Z. Speckle reduction in optical coherence tomography images based on wave atoms. JOURNAL OF BIOMEDICAL OPTICS 2014; 19:056009. [PMID: 24825507 PMCID: PMC4161005 DOI: 10.1117/1.jbo.19.5.056009] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/08/2013] [Accepted: 04/09/2014] [Indexed: 05/03/2023]
Abstract
Optical coherence tomography (OCT) is an emerging noninvasive imaging technique, which is based on low-coherence interferometry. OCT images suffer from speckle noise, which reduces image contrast. A shrinkage filter based on wave atoms transform is proposed for speckle reduction in OCT images. Wave atoms transform is a new multiscale geometric analysis tool that offers sparser expansion and better representation for images containing oscillatory patterns and textures than other traditional transforms, such as wavelet and curvelet transforms. Cycle spinning-based technology is introduced to avoid visual artifacts, such as Gibbs-like phenomenon, and to develop a translation invariant wave atoms denoising scheme. The speckle suppression degree in the denoised images is controlled by an adjustable parameter that determines the threshold in the wave atoms domain. The experimental results show that the proposed method can effectively remove the speckle noise and improve the OCT image quality. The signal-to-noise ratio, contrast-to-noise ratio, average equivalent number of looks, and cross-correlation (XCOR) values are obtained, and the results are also compared with the wavelet and curvelet thresholding techniques.
Collapse
Affiliation(s)
- Yongzhao Du
- University of California, Beckman Laser Institute, 1002 Health Sciences Road East, Irvine, California 92612
- Sichuan University, Department of Opto-Electronics, No.24 South Section 1st, Yihuan Road, Chengdu 610065, China
| | - Gangjun Liu
- University of California, Beckman Laser Institute, 1002 Health Sciences Road East, Irvine, California 92612
- University of California, Department of Biomedical Engineering, 3120 Natural Sciences II, Irvine, California 92697-2715
| | - Guoying Feng
- Sichuan University, Department of Opto-Electronics, No.24 South Section 1st, Yihuan Road, Chengdu 610065, China
| | - Zhongping Chen
- University of California, Beckman Laser Institute, 1002 Health Sciences Road East, Irvine, California 92612
- University of California, Department of Biomedical Engineering, 3120 Natural Sciences II, Irvine, California 92697-2715
- Address all correspondence to: Zhongping Chen, E-mail:
| |
Collapse
|
34
|
Shalev R, Gargesha M, Prabhu D, Tanaka K, Rollins AM, Costa M, Bezerra HG, Lamouche G, Wilson DL. Validation of parameter estimation methods for determining optical properties of atherosclerotic tissues in intravascular OCT. PROCEEDINGS OF SPIE--THE INTERNATIONAL SOCIETY FOR OPTICAL ENGINEERING 2014; 9037. [PMID: 29606785 DOI: 10.1117/12.2043654] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/14/2022]
Abstract
In this paper we present a new process for assessing optical properties of tissues from 3D pullbacks, the standard clinical acquisition method for iOCT data. Our method analyzes a volume of interest (VOI) consisting of about 100 A-lines spread across the angle of rotation (θ) and along the artery, z. The new 3D method uses catheter correction, baseline removal, speckle noise reduction, alignment of A-line sequences, and robust estimation. We compare results to those from a more standard, "gold standard" stationary acquisition where many image frames are averaged to reduce noise. To do these studies in a controlled fashion, we use a realistic optical artery phantom containing of multiple "tissue types." Precision and accuracy for 3D pullback analysis are reported. Our results indicate that when implementing the process on a stationary acquisition dataset, the uncertainty improves at each stage while the uncertainty is reduced. When comparing stationary acquisition dataset to pullback dataset, the values were as follows: calcium: 3.8±1.09mm-1 in stationary and 3.9±1.2 mm-1 in a pullback; lipid: 11.025±0.417 mm-1 in stationary and 11.27±0.25 mm-1 in pullback; fibrous: 6.08±1.337 mm-1 in stationary and 5.58±2.0 mm-1 . These results indicates that the process presented in this paper introduce minimal bias and only a small change in uncertainty when comparing a stationary and pullback dataset, thus paves the way to a highly accurate clinical plaque type discrimination, enabling automatic classification.
Collapse
Affiliation(s)
- Ronny Shalev
- Department of Biomedical Engineering, Case Western Reserve University, Cleveland, OH, 44106, USA
| | - Madhusudhana Gargesha
- Department of Biomedical Engineering, Case Western Reserve University, Cleveland, OH, 44106, USA
| | - David Prabhu
- Department of Biomedical Engineering, Case Western Reserve University, Cleveland, OH, 44106, USA
| | - Kentaro Tanaka
- Cardiovascular Imaging Core Laboratory, Harrington Heart & Vascular Institute, University Hospitals Case Medical Center, Cleveland, OH, 44106, USA
| | - Andrew M Rollins
- Department of Biomedical Engineering, Case Western Reserve University, Cleveland, OH, 44106, USA
| | - Marco Costa
- Cardiovascular Imaging Core Laboratory, Harrington Heart & Vascular Institute, University Hospitals Case Medical Center, Cleveland, OH, 44106, USA
| | - Hiram G Bezerra
- Cardiovascular Imaging Core Laboratory, Harrington Heart & Vascular Institute, University Hospitals Case Medical Center, Cleveland, OH, 44106, USA
| | - Guy Lamouche
- National Research Council, Boucherville, Quebec, Canada
| | - David L Wilson
- Department of Biomedical Engineering, Case Western Reserve University, Cleveland, OH, 44106, USA.,Department of Radiology, Case Western Reserve University, Cleveland, OH, 44106, USA
| |
Collapse
|
35
|
Pircher M, Zawadzki RJ. Combining adaptive optics with optical coherence tomography: unveiling the cellular structure of the human retinain vivo. EXPERT REVIEW OF OPHTHALMOLOGY 2014. [DOI: 10.1586/17469899.2.6.1019] [Citation(s) in RCA: 41] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/12/2023]
|
36
|
Cheng J, Duan L, Wong DWK, Akiba M, Liu J. Speckle reduction in optical coherence tomography by matrix completion using bilateral random projection. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2014; 2014:186-189. [PMID: 25569928 DOI: 10.1109/embc.2014.6943560] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/04/2023]
Abstract
Speckle noise is problematic in optical coherence tomography (OCT) and often obscures the structure details. In this paper, we propose a new method to reduce speckle noise from multiply scanned OCT slices. The proposed method registers the OCT scans using a global alignment followed by a local alignment based on global and local motion estimation. Then low rank matrix completion using bilateral random projection is utilized to estimate the noise and recover the clean image. Experimental results show that the proposed method archives average contrast to noise ratio 14.90, better than 13.78 by the state-of-the-art method used in current OCT machines. The technology can be embedded into current OCT machines to enhance the image quality.
Collapse
|
37
|
Rabbani H, Sonka M, Abramoff MD. Optical Coherence Tomography Noise Reduction Using Anisotropic Local Bivariate Gaussian Mixture Prior in 3D Complex Wavelet Domain. Int J Biomed Imaging 2013; 2013:417491. [PMID: 24222760 PMCID: PMC3810483 DOI: 10.1155/2013/417491] [Citation(s) in RCA: 20] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/07/2013] [Revised: 06/01/2013] [Accepted: 06/21/2013] [Indexed: 11/17/2022] Open
Abstract
In this paper, MMSE estimator is employed for noise-free 3D OCT data recovery in 3D complex wavelet domain. Since the proposed distribution for noise-free data plays a key role in the performance of MMSE estimator, a priori distribution for the pdf of noise-free 3D complex wavelet coefficients is proposed which is able to model the main statistical properties of wavelets. We model the coefficients with a mixture of two bivariate Gaussian pdfs with local parameters which are able to capture the heavy-tailed property and inter- and intrascale dependencies of coefficients. In addition, based on the special structure of OCT images, we use an anisotropic windowing procedure for local parameters estimation that results in visual quality improvement. On this base, several OCT despeckling algorithms are obtained based on using Gaussian/two-sided Rayleigh noise distribution and homomorphic/nonhomomorphic model. In order to evaluate the performance of the proposed algorithm, we use 156 selected ROIs from 650 × 512 × 128 OCT dataset in the presence of wet AMD pathology. Our simulations show that the best MMSE estimator using local bivariate mixture prior is for the nonhomomorphic model in the presence of Gaussian noise which results in an improvement of 7.8 ± 1.7 in CNR.
Collapse
Affiliation(s)
- Hossein Rabbani
- Biomedical Engineering Department, Medical Image & Signal Processing Research Center, Isfahan University of Medical Sciences, Isfahan 81745, Iran
- The Iowa Institute for Biomedical Imaging, The University of Iowa, Iowa City, IA 52242, USA
| | - Milan Sonka
- The Iowa Institute for Biomedical Imaging, The University of Iowa, Iowa City, IA 52242, USA
| | - Michael D. Abramoff
- The Iowa Institute for Biomedical Imaging, The University of Iowa, Iowa City, IA 52242, USA
| |
Collapse
|
38
|
Automatic lumen segmentation in IVOCT images using binary morphological reconstruction. Biomed Eng Online 2013; 12:78. [PMID: 23937790 PMCID: PMC3751056 DOI: 10.1186/1475-925x-12-78] [Citation(s) in RCA: 18] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/09/2013] [Accepted: 08/08/2013] [Indexed: 11/25/2022] Open
Abstract
Background Atherosclerosis causes millions of deaths, annually yielding billions in expenses round the world. Intravascular Optical Coherence Tomography (IVOCT) is a medical imaging modality, which displays high resolution images of coronary cross-section. Nonetheless, quantitative information can only be obtained with segmentation; consequently, more adequate diagnostics, therapies and interventions can be provided. Since it is a relatively new modality, many different segmentation methods, available in the literature for other modalities, could be successfully applied to IVOCT images, improving accuracies and uses. Method An automatic lumen segmentation approach, based on Wavelet Transform and Mathematical Morphology, is presented. The methodology is divided into three main parts. First, the preprocessing stage attenuates and enhances undesirable and important information, respectively. Second, in the feature extraction block, wavelet is associated with an adapted version of Otsu threshold; hence, tissue information is discriminated and binarized. Finally, binary morphological reconstruction improves the binary information and constructs the binary lumen object. Results The evaluation was carried out by segmenting 290 challenging images from human and pig coronaries, and rabbit iliac arteries; the outcomes were compared with the gold standards made by experts. The resultant accuracy was obtained: True Positive (%) = 99.29 ± 2.96, False Positive (%) = 3.69 ± 2.88, False Negative (%) = 0.71 ± 2.96, Max False Positive Distance (mm) = 0.1 ± 0.07, Max False Negative Distance (mm) = 0.06 ± 0.1. Conclusions In conclusion, by segmenting a number of IVOCT images with various features, the proposed technique showed to be robust and more accurate than published studies; in addition, the method is completely automatic, providing a new tool for IVOCT segmentation.
Collapse
|
39
|
Avanaki MRN, Laissue PP, Eom TJ, Podoleanu AG, Hojjatoleslami A. Speckle reduction using an artificial neural network algorithm. APPLIED OPTICS 2013; 52:5050-7. [PMID: 23872747 DOI: 10.1364/ao.52.005050] [Citation(s) in RCA: 18] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/01/2013] [Accepted: 06/14/2013] [Indexed: 05/21/2023]
Abstract
This paper presents an algorithm for reducing speckle noise from optical coherence tomography (OCT) images using an artificial neural network (ANN) algorithm. The noise is modeled using Rayleigh distribution with a noise parameter, sigma, estimated by the ANN. The input to the ANN is a set of intensity and wavelet features computed from the image to be processed, and the output is an estimated sigma value. This is then used along with a numerical method to solve the inverse Rayleigh function to reduce the noise in the image. The algorithm is tested successfully on OCT images of Drosophila larvae. It is demonstrated that the signal-to-noise ratio and the contrast-to-noise ratio of the processed images are increased by the application of the ANN algorithm in comparison with the respective values of the original images.
Collapse
Affiliation(s)
- Mohammad R N Avanaki
- Research and Development Centre, Kent Institute of Medicine and Health Sciences, University of Kent, Canterbury CT2 7PD, UK.
| | | | | | | | | |
Collapse
|
40
|
Wu W, Tan O, Pappuru RR, Duan H, Huang D. Assessment of frame-averaging algorithms in OCT image analysis. Ophthalmic Surg Lasers Imaging Retina 2013; 44:168-75. [PMID: 23510042 DOI: 10.3928/23258160-20130313-09] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2011] [Accepted: 11/14/2012] [Indexed: 11/20/2022]
Abstract
BACKGROUND AND OBJECTIVE To evaluate frame registration and averaging algorithms for optical coherence tomography. PATIENTS AND METHODS Twenty normal and 20 glaucomatous eyes were imaged. Objective differences were measured by comparing noise variance, spread of edge, and contrast-to-noise ratio. Subjective image quality was also evaluated. RESULTS Two frame-averaging algorithms (FA400 and FA407) had better noise variance and contrast-to-noise ratio but worse spread of edge than did single frames (P < .01). Both algorithms provided better subjective assessments of structure boundaries than did single images (P < .001). FA407 had significantly lower spread of edge and better internal limiting membrane visualization than FA400. CONCLUSION Frame averaging significantly suppressed speckle noise and increased the visibility of retinal structures, but imperfect image registration caused edge blurring that could be detected by the spread of edge parameter. In frame-averaging algorithms, higher contrast-to-noise ratio and lower noise variance indicated better noise suppression, but spread of edge was most sensitive in comparing edge preservation between algorithms.
Collapse
Affiliation(s)
- Wei Wu
- College of Biomedical Engineering & Instrument Science, Zhejiang University, the Key Laboratory of Biomedical Engineering, Ministry of Education, Hangzhou, Zhejiang, 310027, China
| | | | | | | | | |
Collapse
|
41
|
Automated drusen segmentation and quantification in SD-OCT images. Med Image Anal 2013; 17:1058-72. [PMID: 23880375 DOI: 10.1016/j.media.2013.06.003] [Citation(s) in RCA: 71] [Impact Index Per Article: 5.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2012] [Revised: 04/23/2013] [Accepted: 06/21/2013] [Indexed: 02/02/2023]
Abstract
Spectral domain optical coherence tomography (SD-OCT) is a useful tool for the visualization of drusen, a retinal abnormality seen in patients with age-related macular degeneration (AMD); however, objective assessment of drusen is thwarted by the lack of a method to robustly quantify these lesions on serial OCT images. Here, we describe an automatic drusen segmentation method for SD-OCT retinal images, which leverages a priori knowledge of normal retinal morphology and anatomical features. The highly reflective and locally connected pixels located below the retinal nerve fiber layer (RNFL) are used to generate a segmentation of the retinal pigment epithelium (RPE) layer. The observed and expected contours of the RPE layer are obtained by interpolating and fitting the shape of the segmented RPE layer, respectively. The areas located between the interpolated and fitted RPE shapes (which have nonzero area when drusen occurs) are marked as drusen. To enhance drusen quantification, we also developed a novel method of retinal projection to generate an en face retinal image based on the RPE extraction, which improves the quality of drusen visualization over the current approach to producing retinal projections from SD-OCT images based on a summed-voxel projection (SVP), and it provides a means of obtaining quantitative features of drusen in the en face projection. Visualization of the segmented drusen is refined through several post-processing steps, drusen detection to eliminate false positive detections on consecutive slices, drusen refinement on a projection view of drusen, and drusen smoothing. Experimental evaluation results demonstrate that our method is effective for drusen segmentation. In a preliminary analysis of the potential clinical utility of our methods, quantitative drusen measurements, such as area and volume, can be correlated with the drusen progression in non-exudative AMD, suggesting that our approach may produce useful quantitative imaging biomarkers to follow this disease and predict patient outcome.
Collapse
|
42
|
Guo Q, Dong F, Sun S, Lei B, Gao BZ. Image denoising algorithm based on contourlet transform for optical coherence tomography heart tube image. IET IMAGE PROCESSING 2013; 7:442-450. [PMID: 27087835 PMCID: PMC4833027 DOI: 10.1049/iet-ipr.2013.0127] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/05/2023]
Abstract
Optical coherence tomography (OCT) is becoming an increasingly important imaging technology in the Biomedical field. However, the application of OCT is limited by the ubiquitous noise. In this study, the noise of OCT heart tube image is first verified as being multiplicative based on the local statistics (i.e. the linear relationship between the mean and the standard deviation of certain flat area). The variance of the noise is evaluated in log-domain. Based on these, a joint probability density function is constructed to take the inter-direction dependency in the contourlet domain from the logarithmic transformed image into account. Then, a bivariate shrinkage function is derived to denoise the image by the maximum a posteriori estimation. Systemic comparative experiments are made to synthesis images, OCT heart tube images and other OCT tissue images by subjective assessment and objective metrics. The experiment results are analysed based on the denoising results and the predominance degree of the proposed algorithm with respect to the wavelet-based algorithm. The results show that the proposed algorithm improves the signal-to-noise ratio, whereas preserving the edges and has more advantages on the images containing multi-direction information like OCT heart tube image.
Collapse
Affiliation(s)
- Qing Guo
- Institute of Intelligent Vision and Image Information, China Three Gorges University, Yichang, Hubei 443002, People’s Republic of China
| | - Fangmin Dong
- Institute of Intelligent Vision and Image Information, China Three Gorges University, Yichang, Hubei 443002, People’s Republic of China
| | - Shuifa Sun
- Institute of Intelligent Vision and Image Information, China Three Gorges University, Yichang, Hubei 443002, People’s Republic of China
| | - Bangjun Lei
- Institute of Intelligent Vision and Image Information, China Three Gorges University, Yichang, Hubei 443002, People’s Republic of China
| | - Bruce Z. Gao
- Department of Bioengineering, Clemson University, Clemson, SC 29634, USA
| |
Collapse
|
43
|
Rodrigues P, Bernardes R. 3-D adaptive nonlinear complex-diffusion despeckling filter. IEEE TRANSACTIONS ON MEDICAL IMAGING 2012; 31:2205-2212. [PMID: 22875245 DOI: 10.1109/tmi.2012.2211609] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/01/2023]
Abstract
This work aims to improve the process of speckle noise reduction while preserving edges and other relevant features through filter expansion from 2-D to 3-D. Despeckling is very important for data visual inspection and as a preprocessing step for other algorithms, as they are usually notably influenced by speckle noise. To that intent, a 3-D approach is proposed for the adaptive complex-diffusion filter. This 3-D iterative filter was applied to spectral-domain optical coherence tomography medical imaging volumes of the human retina and a quantitative evaluation of the results was performed to allow a demonstration of the better performance of the 3-D over the 2-D filtering and to choose the best total diffusion time. In addition, we propose a fast graphical processing unit parallel implementation so that the filter can be used in a clinical setting.
Collapse
Affiliation(s)
- Pedro Rodrigues
- Centre of New Technologies for Medicine, Association for Innovation and Biomedical Research on Light and Image, 3000-548 Coimbra, Portugal.
| | | |
Collapse
|
44
|
Cheng KHY, Lam EY, Standish BA, Yang VXD. Speckle reduction of endovascular optical coherence tomography using a generalized divergence measure. OPTICS LETTERS 2012; 37:2871-2873. [PMID: 22825162 DOI: 10.1364/ol.37.002871] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/01/2023]
Abstract
Endovascular optical coherence tomography (EV-OCT) is an emerging intravascular imaging technique for observing blood vessel walls. Fluctuating speckle noise, especially during rapid pull-back, can severely degrade the visibility of morphological structures. Moreover, the speckle pattern varies in different parts of the image due to beam divergence and is further complicated by interpolation through the coordinate transformation necessary for displaying the rotary scanning images, challenging the use of frequency domain analysis. In this study, a computationally efficient method using a generalized divergence regularization procedure is presented to suppress speckle noise in EV-OCT images. Results show substantial smoothing of the grainy appearance and enhanced visualization of deeper structures as demonstrated in porcine carotid arteries.
Collapse
Affiliation(s)
- Kyle H Y Cheng
- Biophotonics and Bioengineering Laboratory, Ryerson University, 350 Victoria Street, Toronto, Ontario M5B 2K3, Canada
| | | | | | | |
Collapse
|
45
|
Szkulmowski M, Gorczynska I, Szlag D, Sylwestrzak M, Kowalczyk A, Wojtkowski M. Efficient reduction of speckle noise in Optical Coherence Tomography. OPTICS EXPRESS 2012; 20:1337-59. [PMID: 22274479 DOI: 10.1364/oe.20.001337] [Citation(s) in RCA: 91] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/19/2023]
Abstract
Speckle pattern, which is inherent in coherence imaging, influences significantly axial and transversal resolution of Optical Coherence Tomography (OCT) instruments. The well known speckle removal techniques are either sensitive to sample motion, require sophisticated and expensive sample tracking systems, or involve sophisticated numerical procedures. As a result, their applicability to in vivo real-time imaging is limited. In this work, we propose to average multiple A-scans collected in a fully controlled way to reduce the speckle contrast. This procedure involves non-coherent averaging of OCT A-scans acquired from adjacent locations on the sample. The technique exploits scanning protocol with fast beam deflection in the direction perpendicular to lateral dimension of the cross-sectional image. Such scanning protocol reduces the time interval between A-scans to be averaged to the repetition time of the acquisition system. Consequently, the averaging algorithm is immune to bulk motion of an investigated sample, does not require any sophisticated data processing to align cross-sectional images, and allows for precise control of lateral shift of the scanning beam on the object. The technique is tested with standard Spectral OCT system with an extra resonant scanner used for rapid beam deflection in the lateral direction. Ultrahigh speed CMOS camera serves as a detector and acquires 200,000 spectra per second. A dedicated A-scan generation algorithm allows for real-time display of images with reduced speckle contrast at 6 frames/second. This technique is applied to in vivo imaging of anterior and posterior segments of the human eye and human skin.
Collapse
|
46
|
Guo Q, Sun S, Dong F, Gao BZ, Wang R. OPTICAL COHERENCE TOMOGRAPHY HEART TUBE IMAGE DENOISING BASED ON CONTOURLET TRANSFORM. PROCEEDINGS. INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS 2012; 3:1139-1144. [PMID: 25364626 DOI: 10.1109/icmlc.2012.6359515] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Optical Coherence Tomography(OCT) gradually becomes a very important imaging technology in the Biomedical field for its noninvasive, nondestructive and real-time properties. However, the interpretation and application of the OCT images are limited by the ubiquitous noise. In this paper, a denoising algorithm based on contourlet transform for the OCT heart tube image is proposed. A bivariate function is constructed to model the joint probability density function (pdf) of the coefficient and its cousin in contourlet domain. A bivariate shrinkage function is deduced to denoise the image by the maximum a posteriori (MAP) estimation. Three metrics, signal-to-noise ratio (SNR), contrast-to-noise ratio (CNR) and equivalent number of look (ENL), are used to evaluate the denoised image using the proposed algorithm. The results show that the signal-to-noise ratio is improved while the edges of object are preserved by the proposed algorithm. Systemic comparisons with other conventional algorithms, such as mean filter, median filter, RKT filter, Lee filter, as well as bivariate shrinkage function for wavelet-based algorithm are conducted. The advantage of the proposed algorithm over these methods is illustrated.
Collapse
Affiliation(s)
- Qing Guo
- Institute of Intelligent Vision and Image Information, China Three Gorges University, Yichang, Hubei 443002 China
| | - Shuifa Sun
- Institute of Intelligent Vision and Image Information, China Three Gorges University, Yichang, Hubei 443002 China
| | - Fangmin Dong
- Institute of Intelligent Vision and Image Information, China Three Gorges University, Yichang, Hubei 443002 China
| | - Bruce Z Gao
- Department of Bioengineering, Clemson University, Clemson, SC, 29635, USA
| | - Rui Wang
- Department of Bioengineering, Clemson University, Clemson, SC, 29635, USA
| |
Collapse
|
47
|
Marschall S, Sander B, Mogensen M, Jørgensen TM, Andersen PE. Optical coherence tomography-current technology and applications in clinical and biomedical research. Anal Bioanal Chem 2011; 400:2699-720. [PMID: 21547430 DOI: 10.1007/s00216-011-5008-1] [Citation(s) in RCA: 52] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2010] [Revised: 03/25/2011] [Accepted: 04/08/2011] [Indexed: 12/21/2022]
Abstract
Optical coherence tomography (OCT) is a noninvasive imaging technique that provides real-time two- and three-dimensional images of scattering samples with micrometer resolution. By mapping the local reflectivity, OCT visualizes the morphology of the sample. In addition, functional properties such as birefringence, motion, or the distributions of certain substances can be detected with high spatial resolution. Its main field of application is biomedical imaging and diagnostics. In ophthalmology, OCT is accepted as a clinical standard for diagnosing and monitoring the treatment of a number of retinal diseases, and OCT is becoming an important instrument for clinical cardiology. New applications are emerging in various medical fields, such as early-stage cancer detection, surgical guidance, and the early diagnosis of musculoskeletal diseases. OCT has also proven its value as a tool for developmental biology. The number of companies involved in manufacturing OCT systems has increased substantially during the last few years (especially due to its success in opthalmology), and this technology can be expected to continue to spread into various fields of application.
Collapse
Affiliation(s)
- Sebastian Marschall
- DTU Fotonik, Department of Photonics Engineering, Technical University of Denmark, Roskilde, Denmark
| | | | | | | | | |
Collapse
|
48
|
Bernardes R, Maduro C, Serranho P, Araújo A, Barbeiro S, Cunha-Vaz J. Improved adaptive complex diffusion despeckling filter. OPTICS EXPRESS 2010; 18:24048-59. [PMID: 21164752 DOI: 10.1364/oe.18.024048] [Citation(s) in RCA: 68] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/20/2023]
Abstract
Despeckling optical coherence tomograms from the human retina is a fundamental step to a better diagnosis or as a preprocessing stage for retinal layer segmentation. Both of these applications are particularly important in monitoring the progression of retinal disorders. In this study we propose a new formulation for a well-known nonlinear complex diffusion filter. A regularization factor is now made to be dependent on data, and the process itself is now an adaptive one. Experimental results making use of synthetic data show the good performance of the proposed formulation by achieving better quantitative results and increasing computation speed.
Collapse
Affiliation(s)
- Rui Bernardes
- Center of New Technologies for Medicine, Association for Innovation and Biomedical Research on Light and Image, Pólo III, Azinhaga Sta. Comba, 3000-548 Coimbra, Portugal.
| | | | | | | | | | | |
Collapse
|
49
|
Wong A, Mishra A, Bizheva K, Clausi DA. General Bayesian estimation for speckle noise reduction in optical coherence tomography retinal imagery. OPTICS EXPRESS 2010; 18:8338-52. [PMID: 20588679 DOI: 10.1364/oe.18.008338] [Citation(s) in RCA: 88] [Impact Index Per Article: 5.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/20/2023]
Abstract
An important image post-processing step for optical coherence tomography (OCT) images is speckle noise reduction. Noise in OCT images is multiplicative in nature and is difficult to suppress due to the fact that in addition the noise component, OCT speckle also carries structural information about the imaged object. To address this issue, a novel speckle noise reduction algorithm was developed. The algorithm projects the imaging data into the logarithmic space and a general Bayesian least squares estimate of the noise-free data is found using a conditional posterior sampling approach. The proposed algorithm was tested on a number of rodent (rat) retina images acquired in-vivo with an ultrahigh resolution OCT system. The performance of the algorithm was compared to that of the state-of-the-art algorithms currently available for speckle denoising, such as the adaptive median, maximum a posteriori (MAP) estimation, linear least squares estimation, anisotropic diffusion and wavelet-domain filtering methods. Experimental results show that the proposed approach is capable of achieving state-of-the-art performance when compared to the other tested methods in terms of signal-to-noise ratio (SNR), contrast-to-noise ratio (CNR), edge preservation, and equivalent number of looks (ENL) measures. Visual comparisons also show that the proposed approach provides effective speckle noise suppression while preserving the sharpness and improving the visibility of morphological details, such as tiny capillaries and thin layers in the rat retina OCT images.
Collapse
Affiliation(s)
- Alexander Wong
- Dept. of Systems Design Engineering, University of Waterloo, Waterloo, ON N2L3G1, Canada.
| | | | | | | |
Collapse
|
50
|
van Soest G, Goderie T, Regar E, Koljenović S, van Leenders GLJH, Gonzalo N, van Noorden S, Okamura T, Bouma BE, Tearney GJ, Oosterhuis JW, Serruys PW, van der Steen AFW. Atherosclerotic tissue characterization in vivo by optical coherence tomography attenuation imaging. JOURNAL OF BIOMEDICAL OPTICS 2010; 15:011105. [PMID: 20210431 DOI: 10.1117/1.3280271] [Citation(s) in RCA: 163] [Impact Index Per Article: 10.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/18/2023]
Abstract
Optical coherence tomography (OCT) is rapidly becoming the method of choice for assessing arterial wall pathology in vivo. Atherosclerotic plaques can be diagnosed with high accuracy, including measurement of the thickness of fibrous caps, enabling an assessment of the risk of rupture. While the OCT image presents morphological information in highly resolved detail, it relies on interpretation of the images by trained readers for the identification of vessel wall components and tissue type. We present a framework to enable systematic and automatic classification of atherosclerotic plaque constituents, based on the optical attenuation coefficient mu(t) of the tissue. OCT images of 65 coronary artery segments in vitro, obtained from 14 vessels harvested at autopsy, are analyzed and correlated with histology. Vessel wall components can be distinguished based on their optical properties: necrotic core and macrophage infiltration exhibit strong attenuation, mu(t)>or=10 mm(-1), while calcific and fibrous tissue have a lower mu(t) approximately 2-5mm(-1). The algorithm is successfully applied to OCT patient data, demonstrating that the analysis can be used in a clinical setting and assist diagnostics of vessel wall pathology.
Collapse
Affiliation(s)
- Gijs van Soest
- Erasmus Medical Center, Thorax Center, Rotterdam, The Netherlands.
| | | | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|