1
|
Soans RS, Smith BE, Chung STL. Unifying Structure and Function Towards a Comprehensive Macular Evaluation in Eye Disorders: A Multi-Modal Approach Using Microperimetry and Optical Coherence Tomography. IEEE Trans Biomed Eng 2025; 72:1572-1584. [PMID: 40030438 DOI: 10.1109/tbme.2024.3513234] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/05/2025]
Abstract
OBJECTIVE We present a new automatic and comprehensive framework to evaluate retinal sub-layer thickness and visual sensitivity at precise retinal locations through multi-modal registration of confocal scanning laser ophthalmoscope (cSLO) images obtained separately from an optical coherence tomography (OCT) device and a microperimeter. METHODS We map consecutive B-scans onto the cSLO images after accounting for eye motion. Next, we coarsely register the SLO-microperimetry and cSLO-OCT images using SIFT, followed by precise elastic image registration. Subsequently, we ensure the quality of the co-registered images through single-particle and object tracking of the warped microperimetry test locations. Finally, the retinal thickness is queried from the segmented retinal layers in the co-registered space. A manual mode involving projective transformation accounting for perspective distortions in the images arising from the two modalities is also included. RESULTS Validation using retinal images of 8 adults with albinism, 16 adults with amblyopia, 3 adults with macular diseases, and 15 visually healthy adults showed results with excellent reliability. CONCLUSION The proposed framework enables the evaluation of retinal thickness by utilizing precise structural and functional relationships of the eye through a self-assessing multi-tiered approach. SIGNIFICANCE Our framework lays the foundation towards a comprehensive structure-function assessment of the macular region in various eye disorders.
Collapse
|
2
|
Pan H, Lim CW, King K, Guan R, Draelos M. Active Motion Cancellation for Robotic Optical Coherence Tomography of Moving Eyes: A Nystagmus Phantom Study. ... INTERNATIONAL SYMPOSIUM ON MEDICAL ROBOTICS. INTERNATIONAL SYMPOSIUM ON MEDICAL ROBOTICS 2024; 2024:10.1109/ismr63436.2024.10585590. [PMID: 40308375 PMCID: PMC12040409 DOI: 10.1109/ismr63436.2024.10585590] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/02/2025]
Abstract
Optical coherence tomography (OCT) is a preferred imaging technology in ophthalmology for diagnosis and management of eye disease. Standard-of-care clinical OCT systems require patients to sit upright, brace their head against the instrument, and fix their gaze into its sensing aperture. These limitations exclude those with involuntary head and eye movements, such as those present in Parkinson's disease and nystagmus, respectively, from undergoing OCT imaging. To overcome these restrictions, we combine our robotic OCT paradigm, which allows flexible patient positioning during imaging, with active cancellation of periodic motion to reduce image artifact during acquisition. We accomplish this by measuring eye motion with on-board pupil cameras, fitting the movement profile in real-time, and augmenting OCT scan waveforms using the predicted eye position. We evaluate this predictive imaging scheme with eye phantoms to precisely simulate motions typical of head and eye movement disorders and compare it to real-time scan aiming. Using registration shift in captured OCT images to quantify residual motion artifact, we demonstrate motion reduction by up to 98.5 % for typical nystagmus frequencies and an average 3.4 × reduction in residual motion compared to scan aiming alone. This approach may provide access to accurate OCT imaging for those with involuntary eye and head movement.
Collapse
Affiliation(s)
- Haochi Pan
- Department of Robotics, University of Michigan, 2505 Hayward St, Ann Arbor, MI USA
| | - Chae Woo Lim
- Department of Robotics, University of Michigan, 2505 Hayward St, Ann Arbor, MI USA
| | - Katelyn King
- Department of Robotics, University of Michigan, 2505 Hayward St, Ann Arbor, MI USA
| | - Renxiang Guan
- Department of Robotics, University of Michigan, 2505 Hayward St, Ann Arbor, MI USA
| | - Mark Draelos
- Department of Robotics, University of Michigan, 2505 Hayward St, Ann Arbor, MI USA
- Department of Ophthalmology and Visual Sciences, University of Michigan Medical School, 1000 Wall Street, Ann Arbor, MI USA
| |
Collapse
|
3
|
Shen J, Chen Z, Peng Y, Zhang S, Xu C, Zhu W, Liu H, Chen X. Morphological prognosis prediction of choroid neovascularization from longitudinal SD-OCT images. Med Phys 2023; 50:4839-4853. [PMID: 36789971 DOI: 10.1002/mp.16294] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2022] [Revised: 01/09/2023] [Accepted: 01/31/2023] [Indexed: 02/16/2023] Open
Abstract
BACKGROUND Choroid neovascularization (CNV) has no obvious symptoms in the early stage, but with its gradual expansion, leakage, rupture, and bleeding, it can cause vision loss and central scotoma. In some severe cases, it will lead to permanent visual impairment. PURPOSE Accurate prediction of disease progression can greatly help ophthalmologists to formulate appropriate treatment plans and prevent further deterioration of the disease. Therefore, we aim to predict the growth trend of CNV to help the attending physician judge the effectiveness of treatment. METHODS In this paper, we develop a CNN-based method for CNV growth prediction. To achieve this, we first design a registration network to rigidly register the spectral domain optical coherence tomography (SD-OCT) B-scans of each subject at different time points to eliminate retinal displacements of longitudinal data. Then, considering the correlation of longitudinal data, we propose a co-segmentation network with a correlation attention guidance (CAG) module to cooperatively segment CNV lesions of a group of follow-up images and use them as input for growth prediction. Finally, based on the above registration and segmentation networks, an encoder-recurrent-decoder framework is developed for CNV growth prediction, in which an attention-based gated recurrent unit (AGRU) is embedded as the recurrent neural network to recurrently learn robust representations. RESULTS The registration network rigidly registers the follow-up images of patients to the reference images with a root mean square error (RMSE) of 6.754 pixels. And compared with other state-of-the-art segmentation methods, the proposed segmentation network achieves high performance with the Dice similarity coefficients (Dsc) of 85.27%. Based on the above experiments, the proposed growth prediction network can play a role in predicting the future CNV morphology, and the predicted CNV has a Dsc of 83.69% with the ground truth, which is significantly consistent with the actual follow-up visit. CONCLUSION The proposed registration and segmentation networks provide the possibility for growth prediction. In addition, accurately predicting the growth of CNV enables us to know the efficacy of the drug against individuals in advance, creating opportunities for formulating appropriate treatment plans.
Collapse
Affiliation(s)
- Jiayan Shen
- MIPAV Lab, School of Electronics and Information Engineering, Soochow University, Suzhou, Jiangsu Province, China
| | - Zhongyue Chen
- MIPAV Lab, School of Electronics and Information Engineering, Soochow University, Suzhou, Jiangsu Province, China
| | - Yuanyuan Peng
- MIPAV Lab, School of Electronics and Information Engineering, Soochow University, Suzhou, Jiangsu Province, China
| | - Siqi Zhang
- Key Laboratory of Ocular Fundus Diseases, Shanghai General Hospital, Shanghai, China
| | - Chenan Xu
- MIPAV Lab, School of Electronics and Information Engineering, Soochow University, Suzhou, Jiangsu Province, China
| | - Weifang Zhu
- MIPAV Lab, School of Electronics and Information Engineering, Soochow University, Suzhou, Jiangsu Province, China
| | - Haiyun Liu
- Key Laboratory of Ocular Fundus Diseases, Shanghai General Hospital, Shanghai, China
| | - Xinjian Chen
- MIPAV Lab, School of Electronics and Information Engineering, Soochow University, Suzhou, Jiangsu Province, China
- State Key Laboratory of Radiation Medicine and Protection, Soochow University, Suzhou, China
| |
Collapse
|
4
|
Mozaffari S, Feroldi F, LaRocca F, Tiruveedhula P, Gregory PD, Park BH, Roorda A. Retinal imaging using adaptive optics optical coherence tomography with fast and accurate real-time tracking. BIOMEDICAL OPTICS EXPRESS 2022; 13:5909-5925. [PMID: 36733754 PMCID: PMC9872892 DOI: 10.1364/boe.467634] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/15/2022] [Revised: 08/11/2022] [Accepted: 10/04/2022] [Indexed: 05/02/2023]
Abstract
One of the main obstacles in high-resolution 3-D retinal imaging is eye motion, which causes blur and distortion artifacts that require extensive post-processing to be corrected. Here, an adaptive optics optical coherence tomography (AOOCT) system with real-time active eye motion correction is presented. Correction of ocular aberrations and of retinal motion is provided by an adaptive optics scanning laser ophthalmoscope (AOSLO) that is optically and electronically combined with the AOOCT system. We describe the system design and quantify its performance. The AOOCT system features an independent focus adjustment that allows focusing on different retinal layers while maintaining the AOSLO focus on the photoreceptor mosaic for high fidelity active motion correction. The use of a high-quality reference frame for eye tracking increases revisitation accuracy between successive imaging sessions, allowing to collect several volumes from the same area. This system enables spatially targeted retinal imaging as well as volume averaging over multiple imaging sessions with minimal correction of motion in post processing.
Collapse
Affiliation(s)
- Sanam Mozaffari
- Herbert Wertheim School of Optometry and Vision Science, University of California, Berkeley, Berkeley, CA 94720, USA
| | - Fabio Feroldi
- Herbert Wertheim School of Optometry and Vision Science, University of California, Berkeley, Berkeley, CA 94720, USA
| | - Francesco LaRocca
- Herbert Wertheim School of Optometry and Vision Science, University of California, Berkeley, Berkeley, CA 94720, USA
| | - Pavan Tiruveedhula
- Herbert Wertheim School of Optometry and Vision Science, University of California, Berkeley, Berkeley, CA 94720, USA
| | - Patrick D. Gregory
- Department of Bioengineering, University of California, Riverside, CA 92521, USA
| | - B. Hyle Park
- Department of Bioengineering, University of California, Riverside, CA 92521, USA
| | - Austin Roorda
- Herbert Wertheim School of Optometry and Vision Science, University of California, Berkeley, Berkeley, CA 94720, USA
| |
Collapse
|
5
|
Strenge P, Lange B, Grill C, Draxinger W, Danicke V, Theisen-Kunde D, Hagel C, Spahr-Hess S, Bonsanto MM, Huber R, Handels H, Brinkmann R. Registration of histological brain images onto optical coherence tomography images based on shape information. Phys Med Biol 2022; 67. [PMID: 35523170 DOI: 10.1088/1361-6560/ac6d9d] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2022] [Accepted: 05/06/2022] [Indexed: 11/12/2022]
Abstract
Identifying tumour infiltration zones during tumour resection in order to excise as much tumour tissue as possible without damaging healthy brain tissue is still a major challenge in neurosurgery. The detection of tumour infiltrated regions so far requires histological analysis of biopsies taken from at expected tumour boundaries. The gold standard for histological analysis is the staining of thin cut specimen and the evaluation by a neuropathologist. This work presents a way to transfer the histological evaluation of a neuropathologist onto optical coherence tomography (OCT) images. OCT is a method suitable for real timein vivoimaging during neurosurgery however the images require processing for the tumour detection. The method demonstrated here enables the creation of a dataset which will be used for supervised learning in order to provide a better visualization of tumour infiltrated areas for the neurosurgeon. The created dataset contains labelled OCT images from two different OCT-systems (wavelength of 930 nm and 1300 nm). OCT images corresponding to the stained histological images were determined by shaping the sample, a controlled cutting process and a rigid transformation process between the OCT volumes based on their topological information. The histological labels were transferred onto the corresponding OCT images through a non-rigid transformation based on shape context features retrieved from the sample outline in the histological image and the OCT image. The accuracy of the registration was determined to be 200 ± 120μm. The resulting dataset consists of 1248 labelled OCT images for each of the two OCT systems.
Collapse
Affiliation(s)
| | | | - Christin Grill
- Institute of Biomedical Optics, University of Luebeck, Luebeck, Germany
| | | | | | | | - Christian Hagel
- Institute for Neuropathology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Sonja Spahr-Hess
- Department of Neurosurgery, University Medical Center Schleswig-Holstein, Luebeck, Germany
| | - Matteo M Bonsanto
- Department of Neurosurgery, University Medical Center Schleswig-Holstein, Luebeck, Germany
| | - Robert Huber
- Institute of Biomedical Optics, University of Luebeck, Luebeck, Germany
| | - Heinz Handels
- Institute of Medical Informatics, University of Luebeck, Luebeck, Germany
| | - Ralf Brinkmann
- Medical Laser Center Luebeck, Luebeck, Germany.,Institute of Biomedical Optics, University of Luebeck, Luebeck, Germany
| |
Collapse
|
6
|
La Bruna S, Rai A, Mao G, Kerr J, Amin H, Zemborain ZZ, Leshno A, Tsamis E, De Moraes CG, Hood DC. The OCT RNFL Probability Map and Artifacts Resembling Glaucomatous Damage. Transl Vis Sci Technol 2022; 11:18. [PMID: 35289836 PMCID: PMC8934545 DOI: 10.1167/tvst.11.3.18] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2021] [Accepted: 02/24/2022] [Indexed: 11/24/2022] Open
Abstract
Purpose The purpose of this study was to improve the diagnostic ability of the optical coherence tomography (OCT) retinal nerve fiber layer (RNFL) probability (p-) map by understanding the frequency and pattern of artifacts seen on the p-maps of healthy control (HC) eyes resembling glaucomatous damage. Methods RNFL p-maps were generated from wide-field OCT cube scans of 2 groups of HC eyes, 200 from a commercial normative group (HC-norm) and 54 from a prospective study group, as well as from 62 patient eyes, which included 32 with early glaucoma (EG). These 32 EG eyes had 24-2 mean deviation (MD) better than -6 dB and perimetric glaucoma as defined by 24-2 and 10-2 criteria. For the HC groups, "glaucoma-like" arcuates were defined as any red region near the temporal half of the disc. Results Seven percent of the 200 HC-norm and 11% of the 54 HC RNFL p-maps satisfied the definition of "glaucoma-like," as did all the patients' p-maps. The HC p-maps showed two general patterns of abnormal regions, "arcuate" and "temporal quadrant," and these patterns resembled those seen on some of the RNFL p-maps of the EG eyes. A "vertical midline" rule, which required the abnormal region to cross the vertical midline through the fovea, had a specificity of >99%, and a sensitivity of 75% for EG and 93% for moderate to advanced eyes. Conclusions Glaucoma-like artifacts on RNFL p-maps are relatively common and can masquerade as arcuate and/or widespread/temporal damage. Translational Relevance A vertical midline rule had excellent specificity. However, other OCT information is necessary to obtain high sensitivity, especially in eyes with early glaucoma.
Collapse
Affiliation(s)
- Sol La Bruna
- Department of Psychology, Columbia University, New York, NY, USA
| | - Anvit Rai
- Department of Psychology, Columbia University, New York, NY, USA
- Albert Einstein College of Medicine, New York, NY, USA
| | - Grace Mao
- Department of Psychology, Columbia University, New York, NY, USA
| | - Jennifer Kerr
- Department of Psychology, Columbia University, New York, NY, USA
| | - Heer Amin
- Department of Psychology, Columbia University, New York, NY, USA
- Vagelos College of Physicians and Surgeons, New York, NY, USA
| | - Zane Z. Zemborain
- Department of Psychology, Columbia University, New York, NY, USA
- Department of Biomedical Engineering, Duke University, Durham, NC, USA
| | - Ari Leshno
- Bernard and Shirlee Brown Glaucoma Research Laboratory, Department of Ophthalmology, Columbia University Irving Medical Center, New York, NY, USA
- Sackler Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel
| | - Emmanouil Tsamis
- Department of Psychology, Columbia University, New York, NY, USA
| | - Carlos Gustavo De Moraes
- Bernard and Shirlee Brown Glaucoma Research Laboratory, Department of Ophthalmology, Columbia University Irving Medical Center, New York, NY, USA
| | - Donald C. Hood
- Department of Psychology, Columbia University, New York, NY, USA
- Bernard and Shirlee Brown Glaucoma Research Laboratory, Department of Ophthalmology, Columbia University Irving Medical Center, New York, NY, USA
| |
Collapse
|
7
|
Ortiz P, Draelos M, Viehland C, Qian R, McNabb RP, Kuo AN, Izatt JA. Robotically aligned optical coherence tomography with 5 degree of freedom eye tracking for subject motion and gaze compensation. BIOMEDICAL OPTICS EXPRESS 2021; 12:7361-7376. [PMID: 35003839 PMCID: PMC8713666 DOI: 10.1364/boe.443537] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/16/2021] [Revised: 10/21/2021] [Accepted: 10/26/2021] [Indexed: 05/04/2023]
Abstract
Optical coherence tomography (OCT) has revolutionized diagnostics in ophthalmology. However, OCT requires a trained operator and patient cooperation to carefully align a scanner with the subject's eye and orient it in such a way that it images a desired region of interest at the retina. With the goal of automating this process of orienting and aligning the scanner, we developed a robot-mounted OCT scanner that automatically aligned with the pupil while matching its optical axis with the target region of interest at the retina. The system used two 3D cameras for face tracking and three high-resolution 2D cameras for pupil and gaze tracking. The tracking software identified 5 degrees of freedom for robot alignment and ray aiming through the ocular pupil: 3 degrees of translation (x, y, z) and 2 degrees of orientation (yaw, pitch). We evaluated the accuracy, precision, and range of our tracking system and demonstrated imaging performance on free-standing human subjects. Our results demonstrate that the system stabilized images and that the addition of gaze tracking and aiming allowed for region-of-interest specific alignment at any gaze orientation within a 28° range.
Collapse
Affiliation(s)
- Pablo Ortiz
- Department of Biomedical Engineering,
Duke University, Durham, NC 27708, USA
| | - Mark Draelos
- Department of Biomedical Engineering,
Duke University, Durham, NC 27708, USA
| | - Christian Viehland
- Department of Biomedical Engineering,
Duke University, Durham, NC 27708, USA
| | - Ruobing Qian
- Department of Biomedical Engineering,
Duke University, Durham, NC 27708, USA
| | - Ryan P. McNabb
- Department of Ophthalmology,
Duke University, Durham, NC 27708, USA
| | - Anthony N. Kuo
- Department of Biomedical Engineering,
Duke University, Durham, NC 27708, USA
- Department of Ophthalmology,
Duke University, Durham, NC 27708, USA
| | - Joseph A. Izatt
- Department of Biomedical Engineering,
Duke University, Durham, NC 27708, USA
- Department of Ophthalmology,
Duke University, Durham, NC 27708, USA
| |
Collapse
|
8
|
Contactless optical coherence tomography of the eyes of freestanding individuals with a robotic scanner. Nat Biomed Eng 2021; 5:726-736. [PMID: 34253888 PMCID: PMC9272353 DOI: 10.1038/s41551-021-00753-6] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/06/2020] [Accepted: 05/21/2021] [Indexed: 02/02/2023]
Abstract
Clinical systems for optical coherence tomography (OCT) are used routinely to diagnose and monitor patients with a range of ocular diseases. They are large tabletop instruments operated by trained staff, and require mechanical stabilization of the head of the patient for positioning and motion reduction. Here we report the development and performance of a robot-mounted OCT scanner for the autonomous contactless imaging, at safe distances, of the eyes of freestanding individuals without the need for operator intervention or head stabilization. The scanner uses robotic positioning to align itself with the eye to be imaged, as well as optical active scanning to locate the pupil and to attenuate physiological eye motion. We show that the scanner enables the acquisition of OCT volumetric datasets, comparable in quality to those of clinical tabletop systems, that resolve key anatomic structures relevant for the management of common eye conditions. Robotic OCT scanners may enable the diagnosis and monitoring of patients with eye conditions in non-specialist clinics.
Collapse
|
9
|
Ploner SB, Kraus MF, Moult EM, Husvogt L, Schottenhamml J, Yasin Alibhai A, Waheed NK, Duker JS, Fujimoto JG, Maier AK. Efficient and high accuracy 3-D OCT angiography motion correction in pathology. BIOMEDICAL OPTICS EXPRESS 2021; 12:125-146. [PMID: 33520381 PMCID: PMC7818965 DOI: 10.1364/boe.411117] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/29/2020] [Revised: 11/12/2020] [Accepted: 11/13/2020] [Indexed: 05/27/2023]
Abstract
We describe a novel method for non-rigid 3-D motion correction of orthogonally raster-scanned optical coherence tomography angiography volumes. This is the first approach that aligns predominantly axial structural features such as retinal layers as well as transverse angiographic vascular features in a joint optimization. Combined with orthogonal scanning and favorization of kinematically more plausible displacements, subpixel alignment and micrometer-scale distortion correction is achieved in all 3 dimensions. As no specific structures are segmented, the method is by design robust to pathologic changes. Furthermore, the method is designed for highly parallel implementation and short runtime, allowing its integration into clinical workflow even for high density or wide-field scans. We evaluated the algorithm with metrics related to clinically relevant features in an extensive quantitative evaluation based on 204 volumetric scans of 17 subjects, including patients with diverse pathologies and healthy controls. Using this method, we achieve state-of-the-art axial motion correction and show significant advances in both transverse co-alignment and distortion correction, especially in the subgroup with pathology.
Collapse
Affiliation(s)
- Stefan B. Ploner
- Pattern Recognition Lab,
Friedrich-Alexander-Universität Erlangen-Nürnberg,
Martensstr. 3, Erlangen, 91058, Germany
- Department of Electrical Engineering and
Computer Science and Research Laboratory of Electronics, Massachusetts
Institute of Technology, 77 Massachusetts Ave, Cambridge, MA 02139,
USA
| | - Martin F. Kraus
- Pattern Recognition Lab,
Friedrich-Alexander-Universität Erlangen-Nürnberg,
Martensstr. 3, Erlangen, 91058, Germany
| | - Eric M. Moult
- Department of Electrical Engineering and
Computer Science and Research Laboratory of Electronics, Massachusetts
Institute of Technology, 77 Massachusetts Ave, Cambridge, MA 02139,
USA
| | - Lennart Husvogt
- Pattern Recognition Lab,
Friedrich-Alexander-Universität Erlangen-Nürnberg,
Martensstr. 3, Erlangen, 91058, Germany
- Department of Electrical Engineering and
Computer Science and Research Laboratory of Electronics, Massachusetts
Institute of Technology, 77 Massachusetts Ave, Cambridge, MA 02139,
USA
| | - Julia Schottenhamml
- Pattern Recognition Lab,
Friedrich-Alexander-Universität Erlangen-Nürnberg,
Martensstr. 3, Erlangen, 91058, Germany
| | - A. Yasin Alibhai
- New England Eye Center, Tufts Medical
Center, 800 Washington St. Box 450, Boston, MA 02111, USA
| | - Nadia K. Waheed
- New England Eye Center, Tufts Medical
Center, 800 Washington St. Box 450, Boston, MA 02111, USA
| | - Jay S. Duker
- New England Eye Center, Tufts Medical
Center, 800 Washington St. Box 450, Boston, MA 02111, USA
| | - James G. Fujimoto
- Department of Electrical Engineering and
Computer Science and Research Laboratory of Electronics, Massachusetts
Institute of Technology, 77 Massachusetts Ave, Cambridge, MA 02139,
USA
| | - Andreas K. Maier
- Pattern Recognition Lab,
Friedrich-Alexander-Universität Erlangen-Nürnberg,
Martensstr. 3, Erlangen, 91058, Germany
| |
Collapse
|
10
|
Li Z, Pandiyan VP, Maloney-Bertelli A, Jiang X, Li X, Sabesan R. Correcting intra-volume distortion for AO-OCT using 3D correlation based registration. OPTICS EXPRESS 2020; 28:38390-38409. [PMID: 33379652 PMCID: PMC7771894 DOI: 10.1364/oe.410374] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/17/2020] [Revised: 11/15/2020] [Accepted: 11/19/2020] [Indexed: 05/18/2023]
Abstract
Adaptive optics (AO) based ophthalmic imagers, such as scanning laser ophthalmoscopes (SLO) and optical coherence tomography (OCT), are used to evaluate the structure and function of the retina with high contrast and resolution. Fixational eye movements during a raster-scanned image acquisition lead to intra-frame and intra-volume distortion, resulting in an inaccurate reproduction of the underlying retinal structure. For three-dimensional (3D) AO-OCT, segmentation-based and 3D correlation based registration methods have been applied to correct eye motion and achieve a high signal-to-noise ratio registered volume. This involves first selecting a reference volume, either manually or automatically, and registering the image/volume stream against the reference using correlation methods. However, even within the chosen reference volume, involuntary eye motion persists and affects the accuracy with which the 3D retinal structure is finally rendered. In this article, we introduced reference volume distortion correction for AO-OCT using 3D correlation based registration and demonstrate a significant improvement in registration performance via a few metrics. Conceptually, the general paradigm follows that developed previously for intra-frame distortion correction for 2D raster-scanned images, as in an AOSLO, but extended here across all three spatial dimensions via 3D correlation analyses. We performed a frequency analysis of eye motion traces before and after intra-volume correction and revealed how periodic artifacts in eye motion estimates are effectively reduced upon correction. Further, we quantified how the intra-volume distortions and periodic artifacts in the eye motion traces, in general, decrease with increasing AO-OCT acquisition speed. Overall, 3D correlation based registration with intra-volume correction significantly improved the visualization of retinal structure and estimation of fixational eye movements.
Collapse
Affiliation(s)
- Zhenghan Li
- Key Laboratory on Adaptive Optics, Chinese Academy of Sciences, Chengdu, Sichuan 610209, China
- Institute of Optics and Electronics, Chinese Academy of Sciences, Chengdu, Sichuan 610209, China
- University of Chinese Academy of Sciences, Beijing 100049, China
- Department of Ophthalmology, University of Washington, Seattle, Washington 98109, USA
- These authors contributed equally to this work
| | - Vimal Prabhu Pandiyan
- Department of Ophthalmology, University of Washington, Seattle, Washington 98109, USA
- These authors contributed equally to this work
| | | | - Xiaoyun Jiang
- Department of Ophthalmology, University of Washington, Seattle, Washington 98109, USA
| | - Xinyang Li
- Key Laboratory on Adaptive Optics, Chinese Academy of Sciences, Chengdu, Sichuan 610209, China
- Institute of Optics and Electronics, Chinese Academy of Sciences, Chengdu, Sichuan 610209, China
| | - Ramkumar Sabesan
- Department of Ophthalmology, University of Washington, Seattle, Washington 98109, USA
| |
Collapse
|
11
|
Schwarzhans F, Desissaire S, Steiner S, Pircher M, Hitzenberger CK, Resch H, Vass C, Fischer G. Generating large field of view en-face projection images from intra-acquisition motion compensated volumetric optical coherence tomography data. BIOMEDICAL OPTICS EXPRESS 2020; 11:6881-6904. [PMID: 33408968 PMCID: PMC7747913 DOI: 10.1364/boe.404738] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/10/2020] [Revised: 10/16/2020] [Accepted: 10/21/2020] [Indexed: 05/21/2023]
Abstract
A technique to generate large field of view projection maps of arbitrary optical coherence tomography (OCT) data is described. The technique is divided into two stages - an image acquisition stage that features a simple to use fast and robust retinal tracker to get motion free retinal OCT volume scans - and a stitching stage where OCT data from different retinal locations is first registered against a reference image using a custom pyramid-based approach and finally stitched together into one seamless large field of view (FOV) image. The method is applied to data recorded with a polarization sensitive OCT instrument in healthy subjects and glaucoma patients. The tracking and stitching accuracies are quantified, and finally, large FOV images of retinal nerve fiber layer retardation that contain the arcuate nerve fiber bundles from the optic nerve head to the raphe are demonstrated.
Collapse
Affiliation(s)
- Florian Schwarzhans
- Center for Medical Statistics, Informatics and Intelligent Systems, Medical University of Vienna, Vienna, 1090, Austria
| | - Sylvia Desissaire
- Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, 1090, Austria
| | - Stefan Steiner
- Department of Ophthalmology and Optometry, Medical University of Vienna, Vienna, 1090, Austria
| | - Michael Pircher
- Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, 1090, Austria
| | - Christoph K. Hitzenberger
- Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Vienna, 1090, Austria
| | - Hemma Resch
- Department of Ophthalmology and Optometry, Medical University of Vienna, Vienna, 1090, Austria
| | - Clemens Vass
- Department of Ophthalmology and Optometry, Medical University of Vienna, Vienna, 1090, Austria
| | - Georg Fischer
- Center for Medical Statistics, Informatics and Intelligent Systems, Medical University of Vienna, Vienna, 1090, Austria
| |
Collapse
|
12
|
Kelly JP, Baran FM, Phillips JO, Weiss AH. Matching Misaligned Spectralis OCTs to a Reference Scan in Pediatric Glaucoma with Poor Fixation and Nystagmus. Transl Vis Sci Technol 2020; 9:21. [PMID: 33005479 PMCID: PMC7509772 DOI: 10.1167/tvst.9.10.21] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/21/2020] [Accepted: 08/25/2020] [Indexed: 11/24/2022] Open
Abstract
Purpose Poor fixation or nystagmus in children causes misalignment errors when measuring circumpapillary retinal nerve fiber layer (cpRNFL) thickness by simultaneous scanning laser ophthalmoscope imaging/optical coherence tomography (SLO/OCT). We investigated a method to assess cpRNFL from misaligned SLO/OCT scans. Methods Heidelberg Spectralis SLO/OCT scans from a single clinical examination were retrospectively analyzed when automated eye tracking was unreliable. Retinal layer thickness was measured at overlapping match locations between a reference and misaligned scans based on the position data from simultaneously acquired SLO images. Three layers were segmented: cpRNFL, internal limiting membrane to outer nuclear layer (ILM-ONL), and total retinal thickness (TR). Accuracy was defined as the difference in thickness between the reference and misaligned scans at their match locations after correction for scan angle. Results Thirty-five subjects, evaluated for glaucomatous nerve loss, met inclusion criteria. Group-averaged accuracy was −2.7, 1.4, and 0.3 µm for cpRNFL, ILM-ONL, and TR thickness, respectively. Across all layers, interobserver intraclass correlation coefficients ranged from 0.97 to 0.63 and the maximum Bland-Altman 95% limits of agreement were −21.6 to 20.7 µm. Variability was greatest for cpRNFL thickness and least for TR thickness. Increased variability was associated with lower signal-to-noise ratio but not with image-motion indices of shear, rotation, and scale. Conclusions Retinal layer thickness can be compared to a reference cpRNFL OCT scan when poor fixation and nystagmus causes misalignment errors. The analysis can be performed post hoc using multiple misaligned scans from standard SLO/OCT protocols. Translational Relevance Our method allows for assessment of cpRNFL in children who fail eye tracking.
Collapse
Affiliation(s)
- John P Kelly
- Roger H. Johnson Vision Clinic, Seattle Children's Hospital, Division of Ophthalmology, Seattle, WA, USA.,University of Washington, Department of Ophthalmology, Seattle, WA, USA
| | - Francine M Baran
- Roger H. Johnson Vision Clinic, Seattle Children's Hospital, Division of Ophthalmology, Seattle, WA, USA.,University of Washington, Department of Ophthalmology, Seattle, WA, USA
| | - James O Phillips
- Roger H. Johnson Vision Clinic, Seattle Children's Hospital, Division of Ophthalmology, Seattle, WA, USA.,University of Washington School of Medicine, Department of Otolaryngology, Seattle, WA, USA
| | - Avery H Weiss
- University of Washington, Department of Ophthalmology, Seattle, WA, USA
| |
Collapse
|
13
|
Biometric Measurement of Anterior Segment: A Review. SENSORS 2020; 20:s20154285. [PMID: 32752014 PMCID: PMC7435894 DOI: 10.3390/s20154285] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/13/2020] [Revised: 07/22/2020] [Accepted: 07/29/2020] [Indexed: 12/12/2022]
Abstract
Biometric measurement of the anterior segment is of great importance for the ophthalmology, human eye modeling, contact lens fitting, intraocular lens design, etc. This paper serves as a comprehensive review on the historical development and basic principles of the technologies for measuring the geometric profiles of the anterior segment. Both the advantages and drawbacks of the current technologies are illustrated. For in vivo measurement of the anterior segment, there are two main challenges that need to be addressed to achieve high speed, fine resolution, and large range imaging. One is the motion artefacts caused by the inevitable and random human eye movement. The other is the serious multiple scattering effects in intraocular turbid media. The future research perspectives are also outlined in this paper.
Collapse
|
14
|
Wei X, Hormel TT, Guo Y, Hwang TS, Jia Y. High-resolution wide-field OCT angiography with a self-navigation method to correct microsaccades and blinks. BIOMEDICAL OPTICS EXPRESS 2020; 11:3234-3245. [PMID: 32637251 PMCID: PMC7316026 DOI: 10.1364/boe.390430] [Citation(s) in RCA: 24] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/12/2020] [Revised: 05/11/2020] [Accepted: 05/14/2020] [Indexed: 05/18/2023]
Abstract
In this study, we demonstrate a novel self-navigated motion correction method that suppresses eye motion and blinking artifacts on wide-field optical coherence tomographic angiography (OCTA) without requiring any hardware modification. Highly efficient GPU-based, real-time OCTA image acquisition and processing software was developed to detect eye motion artifacts. The algorithm includes an instantaneous motion index that evaluates the strength of motion artifact on en face OCTA images. Areas with suprathreshold motion and eye blinking artifacts are automatically rescanned in real-time. Both healthy eyes and eyes with diabetic retinopathy were imaged, and the self-navigated motion correction performance was demonstrated.
Collapse
Affiliation(s)
- Xiang Wei
- Casey Eye Institute, Oregon Health and Science University, Portland, Oregon 97239, USA
- Department of Biomedical Engineer, Oregon Health and Science University, Portland, Oregon 97239, USA
| | - Tristan T. Hormel
- Casey Eye Institute, Oregon Health and Science University, Portland, Oregon 97239, USA
| | - Yukun Guo
- Casey Eye Institute, Oregon Health and Science University, Portland, Oregon 97239, USA
| | - Thomas S. Hwang
- Casey Eye Institute, Oregon Health and Science University, Portland, Oregon 97239, USA
| | - Yali Jia
- Casey Eye Institute, Oregon Health and Science University, Portland, Oregon 97239, USA
- Department of Biomedical Engineer, Oregon Health and Science University, Portland, Oregon 97239, USA
| |
Collapse
|
15
|
Bazvand F, Ghassemi F. Artifacts in Macular Optical Coherence Tomography. J Curr Ophthalmol 2020; 32:123-131. [PMID: 32671295 PMCID: PMC7337029 DOI: 10.4103/joco.joco_83_20] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2019] [Revised: 03/24/2020] [Accepted: 03/29/2020] [Indexed: 11/30/2022] Open
Abstract
Purpose: To identify and explain different artifacts in macular optical coherence tomography (OCT). Methods: For this comprehensive review, a PubMed and Google Scholar (January 1995–October 2018) search was conducted by the researchers, using the keywords such as OCT, artifacts, artefact, and macula. Results: We reviewed the main OCT artifacts including software break-down or misidentification of retinal layers, incomplete segmentation error, complete segmentation failure, mirror artifact (inverted artifact), cut edge artifact, degraded image scan, out-of-register artifact, off-center artifact, motion artifact, foveal duplication, segmentation shift, blink artifact, static or fixed image artifact, linear artifact, and perfluorocarbon liquid-producing artifact. Conclusions: There are various artifacts in OCT image scans. The identification of these artifacts may help in accurate interpretations of OCT images in clinical settings that can affect the diagnosis and management of different retinal disorders.
Collapse
Affiliation(s)
- Fatemeh Bazvand
- Eye Research Center, Farabi Eye Hospital, Tehran University of Medical Sciences, Tehran, Iran.,Retina and Vitreous Service, Department of Ophthalmology, Farabi Eye Hospital, Tehran University of Medical Sciences, Tehran, Iran
| | - Fariba Ghassemi
- Eye Research Center, Farabi Eye Hospital, Tehran University of Medical Sciences, Tehran, Iran.,Retina and Vitreous Service, Department of Ophthalmology, Farabi Eye Hospital, Tehran University of Medical Sciences, Tehran, Iran
| |
Collapse
|
16
|
Pan L, Shi F, Xiang D, Yu K, Duan L, Zheng J, Chen X. OCTRexpert:A Feature-based 3D Registration Method for Retinal OCT Images. IEEE TRANSACTIONS ON IMAGE PROCESSING : A PUBLICATION OF THE IEEE SIGNAL PROCESSING SOCIETY 2020; 29:3885-3897. [PMID: 31995490 DOI: 10.1109/tip.2020.2967589] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
Medical image registration can be used for studying longitudinal and cross-sectional data, quantitatively monitoring disease progression and guiding computer assisted diagnosis and treatments. However, deformable registration which enables more precise and quantitative comparison has not been well developed for retinal optical coherence tomography (OCT) images. This paper proposes a new 3D registration approach for retinal OCT data called OCTRexpert. To the best of our knowledge, the proposed algorithm is the first full 3D registration approach for retinal OCT images which can be applied to longitudinal OCT images for both normal and serious pathological subjects. In this approach, a pre-processing method is first performed to remove eye motion artifact and then a novel design-detection-deformation strategy is applied for the registration. In the design step, a couple of features are designed for each voxel in the image. In the detection step, active voxels are selected and the point-to-point correspondences between the subject and template images are established. In the deformation step, the image is hierarchically deformed according to the detected correspondences in multi-resolution. The proposed method is evaluated on a dataset with longitudinal OCT images from 20 healthy subjects and 4 subjects diagnosed with serious Choroidal Neovascularization (CNV). Experimental results show that the proposed registration algorithm consistently yields statistically significant improvements in both Dice similarity coefficient and the average unsigned surface error compared with the other registration methods.
Collapse
|
17
|
Napoli PE, Nioi M, d'Aloja E, Fossarello M. The Bull's Eye Pattern of the Tear Film in Humans during Visual Fixation on En-Face Optical Coherence Tomography. Sci Rep 2019; 9:1413. [PMID: 30723239 PMCID: PMC6363734 DOI: 10.1038/s41598-018-38260-5] [Citation(s) in RCA: 26] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2018] [Accepted: 12/19/2018] [Indexed: 12/31/2022] Open
Abstract
The aim of the study was to define and characterize the optical behavior of the tear film during visual fixation in humans on en-face optical coherence tomography (OCT). We included 20 healthy participants, 60% female, aged from 25 to 42 years (33.05 ± 4.97 [mean ± SD]) and ten patients with severe dry eye, 50% female, aged from 26 to 42 years (33.7 ± 5.31). To perform high-resolution tear film imaging, participants were asked to gaze at the internal fixation point in the spectral-domain anterior segment OCT device, and meanwhile scanning session was executed at the following time-points after blinking: at the 2nd, 3rd, 4th, 5th, and 6th second. After one hour, OCT imaging was repeated (second session) by a different operator masked to the study to verify the reliability of results. During each measuring session, a pulse oximetry was used for continuously measuring the heart rate and oxygen saturation (SpO2%). A preliminary experiment was also performed to test the absence of geometric patterns from the anterior surface of a motionless artificial eye. OCT imaging showed a motionless, stable anterior surface of the artificial eye and in dry eye patients. Conversely, in the healthy participants of the study, a bull's eye pattern of the tear film was detected by OCT at the 2nd, 3rd, 4th, 5th, and 6th second after blinking, respectively, in 45%, 60%, 45%, 60%, and 40% of OCT scans during the first session, and in 35%, 65%, 65%, 60%, and 35% of cases in the second session. Overall, a total of 200 OCT scans were performed in normal human population. A significant correlation was found between the novel tear film pattern and heart rate during the first and the second session (p < 0.01) in healthy eyes. Conversely, no correlation was revealed with SpO2%. Intraclass correlation (ICC) analysis for OCT imaging of the tear film revealed a statistically significant reproducibility of the results (ICC = 0.838; p < 0.01), indicating the high level of reliability of the method, independently of heart rate and SpO2% variables. There exists a novel, geometric pattern of the tear film during visual fixation detectable by en-face OCT, which is mainly evident as heart rate increases. Its discovery implies in turn the presence of a specific vibration (or imperceptible motion) of the tear film that, at present, is not recognized and corrected by the OCT software (in image postprocessing) unlike other eyeball movements.
Collapse
Affiliation(s)
- Pietro Emanuele Napoli
- From the San Giovanni di Dio hospital, Clinica Oculistica, Azienda Ospedaliera Universitaria di Cagliari, Cagliari, Italy.
- From the Department of Surgical Sciences, Eye Clinic, University of Cagliari, Cagliari, Italy.
| | - Matteo Nioi
- From the Department of Medical Sciences and Public Health - Forensic Science Unit -University of Cagliari, Cagliari, Italy
| | - Ernesto d'Aloja
- From the Department of Medical Sciences and Public Health - Forensic Science Unit -University of Cagliari, Cagliari, Italy
| | - Maurizio Fossarello
- From the San Giovanni di Dio hospital, Clinica Oculistica, Azienda Ospedaliera Universitaria di Cagliari, Cagliari, Italy
- From the Department of Surgical Sciences, Eye Clinic, University of Cagliari, Cagliari, Italy
| |
Collapse
|
18
|
Tsai G, Banaee T, Conti FF, Singh RP. Optical Coherence Tomography Angiography in Eyes with Retinal Vein Occlusion. J Ophthalmic Vis Res 2018; 13:315-332. [PMID: 30090189 PMCID: PMC6058553 DOI: 10.4103/jovr.jovr_264_17] [Citation(s) in RCA: 45] [Impact Index Per Article: 6.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/10/2017] [Accepted: 01/04/2018] [Indexed: 11/04/2022] Open
Abstract
Optical coherence angiography (OCTA) is a noninvasive technique that has been introduced in recent years to detect ophthalmological pathology. The growing usage of OCTA to detect retinal abnormalities can be attributed to its advantages over the reference-standard fluorescein angiography (FA), although both of these techniques can be used in association. OCTA's advantages include its dye independency, its ability to produce depth-resolved images of retinal and choroidal vessels that yield images of different vascular layers of the retina, and the better delineation of the foveal avascular zone. OCTA's disadvantages include the lack of normalized patient data, artefactual projection issues, and its inability to detect low-flow lesions or pathologic conditions. Different OCTA platforms use unique algorithms to detect microvasculature, which are implemented in both spectral-domain (SD) and swept-source (SS) OCT machines. Microvascular changes in retinal vein occlusions (RVOs) are visible in both the superficial and deep capillary networks of the retina in OCTA. These visualizations include a decrease in foveal and parafoveal vascular densities, non-perfusion areas, capillary engorgement and telangiectasias, vascular tortuosity, microaneurysms, disruption of the foveal perivascular plexus, and formation of collateral vessels. The restricted field of view and inability to show leakage are important limitations associated with the use of OCTA in RVO cases. In this article, we present a brief overview of OCTA and a review of the changes detectable in different slabs by OCTA in RVO cases published in PubMed and Embase.
Collapse
Affiliation(s)
- Grace Tsai
- Cole Eye Institute, Cleveland Clinic, Cleveland, Ohio, USA
- School of Medicine, Royal College of Surgeons in Ireland, Ireland
| | - Touka Banaee
- Cole Eye Institute, Cleveland Clinic, Cleveland, Ohio, USA
- Department of Ophthalmology, Faculty of Medicine, Mashhad University of Medical Sciences, Mashhad, Iran
| | | | - Rishi P. Singh
- Cole Eye Institute, Cleveland Clinic, Cleveland, Ohio, USA
- Cleveland Clinic, Lerner College of Medicine, Case Western Reserve University, Cleveland, USA
| |
Collapse
|
19
|
Yang J, Liu L, Campbell JP, Huang D, Liu G. Handheld optical coherence tomography angiography. BIOMEDICAL OPTICS EXPRESS 2017; 8:2287-2300. [PMID: 28736672 PMCID: PMC5516829 DOI: 10.1364/boe.8.002287] [Citation(s) in RCA: 35] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/08/2016] [Revised: 02/25/2017] [Accepted: 03/12/2017] [Indexed: 05/03/2023]
Abstract
We developed a handheld optical coherence tomography angiography (OCTA) system using a 100-kHz swept-source laser. The handheld probe weighs 0.4 kg and measures 20.6 × 12.8 × 4.6 cm3. The system has dedicated features for handheld operation. The probe is equipped with a mini iris camera for easy alignment. Real-time display of the en face OCT and cross-sectional OCT images in the system allows accurately locating the imaging target. Fast automatic focusing was achieved by an electrically tunable lens controlled by a golden-section search algorithm. An extended axial imaging range of 6 mm allows easy alignment. A registration algorithm using cross-correlation to register adjacent OCT B-frames with propagation from the central frame was used to effectively minimize motion artifacts in volumetric OCTA images captured in relatively short durations of 1 and 2.1 seconds. 2.5 × 2.5 mm (200 × 200 pixels) and 3.5 × 3.5 mm (300 × 300 pixels) retinal angiograms were demonstrated on two awake adult human subjects without the use of any mydriatic eye drops.
Collapse
|
20
|
Lee S, Heisler M, Mackenzie PJ, Sarunic MV, Beg MF. Quantifying Variability in Longitudinal Peripapillary RNFL and Choroidal Layer Thickness Using Surface Based Registration of OCT Images. Transl Vis Sci Technol 2017; 6:11. [PMID: 28275526 PMCID: PMC5338475 DOI: 10.1167/tvst.6.1.11] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/19/2016] [Accepted: 01/09/2017] [Indexed: 12/16/2022] Open
Abstract
Purpose To assess within-subject variability of retinal nerve fiber layer (RNFL) and choroidal layer thickness in longitudinal repeat optical coherence tomography (OCT) images with point-to-point measurement comparison made using nonrigid surface registration. Methods Nine repeat peripapillary OCT images were acquired over 3 weeks from 12 eyes of 6 young, healthy subjects using a 1060-nm prototype swept-source device. The RNFL, choroid and the Bruch's membrane opening (BMO) were segmented, and point-wise layer thicknesses and BMO dimensions were measured. For each eye, the layer surfaces of eight follow-up images were registered to those of the baseline image, first by rigid alignment using blood vessel projections and axial height and tilt correction, followed by nonrigid registration of currents-based diffeomorphisms algorithms. This mapped all follow-up measurements point-wise to the common baseline coordinate system, allowing for point-wise statistical analysis. Measurement variability was evaluated point-wise for layer thicknesses and BMO dimensions by time-standard deviation (tSD). Results The intraclass correlation coefficients (ICCs) of BMO area and eccentricity were 0.993 and 0.972, respectively. Time-mean and tSD were computed point-wise for RNFL and choroidal thickness and color-mapped on the baseline surfaces. tSD was less than two coherence lengths of the system 2ℓ = 12 μm at most vertices. High RNFL thickness variability corresponded to the locations of retinal vessels, and choroidal thickness varied more than RNFL thickness. Conclusions Our registration-based end-to-end pipeline produced point-wise correspondence among time-series retinal and choroidal surfaces with high measurement repeatability (low variability). Blood vessels were found to be the main sources contributing to the normal variability of the RNFL thickness measure. The computational pipeline with a measurement of normal variability can be used in future longitudinal studies to identify changes that are above the threshold of normal point-wise variability and track localized changes in retinal layers in high spatial resolution. Translational Relevance Using the registration-based approach presented in this study, longitudinal changes in retinal and choroidal layers can be detected with higher sensitivity and spatial precision.
Collapse
Affiliation(s)
- Sieun Lee
- School of Engineering Science, Simon Fraser University, Burnaby, BC, Canada
| | - Morgan Heisler
- School of Engineering Science, Simon Fraser University, Burnaby, BC, Canada
| | - Paul J Mackenzie
- Department of Ophthalmology and Visual Sciences, University of British Columbia, Vancouver, BC, Canada
| | - Marinko V Sarunic
- School of Engineering Science, Simon Fraser University, Burnaby, BC, Canada
| | - Mirza Faisal Beg
- School of Engineering Science, Simon Fraser University, Burnaby, BC, Canada
| |
Collapse
|
21
|
Baghaie A, Yu Z, D'Souza RM. Involuntary eye motion correction in retinal optical coherence tomography: Hardware or software solution? Med Image Anal 2017; 37:129-145. [PMID: 28208100 DOI: 10.1016/j.media.2017.02.002] [Citation(s) in RCA: 21] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2016] [Revised: 01/27/2017] [Accepted: 02/03/2017] [Indexed: 01/05/2023]
Abstract
In this paper, we review state-of-the-art techniques to correct eye motion artifacts in Optical Coherence Tomography (OCT) imaging. The methods for eye motion artifact reduction can be categorized into two major classes: (1) hardware-based techniques and (2) software-based techniques. In the first class, additional hardware is mounted onto the OCT scanner to gather information about the eye motion patterns during OCT data acquisition. This information is later processed and applied to the OCT data for creating an anatomically correct representation of the retina, either in an offline or online manner. In software based techniques, the motion patterns are approximated either by comparing the acquired data to a reference image, or by considering some prior assumptions about the nature of the eye motion. Careful investigations done on the most common methods in the field provides invaluable insight regarding future directions of the research in this area. The challenge in hardware-based techniques lies in the implementation aspects of particular devices. However, the results of these techniques are superior to those obtained from software-based techniques because they are capable of capturing secondary data related to eye motion during OCT acquisition. Software-based techniques on the other hand, achieve moderate success and their performance is highly dependent on the quality of the OCT data in terms of the amount of motion artifacts contained in them. However, they are still relevant to the field since they are the sole class of techniques with the ability to be applied to legacy data acquired using systems that do not have extra hardware to track eye motion.
Collapse
Affiliation(s)
- Ahmadreza Baghaie
- Department of Electrical Engineering, University of Wisconsin-Milwaukee, WI 53211, USA.
| | - Zeyun Yu
- Department of Computer Science, University of Wisconsin-Milwaukee, WI 53211, USA
| | - Roshan M D'Souza
- Department of Mechanical Engineering, University of Wisconsin-Milwaukee, WI 53211, USA
| |
Collapse
|
22
|
Lezama J, Mukherjee D, McNabb RP, Sapiro G, Kuo AN, Farsiu S. Segmentation guided registration of wide field-of-view retinal optical coherence tomography volumes. BIOMEDICAL OPTICS EXPRESS 2016; 7:4827-4846. [PMID: 28018709 PMCID: PMC5175535 DOI: 10.1364/boe.7.004827] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/19/2016] [Revised: 10/27/2016] [Accepted: 10/27/2016] [Indexed: 05/25/2023]
Abstract
Patient motion artifacts are often visible in densely sampled or large wide field-of-view (FOV) retinal optical coherence tomography (OCT) volumes. A popular strategy for reducing motion artifacts is to capture two orthogonally oriented volumetric scans. However, due to larger volume sizes, longer acquisition times, and corresponding larger motion artifacts, the registration of wide FOV scans remains a challenging problem. In particular, gaps in data acquisition due to eye motion, such as saccades, can be significant and their modeling becomes critical for successful registration. In this article, we develop a complete computational pipeline for the automatic motion correction and accurate registration of wide FOV orthogonally scanned OCT images of the human retina. The proposed framework utilizes the retinal boundary segmentation as a guide for registration and requires only a minimal transformation of the acquired data to produce a successful registration. It includes saccade detection and correction, a custom version of the optical flow algorithm for dense lateral registration and a linear optimization approach for axial registration. Utilizing a wide FOV swept source OCT system, we acquired retinal volumes of 12 subjects and we provide qualitative and quantitative experimental results to validate the state-of-the-art effectiveness of the proposed technique. The source code corresponding to the proposed algorithm is available online.
Collapse
Affiliation(s)
- José Lezama
- Department of Biomedical Engineering, Duke University, Durham, NC 27708,
USA
- Department of Electrical and Computer Engineering, Duke University, Durham, NC 27708,
USA
| | - Dibyendu Mukherjee
- Department of Biomedical Engineering, Duke University, Durham, NC 27708,
USA
| | - Ryan P. McNabb
- Department of Ophthalmology, Duke University Medical Center, Durham, NC 27710,
USA
| | - Guillermo Sapiro
- Department of Biomedical Engineering, Duke University, Durham, NC 27708,
USA
- Department of Electrical and Computer Engineering, Duke University, Durham, NC 27708,
USA
| | - Anthony N. Kuo
- Department of Ophthalmology, Duke University Medical Center, Durham, NC 27710,
USA
| | - Sina Farsiu
- Department of Biomedical Engineering, Duke University, Durham, NC 27708,
USA
- Department of Electrical and Computer Engineering, Duke University, Durham, NC 27708,
USA
- Department of Ophthalmology, Duke University Medical Center, Durham, NC 27710,
USA
| |
Collapse
|
23
|
Gorczynska I, Migacz JV, Zawadzki RJ, Capps AG, Werner JS. Comparison of amplitude-decorrelation, speckle-variance and phase-variance OCT angiography methods for imaging the human retina and choroid. BIOMEDICAL OPTICS EXPRESS 2016; 7:911-42. [PMID: 27231598 PMCID: PMC4866465 DOI: 10.1364/boe.7.000911] [Citation(s) in RCA: 100] [Impact Index Per Article: 11.1] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/14/2015] [Revised: 02/03/2016] [Accepted: 02/12/2016] [Indexed: 05/18/2023]
Abstract
We compared the performance of three OCT angiography (OCTA) methods: speckle variance, amplitude decorrelation and phase variance for imaging of the human retina and choroid. Two averaging methods, split spectrum and volume averaging, were compared to assess the quality of the OCTA vascular images. All data were acquired using a swept-source OCT system at 1040 nm central wavelength, operating at 100,000 A-scans/s. We performed a quantitative comparison using a contrast-to-noise (CNR) metric to assess the capability of the three methods to visualize the choriocapillaris layer. For evaluation of the static tissue noise suppression in OCTA images we proposed to calculate CNR between the photoreceptor/RPE complex and the choriocapillaris layer. Finally, we demonstrated that implementation of intensity-based OCT imaging and OCT angiography methods allows for visualization of retinal and choroidal vascular layers known from anatomic studies in retinal preparations. OCT projection imaging of data flattened to selected retinal layers was implemented to visualize retinal and choroidal vasculature. User guided vessel tracing was applied to segment the retinal vasculature. The results were visualized in a form of a skeletonized 3D model.
Collapse
Affiliation(s)
- Iwona Gorczynska
- Department of Ophthalmology & Vision Science, University of California Davis, Sacramento, CA 95817, USA
- Faculty of Physics, Astronomy and Informatics, Nicolaus Copernicus University, Torun 87-100, Poland
| | - Justin V. Migacz
- Department of Ophthalmology & Vision Science, University of California Davis, Sacramento, CA 95817, USA
| | - Robert J. Zawadzki
- Department of Ophthalmology & Vision Science, University of California Davis, Sacramento, CA 95817, USA
| | - Arlie G. Capps
- Department of Ophthalmology & Vision Science, University of California Davis, Sacramento, CA 95817, USA
- Physics Division, Lawrence Livermore National Laboratory Livermore, CA 94550, USA
| | - John S. Werner
- Department of Ophthalmology & Vision Science, University of California Davis, Sacramento, CA 95817, USA
| |
Collapse
|
24
|
Baghaie A, Yu Z, D'Souza RM. State-of-the-art in retinal optical coherence tomography image analysis. Quant Imaging Med Surg 2015; 5:603-17. [PMID: 26435924 DOI: 10.3978/j.issn.2223-4292.2015.07.02] [Citation(s) in RCA: 19] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/20/2022]
Abstract
Optical coherence tomography (OCT) is an emerging imaging modality that has been widely used in the field of biomedical imaging. In the recent past, it has found uses as a diagnostic tool in dermatology, cardiology, and ophthalmology. In this paper we focus on its applications in the field of ophthalmology and retinal imaging. OCT is able to non-invasively produce cross-sectional volumetric images of the tissues which can be used for analysis of tissue structure and properties. Due to the underlying physics, OCT images suffer from a granular pattern, called speckle noise, which restricts the process of interpretation. This requires specialized noise reduction techniques to eliminate the noise while preserving image details. Another major step in OCT image analysis involves the use of segmentation techniques for distinguishing between different structures, especially in retinal OCT volumes. The outcome of this step is usually thickness maps of different retinal layers which are very useful in study of normal/diseased subjects. Lastly, movements of the tissue under imaging as well as the progression of disease in the tissue affect the quality and the proper interpretation of the acquired images which require the use of different image registration techniques. This paper reviews various techniques that are currently used to process raw image data into a form that can be clearly interpreted by clinicians.
Collapse
Affiliation(s)
- Ahmadreza Baghaie
- 1 Department of Electrical Engineering, 2 Department of Computer Science, 3 Department of Mechanical Engineering, University of Wisconsin- Milwaukee, Milwaukee, WI, USA
| | - Zeyun Yu
- 1 Department of Electrical Engineering, 2 Department of Computer Science, 3 Department of Mechanical Engineering, University of Wisconsin- Milwaukee, Milwaukee, WI, USA
| | - Roshan M D'Souza
- 1 Department of Electrical Engineering, 2 Department of Computer Science, 3 Department of Mechanical Engineering, University of Wisconsin- Milwaukee, Milwaukee, WI, USA
| |
Collapse
|
25
|
Zhang Q, Huang Y, Zhang T, Kubach S, An L, Laron M, Sharma U, Wang RK. Wide-field imaging of retinal vasculature using optical coherence tomography-based microangiography provided by motion tracking. JOURNAL OF BIOMEDICAL OPTICS 2015; 20:066008. [PMID: 26102573 PMCID: PMC4478052 DOI: 10.1117/1.jbo.20.6.066008] [Citation(s) in RCA: 79] [Impact Index Per Article: 7.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/20/2014] [Accepted: 05/28/2015] [Indexed: 05/18/2023]
Abstract
Optical coherence tomography (OCT)-based optical microangiography (OMAG) is a high-resolution, noninvasive imaging technique capable of providing three-dimensional in vivo blood flow visualization within microcirculatory tissue beds in the eye. Although the technique has demonstrated early clinical utility by imaging diseased eyes, its limited field of view (FOV) and the sensitivity to eye motion remain the two biggest challenges for the widespread clinical use of the technology. Here, we report the results of retinal OMAG imaging obtained from a Zeiss Cirrus 5000 spectral domain OCT system with motion tracking capability achieved by a line scan ophthalmoscope (LSO). The tracking LSO is able to guide the OCT scanning, which minimizes the effect of eye motion in the final results. We show that the tracking can effectively correct the motion artifacts and remove the discontinuities and distortions of vascular appearance due to microsaccade, leading to almost motion-free OMAG angiograms with good repeatability and reliability. Due to the robustness of the tracking LSO, we also show the montage scan protocol to provide unprecedented wide field retinal OMAG angiograms. We experimentally demonstrate a 12 x 16 mm² retinal OMAG angiogram acquired from a volunteer, which is the widest FOV retinal vasculature imaging up to now in the community.
Collapse
Affiliation(s)
- Qinqin Zhang
- University of Washington, Department of Bioengineering, 3720 NE 15th Avenue, Seattle, Washington 98195, United States
| | - Yanping Huang
- University of Washington, Department of Bioengineering, 3720 NE 15th Avenue, Seattle, Washington 98195, United States
| | - Thomas Zhang
- Carl Zeiss Meditec, Inc., 5160 Hacienda Drive, Dublin, California 94568, United States
| | - Sophie Kubach
- Carl Zeiss Meditec, Inc., 5160 Hacienda Drive, Dublin, California 94568, United States
| | - Lin An
- Carl Zeiss Meditec, Inc., 5160 Hacienda Drive, Dublin, California 94568, United States
| | - Michal Laron
- Carl Zeiss Meditec, Inc., 5160 Hacienda Drive, Dublin, California 94568, United States
| | - Utkarsh Sharma
- Carl Zeiss Meditec, Inc., 5160 Hacienda Drive, Dublin, California 94568, United States
| | - Ruikang K. Wang
- University of Washington, Department of Bioengineering, 3720 NE 15th Avenue, Seattle, Washington 98195, United States
| |
Collapse
|
26
|
Teussink MM, Cense B, van Grinsven MJ, Klevering BJ, Hoyng CB, Theelen T. Impact of motion-associated noise on intrinsic optical signal imaging in humans with optical coherence tomography. BIOMEDICAL OPTICS EXPRESS 2015; 6:1632-47. [PMID: 26137369 PMCID: PMC4467722 DOI: 10.1364/boe.6.001632] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/18/2014] [Revised: 04/04/2015] [Accepted: 04/04/2015] [Indexed: 06/04/2023]
Abstract
A growing body of evidence suggests that phototransduction can be studied in the human eye in vivo by imaging of fast intrinsic optical signals (IOS). There is consensus concerning the limiting influence of motion-associated imaging noise on the reproducibility of IOS-measurements, especially in those employing spectral-domain optical coherence tomography (SD-OCT). However, no study to date has conducted a comprehensive analysis of this noise in the context of IOS-imaging. In this study, we discuss biophysical correlates of IOS, and we address motion-associated imaging noise by providing correctional post-processing methods. In order to avoid cross-talk of adjacent IOS of opposite signal polarity, cellular resolution and stability of imaging to the level of individual cones is likely needed. The optical Stiles-Crawford effect can be a source of significant IOS-imaging noise if alignment with the peak of the Stiles-Crawford function cannot be maintained. Therefore, complete head stabilization by implementation of a bite-bar may be critical to maintain a constant pupil entry position of the OCT beam. Due to depth-dependent sensitivity fall-off, heartbeat and breathing associated axial movements can cause tissue reflectivity to vary by 29% over time, although known methods can be implemented to null these effects. Substantial variations in reflectivity can be caused by variable illumination due to changes in the beam pupil entry position and angle, which can be reduced by an adaptive algorithm based on slope-fitting of optical attenuation in the choriocapillary lamina.
Collapse
Affiliation(s)
- Michel M. Teussink
- Department of Ophthalmology, Radboud University Medical Center, Nijmegen, P.O. Box 6500 HB,
The Netherlands
| | - Barry Cense
- Center for Optical Research and Education, Utsunomiya University, Utsunomiya, Tochigi, 321-8585,
Japan
| | - Mark J.J.P. van Grinsven
- Diagnostic Image Analysis Group, Department of Radiology and Nuclear Medicine, Radboud University Medical Center, Nijmegen, P.O. Box 6500 HB,
The Netherlands
| | - B. Jeroen Klevering
- Department of Ophthalmology, Radboud University Medical Center, Nijmegen, P.O. Box 6500 HB,
The Netherlands
| | - Carel B. Hoyng
- Department of Ophthalmology, Radboud University Medical Center, Nijmegen, P.O. Box 6500 HB,
The Netherlands
| | - Thomas Theelen
- Department of Ophthalmology, Radboud University Medical Center, Nijmegen, P.O. Box 6500 HB,
The Netherlands
| |
Collapse
|
27
|
Kraus MF, Liu JJ, Schottenhamml J, Chen CL, Budai A, Branchini L, Ko T, Ishikawa H, Wollstein G, Schuman J, Duker JS, Fujimoto JG, Hornegger J. Quantitative 3D-OCT motion correction with tilt and illumination correction, robust similarity measure and regularization. BIOMEDICAL OPTICS EXPRESS 2014; 5:2591-613. [PMID: 25136488 PMCID: PMC4132991 DOI: 10.1364/boe.5.002591] [Citation(s) in RCA: 119] [Impact Index Per Article: 10.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/04/2014] [Revised: 05/30/2014] [Accepted: 06/04/2014] [Indexed: 05/18/2023]
Abstract
Variability in illumination, signal quality, tilt and the amount of motion pose challenges for post-processing based 3D-OCT motion correction algorithms. We present an advanced 3D-OCT motion correction algorithm using image registration and orthogonal raster scan patterns aimed at addressing these challenges. An intensity similarity measure using the pseudo Huber norm and a regularization scheme based on a pseudo L0.5 norm are introduced. A two-stage registration approach was developed. In the first stage, only axial motion and axial tilt are coarsely corrected. This result is then used as the starting point for a second stage full optimization. In preprocessing, a bias field estimation based approach to correct illumination differences in the input volumes is employed. Quantitative evaluation was performed using a large set of data acquired from 73 healthy and glaucomatous eyes using SD-OCT systems. OCT volumes of both the optic nerve head and the macula region acquired with three independent orthogonal volume pairs for each location were used to assess reproducibility. The advanced motion correction algorithm using the techniques presented in this paper was compared to a basic algorithm corresponding to an earlier version and to performing no motion correction. Errors in segmentation-based measures such as layer positions, retinal and nerve fiber thickness, as well as the blood vessel pattern were evaluated. The quantitative results consistently show that reproducibility is improved considerably by using the advanced algorithm, which also significantly outperforms the basic algorithm. The mean of the mean absolute retinal thickness difference over all data was 9.9 um without motion correction, 7.1 um using the basic algorithm and 5.0 um using the advanced algorithm. Similarly, the blood vessel likelihood map error is reduced to 69% of the uncorrected error for the basic and to 47% of the uncorrected error for the advanced algorithm. These results demonstrate that our advanced motion correction algorithm has the potential to improve the reliability of quantitative measurements derived from 3D-OCT data substantially.
Collapse
Affiliation(s)
- Martin F. Kraus
- Pattern Recognition Lab, University Erlangen-Nürnberg, D-91058 Erlangen, Germany
- School of Advanced Optical Technologies (SAOT), University Erlangen-Nürnberg, D-91058 Erlangen, Germany
- Department of Electrical Engineering and Computer Science and Research Laboratory of Electronics, Massachusetts Institute of Technology, Cambridge, MA 02139, USA
| | - Jonathan J. Liu
- Department of Electrical Engineering and Computer Science and Research Laboratory of Electronics, Massachusetts Institute of Technology, Cambridge, MA 02139, USA
| | - Julia Schottenhamml
- Pattern Recognition Lab, University Erlangen-Nürnberg, D-91058 Erlangen, Germany
| | - Chieh-Li Chen
- Department of Ophthalmology, UPMC Eye Center, Pittsburgh, PA 15213, USA
- Department of Bioengineering, Swanson School of Engineering, University of Pittsburgh, Pittsburgh, PA, USA
| | - Attila Budai
- Pattern Recognition Lab, University Erlangen-Nürnberg, D-91058 Erlangen, Germany
- School of Advanced Optical Technologies (SAOT), University Erlangen-Nürnberg, D-91058 Erlangen, Germany
| | - Lauren Branchini
- New England Eye Center and Tufts Medical Center, Tufts University, Boston, MA 02116, USA
| | - Tony Ko
- Optovue Inc., Fremont, CA 94538, USA
| | - Hiroshi Ishikawa
- Department of Ophthalmology, UPMC Eye Center, Pittsburgh, PA 15213, USA
- Department of Bioengineering, Swanson School of Engineering, University of Pittsburgh, Pittsburgh, PA, USA
| | - Gadi Wollstein
- Department of Ophthalmology, UPMC Eye Center, Pittsburgh, PA 15213, USA
| | - Joel Schuman
- Department of Ophthalmology, UPMC Eye Center, Pittsburgh, PA 15213, USA
- Department of Bioengineering, Swanson School of Engineering, University of Pittsburgh, Pittsburgh, PA, USA
| | - Jay S. Duker
- New England Eye Center and Tufts Medical Center, Tufts University, Boston, MA 02116, USA
| | - James G. Fujimoto
- School of Advanced Optical Technologies (SAOT), University Erlangen-Nürnberg, D-91058 Erlangen, Germany
| | - Joachim Hornegger
- Pattern Recognition Lab, University Erlangen-Nürnberg, D-91058 Erlangen, Germany
- School of Advanced Optical Technologies (SAOT), University Erlangen-Nürnberg, D-91058 Erlangen, Germany
| |
Collapse
|
28
|
Lurie KL, Angst R, Ellerbee AK. Automated Mosaicing of Feature-Poor Optical Coherence Tomography Volumes With an Integrated White Light Imaging System. IEEE Trans Biomed Eng 2014; 61:2141-53. [DOI: 10.1109/tbme.2014.2316535] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
|
29
|
Abstract
Optical coherence tomography (OCT) is now an integral part of management for numerous retinal diseases for diagnosis, treatment planning and follow up. OCT interpretation must involve the understanding of the associated artifacts. These artifacts can mislead physicians to wrong diagnosis or inappropriate management. This review article discusses the various types of artifacts in OCT scans obtained from various devices in various retinal diseases. This article would help to improve the understanding about the various artifacts and their clinical importance.
Collapse
Affiliation(s)
- Jay Chhablani
- Smt. Kanuri Santhamma Retina Vitreous Centre, L.V. Prasad Eye Institute, Kallam Anji Reddy Campus, L.V. Prasad Marg, Banjara Hills, Hyderabad 500 034, India
| | - Tandava Krishnan
- Vitreo Retinal Services, Vasan Eye Care Hospital, Hyderabad, India
| | - Vaibhav Sethi
- Smt. Kanuri Santhamma Retina Vitreous Centre, L.V. Prasad Eye Institute, Kallam Anji Reddy Campus, L.V. Prasad Marg, Banjara Hills, Hyderabad 500 034, India
| | - Igor Kozak
- Division of Vitreoretinal Diseases and Surgery, King Khaled Eye Specialist Hospital, P.O. Box 7191, Riyadh 11462, Saudi Arabia
| |
Collapse
|
30
|
Zawadzki RJ, Capps AG, Kim DY, Panorgias A, Stevenson SB, Hamann B, Werner JS. Progress on Developing Adaptive Optics-Optical Coherence Tomography for In Vivo Retinal Imaging: Monitoring and Correction of Eye Motion Artifacts. IEEE JOURNAL OF SELECTED TOPICS IN QUANTUM ELECTRONICS : A PUBLICATION OF THE IEEE LASERS AND ELECTRO-OPTICS SOCIETY 2014; 20:7100912. [PMID: 25544826 PMCID: PMC4276343 DOI: 10.1109/jstqe.2013.2288302] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/18/2023]
Abstract
Recent progress in retinal image acquisition techniques, including optical coherence tomography (OCT) and scanning laser ophthalmoscopy (SLO), combined with improved performance of adaptive optics (AO) instrumentation, has resulted in improvement in the quality of in vivo images of cellular structures in the human retina. Here, we present a short review of progress on developing AO-OCT instruments. Despite significant progress in imaging speed and resolution, eye movements present during acquisition of a retinal image with OCT introduce motion artifacts into the image, complicating analysis and registration. This effect is especially pronounced in high-resolution datasets acquired with AO-OCT instruments. Several retinal tracking systems have been introduced to correct retinal motion during data acquisition. We present a method for correcting motion artifacts in AO-OCT volume data after acquisition using simultaneously captured adaptive optics-scanning laser ophthalmoscope (AO-SLO) images. We extract transverse eye motion data from the AO-SLO images, assign a motion adjustment vector to each AO-OCT A-scan, and re-sample from the scattered data back onto a regular grid. The corrected volume data improve the accuracy of quantitative analyses of microscopic structures.
Collapse
Affiliation(s)
- Robert J. Zawadzki
- Vision Science and Advanced Retinal Imaging Laboratroy (VSRI), Department of Ophthalmology and Vision Science, and Department of Cell Biology and Human Anatomy, University of California Davis, Sacramento, CA 95817 USA
| | - Arlie G. Capps
- Vision Science and Advanced Retinal Imaging Laboratory (VSRI), Department of Ophthalmology and Vision Science, with the Institute for Data Analysis and Visualization (IDAV), Department of Computer Science, University of California, Davis, Davis, CA 95616 USA, and also with Physical and Life Sciences, Lawrence Livermore National Laboratory, CA 94551 USA
| | - Dae Yu Kim
- Vision Science and Advanced Retinal Imaging Laboratroy (VSRI), Department of Ophthalmology and Vision Science, University of California Davis, Sacramento, CA 95817 USA
| | - Athanasios Panorgias
- Vision Science and Advanced Retinal Imaging Laboratroy (VSRI), Department of Ophthalmology and Vision Science, University of California Davis, Sacramento, CA 95817 USA
| | | | - Bernd Hamann
- Institute for Data Analysis and Visualization (IDAV), Department of Computer Science, University of California, Davis, CA 95616–8562 USA
| | - John S. Werner
- Vision Science and Advanced Retinal Imaging Laboratroy (VSRI), Department of Ophthalmology and Vision Science, University of California Davis, Sacramento, CA 95817 USA
| |
Collapse
|
31
|
Montuoro A, Wu J, Waldstein S, Gerendas B, Langs G, Simader C, Schmidt-Erfurth U. Motion Artefact Correction in Retinal Optical Coherence Tomography Using Local Symmetry. MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION – MICCAI 2014 2014; 17:130-7. [DOI: 10.1007/978-3-319-10470-6_17] [Citation(s) in RCA: 19] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/04/2022]
|
32
|
Hendargo HC, Estrada R, Chiu SJ, Tomasi C, Farsiu S, Izatt JA. Automated non-rigid registration and mosaicing for robust imaging of distinct retinal capillary beds using speckle variance optical coherence tomography. BIOMEDICAL OPTICS EXPRESS 2013; 4:803-21. [PMID: 23761845 PMCID: PMC3675861 DOI: 10.1364/boe.4.000803] [Citation(s) in RCA: 100] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/19/2013] [Revised: 04/25/2013] [Accepted: 04/27/2013] [Indexed: 05/17/2023]
Abstract
Variance processing methods in Fourier domain optical coherence tomography (FD-OCT) have enabled depth-resolved visualization of the capillary beds in the retina due to the development of imaging systems capable of acquiring A-scan data in the 100 kHz regime. However, acquisition of volumetric variance data sets still requires several seconds of acquisition time, even with high speed systems. Movement of the subject during this time span is sufficient to corrupt visualization of the vasculature. We demonstrate a method to eliminate motion artifacts in speckle variance FD-OCT images of the retinal vasculature by creating a composite image from multiple volumes of data acquired sequentially. Slight changes in the orientation of the subject's eye relative to the optical system between acquired volumes may result in non-rigid warping of the image. Thus, we use a B-spline based free form deformation method to automatically register variance images from multiple volumes to obtain a motion-free composite image of the retinal vessels. We extend this technique to automatically mosaic individual vascular images into a widefield image of the retinal vasculature.
Collapse
Affiliation(s)
| | - Rolando Estrada
- Department of Computer Science, Duke University, Durham, NC 27708, USA
| | - Stephanie J. Chiu
- Department of Biomedical Engineering, Duke University, Durham, NC 27708, USA
| | - Carlo Tomasi
- Department of Computer Science, Duke University, Durham, NC 27708, USA
| | - Sina Farsiu
- Department of Biomedical Engineering, Duke University, Durham, NC 27708, USA
- Department of Ophthalmology, Duke University, Durham, NC 27708, USA
| | - Joseph A. Izatt
- Department of Biomedical Engineering, Duke University, Durham, NC 27708, USA
- Department of Ophthalmology, Duke University, Durham, NC 27708, USA
| |
Collapse
|
33
|
Müller O, Donner S, Klinder T, Bartsch I, Krüger A, Heisterkamp A, Rosenhahn B. Compensating motion artifacts of 3D in vivo SD-OCT scans. MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION : MICCAI ... INTERNATIONAL CONFERENCE ON MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION 2013; 15:198-205. [PMID: 23285552 DOI: 10.1007/978-3-642-33415-3_25] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
Abstract
We propose a probabilistic approach for compensating motion artifacts in 3D in vivo SD-OCT (spectral-domain optical coherence tomography) tomographs. Subject movement causing axial image shifting is a major problem for in vivo imaging. Our technique is applied to analyze the tissue at percutaneous implants recorded with SD-OCT in 3D. The key challenge is to distinguish between motion and the natural 3D spatial structure of the scanned subject. To achieve this, the motion estimation problem is formulated as a conditional random field (CRF). For efficient inference, the CRF is approximated by a Gaussian Markov random field. The method is verified on synthetic datasets and applied on noisy in vivo recordings showing significant reduction of motion artifacts while preserving the tissue geometry.
Collapse
Affiliation(s)
- O Müller
- Institut für Informationsverarbeitung, Leibniz Universität Hannover, Germany.
| | | | | | | | | | | | | |
Collapse
|
34
|
Theelen T, Hoyng CB. A Prospective, Comparative, Observational Study on Optical Coherence Tomography of the Anterior Eye Segment. Ophthalmologica 2013; 230:222-6. [DOI: 10.1159/000354114] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2013] [Accepted: 06/26/2013] [Indexed: 11/19/2022]
|
35
|
Braaf B, Vienola KV, Sheehy CK, Yang Q, Vermeer KA, Tiruveedhula P, Arathorn DW, Roorda A, de Boer JF. Real-time eye motion correction in phase-resolved OCT angiography with tracking SLO. BIOMEDICAL OPTICS EXPRESS 2013; 4:51-65. [PMID: 23304647 PMCID: PMC3539196 DOI: 10.1364/boe.4.000051] [Citation(s) in RCA: 67] [Impact Index Per Article: 5.6] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/12/2012] [Revised: 12/05/2012] [Accepted: 12/05/2012] [Indexed: 05/18/2023]
Abstract
In phase-resolved OCT angiography blood flow is detected from phase changes in between A-scans that are obtained from the same location. In ophthalmology, this technique is vulnerable to eye motion. We address this problem by combining inter-B-scan phase-resolved OCT angiography with real-time eye tracking. A tracking scanning laser ophthalmoscope (TSLO) at 840 nm provided eye tracking functionality and was combined with a phase-stabilized optical frequency domain imaging (OFDI) system at 1040 nm. Real-time eye tracking corrected eye drift and prevented discontinuity artifacts from (micro)saccadic eye motion in OCT angiograms. This improved the OCT spot stability on the retina and consequently reduced the phase-noise, thereby enabling the detection of slower blood flows by extending the inter-B-scan time interval. In addition, eye tracking enabled the easy compounding of multiple data sets from the fovea of a healthy volunteer to create high-quality eye motion artifact-free angiograms. High-quality images are presented of two distinct layers of vasculature in the retina and the dense vasculature of the choroid. Additionally we present, for the first time, a phase-resolved OCT angiogram of the mesh-like network of the choriocapillaris containing typical pore openings.
Collapse
Affiliation(s)
- Boy Braaf
- Rotterdam Ophthalmic Institute, Schiedamse Vest 160, 3011 BH Rotterdam, Netherlands
| | - Kari V. Vienola
- Rotterdam Ophthalmic Institute, Schiedamse Vest 160, 3011 BH Rotterdam, Netherlands
| | - Christy K. Sheehy
- School of Optometry, University of California, Berkeley; Berkeley, CA 94720, USA
| | - Qiang Yang
- Montana State University, Bozeman, MT 59717, USA
| | - Koenraad A. Vermeer
- Rotterdam Ophthalmic Institute, Schiedamse Vest 160, 3011 BH Rotterdam, Netherlands
| | - Pavan Tiruveedhula
- School of Optometry, University of California, Berkeley; Berkeley, CA 94720, USA
| | | | - Austin Roorda
- School of Optometry, University of California, Berkeley; Berkeley, CA 94720, USA
| | - Johannes F. de Boer
- Rotterdam Ophthalmic Institute, Schiedamse Vest 160, 3011 BH Rotterdam, Netherlands
- LaserLaB, Department of Physics and Astronomy, VU University, de Boelelaan 1081, 1081 HV Amsterdam, Netherlands
| |
Collapse
|
36
|
LaRocca F, Nankivil D, Farsiu S, Izatt JA. Handheld simultaneous scanning laser ophthalmoscopy and optical coherence tomography system. BIOMEDICAL OPTICS EXPRESS 2013; 4:2307-21. [PMID: 24298396 PMCID: PMC3829529 DOI: 10.1364/boe.4.002307] [Citation(s) in RCA: 20] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/12/2013] [Revised: 09/24/2013] [Accepted: 09/25/2013] [Indexed: 05/03/2023]
Abstract
Scanning laser ophthalmoscopy (SLO) and optical coherence tomography (OCT) are widely used retinal imaging modalities that can assist in the diagnosis of retinal pathologies. The combination of SLO and OCT provides a more comprehensive imaging system and a method to register OCT images to produce motion corrected retinal volumes. While high quality, bench-top SLO-OCT systems have been discussed in the literature and are available commercially, there are currently no handheld designs. We describe the first design and fabrication of a handheld SLO/spectral domain OCT probe. SLO and OCT images were acquired simultaneously with a combined power under the ANSI limit. High signal-to-noise ratio SLO and OCT images were acquired simultaneously from a normal subject with visible motion artifacts. Fully automated motion estimation methods were performed in post-processing to correct for the inter- and intra-frame motion in SLO images and their concurrently acquired OCT volumes. The resulting set of reconstructed SLO images and the OCT volume were without visible motion artifacts. At a reduced field of view, the SLO resolved parafoveal cones without adaptive optics at a retinal eccentricity of 11° in subjects with good ocular optics. This system may be especially useful for imaging young children and subjects with less stable fixation.
Collapse
Affiliation(s)
- Francesco LaRocca
- Department of Biomedical Engineering, Duke University, Durham, NC, 27708, USA
| | - Derek Nankivil
- Department of Biomedical Engineering, Duke University, Durham, NC, 27708, USA
| | - Sina Farsiu
- Department of Biomedical Engineering, Duke University, Durham, NC, 27708, USA
- Department of Ophthalmology, Duke University Medical Center, Durham, NC, 27710, USA
| | - Joseph A. Izatt
- Department of Biomedical Engineering, Duke University, Durham, NC, 27708, USA
- Department of Ophthalmology, Duke University Medical Center, Durham, NC, 27710, USA
| |
Collapse
|
37
|
Klein T, Wieser W, Reznicek L, Neubauer A, Kampik A, Huber R. Multi-MHz retinal OCT. BIOMEDICAL OPTICS EXPRESS 2013; 4:1890-908. [PMID: 24156052 PMCID: PMC3799654 DOI: 10.1364/boe.4.001890] [Citation(s) in RCA: 128] [Impact Index Per Article: 10.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/29/2013] [Revised: 07/17/2013] [Accepted: 07/18/2013] [Indexed: 05/17/2023]
Abstract
We analyze the benefits and problems of in vivo optical coherence tomography (OCT) imaging of the human retina at A-scan rates in excess of 1 MHz, using a 1050 nm Fourier-domain mode-locked (FDML) laser. Different scanning strategies enabled by MHz OCT line rates are investigated, and a simple multi-volume data processing approach is presented. In-vivo OCT of the human ocular fundus is performed at different axial scan rates of up to 6.7 MHz. High quality non-mydriatic retinal imaging over an ultra-wide field is achieved by a combination of several key improvements compared to previous setups. For the FDML laser, long coherence lengths and 72 nm wavelength tuning range are achieved using a chirped fiber Bragg grating in a laser cavity at 419.1 kHz fundamental tuning rate. Very large data sets can be acquired with sustained data transfer from the data acquisition card to host computer memory, enabling high-quality averaging of many frames and of multiple aligned data sets. Three imaging modes are investigated: Alignment and averaging of 24 data sets at 1.68 MHz axial line rate, ultra-dense transverse sampling at 3.35 MHz line rate, and dual-beam imaging with two laser spots on the retina at an effective line rate of 6.7 MHz.
Collapse
Affiliation(s)
- Thomas Klein
- Lehrstuhl für BioMolekulare Optik, Fakultät für Physik, Ludwig-Maximilians-Universität München, Oettingenstr. 67, 80538 Munich, Germany
| | - Wolfgang Wieser
- Lehrstuhl für BioMolekulare Optik, Fakultät für Physik, Ludwig-Maximilians-Universität München, Oettingenstr. 67, 80538 Munich, Germany
| | - Lukas Reznicek
- Augenklinik der Ludwig-Maximilians-Universität München, Mathildenstraße 8, 80336 Munich, Germany
| | - Aljoscha Neubauer
- Augenklinik der Ludwig-Maximilians-Universität München, Mathildenstraße 8, 80336 Munich, Germany
| | - Anselm Kampik
- Augenklinik der Ludwig-Maximilians-Universität München, Mathildenstraße 8, 80336 Munich, Germany
| | - Robert Huber
- Lehrstuhl für BioMolekulare Optik, Fakultät für Physik, Ludwig-Maximilians-Universität München, Oettingenstr. 67, 80538 Munich, Germany
| |
Collapse
|
38
|
Vienola KV, Braaf B, Sheehy CK, Yang Q, Tiruveedhula P, Arathorn DW, de Boer JF, Roorda A. Real-time eye motion compensation for OCT imaging with tracking SLO. BIOMEDICAL OPTICS EXPRESS 2012; 3:2950-63. [PMID: 23162731 PMCID: PMC3493227 DOI: 10.1364/boe.3.002950] [Citation(s) in RCA: 79] [Impact Index Per Article: 6.1] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/29/2012] [Revised: 10/10/2012] [Accepted: 10/10/2012] [Indexed: 05/17/2023]
Abstract
Fixational eye movements remain a major cause of artifacts in optical coherence tomography (OCT) images despite the increases in acquisition speeds. One approach to eliminate the eye motion is to stabilize the ophthalmic imaging system in real-time. This paper describes and quantifies the performance of a tracking OCT system, which combines a phase-stabilized optical frequency domain imaging (OFDI) system and an eye tracking scanning laser ophthalmoscope (TSLO). We show that active eye tracking minimizes artifacts caused by eye drift and micro saccades. The remaining tracking lock failures caused by blinks and large saccades generate a trigger signal which signals the OCT system to rescan corrupted B-scans. Residual motion artifacts in the OCT B-scans are reduced to 0.32 minutes of arc (~1.6 µm) in an in vivo human eye enabling acquisition of high quality images from the optic nerve head and lamina cribrosa pore structure.
Collapse
Affiliation(s)
- Kari V. Vienola
- Rotterdam Ophthalmic Institute, Schiedamse Vest 160, 3011 BH
Rotterdam, Netherlands
| | - Boy Braaf
- Rotterdam Ophthalmic Institute, Schiedamse Vest 160, 3011 BH
Rotterdam, Netherlands
| | - Christy K. Sheehy
- School of Optometry, University of California, Berkeley; Berkeley,
CA, 94720, USA
| | - Qiang Yang
- Montana State University, Bozeman, MT 59717,
USA
| | - Pavan Tiruveedhula
- School of Optometry, University of California, Berkeley; Berkeley,
CA, 94720, USA
| | | | - Johannes F. de Boer
- Rotterdam Ophthalmic Institute, Schiedamse Vest 160, 3011 BH
Rotterdam, Netherlands
- LaserLAB, Department of Physics and Astronomy, VU University, de
Boelelaan 1081, 1081 HV, Amsterdam, Netherlands
| | - Austin Roorda
- School of Optometry, University of California, Berkeley; Berkeley,
CA, 94720, USA
| |
Collapse
|
39
|
Abstract
Optical coherence tomography captures a major role in clinical assessment in eye care. Innovative hardware and software improvements in the technology would further enhance its usefulness. In this review, we present several promising initiatives currently in development or early phase of assessment that we expect to have a future impact on optical coherence tomography.
Collapse
|
40
|
Hu Z, Niemeijer M, Abràmoff MD, Garvin MK. Multimodal retinal vessel segmentation from spectral-domain optical coherence tomography and fundus photography. IEEE TRANSACTIONS ON MEDICAL IMAGING 2012; 31:1900-11. [PMID: 22759443 PMCID: PMC4049064 DOI: 10.1109/tmi.2012.2206822] [Citation(s) in RCA: 20] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/22/2023]
Abstract
Segmenting retinal vessels in optic nerve head (ONH) centered spectral-domain optical coherence tomography (SD-OCT) volumes is particularly challenging due to the projected neural canal opening (NCO) and relatively low visibility in the ONH center. Color fundus photographs provide a relatively high vessel contrast in the region inside the NCO, but have not been previously used to aid the SD-OCT vessel segmentation process. Thus, in this paper, we present two approaches for the segmentation of retinal vessels in SD-OCT volumes that each take advantage of complimentary information from fundus photographs. In the first approach (referred to as the registered-fundus vessel segmentation approach), vessels are first segmented on the fundus photograph directly (using a k-NN pixel classifier) and this vessel segmentation result is mapped to the SD-OCT volume through the registration of the fundus photograph to the SD-OCT volume. In the second approach (referred to as the multimodal vessel segmentation approach), after fundus-to-SD-OCT registration, vessels are simultaneously segmented with a k -NN classifier using features from both modalities. Three-dimensional structural information from the intraretinal layers and neural canal opening obtained through graph-theoretic segmentation approaches of the SD-OCT volume are used in combination with Gaussian filter banks and Gabor wavelets to generate the features. The approach is trained on 15 and tested on 19 randomly chosen independent image pairs of SD-OCT volumes and fundus images from 34 subjects with glaucoma. Based on a receiver operating characteristic (ROC) curve analysis, the present registered-fundus and multimodal vessel segmentation approaches [area under the curve (AUC) of 0.85 and 0.89, respectively] both perform significantly better than the two previous OCT-based approaches (AUC of 0.78 and 0.83, p < 0.05). The multimodal approach overall performs significantly better than the other three approaches (p < 0.05).
Collapse
Affiliation(s)
- Zhihong Hu
- Department of Electrical and Computer Engineering, The University of Iowa, Iowa City, IA, 52242 USA. She is currently with Doheny Eye Institute, The University of Southern California, Los Angeles, CA, 90033 USA
| | - Meindert Niemeijer
- Department of Electrical and Computer Engineering, The University of Iowa, Iowa City, IA, 52242 USA
| | - Michael D. Abràmoff
- Departments of Ophthalmology and Visual Sciences, Electrical and Computer Engineering, and Biomedical Engineering, The University of Iowa, Iowa City, IA, 52242 USA. He is also with the VA Center for the Prevention and Treatment of Visual Loss, Iowa City, IA, 52246 USA
| | | |
Collapse
|
41
|
Liew YM, McLaughlin RA, Wood FM, Sampson DD. Motion correction of in vivo three-dimensional optical coherence tomography of human skin using a fiducial marker. BIOMEDICAL OPTICS EXPRESS 2012; 3:1774-86. [PMID: 22876343 PMCID: PMC3409698 DOI: 10.1364/boe.3.001774] [Citation(s) in RCA: 24] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/02/2012] [Revised: 06/21/2012] [Accepted: 06/26/2012] [Indexed: 05/04/2023]
Abstract
This paper presents a novel method based on a fiducial marker for correction of motion artifacts in 3D, in vivo, optical coherence tomography (OCT) scans of human skin and skin scars. The efficacy of this method was compared against a standard cross-correlation intensity-based registration method. With a fiducial marker adhered to the skin, OCT scans were acquired using two imaging protocols: direct imaging from air into tissue; and imaging through ultrasound gel into tissue, which minimized the refractive index mismatch at the tissue surface. The registration methods were assessed with data from both imaging protocols and showed reduced distortion of skin features due to motion. The fiducial-based method was found to be more accurate and robust, with an average RMS error below 20 µm and success rate above 90%. In contrast, the intensity-based method had an average RMS error ranging from 36 to 45 µm, and a success rate from 50% to 86%. The intensity-based algorithm was found to be particularly confounded by corrugations in the skin. By contrast, tissue features did not affect the fiducial-based method, as the motion correction was based on delineation of the flat fiducial marker. The average computation time for the fiducial-based algorithm was approximately 21 times less than for the intensity-based algorithm.
Collapse
Affiliation(s)
- Yih Miin Liew
- Optical+Biomedical Engineering Laboratory, School of Electrical, Electronic & Computer Engineering, The University of Western Australia, M018, 35 Stirling Highway, Crawley WA 6009, Australia
| | - Robert A. McLaughlin
- Optical+Biomedical Engineering Laboratory, School of Electrical, Electronic & Computer Engineering, The University of Western Australia, M018, 35 Stirling Highway, Crawley WA 6009, Australia
| | - Fiona M. Wood
- Burns Service of Western Australia, Royal Perth Hospital (RPH), Wellington Street, Perth WA 6000, Australia
- Burn Injury Research Unit, School of Surgery, The University of Western Australia, 35 Stirling Highway, Crawley WA 6009, Australia
| | - David D. Sampson
- Optical+Biomedical Engineering Laboratory, School of Electrical, Electronic & Computer Engineering, The University of Western Australia, M018, 35 Stirling Highway, Crawley WA 6009, Australia
- Centre for Microscopy, Characterisation & Analysis, The University of Western Australia, M010, 35 Stirling Highway, Crawley, Perth, WA 6009, Australia
| |
Collapse
|
42
|
Xu J, Ishikawa H, Wollstein G, Kagemann L, Schuman JS. Alignment of 3-D optical coherence tomography scans to correct eye movement using a particle filtering. IEEE TRANSACTIONS ON MEDICAL IMAGING 2012; 31:1337-45. [PMID: 22231171 PMCID: PMC3417150 DOI: 10.1109/tmi.2011.2182618] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/22/2023]
Abstract
Eye movement artifacts occurring during 3-D optical coherence tomography (OCT) scanning is a well-recognized problem that may adversely affect image analysis and interpretation. A particle filtering algorithm is presented in this paper to correct motion in a 3-D dataset by considering eye movement as a target tracking problem in a dynamic system. The proposed particle filtering algorithm is an independent 3-D alignment approach, which does not rely on any reference image. 3-D OCT data is considered as a dynamic system, while the location of each A-scan is represented by the state space. A particle set is used to approximate the probability density of the state in the dynamic system. The state of the system is updated frame by frame to detect A-scan movement. The proposed method was applied on both simulated data for objective evaluation and experimental data for subjective evaluation. The sensitivity and specificity of the x-movement detection were 98.85% and 99.43%, respectively, in the simulated data. For the experimental data (74 3-D OCT images), all the images were improved after z-alignment, while 81.1% images were improved after x-alignment. The proposed algorithm is an efficient way to align 3-D OCT volume data and correct the eye movement without using references.
Collapse
Affiliation(s)
| | - Hiroshi Ishikawa
- Department of Ophthalmology, UPMC Eye Center, University of Pittsburgh School of Medicine, Pittsburgh, PA 15213 USA ()
| | - Gadi Wollstein
- Department of Ophthalmology, UPMC Eye Center, University of Pittsburgh School of Medicine, Pittsburgh, PA 15213 USA ()
| | - Larry Kagemann
- Department of Bioengineering, Swanson School of Engineering, University of Pittsburgh, Pittsburgh, PA 15213 USA ()
| | - Joel S. Schuman
- Department of Bioengineering, Swanson School of Engineering, University of Pittsburgh, Pittsburgh, PA 15213 USA ()
| |
Collapse
|
43
|
Wang JK, Kardon RH, Kupersmith MJ, Garvin MK. Automated quantification of volumetric optic disc swelling in papilledema using spectral-domain optical coherence tomography. Invest Ophthalmol Vis Sci 2012; 53:4069-75. [PMID: 22599584 DOI: 10.1167/iovs.12-9438] [Citation(s) in RCA: 57] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
PURPOSE To develop an automated method for the quantification of volumetric optic disc swelling in papilledema subjects using spectral-domain optical coherence tomography (SD-OCT) and to determine the extent that such volumetric measurements correlate with Frisén scale grades (from fundus photographs) and two-dimensional (2-D) peripapillary retinal nerve fiber layer (RNFL) and total retinal (TR) thickness measurements from SD-OCT. METHODS A custom image-analysis algorithm was developed to obtain peripapillary circular RNFL thickness, TR thickness, and TR volume measurements from SD-OCT volumes of subjects with papilledema. In addition, peripapillary RNFL thickness measures from the commercially available Zeiss SD-OCT machine were obtained. Expert Frisén scale grades were independently obtained from corresponding fundus photographs. RESULTS In 71 SD-OCT scans, the mean (± standard deviation) resulting TR volumes for Frisén scale 0 to scale 4 were 11.36 ± 0.56, 12.53 ± 1.21, 14.42 ± 2.11, 17.48 ± 2.63, and 21.81 ± 3.16 mm(3), respectively. The Spearman's rank correlation coefficient was 0.737. Using 55 eyes with valid Zeiss RNFL measurements, Pearson's correlation coefficient (r) between the TR volume and the custom algorithm's TR thickness, the custom algorithm's RNFL thickness, and Zeiss' RNFL thickness was 0.980, 0.929, and 0.946, respectively. Between Zeiss' RNFL and the custom algorithm's RNFL, and the study's TR thickness, r was 0.901 and 0.961, respectively. CONCLUSIONS Volumetric measurements of the degree of disc swelling in subjects with papilledema can be obtained from SD-OCT volumes, with the mean volume appearing to be roughly linearly related to the Frisén scale grade. Using such an approach can provide a more continuous, objective, and robust means for assessing the degree of disc swelling compared with presently available approaches.
Collapse
Affiliation(s)
- Jui-Kai Wang
- Department of Electrical and Computer Engineering, The University of Iowa, Iowa City, USA
| | | | | | | |
Collapse
|
44
|
Kraus MF, Potsaid B, Mayer MA, Bock R, Baumann B, Liu JJ, Hornegger J, Fujimoto JG. Motion correction in optical coherence tomography volumes on a per A-scan basis using orthogonal scan patterns. BIOMEDICAL OPTICS EXPRESS 2012; 3:1182-99. [PMID: 22741067 PMCID: PMC3370961 DOI: 10.1364/boe.3.001182] [Citation(s) in RCA: 270] [Impact Index Per Article: 20.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/09/2012] [Revised: 04/23/2012] [Accepted: 04/25/2012] [Indexed: 05/18/2023]
Abstract
High speed Optical Coherence Tomography (OCT) has made it possible to rapidly capture densely sampled 3D volume data. One key application is the acquisition of high quality in vivo volumetric data sets of the human retina. Since the volume is acquired in a few seconds, eye movement during the scan process leads to distortion, which limits the accuracy of quantitative measurements using 3D OCT data. In this paper, we present a novel software based method to correct motion artifacts in OCT raster scans. Motion compensation is performed retrospectively using image registration algorithms on the OCT data sets themselves. Multiple, successively acquired volume scans with orthogonal fast scan directions are registered retrospectively in order to estimate and correct eye motion. Registration is performed by optimizing a large scale numerical problem as given by a global objective function using one dense displacement field for each input volume and special regularization based on the time structure of the acquisition process. After optimization, each volume is undistorted and a single merged volume is constructed that has superior signal quality compared to the input volumes. Experiments were performed using 3D OCT data from the macula and optic nerve head acquired with a high-speed ultra-high resolution 850 nm spectral OCT as well as wide field data acquired with a 1050 nm swept source OCT instrument. Evaluation of registration performance and result stability as well as visual inspection shows that the algorithm can correct for motion in all three dimensions and on a per A-scan basis. Corrected volumes do not show visible motion artifacts. In addition, merging multiple motion corrected and registered volumes leads to improved signal quality. These results demonstrate that motion correction and merging improves image quality and should also improve morphometric measurement accuracy from volumetric OCT data.
Collapse
Affiliation(s)
- Martin F. Kraus
- Pattern Recognition Lab, University Erlangen-Nuremberg, Erlangen, Germany
- School of Advanced Optical Technologies (SAOT), University Erlangen-Nuremberg, Germany
- Dept of Electrical Engineering and Computer Science and Research Laboratory of Electronics, Massachusetts Inst. of Technology, Cambridge, MA, USA
| | - Benjamin Potsaid
- Dept of Electrical Engineering and Computer Science and Research Laboratory of Electronics, Massachusetts Inst. of Technology, Cambridge, MA, USA
- Advanced Imaging Group, Thorlabs, Inc., Newton, NJ 07860, USA
| | - Markus A. Mayer
- Pattern Recognition Lab, University Erlangen-Nuremberg, Erlangen, Germany
- School of Advanced Optical Technologies (SAOT), University Erlangen-Nuremberg, Germany
| | - Ruediger Bock
- Pattern Recognition Lab, University Erlangen-Nuremberg, Erlangen, Germany
- School of Advanced Optical Technologies (SAOT), University Erlangen-Nuremberg, Germany
| | - Bernhard Baumann
- Dept of Electrical Engineering and Computer Science and Research Laboratory of Electronics, Massachusetts Inst. of Technology, Cambridge, MA, USA
| | - Jonathan J. Liu
- Dept of Electrical Engineering and Computer Science and Research Laboratory of Electronics, Massachusetts Inst. of Technology, Cambridge, MA, USA
| | - Joachim Hornegger
- Pattern Recognition Lab, University Erlangen-Nuremberg, Erlangen, Germany
- School of Advanced Optical Technologies (SAOT), University Erlangen-Nuremberg, Germany
| | - James G. Fujimoto
- Dept of Electrical Engineering and Computer Science and Research Laboratory of Electronics, Massachusetts Inst. of Technology, Cambridge, MA, USA
| |
Collapse
|
45
|
Young M, Lebed E, Jian Y, Mackenzie PJ, Beg MF, Sarunic MV. Real-time high-speed volumetric imaging using compressive sampling optical coherence tomography. BIOMEDICAL OPTICS EXPRESS 2011; 2:2690-7. [PMID: 21991557 PMCID: PMC3184877 DOI: 10.1364/boe.2.002690] [Citation(s) in RCA: 28] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/21/2011] [Revised: 08/19/2011] [Accepted: 08/19/2011] [Indexed: 05/25/2023]
Abstract
Volumetric imaging of the Optic Nerve Head (ONH) morphometry with Optical Coherence Tomography (OCT) requires dense sampling and relatively long acquisition times. Compressive Sampling (CS) is an emerging technique to reduce volume acquisition time with minimal image degradation by sparsely sampling the object and reconstructing the missing data in software. In this report, we demonstrated real-time CS-OCT for volumetric imaging of the ONH using a 1060nm Swept-Source OCT prototype. We also showed that registration and averaging of CS-recovered volumes enhanced visualization of deep structures of the sclera and lamina cribrosa. This work validates CS-OCT as a means for reducing volume acquisition time and for preserving high-resolution in volume-averaged images. Compressive sampling can be integrated into new and existing OCT systems without changes to the optics, requiring only software changes and post-processing of acquired data.
Collapse
Affiliation(s)
- Mei Young
- School of Engineering Science, Simon Fraser University, Canada
| | - Evgeniy Lebed
- School of Engineering Science, Simon Fraser University, Canada
| | - Yifan Jian
- School of Engineering Science, Simon Fraser University, Canada
| | - Paul J. Mackenzie
- Department of Ophthalmology and Visual Sciences, University of British Columbia, Canada
| | | | | |
Collapse
|
46
|
Antony B, Abràmoff MD, Tang L, Ramdas WD, Vingerling JR, Jansonius NM, Lee K, Kwon YH, Sonka M, Garvin MK. Automated 3-D method for the correction of axial artifacts in spectral-domain optical coherence tomography images. BIOMEDICAL OPTICS EXPRESS 2011; 2:2403-16. [PMID: 21833377 PMCID: PMC3149538 DOI: 10.1364/boe.2.002403] [Citation(s) in RCA: 55] [Impact Index Per Article: 3.9] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/20/2011] [Revised: 07/13/2011] [Accepted: 07/19/2011] [Indexed: 05/18/2023]
Abstract
The 3-D spectral-domain optical coherence tomography (SD-OCT) images of the retina often do not reflect the true shape of the retina and are distorted differently along the x and y axes. In this paper, we propose a novel technique that uses thin-plate splines in two stages to estimate and correct the distinct axial artifacts in SD-OCT images. The method was quantitatively validated using nine pairs of OCT scans obtained with orthogonal fast-scanning axes, where a segmented surface was compared after both datasets had been corrected. The mean unsigned difference computed between the locations of this artifact-corrected surface after the single-spline and dual-spline correction was 23.36 ± 4.04 μm and 5.94 ± 1.09 μm, respectively, and showed a significant difference (p < 0.001 from two-tailed paired t-test). The method was also validated using depth maps constructed from stereo fundus photographs of the optic nerve head, which were compared to the flattened top surface from the OCT datasets. Significant differences (p < 0.001) were noted between the artifact-corrected datasets and the original datasets, where the mean unsigned differences computed over 30 optic-nerve-head-centered scans (in normalized units) were 0.134 ± 0.035 and 0.302 ± 0.134, respectively.
Collapse
|
47
|
Liu YY, Chen M, Ishikawa H, Wollstein G, Schuman JS, Rehg JM. Automated macular pathology diagnosis in retinal OCT images using multi-scale spatial pyramid and local binary patterns in texture and shape encoding. Med Image Anal 2011; 15:748-59. [PMID: 21737338 DOI: 10.1016/j.media.2011.06.005] [Citation(s) in RCA: 70] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2011] [Revised: 06/03/2011] [Accepted: 06/06/2011] [Indexed: 11/18/2022]
Abstract
We address a novel problem domain in the analysis of optical coherence tomography (OCT) images: the diagnosis of multiple macular pathologies in retinal OCT images. The goal is to identify the presence of normal macula and each of three types of macular pathologies, namely, macular edema, macular hole, and age-related macular degeneration, in the OCT slice centered at the fovea. We use a machine learning approach based on global image descriptors formed from a multi-scale spatial pyramid. Our local features are dimension-reduced local binary pattern histograms, which are capable of encoding texture and shape information in retinal OCT images and their edge maps, respectively. Our representation operates at multiple spatial scales and granularities, leading to robust performance. We use 2-class support vector machine classifiers to identify the presence of normal macula and each of the three pathologies. To further discriminate sub-types within a pathology, we also build a classifier to differentiate full-thickness holes from pseudo-holes within the macular hole category. We conduct extensive experiments on a large dataset of 326 OCT scans from 136 subjects. The results show that the proposed method is very effective (all AUC>0.93).
Collapse
Affiliation(s)
- Yu-Ying Liu
- School of Interactive Computing, College of Computing, Georgia Institute of Technology, Atlanta, GA, USA.
| | | | | | | | | | | |
Collapse
|
48
|
Gabriele ML, Wollstein G, Ishikawa H, Kagemann L, Xu J, Folio LS, Schuman JS. Optical coherence tomography: history, current status, and laboratory work. Invest Ophthalmol Vis Sci 2011; 52:2425-36. [PMID: 21493951 DOI: 10.1167/iovs.10-6312] [Citation(s) in RCA: 159] [Impact Index Per Article: 11.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/06/2023] Open
Abstract
Optical coherence tomography (OCT) imaging has become widespread in ophthalmology over the past 15 years, because of its ability to visualize ocular structures at high resolution. This article reviews the history of OCT imaging of the eye, its current status, and the laboratory work that is driving the future of the technology.
Collapse
Affiliation(s)
- Michelle L Gabriele
- Department of Ophthalmology, UPMC Eye Center, Eye and Ear Institute, Ophthalmology and Visual Science Research Center, University of Pittsburgh School of Medicine, Pittsburgh, Pennsylvania 15213, USA
| | | | | | | | | | | | | |
Collapse
|
49
|
Gabriele ML, Wollstein G, Ishikawa H, Xu J, Kim J, Kagemann L, Folio LS, Schuman JS. Three dimensional optical coherence tomography imaging: advantages and advances. Prog Retin Eye Res 2010; 29:556-79. [PMID: 20542136 DOI: 10.1016/j.preteyeres.2010.05.005] [Citation(s) in RCA: 39] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/04/2023]
Abstract
Three dimensional (3D) ophthalmic imaging using optical coherence tomography (OCT) has revolutionized assessment of the eye, the retina in particular. Recent technological improvements have made the acquisition of 3D-OCT datasets feasible. However, while volumetric data can improve disease diagnosis and follow-up, novel image analysis techniques are now necessary in order to process the dense 3D-OCT dataset. Fundamental software improvements include methods for correcting subject eye motion, segmenting structures or volumes of interest, extracting relevant data post hoc and signal averaging to improve delineation of retinal layers. In addition, innovative methods for image display, such as C-mode sectioning, provide a unique viewing perspective and may improve interpretation of OCT images of pathologic structures. While all of these methods are being developed, most remain in an immature state. This review describes the current status of 3D-OCT scanning and interpretation, and discusses the need for standardization of clinical protocols as well as the potential benefits of 3D-OCT scanning that could come when software methods for fully exploiting these rich datasets are available clinically. The implications of new image analysis approaches include improved reproducibility of measurements garnered from 3D-OCT, which may then help improve disease discrimination and progression detection. In addition, 3D-OCT offers the potential for preoperative surgical planning and intraoperative surgical guidance.
Collapse
Affiliation(s)
- Michelle L Gabriele
- Department of Ophthalmology, UPMC Eye Center, University of Pittsburgh School of Medicine, Pittsburgh, PA 15213, USA
| | | | | | | | | | | | | | | |
Collapse
|
50
|
Abstract
Many important eye diseases as well as systemic diseases manifest themselves in the retina. While a number of other anatomical structures contribute to the process of vision, this review focuses on retinal imaging and image analysis. Following a brief overview of the most prevalent causes of blindness in the industrialized world that includes age-related macular degeneration, diabetic retinopathy, and glaucoma, the review is devoted to retinal imaging and image analysis methods and their clinical implications. Methods for 2-D fundus imaging and techniques for 3-D optical coherence tomography (OCT) imaging are reviewed. Special attention is given to quantitative techniques for analysis of fundus photographs with a focus on clinically relevant assessment of retinal vasculature, identification of retinal lesions, assessment of optic nerve head (ONH) shape, building retinal atlases, and to automated methods for population screening for retinal diseases. A separate section is devoted to 3-D analysis of OCT images, describing methods for segmentation and analysis of retinal layers, retinal vasculature, and 2-D/3-D detection of symptomatic exudate-associated derangements, as well as to OCT-based analysis of ONH morphology and shape. Throughout the paper, aspects of image acquisition, image analysis, and clinical relevance are treated together considering their mutually interlinked relationships.
Collapse
Affiliation(s)
- Michael D Abràmoff
- Department of Ophthalmology and Visual Sciences, University of Iowa, Iowa City, IA 52242, USA
| | | | | |
Collapse
|