1
|
Janpongsri W, Huang J, Ng R, Wahl DJ, Sarunic MV, Jian Y. Pseudo-real-time retinal layer segmentation for high-resolution adaptive optics optical coherence tomography. JOURNAL OF BIOPHOTONICS 2020; 13:e202000042. [PMID: 32421890 DOI: 10.1002/jbio.202000042] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/13/2020] [Revised: 04/04/2020] [Accepted: 04/28/2020] [Indexed: 06/11/2023]
Abstract
We present a pseudo-real-time retinal layer segmentation for high-resolution Sensorless Adaptive Optics-Optical Coherence Tomography (SAO-OCT). Our pseudo-real-time segmentation method is based on Dijkstra's algorithm that uses the intensity of pixels and the vertical gradient of the image to find the minimum cost in a geometric graph formulation within a limited search region. It segments six retinal layer boundaries in an iterative process according to their order of prominence. The segmentation time is strongly correlated to the number of retinal layers to be segmented. Our program permits en face images to be extracted during data acquisition to guide the depth specific focus control and depth dependent aberration correction for high-resolution SAO-OCT systems. The average processing times for our entire pipeline for segmenting six layers in a retinal B-scan of 496 × 400 and 240 × 400 pixels are around 25.60 and 13.76 ms, respectively. When reducing the number of layers segmented to only two layers, the time required for a 240 × 400 pixel image is 8.26 ms.
Collapse
Affiliation(s)
- Worawee Janpongsri
- Biomedical Optics Research Group, School of Engineering Science, Simon Fraser University, Burnaby, British Columbia, Canada
| | - Joey Huang
- Biomedical Optics Research Group, School of Engineering Science, Simon Fraser University, Burnaby, British Columbia, Canada
| | - Ringo Ng
- Biomedical Optics Research Group, School of Engineering Science, Simon Fraser University, Burnaby, British Columbia, Canada
| | - Daniel J Wahl
- Biomedical Optics Research Group, School of Engineering Science, Simon Fraser University, Burnaby, British Columbia, Canada
| | - Marinko V Sarunic
- Biomedical Optics Research Group, School of Engineering Science, Simon Fraser University, Burnaby, British Columbia, Canada
| | - Yifan Jian
- Casey Eye Institute, Oregon Health & Science University, Portland, OR, USA
- Department of Biomedical Engineering, Oregon Health & Science University, Portland, Oregon, USA
| |
Collapse
|
2
|
WEI XIANG, CAMINO ACNER, PI SHAOHUA, HORMEL TRISTANT, CEPURNA WILLIAM, HUANG DAVID, MORRISON JOHNC, JIA YALI. Real-time cross-sectional and en face OCT angiography guiding high-quality scan acquisition. OPTICS LETTERS 2019; 44:1431-1434. [PMID: 30874667 PMCID: PMC7188388 DOI: 10.1364/ol.44.001431] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/09/2019] [Accepted: 02/08/2019] [Indexed: 05/18/2023]
Abstract
Defocusing, vignetting, and bulk motion degrade the image quality of optical coherence tomography angiography (OCTA) more significantly than structural OCT. The assessment of focus, alignment conditions, and stability of imaging subjects in commercially available OCTA systems are currently based on OCT signal quality alone, without knowledge of OCTA signal quality. This results in low yield rates for further quantification. In this Letter, we developed a novel OCTA platform based on a graphics processing unit (GPU) for a real-time, high refresh rate, B-san-by-B-scan split-spectrum amplitude-decorrelation angiography. The GPU provides a real-time display of both cross-sectional and en face images to assist operators during scan acquisition and ensure OCTA scan quality.
Collapse
|
3
|
Jeon D, Cho NH, Park K, Kim K, Jeon M, Jang JH, Kim J. In Vivo Vibration Measurement of Middle Ear Structure Using Doppler Optical Coherence Tomography: Preliminary Study. Clin Exp Otorhinolaryngol 2018; 12:40-49. [PMID: 30045616 PMCID: PMC6315208 DOI: 10.21053/ceo.2018.00185] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2018] [Accepted: 05/31/2018] [Indexed: 12/27/2022] Open
Abstract
Objectives Doppler optical coherence tomography (DOCT) is useful for both, the spatially resolved measurement of the tympanic membrane (TM) oscillation and high-resolution imaging. We demonstrated a new technique capable of providing real-time two-dimensional Doppler OCT image of rapidly oscillatory latex mini-drum and in vivo rat TM and ossicles. Methods Using DOCT system, the oscillation of sample was measured at frequency range of 1–4 kHz at an output of 15 W. After the sensitivity of the DOCT system was verified using a latex mini-drum consisting of a 100 μm-thick latex membrane, changes in displacement of the umbo and contacted area between TM and malleus in normal and pathologic conditions. Results The oscillation cycles of the mini-drum for stimulus frequencies were 1.006 kHz for 1 kHz, 2.012 kHz for 2kHz, and 3.912 kHz for 4 kHz, which means that the oscillation cycle of the mini-drum become short in proportional to the frequency of stimuli. The oscillation cycles of umbo area and the junction area in normal TM for frequencies of the stimuli showed similar integer ratio with the data of latex mini-drum for stimuli less than 4 kHz. In the case of middle ear effusion condition, the Doppler signal showed a tendency of attenuation in all frequencies, which was prominent at 1 kHz and 2 kHz. Conclusion The TM vibration under sound stimulation with frequencies from 1 kHz to 4 kHz in normal and pathologic conditions was demonstrated using signal demodulation method in in vivo condition. The OCT technology could be helpful for functional and structural assessment as an optional modality.
Collapse
Affiliation(s)
- Doekmin Jeon
- School of Electronics Engineering, College of IT Engineering, Kyungpook National University, Daegu, Korea
| | - Nam Hyun Cho
- Department of Otology and Laryngology, Harvard Medical School, Boston, MA, USA.,Eaton-Peabody Laboratories, Massachusetts Eye and Ear Infirmary (MEEI), Boston, MA, USA
| | - Kibeom Park
- School of Electronics Engineering, College of IT Engineering, Kyungpook National University, Daegu, Korea
| | - Kanghae Kim
- School of Electronics Engineering, College of IT Engineering, Kyungpook National University, Daegu, Korea
| | - Mansik Jeon
- School of Electronics Engineering, College of IT Engineering, Kyungpook National University, Daegu, Korea
| | - Jeong Hun Jang
- Department of Otolaryngology, Ajou University School of Medicine, Suwon, Korea
| | - Jeehyun Kim
- School of Electronics Engineering, College of IT Engineering, Kyungpook National University, Daegu, Korea
| |
Collapse
|
4
|
Structural Analysis of Polymer Composites Using Spectral Domain Optical Coherence Tomography. SENSORS 2017; 17:s17051155. [PMID: 28524105 PMCID: PMC5470901 DOI: 10.3390/s17051155] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/02/2017] [Revised: 04/23/2017] [Accepted: 05/15/2017] [Indexed: 11/24/2022]
Abstract
The structural analysis of nylon/graphene oxide (NY/GO) and polyetherblockamide/ trisilinolphenyl-polyhederal oligomeric silsesquioxane (PEBA/t-POSS) composites were performed using high-resolution spectral domain optical coherence tomography (SD-OCT). This optical technology revealed both cross-sectional, as well as sub-layer depth information of sample. The non-destructive real-time imaging demonstrated the nature of defects in the composites. The thickness and location of each defect point in the composites were measured using A-scan analysis on the SD-OCT images. The cross-sectional and volumetric images clearly demonstrate the effectiveness of SD-OCT for composite research, as well as the for industrial quality assurance of polymer materials.
Collapse
|
5
|
Park K, Cho NH, Jang JH, Lee SH, Kim P, Jeon M, Boppart SA, Kim J, Jung W. In vivo 3D imaging of the human tympanic membrane using a wide-field diagonal-scanning optical coherence tomography probe. APPLIED OPTICS 2017; 56:D115-D119. [PMID: 28375378 PMCID: PMC5508522 DOI: 10.1364/ao.56.00d115] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/08/2023]
Abstract
A wide-field optical coherence tomography (OCT) probe was developed that adapts a diagonal-scanning scheme for three-dimensional (3D) in vivo imaging of the human tympanic membrane. The probe consists of a relay lens to enhance the lateral scanning range up to 7 mm. Motion artifacts that occur with the use of handheld probes were found to be decreased owing to the diagonal-scanning pattern, which crosses the center of the sample to facilitate entire 3D scans. 3D images could be constructed from a small number of two-dimensional OCT images acquired using the diagonal-scanning technique. To demonstrate the usefulness and performance of the developed system with the handheld probe, in vivo tympanic membranes of humans and animals were imaged in real time.
Collapse
Affiliation(s)
- Kibeom Park
- School of Electronics Engineering, Kyungpook National University, Daegu 702-701, South Korea
- Oz-tec Co., Ltd., Daegu 702-701, South Korea
| | - Nam Hyun Cho
- Eaton-Peabody Laboratories, Massachusetts Eye and Ear Infirmary (MEEI), 243, Charles Street, Boston, Massachusetts 02114, USA
- Department of Otology and Laryngology, Harvard Medical School, 243, Charles Street, Boston, Massachusetts 02114, USA
| | - Jeong Hun Jang
- Department of Otolaryngology, Ajou University School of Medicine, 164 World cup-ro, Yeongtong-gu, Suwon, South Korea
| | - Sang Heun Lee
- Department of Otorhinolaryngology-Head and Neck Surgery, Daegu Veterans Hospital, Daegu 704-802, South Korea
| | - Pilun Kim
- Oz-tec Co., Ltd., Daegu 702-701, South Korea
| | - Mansik Jeon
- School of Electronics Engineering, Kyungpook National University, Daegu 702-701, South Korea
| | - Stephen A. Boppart
- Department of Electrical and Computer Engineering, University of Illinois at Urbana-Champaign, Urbana, Illinois 61801, USA
- Beckman Institute for Advanced Science and Technology, Urbana, Illinois 61801, USA
| | - Jeehyun Kim
- School of Electronics Engineering, Kyungpook National University, Daegu 702-701, South Korea
| | - Woonggyu Jung
- Ulsan National Institute of Science and Technology, School of Nano-Bioscience and Chemical Engineering, 689-798, South Korea
- Corresponding author:
| |
Collapse
|
6
|
Kim HJ, Kim PU, Hyeon MG, Choi Y, Kim J, Kim BM. High-resolution, dual-depth spectral-domain optical coherence tomography with interlaced detection for whole-eye imaging. APPLIED OPTICS 2016; 55:7212-7217. [PMID: 27661354 DOI: 10.1364/ao.55.007212] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
Dual-depth spectral-domain optical coherence tomography (SD-OCT) enables high-resolution in vivo whole-eye imaging. Two orthogonally polarized beams from a source are focused simultaneously on two axial positions of the anterior segment and the retina. For the detector arm, a 1×2 ultrafast optical switch sequentially delivers two spectral interference signals to a single spectrometer, which extends the in-air axial depth range up to 9.44 mm. An off-pivot complex conjugate removal technique doubles the depth range for all anterior segment imaging. The graphics-processing-unit-based parallel signal processing algorithm supports fast two- and three-dimensional image displays. The obtained high-resolution anterior and retinal images are measured biometrically. The dual-depth SD-OCT system has an axial resolution of ∼6.4 μm in air, and the sensitivity is 91.79 dB at 150 μm from the zero-delay line.
Collapse
|
7
|
Kang H, Lee SW, Lee ES, Kim SH, Lee TG. Real-time GPU-accelerated processing and volumetric display for wide-field laser-scanning optical-resolution photoacoustic microscopy. BIOMEDICAL OPTICS EXPRESS 2015; 6:4650-60. [PMID: 26713184 PMCID: PMC4679244 DOI: 10.1364/boe.6.004650] [Citation(s) in RCA: 19] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/10/2015] [Revised: 10/26/2015] [Accepted: 10/29/2015] [Indexed: 05/02/2023]
Abstract
Fast signal processing and real-time displays are essential for practical imaging modality in various fields of applications. However, the imaging speed in optical-resolution photoacoustic microscopy (OR-PAM), in particular, depends on factors such as the pulse repetition rate of the laser, scanning method, field of view (FOV), and signal processing time. In the past, efforts to increase acquisition speed either focused on developing new scanning methods or using lasers with higher pulse repetition rates. However, high-speed signal processing is also important for real-time volumetric display in OR-PAM. In this study, we carried out parallel signal processing using a graphics processing unit (GPU) to enable fast signal processing and wide-field real-time displays in laser-scanning OR-PAM. The average total GPU processing time for a B-mode PAM image was approximately 1.35 ms at a display speed of 480 fps when the data samples were acquired with 736 (axial) × 500 (lateral) points/B-mode-frame at a pulse repetition rate of 300 kHz. In addition, we successfully displayed maximum amplitude projection images of a mouse's ear as volumetric images with an FOV of 3 mm × 3 mm (500 × 500 pixels) at 1.02 s, corresponding to 0.98 fps.
Collapse
Affiliation(s)
- Heesung Kang
- Center for Nano-Bio Measurement, Korea Research Institute of Standards and Science, Daejoen 305-340, South Korea ; contributed equally
| | - Sang-Won Lee
- Center for Nano-Bio Measurement, Korea Research Institute of Standards and Science, Daejoen 305-340, South Korea ; Center for Nanosafety Metrology, Korea Research Institute of Standards and Science, Daejeon 305-340, South Korea ; Department of Nano Science, University of Science and Technology, Daejoen 305-350, South Korea ; contributed equally ;
| | - Eun-Soo Lee
- Center for Nano-Bio Measurement, Korea Research Institute of Standards and Science, Daejoen 305-340, South Korea
| | - Se-Hwa Kim
- Center for Nano-Bio Measurement, Korea Research Institute of Standards and Science, Daejoen 305-340, South Korea ; Center for Nanosafety Metrology, Korea Research Institute of Standards and Science, Daejeon 305-340, South Korea ; Department of Nano and Bio Surface Science, University of Science and Technology, Daejeon 305-350, South Korea
| | - Tae Geol Lee
- Center for Nano-Bio Measurement, Korea Research Institute of Standards and Science, Daejoen 305-340, South Korea ; Department of Nano Science, University of Science and Technology, Daejoen 305-350, South Korea ;
| |
Collapse
|
8
|
Lee SW, Kang H, Park JH, Lee TG, Lee ES, Lee JY. Ultrahigh-Resolution Spectral Domain Optical Coherence Tomography Based on a Linear-Wavenumber Spectrometer. ACTA ACUST UNITED AC 2015. [DOI: 10.3807/josk.2015.19.1.055] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022]
|
9
|
Kabir MM, Jonayat ASM, Patel S, Toussaint KC. Graphics processing unit-based quantitative second-harmonic generation imaging. JOURNAL OF BIOMEDICAL OPTICS 2014; 19:96009. [PMID: 25223706 DOI: 10.1117/1.jbo.19.9.096009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/04/2014] [Accepted: 08/15/2014] [Indexed: 06/03/2023]
Abstract
We adapt a graphics processing unit (GPU) to dynamic quantitative second-harmonic generation imaging. We demonstrate the temporal advantage of the GPU-based approach by computing the number of frames analyzed per second from SHG image videos showing varying fiber orientations. In comparison to our previously reported CPU-based approach, our GPU-based image analysis results in ∼10× improvement in computational time. This work can be adapted to other quantitative, nonlinear imaging techniques and provides a significant step toward obtaining quantitative information from fast in vivo biological processes.
Collapse
Affiliation(s)
- Mohammad Mahfuzul Kabir
- University of Illinois at Urbana-Champaign, Department of Mechanical Science and Engineering, Laboratory for Photonics Research of Bio/nano Environments (PROBE), Urbana, Illinois 61801, United States
| | - A S M Jonayat
- University of Illinois at Urbana-Champaign, Department of Mechanical Science and Engineering, Urbana, Illinois 61801, United States
| | - Sanjay Patel
- University of Illinois at Urbana-Champaign, Department of Electrical and Computer Engineering, Urbana, Illinois 61801, United States
| | - Kimani C Toussaint
- University of Illinois at Urbana-Champaign, Department of Mechanical Science and Engineering, Laboratory for Photonics Research of Bio/nano Environments (PROBE), Urbana, Illinois 61801, United StatesbUniversity of Illinois at Urbana-Champaign, Department
| |
Collapse
|
10
|
Tankam P, Santhanam AP, Lee KS, Won J, Canavesi C, Rolland JP. Parallelized multi-graphics processing unit framework for high-speed Gabor-domain optical coherence microscopy. JOURNAL OF BIOMEDICAL OPTICS 2014; 19:71410. [PMID: 24695868 PMCID: PMC4019421 DOI: 10.1117/1.jbo.19.7.071410] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/20/2013] [Revised: 02/27/2014] [Accepted: 03/07/2014] [Indexed: 05/20/2023]
Abstract
Gabor-domain optical coherence microscopy (GD-OCM) is a volumetric high-resolution technique capable of acquiring three-dimensional (3-D) skin images with histological resolution. Real-time image processing is needed to enable GD-OCM imaging in a clinical setting. We present a parallelized and scalable multi-graphics processing unit (GPU) computing framework for real-time GD-OCM image processing. A parallelized control mechanism was developed to individually assign computation tasks to each of the GPUs. For each GPU, the optimal number of amplitude-scans (A-scans) to be processed in parallel was selected to maximize GPU memory usage and core throughput. We investigated five computing architectures for computational speed-up in processing 1000×1000 A-scans. The proposed parallelized multi-GPU computing framework enables processing at a computational speed faster than the GD-OCM image acquisition, thereby facilitating high-speed GD-OCM imaging in a clinical setting. Using two parallelized GPUs, the image processing of a 1×1×0.6 mm3 skin sample was performed in about 13 s, and the performance was benchmarked at 6.5 s with four GPUs. This work thus demonstrates that 3-D GD-OCM data may be displayed in real-time to the examiner using parallelized GPU processing.
Collapse
Affiliation(s)
- Patrice Tankam
- University of Rochester, The Institute of Optics, 275 Hutchinson Road, Rochester, New York 14627
- University of Rochester, Center for Visual Science, 601 Elmwood Avenue, Rochester, New York 14642
| | - Anand P. Santhanam
- University of California, Department of Radiation Oncology, Los Angeles, 200 Medical plaza drive, Los Angeles, California 90095
| | - Kye-Sung Lee
- University of Rochester, The Institute of Optics, 275 Hutchinson Road, Rochester, New York 14627
- Korea Basic Science Institute, Center for Analytical Instrumentation Development, Daejeon 305-806, South Korea
| | - Jungeun Won
- University of Rochester, Department of Biomedical Engineering, 275 Hutchinson Road, Rochester, New York 14627
| | - Cristina Canavesi
- LighTopTech Corp., 150 Lucius Gordon Dr., Ste 115, West Henrietta, New York 14586
| | - Jannick P. Rolland
- University of Rochester, The Institute of Optics, 275 Hutchinson Road, Rochester, New York 14627
- University of Rochester, Center for Visual Science, 601 Elmwood Avenue, Rochester, New York 14642
- University of Rochester, Department of Biomedical Engineering, 275 Hutchinson Road, Rochester, New York 14627
- LighTopTech Corp., 150 Lucius Gordon Dr., Ste 115, West Henrietta, New York 14586
- Address all correspondence to: Jannick P. Rolland, E-mail:
| |
Collapse
|
11
|
Nam SY, Emelianov SY. Array-Based Real-Time Ultrasound and Photoacoustic Ocular Imaging. ACTA ACUST UNITED AC 2014. [DOI: 10.3807/josk.2014.18.2.151] [Citation(s) in RCA: 18] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022]
|
12
|
Development of real-time dual-display handheld and bench-top hybrid-mode SD-OCTs. SENSORS 2014; 14:2171-81. [PMID: 24473286 PMCID: PMC3958276 DOI: 10.3390/s140202171] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/29/2013] [Revised: 01/13/2014] [Accepted: 01/21/2014] [Indexed: 11/17/2022]
Abstract
Development of a dual-display handheld optical coherence tomography (OCT) system for retina and optic-nerve-head diagnosis beyond the volunteer motion constraints is reported. The developed system is portable and easily movable, containing the compact portable OCT system that includes the handheld probe and computer. Eye posterior chambers were diagnosed using the handheld probe, and the probe could be fixed to the bench-top cradle depending on the volunteers' physical condition. The images obtained using this handheld probe were displayed in real time on the computer monitor and on a small secondary built-in monitor; the displayed images were saved using the handheld probe's built-in button. Large-scale signal-processing procedures such as k-domain linearization, fast Fourier transform (FFT), and log-scaling signal processing can be rapidly applied using graphics-processing-unit (GPU) accelerated processing rather than central-processing-unit (CPU) processing. The Labview-based system resolution is 1,024 × 512 pixels, and the frame rate is 56 frames/s, useful for real-time display. The 3D images of the posterior chambers including the retina, optic-nerve head, blood vessels, and optic nerve were composed using real-time displayed images with 500 × 500 × 500 pixel resolution. A handheld and bench-top hybrid mode with a dual-display handheld OCT was developed to overcome the drawbacks of the conventional method.
Collapse
|