1
|
Kim W, Long R, Yang Z, Oghalai JS, Applegate BE. Optical coherence tomography otoscope for imaging of tympanic membrane and middle ear pathology. JOURNAL OF BIOMEDICAL OPTICS 2024; 29:086005. [PMID: 39165857 PMCID: PMC11334941 DOI: 10.1117/1.jbo.29.8.086005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Figures] [Subscribe] [Scholar Register] [Received: 04/23/2024] [Revised: 07/08/2024] [Accepted: 07/23/2024] [Indexed: 08/22/2024]
Abstract
Significance Pathologies within the tympanic membrane (TM) and middle ear (ME) can lead to hearing loss. Imaging tools available in the hearing clinic for diagnosis and management are limited to visual inspection using the classic otoscope. The otoscopic view is limited to the surface of the TM, especially in diseased ears where the TM is opaque. An integrated optical coherence tomography (OCT) otoscope can provide images of the interior of the TM and ME space as well as an otoscope image. This enables the clinicians to correlate the standard otoscopic view with OCT and then use the new information to improve the diagnostic accuracy and management. Aim We aim to develop an OCT otoscope that can easily be used in the hearing clinic and demonstrate the system in the hearing clinic, identifying relevant image features of various pathologies not apparent in the standard otoscopic view. Approach We developed a portable OCT otoscope device featuring an improved field of view and form-factor that can be operated solely by the clinician using an integrated foot pedal to control image acquisition. The device was used to image patients at a hearing clinic. Results The field of view of the imaging system was improved to a 7.4 mm diameter, with lateral and axial resolutions of 38 μ m and 33.4 μ m , respectively. We developed algorithms to resample the images in Cartesian coordinates after collection in spherical polar coordinates and correct the image aberration. We imaged over 100 patients in the hearing clinic at USC Keck Hospital. Here, we identify some of the pathological features evident in the OCT images and highlight cases in which the OCT image provided clinically relevant information that was not available from traditional otoscopic imaging. Conclusions The developed OCT otoscope can readily fit into the hearing clinic workflow and provide new relevant information for diagnosing and managing TM and ME disease.
Collapse
Affiliation(s)
- Wihan Kim
- University of Southern California, Caruso Department of Otolaryngology–Head & Neck Surgery, Los Angeles, California, United States
| | - Ryan Long
- University of Southern California, Caruso Department of Otolaryngology–Head & Neck Surgery, Los Angeles, California, United States
| | - Zihan Yang
- University of Southern California, Caruso Department of Otolaryngology–Head & Neck Surgery, Los Angeles, California, United States
| | - John S. Oghalai
- University of Southern California, Caruso Department of Otolaryngology–Head & Neck Surgery, Los Angeles, California, United States
- University of Southern California, Alfred Mann Department of Biomedical Engineering, Los Angeles, California, United States
| | - Brian E. Applegate
- University of Southern California, Caruso Department of Otolaryngology–Head & Neck Surgery, Los Angeles, California, United States
- University of Southern California, Alfred Mann Department of Biomedical Engineering, Los Angeles, California, United States
| |
Collapse
|
2
|
Iyer RR, Yang L, Sorrells JE, Chaney EJ, Spillman DR, Boppart SA. Dispersion mismatch correction for evident chromatic anomaly in low coherence interferometry. APL PHOTONICS 2024; 9:076114. [PMID: 39072189 PMCID: PMC11273218 DOI: 10.1063/5.0207414] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/07/2024] [Accepted: 07/02/2024] [Indexed: 07/30/2024]
Abstract
The applications of ultrafast optics to biomedical microscopy have expanded rapidly in recent years, including interferometric techniques like optical coherence tomography and microscopy (OCT/OCM). The advances of ultra-high resolution OCT and the inclusion of OCT/OCM in multimodal systems combined with multiphoton microscopy have marked a transition from using pseudo-continuous broadband sources, such as superluminescent diodes, to ultrafast supercontinuum optical sources. We report anomalies in the dispersion profiles of low-coherence ultrafast pulses through long and non-identical arms of a Michelson interferometer that are well beyond group delay or third-order dispersions. This chromatic anomaly worsens the observed axial resolution and causes fringe artifacts in the reconstructed tomograms in OCT/OCM using traditional algorithms. We present DISpersion COmpensation Techniques for Evident Chromatic Anomalies (DISCOTECA) as a universal solution to address the problem of chromatic dispersion mismatch in interferometry, especially with ultrafast sources. First, we demonstrate the origin of these artifacts through the self-phase modulation of ultrafast pulses due to focusing elements in the beam path. Next, we present three solution paradigms for DISCOTECA: optical, optoelectronic, and computational, along with quantitative comparisons to traditional methods to highlight the improvements to the dynamic range and axial profile. We explain the piecewise reconstruction of the phase mismatch between the arms of the spectral-domain interferometer using a modified short-term Fourier transform algorithm inspired by spectroscopic OCT. Finally, we present a decision-making guide for evaluating the utility of DISCOTECA in interferometry and for the artifact-free reconstruction of OCT images using an ultrafast supercontinuum source for biomedical applications.
Collapse
Affiliation(s)
| | | | | | | | | | - Stephen A. Boppart
- Author to whom correspondence should be addressed: . Tel.: (217) 244-7479
| |
Collapse
|
3
|
Walker CB, Wisniowiecki A, Tang JC, Quiñones PM, Kim W, Oghalai JS, Applegate BE. Multi-window approach enables two-fold improvement in OCT axial resolution with strong side-lobe suppression and improved phase sensitivity. BIOMEDICAL OPTICS EXPRESS 2023; 14:6301-6316. [PMID: 38420305 PMCID: PMC10898564 DOI: 10.1364/boe.501649] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/26/2023] [Revised: 10/31/2023] [Accepted: 11/03/2023] [Indexed: 03/02/2024]
Abstract
A common processing approach for optical coherence tomography (OCT) uses a window function (e.g., Hann or rectangular window) for spectral shaping prior to calculating the Fourier transform. Here we build on a multi-window approach [Opt. Express8, 5267 (2017)10.1364/BOE.8.005267] that enables improved resolution while still suppressing side-lobe intensity. The shape of the window function defines the trade-off between main-lobe width (resolution) and side-lobe intensity. We have extended the approach to include the interferometric phase for phase-sensitive applications like vibrometry and Doppler OCT. Using the Hann window as a reference, we show that 11 Taylor windows are sufficient to achieve 50% improvement in axial resolution, -31 dB side-lobe intensity, and 20% improvement in phase sensitivity with low computational cost.
Collapse
Affiliation(s)
- Clayton B Walker
- Caruso Department of Otolaryngology-Head and Neck Surgery, University of Southern California, Los Angeles, CA 90033, USA
- Department of Biomedical Engineering, Texas A&M University, College Station, TX 77843, USA
| | - Anna Wisniowiecki
- Caruso Department of Otolaryngology-Head and Neck Surgery, University of Southern California, Los Angeles, CA 90033, USA
- Department of Biomedical Engineering, Texas A&M University, College Station, TX 77843, USA
| | - Jack C Tang
- Caruso Department of Otolaryngology-Head and Neck Surgery, University of Southern California, Los Angeles, CA 90033, USA
| | - Patricia M Quiñones
- Caruso Department of Otolaryngology-Head and Neck Surgery, University of Southern California, Los Angeles, CA 90033, USA
| | - Wihan Kim
- Caruso Department of Otolaryngology-Head and Neck Surgery, University of Southern California, Los Angeles, CA 90033, USA
| | - John S Oghalai
- Caruso Department of Otolaryngology-Head and Neck Surgery, University of Southern California, Los Angeles, CA 90033, USA
| | - Brian E Applegate
- Caruso Department of Otolaryngology-Head and Neck Surgery, University of Southern California, Los Angeles, CA 90033, USA
- Department of Biomedical Engineering, University of Southern California, Los Angeles, CA 90089, USA
| |
Collapse
|
4
|
Qiao Z, Huang Y, Hao Q. Multi-shaping sparse-continuous reconstruction for an optical coherence tomography sidelobe suppression. OPTICS LETTERS 2023; 48:5679-5682. [PMID: 37910732 DOI: 10.1364/ol.501670] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/26/2023] [Accepted: 10/09/2023] [Indexed: 11/03/2023]
Abstract
Optical coherence tomography (OCT) images are commonly affected by sidelobe artifacts due to spectral non-uniformity and spectral leakage. Conventional frequency domain spectral shaping methods widen the mainlobe and compromise axial resolution. While image-domain deconvolution techniques can address the trade-off between axial resolution and artifact suppression, their reconstruction quality relies on accurate measurement or estimation of system point spread function (PSF). Inaccurate PSF estimation leads to loss of details in the reconstructed images. In this Letter, we introduce multi-shaping sparse-continuous reconstruction (MSSCR) for an OCT image, a novel, to the best of our knowledge, framework that combines spectral multi-shaping and iterative image reconstruction with sparse-continuous priors. The MSSCR achieves sidelobe suppression without requiring any PSF measurement or estimation and effectively preserving the axial resolution. The experimental results demonstrate that the MSSCR achieves sidelobe suppression of more than 8 dB. We believe that the MSSCR holds potential for addressing sidelobe artifacts in OCT.
Collapse
|
5
|
Li X, Dong Z, Liu H, Kang-Mieler JJ, Ling Y, Gan Y. Frequency-aware optical coherence tomography image super-resolution via conditional generative adversarial neural network. BIOMEDICAL OPTICS EXPRESS 2023; 14:5148-5161. [PMID: 37854579 PMCID: PMC10581809 DOI: 10.1364/boe.494557] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/02/2023] [Revised: 08/27/2023] [Accepted: 09/01/2023] [Indexed: 10/20/2023]
Abstract
Optical coherence tomography (OCT) has stimulated a wide range of medical image-based diagnosis and treatment in fields such as cardiology and ophthalmology. Such applications can be further facilitated by deep learning-based super-resolution technology, which improves the capability of resolving morphological structures. However, existing deep learning-based method only focuses on spatial distribution and disregards frequency fidelity in image reconstruction, leading to a frequency bias. To overcome this limitation, we propose a frequency-aware super-resolution framework that integrates three critical frequency-based modules (i.e., frequency transformation, frequency skip connection, and frequency alignment) and frequency-based loss function into a conditional generative adversarial network (cGAN). We conducted a large-scale quantitative study from an existing coronary OCT dataset to demonstrate the superiority of our proposed framework over existing deep learning frameworks. In addition, we confirmed the generalizability of our framework by applying it to fish corneal images and rat retinal images, demonstrating its capability to super-resolve morphological details in eye imaging.
Collapse
Affiliation(s)
- Xueshen Li
- Department of Biomedical Engineering, Stevens Institute of Technology, Hoboken, NJ 07030, USA
| | - Zhenxing Dong
- Department of Electronic Engineering, Shanghai Jiao Tong University, Shanghai, Minhang District, 200240, China
| | - Hongshan Liu
- Department of Biomedical Engineering, Stevens Institute of Technology, Hoboken, NJ 07030, USA
| | - Jennifer J. Kang-Mieler
- Department of Biomedical Engineering, Stevens Institute of Technology, Hoboken, NJ 07030, USA
| | - Yuye Ling
- Department of Electronic Engineering, Shanghai Jiao Tong University, Shanghai, Minhang District, 200240, China
| | - Yu Gan
- Department of Biomedical Engineering, Stevens Institute of Technology, Hoboken, NJ 07030, USA
| |
Collapse
|
6
|
Yuan Z, Yang D, Wang W, Zhao J, Liang Y. Self super-resolution of optical coherence tomography images based on deep learning. OPTICS EXPRESS 2023; 31:27566-27581. [PMID: 37710829 DOI: 10.1364/oe.495530] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/17/2023] [Accepted: 07/20/2023] [Indexed: 09/16/2023]
Abstract
As a medical imaging modality, many researches have been devoted to improving the resolution of optical coherence tomography (OCT). We developed a deep-learning based OCT self super-resolution (OCT-SSR) pipeline to improve the axial resolution of OCT images based on the high-resolution and low-resolution spectral data collected by the OCT system. In this pipeline, the enhanced super-resolution asymmetric generative adversarial networks were built to improve the network outputs without increasing the complexity. The feasibility and effectiveness of the approach were demonstrated by experimental results on the images of the biological samples collected by the home-made spectral-domain OCT and swept-source OCT systems. More importantly, we found the sidelobes in the original images can be obviously suppressed while improving the resolution based on the OCT-SSR method, which can help to reduce pseudo-signal in OCT imaging when non-Gaussian spectra light source is used. We believe that the OCT-SSR method has broad prospects in breaking the limitation of the source bandwidth on the axial resolution of the OCT system.
Collapse
|
7
|
Lee W, Nam HS, Seok JY, Oh WY, Kim JW, Yoo H. Deep learning-based image enhancement in optical coherence tomography by exploiting interference fringe. Commun Biol 2023; 6:464. [PMID: 37117279 PMCID: PMC10147647 DOI: 10.1038/s42003-023-04846-7] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2022] [Accepted: 04/17/2023] [Indexed: 04/30/2023] Open
Abstract
Optical coherence tomography (OCT), an interferometric imaging technique, provides non-invasive, high-speed, high-sensitive volumetric biological imaging in vivo. However, systemic features inherent in the basic operating principle of OCT limit its imaging performance such as spatial resolution and signal-to-noise ratio. Here, we propose a deep learning-based OCT image enhancement framework that exploits raw interference fringes to achieve further enhancement from currently obtainable optimized images. The proposed framework for enhancing spatial resolution and reducing speckle noise in OCT images consists of two separate models: an A-scan-based network (NetA) and a B-scan-based network (NetB). NetA utilizes spectrograms obtained via short-time Fourier transform of raw interference fringes to enhance axial resolution of A-scans. NetB was introduced to enhance lateral resolution and reduce speckle noise in B-scan images. The individually trained networks were applied sequentially. We demonstrate the versatility and capability of the proposed framework by visually and quantitatively validating its robust performance. Comparative studies suggest that deep learning utilizing interference fringes can outperform the existing methods. Furthermore, we demonstrate the advantages of the proposed method by comparing our outcomes with multi-B-scan averaged images and contrast-adjusted images. We expect that the proposed framework will be a versatile technology that can improve functionality of OCT.
Collapse
Affiliation(s)
- Woojin Lee
- Department of Mechanical Engineering, Korea Advanced Institute of Science and Technology, 291 Daehak-ro, Yuseong-gu, Daejeon, 34141, Republic of Korea
| | - Hyeong Soo Nam
- Department of Mechanical Engineering, Korea Advanced Institute of Science and Technology, 291 Daehak-ro, Yuseong-gu, Daejeon, 34141, Republic of Korea
| | - Jae Yeon Seok
- Department of Pathology, Yongin Severance Hospital, Yonsei University College of Medicine, 363 Dongbaekjukjeon-daero, Giheung-gu, Yongin-si, Gyeonggi-do, 16995, Republic of Korea
| | - Wang-Yuhl Oh
- Department of Mechanical Engineering, Korea Advanced Institute of Science and Technology, 291 Daehak-ro, Yuseong-gu, Daejeon, 34141, Republic of Korea
| | - Jin Won Kim
- Multimodal Imaging and Theranostic Lab, Cardiovascular Center, Korea University Guro Hospital, 148 Gurodong-ro, Guro-gu, Seoul, 08308, Republic of Korea
| | - Hongki Yoo
- Department of Mechanical Engineering, Korea Advanced Institute of Science and Technology, 291 Daehak-ro, Yuseong-gu, Daejeon, 34141, Republic of Korea.
| |
Collapse
|
8
|
Kang YG, Canoy RJE, Jang Y, Santos ARMP, Son I, Kim BM, Park Y. Optical coherence microscopy with a split-spectrum image reconstruction method for temporal-dynamics contrast-based imaging of intracellular motility. BIOMEDICAL OPTICS EXPRESS 2023; 14:577-592. [PMID: 36874497 PMCID: PMC9979675 DOI: 10.1364/boe.478264] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/26/2022] [Revised: 12/21/2022] [Accepted: 12/23/2022] [Indexed: 06/18/2023]
Abstract
Biomedical researchers use optical coherence microscopy (OCM) for its high resolution in real-time label-free tomographic imaging. However, OCM lacks bioactivity-related functional contrast. We developed an OCM system that can measure changes in intracellular motility (indicating cellular process states) via pixel-wise calculations of intensity fluctuations from metabolic activity of intracellular components. To reduce image noise, the source spectrum is split into five using Gaussian windows with 50% of the full bandwidth. The technique verified that F-actin fiber inhibition by Y-27632 reduces intracellular motility. This finding could be used to search for other intracellular-motility-associated therapeutic strategies for cardiovascular diseases.
Collapse
Affiliation(s)
- Yong Guk Kang
- BK21 Four Institute of Precision Public Health, Korea University, Seoul 02841, Republic of Korea
- These authors contributed equally to this work
| | - Raymart Jay E. Canoy
- Department of Biomicro System Technology, College of Engineering, Korea University, Seoul 02841, Republic of Korea
- These authors contributed equally to this work
| | - Yongjun Jang
- Department of Biomedical Science, College of Medicine, Korea University, Seoul 02841, Republic of Korea
| | - Ana Rita M. P. Santos
- Department of Biomedical Science, College of Medicine, Korea University, Seoul 02841, Republic of Korea
| | - Inwoo Son
- Department of Biomedical Science, College of Medicine, Korea University, Seoul 02841, Republic of Korea
| | - Beop-Min Kim
- BK21 Four Institute of Precision Public Health, Korea University, Seoul 02841, Republic of Korea
- Department of Biomedical Engineering, College of Health Science, Korea University, Seoul 02841, Republic of Korea
| | - Yongdoo Park
- Department of Biomedical Science, College of Medicine, Korea University, Seoul 02841, Republic of Korea
| |
Collapse
|
9
|
Wang J, Wohlberg B, Adamson RBA. Convolutional dictionary learning for blind deconvolution of optical coherence tomography images. BIOMEDICAL OPTICS EXPRESS 2022; 13:1834-1854. [PMID: 35519239 PMCID: PMC9045938 DOI: 10.1364/boe.447394] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/08/2021] [Revised: 01/23/2022] [Accepted: 02/02/2022] [Indexed: 06/14/2023]
Abstract
In this study, we demonstrate a sparsity-regularized, complex, blind deconvolution method for removing sidelobe artefacts and stochastic noise from optical coherence tomography (OCT) images. Our method estimates the complex scattering amplitude of tissue on a line-by-line basis by estimating and deconvolving the complex, one-dimensional axial point spread function (PSF) from measured OCT A-line data. We also present a strategy for employing a sparsity weighting mask to mitigate the loss of speckle brightness within tissue-containing regions caused by the sparse deconvolution. Qualitative and quantitative analyses show that this approach suppresses sidelobe artefacts and background noise better than traditional spectral reshaping techniques, with negligible loss of tissue structure. The technique is particularly useful for emerging OCT applications where OCT images contain strong specular reflections at air-tissue boundaries that create large sidelobe artefacts.
Collapse
Affiliation(s)
- Junzhe Wang
- School of Biomedical Engineering, Dalhousie University, Halifax, NS B3H 4R2, Canada
| | - Brendt Wohlberg
- Theoretical Division, Los Alamos National Laboratory, Los Alamos, NM 87545, USA
| | - R. B. A. Adamson
- School of Biomedical Engineering, Dalhousie University, Halifax, NS B3H 4R2, Canada
- Electrical & Computer Engineering Department, Dalhousie University, Halifax, NS B3H 4R2, Canada
| |
Collapse
|
10
|
Huang D, Li F, He Z, Cheng Z, Shang C, Wai PKA. 400 MHz ultrafast optical coherence tomography. OPTICS LETTERS 2020; 45:6675-6678. [PMID: 33325868 DOI: 10.1364/ol.409607] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/08/2020] [Accepted: 11/06/2020] [Indexed: 05/18/2023]
Abstract
An ultrafast time-stretched swept source with a sweep rate of 400 MHz is demonstrated based on the buffering of a 100 MHz femtosecond laser pulse train. To the best of our knowledge, this is the highest sweep rate of swept sources for optical coherence tomography (OCT) that has been reported. With a 10 dB sweep range of ∼100nm, an axial resolution of 19 µm is obtained in the OCT. OCT imaging of high-speed rotating disks is demonstrated. A composite complex apodization method is proposed and demonstrated to enhance the signal to noise ratio in the OCT imaging.
Collapse
|
11
|
Ling Y, Wang M, Yao X, Gan Y, Schmetterer L, Zhou C, Su Y. Effect of spectral leakage on the image formation of Fourier-domain optical coherence tomography. OPTICS LETTERS 2020; 45:6394-6397. [PMID: 33258820 DOI: 10.1364/ol.404654] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/06/2020] [Accepted: 10/22/2020] [Indexed: 06/12/2023]
Abstract
We report on the investigation of spectral leakage's impact on the reconstruction of Fourier-domain optical coherence tomography (FD-OCT). We discuss the shift-variant nature introduced by the spectral leakage and develop a novel spatial-domain FD-OCT image formation model. A proof-of-concept phantom experiment is conducted to validate our model. Compared with previous models, the proposed framework could better describe the image formation process, especially when the fineness of the axial structure approaches the theoretical resolution limit.
Collapse
|