1
|
Li K, Yang J, Liang W, Li X, Zhang C, Chen L, Wu C, Zhang X, Xu Z, Wang Y, Meng L, Zhang Y, Chen Y, Zhou SK. O-PRESS: Boosting OCT axial resolution with Prior guidance, Recurrence, and Equivariant Self-Supervision. Med Image Anal 2025; 99:103319. [PMID: 39270466 DOI: 10.1016/j.media.2024.103319] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/02/2024] [Revised: 07/10/2024] [Accepted: 08/19/2024] [Indexed: 09/15/2024]
Abstract
Optical coherence tomography (OCT) is a noninvasive technology that enables real-time imaging of tissue microanatomies. The axial resolution of OCT is intrinsically constrained by the spectral bandwidth of the employed light source while maintaining a fixed center wavelength for a specific application. Physically extending this bandwidth faces strong limitations and requires a substantial cost. We present a novel computational approach, called as O-PRESS, for boosting the axial resolution of OCT with Prior guidance, a Recurrent mechanism, and Equivariant Self-Supervision. Diverging from conventional deconvolution methods that rely on physical models or data-driven techniques, our method seamlessly integrates OCT modeling and deep learning, enabling us to achieve real-time axial-resolution enhancement exclusively from measurements without a need for paired images. Our approach solves two primary tasks of resolution enhancement and noise reduction with one treatment. Both tasks are executed in a self-supervised manner, with equivariance imaging and free space priors guiding their respective processes. Experimental evaluations, encompassing both quantitative metrics and visual assessments, consistently verify the efficacy and superiority of our approach, which exhibits performance on par with fully supervised methods. Importantly, the robustness of our model is affirmed, showcasing its dual capability to enhance axial resolution while concurrently improving the signal-to-noise ratio.
Collapse
Affiliation(s)
- Kaiyan Li
- School of Biomedical Engineering, Division of Life Sciences and Medicine, University of Science and Technology of China (USTC), Hefei Anhui, 230026, China; Center for Medical Imaging, Robotics, Analytic Computing & Learning (MIRACLE), Suzhou Institute for Advanced Research, USTC, Suzhou Jiangsu, 215123, China
| | - Jingyuan Yang
- Department of Ophthalmology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences, Beijing, 100730, China; Key Laboratory of Ocular Fundus Diseases, Chinese Academy of Medical Sciences, Beijing, 100730, China
| | - Wenxuan Liang
- School of Biomedical Engineering, Division of Life Sciences and Medicine, University of Science and Technology of China (USTC), Hefei Anhui, 230026, China; Center for Medical Imaging, Robotics, Analytic Computing & Learning (MIRACLE), Suzhou Institute for Advanced Research, USTC, Suzhou Jiangsu, 215123, China; School of Physical Sciences, University of Science and Technology of China, Hefei Anhui, 230026, China
| | - Xingde Li
- Department of Biomedical Engineering, Johns Hopkins University, Baltimore, 21287, USA
| | - Chenxi Zhang
- Department of Ophthalmology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences, Beijing, 100730, China; Key Laboratory of Ocular Fundus Diseases, Chinese Academy of Medical Sciences, Beijing, 100730, China
| | - Lulu Chen
- Department of Ophthalmology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences, Beijing, 100730, China; Key Laboratory of Ocular Fundus Diseases, Chinese Academy of Medical Sciences, Beijing, 100730, China
| | - Chan Wu
- Department of Ophthalmology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences, Beijing, 100730, China; Key Laboratory of Ocular Fundus Diseases, Chinese Academy of Medical Sciences, Beijing, 100730, China
| | - Xiao Zhang
- Department of Ophthalmology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences, Beijing, 100730, China; Key Laboratory of Ocular Fundus Diseases, Chinese Academy of Medical Sciences, Beijing, 100730, China
| | - Zhiyan Xu
- Department of Ophthalmology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences, Beijing, 100730, China; Key Laboratory of Ocular Fundus Diseases, Chinese Academy of Medical Sciences, Beijing, 100730, China
| | - Yueling Wang
- Department of Ophthalmology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences, Beijing, 100730, China; Key Laboratory of Ocular Fundus Diseases, Chinese Academy of Medical Sciences, Beijing, 100730, China
| | - Lihui Meng
- Department of Ophthalmology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences, Beijing, 100730, China; Key Laboratory of Ocular Fundus Diseases, Chinese Academy of Medical Sciences, Beijing, 100730, China
| | - Yue Zhang
- School of Biomedical Engineering, Division of Life Sciences and Medicine, University of Science and Technology of China (USTC), Hefei Anhui, 230026, China; Center for Medical Imaging, Robotics, Analytic Computing & Learning (MIRACLE), Suzhou Institute for Advanced Research, USTC, Suzhou Jiangsu, 215123, China
| | - Youxin Chen
- Department of Ophthalmology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences, Beijing, 100730, China; Key Laboratory of Ocular Fundus Diseases, Chinese Academy of Medical Sciences, Beijing, 100730, China.
| | - S Kevin Zhou
- School of Biomedical Engineering, Division of Life Sciences and Medicine, University of Science and Technology of China (USTC), Hefei Anhui, 230026, China; Center for Medical Imaging, Robotics, Analytic Computing & Learning (MIRACLE), Suzhou Institute for Advanced Research, USTC, Suzhou Jiangsu, 215123, China; Key Laboratory of Precision and Intelligent Chemistry, USTC, Hefei Anhui, 230026, China; Key Laboratory of Intelligent Information Processing of Chinese Academy of Sciences (CAS), Institute of Computing Technology, CAS, Beijing, 100190, China.
| |
Collapse
|
2
|
Yuan Z, Yang D, Zhao J, Liang Y. Enhancement of OCT en faceimages by unsupervised deep learning. Phys Med Biol 2024; 69:115042. [PMID: 38749469 DOI: 10.1088/1361-6560/ad4c52] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2023] [Accepted: 05/15/2024] [Indexed: 05/31/2024]
Abstract
Objective. The quality of optical coherence tomography (OCT)en faceimages is crucial for clinical visualization of early disease. As a three dimensional and coherent imaging, defocus and speckle noise are inevitable, which seriously affect evaluation of microstructure of bio-samples in OCT images. The deep learning has demonstrated great potential in OCT refocusing and denoising, but it is limited by the difficulty of sufficient paired training data. This work aims to develop an unsupervised method to enhance the quality of OCTen faceimages.Approach. We proposed an unsupervised deep learning-based pipeline. The unregistered defocused conventional OCT images and focused speckle-free OCT images were collected by a home-made speckle modulating OCT system to construct the dataset. The image enhancement model was trained with the cycle training strategy. Finally, the speckle noise and defocus were both effectively improved.Main results. The experimental results on complex bio-samples indicated that the proposed method is effective and generalized in enhancing the quality of OCTen faceimages.Significance. The proposed unsupervised deep learning method helps to reduce the complexity of data construction, which is conducive to practical applications in OCT bio-sample imaging.
Collapse
Affiliation(s)
- Zhuoqun Yuan
- Institute of Modern Optics, Nankai University, Tianjin Key Laboratory of Micro-scale Optical Information Science and Technology, Tianjin 300350, People's Republic of China
| | - Di Yang
- Institute of Modern Optics, Nankai University, Tianjin Key Laboratory of Micro-scale Optical Information Science and Technology, Tianjin 300350, People's Republic of China
| | - Jingzhu Zhao
- Department of Thyroid and Neck Tumor, Tianjin Medical University Cancer Institute and Hospital, National Clinical Research Center for Cancer, Key Laboratory of Cancer Prevention and Therapy, Tianjin 300060, People's Republic of China
| | - Yanmei Liang
- Institute of Modern Optics, Nankai University, Tianjin Key Laboratory of Micro-scale Optical Information Science and Technology, Tianjin 300350, People's Republic of China
| |
Collapse
|
3
|
Salimi M, Roshanfar M, Tabatabaei N, Mosadegh B. Machine Learning-Assisted Short-Wave InfraRed (SWIR) Techniques for Biomedical Applications: Towards Personalized Medicine. J Pers Med 2023; 14:33. [PMID: 38248734 PMCID: PMC10817559 DOI: 10.3390/jpm14010033] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/24/2023] [Revised: 12/08/2023] [Accepted: 12/20/2023] [Indexed: 01/23/2024] Open
Abstract
Personalized medicine transforms healthcare by adapting interventions to individuals' unique genetic, molecular, and clinical profiles. To maximize diagnostic and/or therapeutic efficacy, personalized medicine requires advanced imaging devices and sensors for accurate assessment and monitoring of individual patient conditions or responses to therapeutics. In the field of biomedical optics, short-wave infrared (SWIR) techniques offer an array of capabilities that hold promise to significantly enhance diagnostics, imaging, and therapeutic interventions. SWIR techniques provide in vivo information, which was previously inaccessible, by making use of its capacity to penetrate biological tissues with reduced attenuation and enable researchers and clinicians to delve deeper into anatomical structures, physiological processes, and molecular interactions. Combining SWIR techniques with machine learning (ML), which is a powerful tool for analyzing information, holds the potential to provide unprecedented accuracy for disease detection, precision in treatment guidance, and correlations of complex biological features, opening the way for the data-driven personalized medicine field. Despite numerous biomedical demonstrations that utilize cutting-edge SWIR techniques, the clinical potential of this approach has remained significantly underexplored. This paper demonstrates how the synergy between SWIR imaging and ML is reshaping biomedical research and clinical applications. As the paper showcases the growing significance of SWIR imaging techniques that are empowered by ML, it calls for continued collaboration between researchers, engineers, and clinicians to boost the translation of this technology into clinics, ultimately bridging the gap between cutting-edge technology and its potential for personalized medicine.
Collapse
Affiliation(s)
| | - Majid Roshanfar
- Department of Mechanical Engineering, Concordia University, Montreal, QC H3G 1M8, Canada;
| | - Nima Tabatabaei
- Department of Mechanical Engineering, York University, Toronto, ON M3J 1P3, Canada;
| | - Bobak Mosadegh
- Dalio Institute of Cardiovascular Imaging, Department of Radiology, Weill Cornell Medicine, New York, NY 10021, USA
| |
Collapse
|
4
|
Wang L, Chen S, Liu L, Yin X, Shi G, Mo J. Axial super-resolution optical coherence tomography via complex-valued network. Phys Med Biol 2023; 68:235016. [PMID: 37922558 DOI: 10.1088/1361-6560/ad0997] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/21/2023] [Accepted: 11/03/2023] [Indexed: 11/07/2023]
Abstract
Optical coherence tomography (OCT) is a fast and non-invasive optical interferometric imaging technique that can provide high-resolution cross-sectional images of biological tissues. OCT's key strength is its depth resolving capability which remains invariant along the imaging depth and is determined by the axial resolution. The axial resolution is inversely proportional to the bandwidth of the OCT light source. Thus, the use of broadband light sources can effectively improve the axial resolution and however leads to an increased cost. In recent years, real-valued deep learning technique has been introduced to obtain super-resolution optical imaging. In this study, we proposed a complex-valued super-resolution network (CVSR-Net) to achieve an axial super-resolution for OCT by fully utilizing the amplitude and phase of OCT signal. The method was evaluated on three OCT datasets. The results show that the CVSR-Net outperforms its real-valued counterpart with a better depth resolving capability. Furthermore, comparisons were made between our network, six prevailing real-valued networks and their complex-valued counterparts. The results demonstrate that the complex-valued network exhibited a better super-resolution performance than its real-valued counterpart and our proposed CVSR-Net achieved the best performance. In addition, the CVSR-Net was tested on out-of-distribution domain datasets and its super-resolution performance was well maintained as compared to that on source domain datasets, indicating a good generalization capability.
Collapse
Affiliation(s)
- Lingyun Wang
- School of Electronics and Information Engineering, Soochow University, Suzhou, People's Republic of China
| | - Si Chen
- School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore
| | - Linbo Liu
- School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore
| | - Xue Yin
- The First Affiliated Hospital of Soochow University, Suzhou, People's Republic of China
| | - Guohua Shi
- Jiangsu Key Laboratory of Medical Optics, Suzhou Institute of Biomedical Engineering and Technology, Suzhou, People's Republic of China
| | - Jianhua Mo
- School of Electronics and Information Engineering, Soochow University, Suzhou, People's Republic of China
| |
Collapse
|
5
|
Wu R, Huang S, Zhong J, Li M, Zheng F, Bo E, Liu L, Liu Y, Ge X, Ni G. MAS-Net OCT: a deep-learning-based speckle-free multiple aperture synthetic optical coherence tomography. BIOMEDICAL OPTICS EXPRESS 2023; 14:2591-2607. [PMID: 37342716 PMCID: PMC10278634 DOI: 10.1364/boe.483740] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/19/2022] [Revised: 02/26/2023] [Accepted: 04/28/2023] [Indexed: 06/23/2023]
Abstract
High-resolution spectral domain optical coherence tomography (SD-OCT) is a vital clinical technique that suffers from the inherent compromise between transverse resolution and depth of focus (DOF). Meanwhile, speckle noise worsens OCT imaging resolving power and restricts potential resolution-enhancement techniques. Multiple aperture synthetic (MAS) OCT transmits light signals and records sample echoes along a synthetic aperture to extend DOF, acquired by time-encoding or optical path length encoding. In this work, a deep-learning-based multiple aperture synthetic OCT termed MAS-Net OCT, which integrated a speckle-free model based on self-supervised learning, was proposed. MAS-Net was trained on datasets generated by the MAS OCT system. Here we performed experiments on homemade microparticle samples and various biological tissues. Results demonstrated that the proposed MAS-Net OCT could effectively improve the transverse resolution in a large imaging depth as well as reduced most speckle noise.
Collapse
Affiliation(s)
- Renxiong Wu
- School of Optoelectronic Science and Engineering, University of Electronic Science and Technology of China, Chengdu 610054, China
| | - Shaoyan Huang
- School of Optoelectronic Science and Engineering, University of Electronic Science and Technology of China, Chengdu 610054, China
| | - Junming Zhong
- School of Optoelectronic Science and Engineering, University of Electronic Science and Technology of China, Chengdu 610054, China
| | - Meixuan Li
- School of Optoelectronic Science and Engineering, University of Electronic Science and Technology of China, Chengdu 610054, China
| | - Fei Zheng
- School of Optoelectronic Science and Engineering, University of Electronic Science and Technology of China, Chengdu 610054, China
| | - En Bo
- School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore 639798, Singapore
| | - Linbo Liu
- School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore 639798, Singapore
| | - Yong Liu
- School of Optoelectronic Science and Engineering, University of Electronic Science and Technology of China, Chengdu 610054, China
| | - Xin Ge
- School of Science, Shenzhen Campus of Sun Yat-sen University, Shenzhen 510275, China
| | - Guangming Ni
- School of Optoelectronic Science and Engineering, University of Electronic Science and Technology of China, Chengdu 610054, China
| |
Collapse
|
6
|
Kang YG, Canoy RJE, Jang Y, Santos ARMP, Son I, Kim BM, Park Y. Optical coherence microscopy with a split-spectrum image reconstruction method for temporal-dynamics contrast-based imaging of intracellular motility. BIOMEDICAL OPTICS EXPRESS 2023; 14:577-592. [PMID: 36874497 PMCID: PMC9979675 DOI: 10.1364/boe.478264] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/26/2022] [Revised: 12/21/2022] [Accepted: 12/23/2022] [Indexed: 06/18/2023]
Abstract
Biomedical researchers use optical coherence microscopy (OCM) for its high resolution in real-time label-free tomographic imaging. However, OCM lacks bioactivity-related functional contrast. We developed an OCM system that can measure changes in intracellular motility (indicating cellular process states) via pixel-wise calculations of intensity fluctuations from metabolic activity of intracellular components. To reduce image noise, the source spectrum is split into five using Gaussian windows with 50% of the full bandwidth. The technique verified that F-actin fiber inhibition by Y-27632 reduces intracellular motility. This finding could be used to search for other intracellular-motility-associated therapeutic strategies for cardiovascular diseases.
Collapse
Affiliation(s)
- Yong Guk Kang
- BK21 Four Institute of Precision Public Health, Korea University, Seoul 02841, Republic of Korea
- These authors contributed equally to this work
| | - Raymart Jay E. Canoy
- Department of Biomicro System Technology, College of Engineering, Korea University, Seoul 02841, Republic of Korea
- These authors contributed equally to this work
| | - Yongjun Jang
- Department of Biomedical Science, College of Medicine, Korea University, Seoul 02841, Republic of Korea
| | - Ana Rita M. P. Santos
- Department of Biomedical Science, College of Medicine, Korea University, Seoul 02841, Republic of Korea
| | - Inwoo Son
- Department of Biomedical Science, College of Medicine, Korea University, Seoul 02841, Republic of Korea
| | - Beop-Min Kim
- BK21 Four Institute of Precision Public Health, Korea University, Seoul 02841, Republic of Korea
- Department of Biomedical Engineering, College of Health Science, Korea University, Seoul 02841, Republic of Korea
| | - Yongdoo Park
- Department of Biomedical Science, College of Medicine, Korea University, Seoul 02841, Republic of Korea
| |
Collapse
|