1
|
Wang J, Zhao X, Wang Y, Li D. Color-multiplexed 3D differential phase contrast microscopy with optimal annular illumination. OPTICS EXPRESS 2024; 32:49135-49152. [PMID: 39876200 DOI: 10.1364/oe.545480] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/21/2024] [Accepted: 12/12/2024] [Indexed: 01/30/2025]
Abstract
Quantitative phase imaging (QPI) has become a valuable tool in the field of biomedical research due to its ability to quantify refractive index variations of live cells and tissues. For example, three-dimensional differential phase contrast (3D DPC) imaging uses through-focus images captured under different illumination patterns deconvoluted with a computed 3D phase transfer function (PTF) to reconstruct the 3D refractive index. In conventional 3D DPC with semi-circular illumination, partially spatially coherent illumination often diminishes phase contrast, exacerbating inherent noise, and can lead to a large number of zero values in the 3D PTF, resulting in strong low-frequency artifacts and deteriorating imaging resolution. To overcome the above drawbacks, we obtain the conditions for acquiring the optimal 3D PTF based on the analysis of the 3D imaging model and the derivation of the 3D PTF calculation process and propose a 3D DPC microscopy based on optimal annular illumination. The proposed optimal annular illumination pattern minimizes the missing frequency components in the 3D Fourier space, resulting in the best noise-robustness and significantly increased phase contrast. To expedite imaging speed, we utilize a 1/2 annular multiplexed illumination, reducing data acquisition volume by 75%. The 3D refractive index tomography of a simulated 3D phase object, unstained tongue sections, and oral epithelial cells demonstrates that our proposed method achieves the above advantages. In conclusion, we demonstrate a novel 3D DPC microscope that only requires replacing the illumination of a commercial microscope with a programmable LED array. The accurate 3D refractive index tomography and the compactness of the system setup allow the method to play a significant role in the biomedical field.
Collapse
|
2
|
Shu Y, Sun J, Fan Y, Jin Y, Chen Q, Zuo C. Diagonal illumination scheme for Fourier ptychographic microscopy: resolution doubling and aliasing minimization. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA. A, OPTICS, IMAGE SCIENCE, AND VISION 2024; 41:C62-C71. [PMID: 39889060 DOI: 10.1364/josaa.532252] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/05/2024] [Accepted: 09/11/2024] [Indexed: 02/02/2025]
Abstract
Fourier ptychographic microscopy (FPM) is a high-throughput computational imaging technology that enables wide-field and high-resolution imaging of samples with both amplitude and phase information. It holds great promise for quantitative phase imaging (QPI) on a large population of cells in parallel. However, detector undersampling leads to spectrum aliasing, which may significantly degenerate the resolution, efficiency, and quality of QPI, especially when an objective lens with a high space-bandwidth product is used. Here, we introduce a diagonal illumination scheme for FPM to minimize spectrum aliasing, enabling high-resolution QPI under a limited detector sampling rate. By orienting the LED illumination diagonally relative to the detector plane, the non-aliased sampling frequency of the raw image under oblique illumination can be maximized. This illumination scheme, when integrated with a color camera, facilitates single-shot, high-throughput QPI, effectively overcoming spectrum aliasing and achieving incoherent diffraction-limited resolution. Theoretical analysis, simulations, and experiments on resolution target and live cells validate the effectiveness and the proposed illumination scheme, offering a potential guideline for designing an FPM platform for high-speed QPI under the limited detector sampling rates.
Collapse
|
3
|
Wu X, Zhou N, Chen Y, Sun J, Lu L, Chen Q, Zuo C. Lens-free on-chip 3D microscopy based on wavelength-scanning Fourier ptychographic diffraction tomography. LIGHT, SCIENCE & APPLICATIONS 2024; 13:237. [PMID: 39237522 PMCID: PMC11377727 DOI: 10.1038/s41377-024-01568-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/01/2024] [Revised: 07/16/2024] [Accepted: 08/06/2024] [Indexed: 09/07/2024]
Abstract
Lens-free on-chip microscopy is a powerful and promising high-throughput computational microscopy technique due to its unique advantage of creating high-resolution images across the full field-of-view (FOV) of the imaging sensor. Nevertheless, most current lens-free microscopy methods have been designed for imaging only two-dimensional thin samples. Lens-free on-chip tomography (LFOCT) with a uniform resolution across the entire FOV and at a subpixel level remains a critical challenge. In this paper, we demonstrated a new LFOCT technique and associated imaging platform based on wavelength scanning Fourier ptychographic diffraction tomography (wsFPDT). Instead of using angularly-variable illuminations, in wsFPDT, the sample is illuminated by on-axis wavelength-variable illuminations, ranging from 430 to 1200 nm. The corresponding under-sampled diffraction patterns are recorded, and then an iterative ptychographic reconstruction procedure is applied to fill the spectrum of the three-dimensional (3D) scattering potential to recover the sample's 3D refractive index (RI) distribution. The wavelength-scanning scheme not only eliminates the need for mechanical motion during image acquisition and precise registration of the raw images but secures a quasi-uniform, pixel-super-resolved imaging resolution across the entire imaging FOV. With wsFPDT, we demonstrate the high-throughput, billion-voxel 3D tomographic imaging results with a half-pitch lateral resolution of 775 nm and an axial resolution of 5.43 μm across a large FOV of 29.85 mm2 and an imaging depth of >200 μm. The effectiveness of the proposed method was demonstrated by imaging various types of samples, including micro-polystyrene beads, diatoms, and mouse mononuclear macrophage cells. The unique capability to reveal quantitative morphological properties, such as area, volume, and sphericity index of single cell over large cell populations makes wsFPDT a powerful quantitative and label-free tool for high-throughput biological applications.
Collapse
Affiliation(s)
- Xuejuan Wu
- Smart Computational Imaging (SCI) Laboratory, Nanjing University of Science and Technology, No. 200 Xiaolingwei Street, 210094, Nanjing, Jiangsu, China
- Smart Computational Imaging Research Institute (SCIRI) of Nanjing University of Science and Technology, 210094, Nanjing, Jiangsu, China
- Jiangsu Key Laboratory of Spectral Imaging & Intelligent Sense, No. 200 Xiaolingwei Street, 210094, Nanjing, Jiangsu, China
| | - Ning Zhou
- Smart Computational Imaging (SCI) Laboratory, Nanjing University of Science and Technology, No. 200 Xiaolingwei Street, 210094, Nanjing, Jiangsu, China
- Smart Computational Imaging Research Institute (SCIRI) of Nanjing University of Science and Technology, 210094, Nanjing, Jiangsu, China
- Jiangsu Key Laboratory of Spectral Imaging & Intelligent Sense, No. 200 Xiaolingwei Street, 210094, Nanjing, Jiangsu, China
| | - Yang Chen
- Smart Computational Imaging (SCI) Laboratory, Nanjing University of Science and Technology, No. 200 Xiaolingwei Street, 210094, Nanjing, Jiangsu, China
- Smart Computational Imaging Research Institute (SCIRI) of Nanjing University of Science and Technology, 210094, Nanjing, Jiangsu, China
- Jiangsu Key Laboratory of Spectral Imaging & Intelligent Sense, No. 200 Xiaolingwei Street, 210094, Nanjing, Jiangsu, China
| | - Jiasong Sun
- Smart Computational Imaging (SCI) Laboratory, Nanjing University of Science and Technology, No. 200 Xiaolingwei Street, 210094, Nanjing, Jiangsu, China
- Smart Computational Imaging Research Institute (SCIRI) of Nanjing University of Science and Technology, 210094, Nanjing, Jiangsu, China
- Jiangsu Key Laboratory of Spectral Imaging & Intelligent Sense, No. 200 Xiaolingwei Street, 210094, Nanjing, Jiangsu, China
| | - Linpeng Lu
- Smart Computational Imaging (SCI) Laboratory, Nanjing University of Science and Technology, No. 200 Xiaolingwei Street, 210094, Nanjing, Jiangsu, China
- Smart Computational Imaging Research Institute (SCIRI) of Nanjing University of Science and Technology, 210094, Nanjing, Jiangsu, China
- Jiangsu Key Laboratory of Spectral Imaging & Intelligent Sense, No. 200 Xiaolingwei Street, 210094, Nanjing, Jiangsu, China
| | - Qian Chen
- Jiangsu Key Laboratory of Spectral Imaging & Intelligent Sense, No. 200 Xiaolingwei Street, 210094, Nanjing, Jiangsu, China.
| | - Chao Zuo
- Smart Computational Imaging (SCI) Laboratory, Nanjing University of Science and Technology, No. 200 Xiaolingwei Street, 210094, Nanjing, Jiangsu, China.
- Smart Computational Imaging Research Institute (SCIRI) of Nanjing University of Science and Technology, 210094, Nanjing, Jiangsu, China.
- Jiangsu Key Laboratory of Spectral Imaging & Intelligent Sense, No. 200 Xiaolingwei Street, 210094, Nanjing, Jiangsu, China.
| |
Collapse
|
4
|
Ma Q, Zhao J, Cui G. LED-based temporal variant noise model for Fourier ptychographic microscopy. OPTICS EXPRESS 2024; 32:14620-14644. [PMID: 38859402 DOI: 10.1364/oe.518908] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/15/2024] [Accepted: 03/22/2024] [Indexed: 06/12/2024]
Abstract
Fourier ptychographic microscopy (FPM) is a technique to reconstruct a high-resolution image from a set of low-resolution images captured with different illumination angles, which is susceptible to ambient noise, system noise, and weak currents when acquiring large-angle images, especially dark field images. To effectively address the noise problem, we propose an adaptive denoising algorithm based on a LED-based temporal variant noise model. Taking the results of blank slide samples as the reference value of noise, and analyzing the distribution of noise, we establish a statistical model for temporal variant noise, describing the relationship between temporal noise and LED spatial location. Based on this model, Gaussian denoising parameters are selected to adaptively denoise the images with different locations, with which high-resolution images can be reconstructed. Compared with other methods, the experimental results show that the proposed method effectively suppresses the noise, recovers more image details, increases the image contrast, and obtains better visual effects. Meanwhile, better objective evaluation also mirrors the advantages of the proposed algorithms.
Collapse
|
5
|
Wang J, Zhao X, Wang Y, Li D. Quantitative real-time phase microscopy for extended depth-of-field imaging based on the 3D single-shot differential phase contrast (ssDPC) imaging method. OPTICS EXPRESS 2024; 32:2081-2096. [PMID: 38297745 DOI: 10.1364/oe.512285] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/14/2023] [Accepted: 12/21/2023] [Indexed: 02/02/2024]
Abstract
Optical diffraction tomography (ODT) is a promising label-free imaging method capable of quantitatively measuring the three-dimensional (3D) refractive index distribution of transparent samples. In recent years, partially coherent ODT (PC-ODT) has attracted increasing attention due to its system simplicity and absence of laser speckle noise. Quantitative phase imaging (QPI) technologies represented by Fourier ptychographic microscopy (FPM), differential phase contrast (DPC) imaging and intensity diffraction tomography (IDT) need to collect several or hundreds of intensity images, which usually introduce motion artifacts when shooting fast-moving targets, leading to a decrease in image quality. Hence, a quantitative real-time phase microscopy (qRPM) for extended depth of field (DOF) imaging based on 3D single-shot differential phase contrast (ssDPC) imaging method is proposed in this research study. qRPM incorporates a microlens array (MLA) to simultaneously collect spatial information and angular information. In subsequent optical information processing, a deconvolution method is used to obtain intensity stacks under different illumination angles in a raw light field image. Importing the obtained intensity stack into the 3D DPC imaging model is able to finally obtain the 3D refractive index distribution. The captured four-dimensional light field information enables the reconstruction of 3D information in a single snapshot and extending the DOF of qRPM. The imaging capability of the proposed qRPM system is experimental verified on different samples, achieve single-exposure 3D label-free imaging with an extended DOF for 160 µm which is nearly 30 times higher than the traditional microscope system.
Collapse
|
6
|
Aleksandrovych M, Strassberg M, Melamed J, Xu M. Polarization differential interference contrast microscopy with physics-inspired plug-and-play denoiser for single-shot high-performance quantitative phase imaging. BIOMEDICAL OPTICS EXPRESS 2023; 14:5833-5850. [PMID: 38021115 PMCID: PMC10659786 DOI: 10.1364/boe.499316] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/30/2023] [Revised: 08/31/2023] [Accepted: 09/15/2023] [Indexed: 12/01/2023]
Abstract
We present single-shot high-performance quantitative phase imaging with a physics-inspired plug-and-play denoiser for polarization differential interference contrast (PDIC) microscopy. The quantitative phase is recovered by the alternating direction method of multipliers (ADMM), balancing total variance regularization and a pre-trained dense residual U-net (DRUNet) denoiser. The custom DRUNet uses the Tanh activation function to guarantee the symmetry requirement for phase retrieval. In addition, we introduce an adaptive strategy accelerating convergence and explicitly incorporating measurement noise. After validating this deep denoiser-enhanced PDIC microscopy on simulated data and phantom experiments, we demonstrated high-performance phase imaging of histological tissue sections. The phase retrieval by the denoiser-enhanced PDIC microscopy achieves significantly higher quality and accuracy than the solution based on Fourier transforms or the iterative solution with total variance regularization alone.
Collapse
Affiliation(s)
- Mariia Aleksandrovych
- Dept. of Physics and Astronomy, Hunter College and the Graduate Center, The City University of New York, 695 Park Ave, New York, NY 10065, USA
| | - Mark Strassberg
- Dept. of Physics and Astronomy, Hunter College and the Graduate Center, The City University of New York, 695 Park Ave, New York, NY 10065, USA
| | - Jonathan Melamed
- Department of Pathology, New York University Langone School of Medicine, New York, NY 10016, USA
| | - Min Xu
- Dept. of Physics and Astronomy, Hunter College and the Graduate Center, The City University of New York, 695 Park Ave, New York, NY 10065, USA
| |
Collapse
|
7
|
Yang D, Zhang S, Zheng C, Zhou G, Hu Y, Hao Q. Refractive index tomography with a physics-based optical neural network. BIOMEDICAL OPTICS EXPRESS 2023; 14:5886-5903. [PMID: 38021108 PMCID: PMC10659804 DOI: 10.1364/boe.504242] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/28/2023] [Revised: 09/27/2023] [Accepted: 09/27/2023] [Indexed: 12/01/2023]
Abstract
The non-interference three-dimensional refractive index (RI) tomography has attracted extensive attention in the life science field for its simple system implementation and robust imaging performance. However, the complexity inherent in the physical propagation process poses significant challenges when the sample under study deviates from the weak scattering approximation. Such conditions complicate the task of achieving global optimization with conventional algorithms, rendering the reconstruction process both time-consuming and potentially ineffective. To address such limitations, this paper proposes an untrained multi-slice neural network (MSNN) with an optical structure, in which each layer has a clear corresponding physical meaning according to the beam propagation model. The network does not require pre-training and performs good generalization and can be recovered through the optimization of a set of intensity images. Concurrently, MSNN can calibrate the intensity of different illumination by learnable parameters, and the multiple backscattering effects have also been taken into consideration by integrating a "scattering attenuation layer" between adjacent "RI" layers in the MSNN. Both simulations and experiments have been conducted carefully to demonstrate the effectiveness and feasibility of the proposed method. Experimental results reveal that MSNN can enhance clarity with increased efficiency in RI tomography. The implementation of MSNN introduces a novel paradigm for RI tomography.
Collapse
Affiliation(s)
- Delong Yang
- School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China
| | - Shaohui Zhang
- School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China
- Yangtze Delta Region Academy of Beijing Institute of Technology, China
| | - Chuanjian Zheng
- School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China
| | - Guocheng Zhou
- School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China
| | - Yao Hu
- School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China
| | - Qun Hao
- School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China
- Yangtze Delta Region Academy of Beijing Institute of Technology, China
| |
Collapse
|
8
|
Song S, Kim J, Moon T, Seong B, Kim W, Yoo CH, Choi JK, Joo C. Polarization-sensitive intensity diffraction tomography. LIGHT, SCIENCE & APPLICATIONS 2023; 12:124. [PMID: 37202421 PMCID: PMC10195819 DOI: 10.1038/s41377-023-01151-0] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/05/2022] [Revised: 04/07/2023] [Accepted: 04/10/2023] [Indexed: 05/20/2023]
Abstract
Optical anisotropy, which is an intrinsic property of many materials, originates from the structural arrangement of molecular structures, and to date, various polarization-sensitive imaging (PSI) methods have been developed to investigate the nature of anisotropic materials. In particular, the recently developed tomographic PSI technologies enable the investigation of anisotropic materials through volumetric mappings of the anisotropy distribution of these materials. However, these reported methods mostly operate on a single scattering model, and are thus not suitable for three-dimensional (3D) PSI imaging of multiple scattering samples. Here, we present a novel reference-free 3D polarization-sensitive computational imaging technique-polarization-sensitive intensity diffraction tomography (PS-IDT)-that enables the reconstruction of 3D anisotropy distribution of both weakly and multiple scattering specimens from multiple intensity-only measurements. A 3D anisotropic object is illuminated by circularly polarized plane waves at various illumination angles to encode the isotropic and anisotropic structural information into 2D intensity information. These information are then recorded separately through two orthogonal analyzer states, and a 3D Jones matrix is iteratively reconstructed based on the vectorial multi-slice beam propagation model and gradient descent method. We demonstrate the 3D anisotropy imaging capabilities of PS-IDT by presenting 3D anisotropy maps of various samples, including potato starch granules and tardigrade.
Collapse
Affiliation(s)
- Seungri Song
- Department of Mechanical Engineering, Yonsei University, Seoul, 03722, Republic of Korea
| | - Jeongsoo Kim
- Department of Mechanical Engineering, Yonsei University, Seoul, 03722, Republic of Korea
| | - Taegyun Moon
- Department of Mechanical Engineering, Yonsei University, Seoul, 03722, Republic of Korea
| | - Baekcheon Seong
- Department of Mechanical Engineering, Yonsei University, Seoul, 03722, Republic of Korea
| | - Woovin Kim
- Department of Mechanical Engineering, Yonsei University, Seoul, 03722, Republic of Korea
| | - Chang-Hyuk Yoo
- Small Machines Company, Ltd., Seoul, 04808, Republic of Korea
| | - Jun-Kyu Choi
- Small Machines Company, Ltd., Seoul, 04808, Republic of Korea
| | - Chulmin Joo
- Department of Mechanical Engineering, Yonsei University, Seoul, 03722, Republic of Korea.
| |
Collapse
|