1
|
Yuan T, Riobo L, Gasparin F, Ntziachristos V, Pleitez MA. Phase-shifting optothermal microscopy enables live-cell mid-infrared hyperspectral imaging of large cell populations at high confluency. SCIENCE ADVANCES 2024; 10:eadj7944. [PMID: 38381817 PMCID: PMC10881023 DOI: 10.1126/sciadv.adj7944] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/17/2023] [Accepted: 01/11/2024] [Indexed: 02/23/2024]
Abstract
Rapid live-cell hyperspectral imaging at large fields of view (FOVs) and high cell confluency remains challenging for conventional vibrational spectroscopy-based microscopy technologies. At the same time, imaging at high cell confluency and large FOVs is important for proper cell function and statistical significance of measurements, respectively. Here, we introduce phase-shifting mid-infrared optothermal microscopy (PSOM), which interprets molecular-vibrational information as the optical path difference induced by mid-infrared absorption and can take snapshot vibrational images over broad excitation areas at high live-cell confluency. By means of phase-shifting, PSOM suppresses noise to a quarter of current optothermal microscopy modalities to allow capturing live-cell vibrational images at FOVs up to 50 times larger than state of the art. PSOM also reduces illumination power flux density (PFD) down to four orders of magnitude lower than other conventional vibrational microscopy methods, such as coherent anti-Stokes Raman scattering (CARS), thus considerably decreasing the risk of cell photodamage.
Collapse
Affiliation(s)
- Tao Yuan
- Chair of Biological Imaging at the Central Institute for Translational Cancer Research (TranslaTUM), School of Medicine and Health, Technical University of Munich, Munich, Germany
- Institute of Biological and Medical Imaging, Helmholtz Zentrum München, Neuherberg, Germany
| | - Lucas Riobo
- Chair of Biological Imaging at the Central Institute for Translational Cancer Research (TranslaTUM), School of Medicine and Health, Technical University of Munich, Munich, Germany
- Institute of Biological and Medical Imaging, Helmholtz Zentrum München, Neuherberg, Germany
| | - Francesca Gasparin
- Chair of Biological Imaging at the Central Institute for Translational Cancer Research (TranslaTUM), School of Medicine and Health, Technical University of Munich, Munich, Germany
- Institute of Biological and Medical Imaging, Helmholtz Zentrum München, Neuherberg, Germany
| | - Vasilis Ntziachristos
- Chair of Biological Imaging at the Central Institute for Translational Cancer Research (TranslaTUM), School of Medicine and Health, Technical University of Munich, Munich, Germany
- Institute of Biological and Medical Imaging, Helmholtz Zentrum München, Neuherberg, Germany
- Munich Institute of Biomedical Engineering (MIBE), Technical University of Munich, Garching b. München, Germany
| | - Miguel A. Pleitez
- Chair of Biological Imaging at the Central Institute for Translational Cancer Research (TranslaTUM), School of Medicine and Health, Technical University of Munich, Munich, Germany
- Institute of Biological and Medical Imaging, Helmholtz Zentrum München, Neuherberg, Germany
| |
Collapse
|
2
|
Zhong Z, Song D, Liu L, Nastasa V, Liu B, Shan M. Multi-derivative method for phase extraction without knowing carrier frequencies in off-axis quantitative phase imaging. OPTICS LETTERS 2023; 48:6304-6307. [PMID: 38039253 DOI: 10.1364/ol.503902] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/22/2023] [Accepted: 10/31/2023] [Indexed: 12/03/2023]
Abstract
We propose a multi-derivative method to reconstruct the phase of transparent objects in off-axis quantitative phase imaging (QPI). By numerically computing first-, second-, and third-order derivatives of the interferogram, we demonstrate that one can extract the quantitative phase information in a straightforward way, without prior knowledge of the carrier frequencies or Fourier transform. In contrast to existing advanced derivative methods, our approach markedly streamlines the alignment and retrieval processes, all without requiring any special prerequisites. This enhancement seamlessly translates into improved reconstruction quality. Furthermore, when compared to cutting-edge Fourier-division-based methods, our technique distinctly accelerates the phase retrieval speed. We verified our method using white-light diffraction phase microscopy and laser off-axis QPI, and the results indicate that our method can allow a fast, high-quality retrieval with frame rates up to 41.6 fps for one- megapixel interferograms on a regular computer.
Collapse
|
3
|
Zhong Z, Song D, Liu L, Chen X, Shan M. Dual-wavelength off-axis digital holography in ImageJ: toward real-time phase retrieval using CUDA streams. APPLIED OPTICS 2023; 62:5868-5874. [PMID: 37706936 DOI: 10.1364/ao.493456] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/19/2023] [Accepted: 07/05/2023] [Indexed: 09/15/2023]
Abstract
An ImageJ plug-in is developed to realize automatic real-time phase reconstruction for dual-wavelength digital holography (DH). This plug-in assembles the algorithms, including automatic phase reconstruction based on the division algorithm and post-processing. These algorithms are implemented and analyzed using a CPU and GPU, respectively. To hide the CPU-to-GPU data transfer latency, an optimization scheme using Compute Unified Device Architecture (CUDA) streams is proposed in ImageJ. Experimental results show that the proposed plug-in can perform faster reconstruction for dual-wavelength DH, resulting in frame rates up to 48 fps even for one-megapixel digital holograms on a normal PC. In other words, the proposed plug-in can realize real-time phase reconstruction for dual-wavelength digital holographic videos.
Collapse
|
4
|
Tanjaya NK, Toda K, Ideguchi T, Ishii S. Thermo-optical measurements using quantitative phase microscopy. OPTICS LETTERS 2023; 48:3311-3314. [PMID: 37319089 DOI: 10.1364/ol.489182] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/03/2023] [Accepted: 05/18/2023] [Indexed: 06/17/2023]
Abstract
Quantitative phase microscopy (QPM) literally images the quantitative phase shift associated with image contrast, where the phase shift can be altered by laser heating. In this study, the thermal conductivity and thermo-optic coefficient (TOC) of a transparent substrate are simultaneously determined by measuring the phase difference induced by an external heating laser using a QPM setup. The substrates are coated with a 50-nm-thick titanium nitride film to photothermally generate heat. Then, the phase difference is semi-analytically modeled based on the heat transfer and thermo-optic effect to simultaneously extract the thermal conductivity and TOC. The measured thermal conductivity and TOC agree reasonably well, indicating the potential for measuring the thermal conductivities and TOCs of other transparent substrates. The concise setup and simple modeling differentiate the advantages of our method from other techniques.
Collapse
|
5
|
Picazo-Bueno JA, Trusiak M, Micó V. Single-shot slightly off-axis digital holographic microscopy with add-on module based on beamsplitter cube. OPTICS EXPRESS 2019; 27:5655-5669. [PMID: 30876163 DOI: 10.1364/oe.27.005655] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/22/2018] [Accepted: 12/17/2018] [Indexed: 05/21/2023]
Abstract
Slightly off-axis digital holographic microscopy (SO-DHM) has recently emerged as a novel experimental arrangement for quantitative phase imaging (QPI). It offers improved capabilities in conventional on-axis and off-axis interferometric configurations. In this contribution, we report on a single-shot SO-DHM approach based on an add-on module adapted to the exit port of a regular microscope. The module employs a beamsplitter (BS) cube interferometer and includes, in addition, a Stokes lens (SL) for astigmatism compensation. Each recorded frame contains two fields of view (FOVs) of the sample, where each FOV is a hologram which is phase shifted by π rads with respect to the other. These two simultaneously recorded holograms are numerically processed, in order to retrieve complex amplitude distribution with enhanced quality. The tradeoff is done in the FOV which becomes penalized as a consequence of the simultaneous recording of the two holograms in a single snapshot. Experimental validation is presented for a wide variety of samples using a regular Olympus BX-60 upright microscope. The proposed approach provides an optimized use of the imaging system, in terms of the space-bandwidth product, in comparison with off-axis configuration; allows the analysis of fast-dynamic events, owing to its single-shot capability when compared with on-axis arrangement; and becomes easily implementable in conventional white-light microscopes for upgrading them into holographic microscopes for QPI.
Collapse
|
6
|
Ameen Yasir PA, Solomon Ivan J. Phase estimation using phase gradients obtained through Hilbert transform. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA. A, OPTICS, IMAGE SCIENCE, AND VISION 2016; 33:2010-2019. [PMID: 27828104 DOI: 10.1364/josaa.33.002010] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
An algorithm to extract phase in its unwrapped form from an interferogram having perturbed straight line fringes is proposed and studied. Phase gradients are extracted from an interferogram using the Hilbert transform, and the phase is then estimated from their gradients using the method of least squares for the Hudgin geometry. The matrix inversion required in implementing the method of least squares for the Hudgin geometry is carried out analytically by exploiting the additional symmetries available in the Hudgin matrix. The consistency of the proposed algorithm is demonstrated through its implementation, both on numerically generated interferograms, as well as on interferograms measured in a Mach-Zehnder interferometric setup, where the respective imparted phases were random, and corresponded to atmospheric turbulence-like models.
Collapse
|
7
|
Girshovitz P, Shaked NT. Fast phase processing in off-axis holography using multiplexing with complex encoding and live-cell fluctuation map calculation in real-time. OPTICS EXPRESS 2015; 23:8773-87. [PMID: 25968715 DOI: 10.1364/oe.23.008773] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/23/2023]
Abstract
We present efficient algorithms for rapid reconstruction of quantitative phase maps from off-axis digital holograms. The new algorithms are aimed at speeding up the conventional Fourier-based algorithm. By implementing the new algorithms on a standard personal computer, while using only a single-core processing unit, we were able to reconstruct the unwrapped phase maps from one megapixel off-axis holograms at frame rates of up to 45 frames per second (fps). When phase unwrapping is not required, the same algorithms allow frame rates of up to 150 fps for one megapixel off-axis holograms. In addition to obtaining real-time quantitative visualization of the sample, the increased frame rate allows integrating additional calculations as a part of the reconstruction process, providing sample-related information that was not available in real time until now. We use these new capabilities to extract, for the first time to our knowledge, the dynamic fluctuation maps of red blood cells at frame rate of 31 fps for one megapixel holograms.
Collapse
|
8
|
Pan M, Zeng Y, Huang Z. Quantitative measurement of phase variation amplitude of ultrasonic diffraction grating based on diffraction spectral analysis. THE REVIEW OF SCIENTIFIC INSTRUMENTS 2014; 85:093112. [PMID: 25273712 DOI: 10.1063/1.4895649] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/03/2023]
Abstract
A new method based on diffraction spectral analysis is proposed for the quantitative measurement of the phase variation amplitude of an ultrasonic diffraction grating. For a traveling wave, the phase variation amplitude of the grating depends on the intensity of the zeroth- and first-order diffraction waves. By contrast, for a standing wave, this amplitude depends on the intensity of the zeroth-, first-, and second-order diffraction waves. The proposed method is verified experimentally. The measured phase variation amplitude ranges from 0 to 2π, with a relative error of approximately 5%. A nearly linear relation exists between the phase variation amplitude and driving voltage. Our proposed method can also be applied to ordinary sinusoidal phase grating.
Collapse
Affiliation(s)
- Meiyan Pan
- Laboratory of Quantum Engineering and Quantum Materials, School of Physics and Telecommunication Engineering, South China Normal University, Guangzhou, Guangdong 510006, China
| | - Yingzhi Zeng
- Laboratory of Quantum Engineering and Quantum Materials, School of Physics and Telecommunication Engineering, South China Normal University, Guangzhou, Guangdong 510006, China
| | - Zuohua Huang
- Laboratory of Quantum Engineering and Quantum Materials, School of Physics and Telecommunication Engineering, South China Normal University, Guangzhou, Guangdong 510006, China
| |
Collapse
|
9
|
Kim K, Kim KS, Park H, Ye JC, Park Y. Real-time visualization of 3-D dynamic microscopic objects using optical diffraction tomography. OPTICS EXPRESS 2013; 21:32269-78. [PMID: 24514820 DOI: 10.1364/oe.21.032269] [Citation(s) in RCA: 81] [Impact Index Per Article: 7.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/18/2023]
Abstract
3-D refractive index (RI) distribution is an intrinsic bio-marker for the chemical and structural information about biological cells. Here we develop an optical diffraction tomography technique for the real-time reconstruction of 3-D RI distribution, employing sparse angle illumination and a graphic processing unit (GPU) implementation. The execution time for the tomographic reconstruction is 0.21 s for 96(3) voxels, which is 17 times faster than that of a conventional approach. We demonstrated the real-time visualization capability with imaging the dynamics of Brownian motion of an anisotropic colloidal dimer and the dynamic shape change in a red blood cell upon shear flow.
Collapse
|
10
|
Matías Di Martino J, Flores JL, Pfeiffer F, Scherer K, Ayubi GA, Ferrari JA. Phase retrieval from one partial derivative. OPTICS LETTERS 2013; 38:4813-4816. [PMID: 24322139 DOI: 10.1364/ol.38.004813] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/03/2023]
Abstract
Phase objects can be characterized using well-known methods such as shear interferometry and deflectometry, which provide information on the partial derivatives of the phase. It is often believed that for phase retrieval it is strictly necessary to have knowledge of two partial derivatives in orthogonal directions. In the praxis, this implies that the measurements have to be performed along two dimensions, which often requires a rotation of the object or rotation of the shear direction. This is time consuming and errors can be easily generated from the process of rotation, especially for image registration in the axial direction. In the present Letter, we will demonstrate that only one partial derivative often suffices to recover the phase, and we will discuss under which conditions that is possible. Simulations and validation experiments are presented.
Collapse
|
11
|
Quantitative phase imaging techniques for the study of cell pathophysiology: from principles to applications. SENSORS 2013; 13:4170-91. [PMID: 23539026 PMCID: PMC3673078 DOI: 10.3390/s130404170] [Citation(s) in RCA: 222] [Impact Index Per Article: 20.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/19/2013] [Revised: 03/11/2013] [Accepted: 03/18/2013] [Indexed: 11/17/2022]
Abstract
A cellular-level study of the pathophysiology is crucial for understanding the mechanisms behind human diseases. Recent advances in quantitative phase imaging (QPI) techniques show promises for the cellular-level understanding of the pathophysiology of diseases. To provide important insight on how the QPI techniques potentially improve the study of cell pathophysiology, here we present the principles of QPI and highlight some of the recent applications of QPI ranging from cell homeostasis to infectious diseases and cancer.
Collapse
|
12
|
Pham HV, Edwards C, Goddard LL, Popescu G. Fast phase reconstruction in white light diffraction phase microscopy. APPLIED OPTICS 2013; 52:A97-A101. [PMID: 23292428 DOI: 10.1364/ao.52.000a97] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/16/2012] [Accepted: 09/26/2012] [Indexed: 05/27/2023]
Abstract
In off-axis interferometry, we usually have to deal with the unwrapping process, which is very computationally intensive and prevents us from real time phase reconstruction. The wrapping problem usually occurs when imaging thick objects, which introduce phase shifts of more than 2π radians. However, in off-axis interferometry, the nonzero angle of interference of the two beams creates a ramp in the phase across the image that can produce phase wrapping errors. In this paper, we propose a simple technique that avoids the need for the unwrapping step in reconstructing quantitative phase images in white light diffraction phase microscopy of thin samples. We show that this approach can improve significantly the phase reconstruction speed and allow high impact applications, such as real-time blood testing.
Collapse
Affiliation(s)
- Hoa V Pham
- Quantitative Light Imaging Laboratory, Department of Electrical and Computer Engineering, Beckman Institute for Advanced Science & Technology, University of Illinois at Urbana–Champaign, Urbana, Illinois 61801, USA
| | | | | | | |
Collapse
|