Submicrometer tomography of cells by multiple-wavelength digital holographic microscopy in reflection

Recent Advances and Current Trends in Transmission Tomographic Diffraction Microscopy

Optical microscopy techniques are among the most used methods in biomedical sample characterization. In their more advanced realization, optical microscopes demonstrate resolution down to the nanometric scale. These methods rely on the use of fluorescent sample labeling in order to break the diffraction limit. However, fluorescent molecules' phototoxicity or photobleaching is not always compatible with the investigated samples. To overcome this limitation, quantitative phase imaging techniques have been proposed. Among these, holographic imaging has demonstrated its ability to image living microscopic samples without staining. However, for a 3D assessment of samples, tomographic acquisitions are needed. Tomographic Diffraction Microscopy (TDM) combines holographic acquisitions with tomographic reconstructions. Relying on a 3D synthetic aperture process, TDM allows for 3D quantitative measurements of the complex refractive index of the investigated sample. Since its initial proposition by Emil Wolf in 1969, the concept of TDM has found a lot of applications and has become one of the hot topics in biomedical imaging. This review focuses on recent achievements in TDM development. Current trends and perspectives of the technique are also discussed.

Roadmap on Digital Holography-Based Quantitative Phase Imaging

Quantitative Phase Imaging (QPI) provides unique means for the imaging of biological or technical microstructures, merging beneficial features identified with microscopy, interferometry, holography, and numerical computations. This roadmap article reviews several digital holography-based QPI approaches developed by prominent research groups. It also briefly discusses the present and future perspectives of 2D and 3D QPI research based on digital holographic microscopy, holographic tomography, and their applications.

Multifocal imaging for precise, label-free tracking of fast biological processes in 3D

Many biological processes happen on a nano- to millimeter scale and within milliseconds. Established methods such as confocal microscopy are suitable for precise 3D recordings but lack the temporal or spatial resolution to resolve fast 3D processes and require labeled samples. Multifocal imaging (MFI) allows high-speed 3D imaging but is limited by the compromise between high spatial resolution and large field-of-view (FOV), and the requirement for bright fluorescent labels. Here, we provide an open-source 3D reconstruction algorithm for multi-focal images that allows using MFI for fast, precise, label-free tracking spherical and filamentous structures in a large FOV and across a high depth. We characterize fluid flow and flagellar beating of human and sea urchin sperm with a z-precision of 0.15 µm, in a volume of 240 × 260 × 21 µm, and at high speed (500 Hz). The sampling volume allowed to follow sperm trajectories while simultaneously recording their flagellar beat. Our MFI concept is cost-effective, can be easily implemented, and does not rely on object labeling, which renders it broadly applicable.

Single-Shot Imaging of Two-Wavelength Spatial Phase-Shifting Interferometry

In this investigation, we propose an effective method to measure 3D surface profiles of specimens with single-shot imaging. Based on the two-wavelength interferometric principle and spatial phase-shifting technique using a polarization pixelated camera, the proposed system can not only rapidly measure the phase, but also overcome the 2π-ambiguity problem of typical phase-shifting interferometry. The rough surface profile can be calculated by the visibility of the interference fringe and can compensate for the height discontinuity by phase jumps occurring in a fine height map. An inclined plane mirror and a step height specimen with 9 μm were used for the validation of capability of measuring continuously smooth surface and large step heights. The measurement results were in good agreement with the results of typical two-wavelength interferometry.

Low-coherent optical diffraction tomography by angle-scanning illumination

Temporally low-coherent optical diffraction tomography (ODT) is proposed and demonstrated based on angle-scanning Mach-Zehnder interferometry. Using a digital micromirror device based on diffractive tilting, the full-field interference of incoherent light is successfully maintained during every angle-scanning sequences. Further, current ODT reconstruction principles for temporally incoherent illuminations are thoroughly reviewed and developed. Several limitations of incoherent illumination are also discussed, such as the nondispersive assumption, optical sectioning capacity and illumination angle limitation. Using the proposed setup and reconstruction algorithms, low-coherent ODT imaging of plastic microspheres, human red blood cells and rat pheochromocytoma cells is experimentally demonstrated.

Multi-wavelength multi-angle reflection tomography

We have developed a reflection tomographic microscope in which the sample is reconstructed from different holograms recorded under various angles and wavelengths of incidence. We present an iterative inversion algorithm based on a rigorous modeling of the wave-sample interaction that processes all the data simultaneously to estimate the sample permittivity distribution. We show that using several wavelengths permits a significant improvement of the reconstruction, especially along the optical axis.

Fast phase retrieval in off-axis digital holographic microscopy through deep learning

Traditional digital holographic imaging algorithms need multiple iterations to obtain focused reconstructed image, which is time-consuming. In terms of phase retrieval, there is also the problem of phase compensation in addition to focusing task. Here, a new method is proposed for fast digital focus, where we use U-type convolutional neural network (U-net) to recover the original phase of microscopic samples. Generated data sets are used to simulate different degrees of defocused image, and verify that the U-net can restore the original phase to a great extent and realize phase compensation at the same time. We apply this method in the construction of real-time off-axis digital holographic microscope and obtain great breakthroughs in imaging speed.

Beyond Born-Rytov limit for super-resolution optical diffraction tomography

Optical diffraction tomography (ODT) using Born or Rytov approximation suffers from severe distortions in reconstructed refractive index (RI) tomograms when multiple scattering occurs or the scattering signals are strong. These effects are usually seen as a significant impediment to the application of ODT because multiple scattering is directly linked to an unknown object itself rather than a surrounding medium, and a strong scatter invalidates the underlying assumptions of the Born and Rytov approximations. The focus of this article is to demonstrate for the first time that multiple scattering and high material contrast, if handled aptly, can significantly improve the image quality of the ODT thanks to multiple scattering inside a sample. Experimental verification using various phantom and biological cells substantiates that we not only revealed the structures that were not observable using the conventional approaches but also resolved the long-standing problem of missing cones in the ODT.

Automatic phase aberration compensation for digital holographic microscopy based on deep learning background detection

We propose a fully automatic technique to obtain aberration free quantitative phase imaging in digital holographic microscopy (DHM) based on deep learning. The traditional DHM solves the phase aberration compensation problem by manually detecting the background for quantitative measurement. This would be a drawback in real time implementation and for dynamic processes such as cell migration phenomena. A recent automatic aberration compensation approach using principle component analysis (PCA) in DHM avoids human intervention regardless of the cells' motion. However, it corrects spherical/elliptical aberration only and disregards the higher order aberrations. Traditional image segmentation techniques can be employed to spatially detect cell locations. Ideally, automatic image segmentation techniques make real time measurement possible. However, existing automatic unsupervised segmentation techniques have poor performance when applied to DHM phase images because of aberrations and speckle noise. In this paper, we propose a novel method that combines a supervised deep learning technique with convolutional neural network (CNN) and Zernike polynomial fitting (ZPF). The deep learning CNN is implemented to perform automatic background region detection that allows for ZPF to compute the self-conjugated phase to compensate for most aberrations.

Label-free high temporal resolution assessment of cell proliferation using digital holographic microscopy

Cell proliferation assays are widely applied in biological sciences to understand the effect of drugs over time. However, current methods often assess cell population growth indirectly, that is, the cells are not actually counted. Instead other parameters, for example, the amount of protein, are determined. These methods often also demand phototoxic labels, have low temporal resolution, or employ end-point assays, and frequently are labor intensive. We have developed a robust and label-free kinetic cell proliferation assay with high temporal resolution for adherent cells using digital holographic microscopy (DHM), one of many quantitative phase microscopy techniques. As no labels or stains are required, and only very low intensity illumination is necessary, the technique allows for noninvasive continuous cell counting. Only two image processing settings were adjusted between cell lines, making the assay practical, user friendly, and free of user bias. The developed direct assay was validated by analyzing cell cultures treated with various concentrations of the anti-cancer drug etoposide, a well-established topoisomerase inhibitor that causes DNA damage and leads to programmed cell death. After treatment, the unstained adherent cells were nondestructively imaged every 30 min for 36 h inside a cell incubator. In the recorded time-lapse image sequences, individual cells were automatically identified to provide detailed growth curves and growth rate data of cell number, confluence, and average cell volume. Our results demonstrate how these parameters facilitate a deeper understanding of cell processes than what is achievable with current single-parameter and end-point methods. © 2017 International Society for Advancement of Cytometry.

Accurate quantitative phase digital holographic microscopy with single- and multiple-wavelength telecentric and nontelecentric configurations

In this work, we investigate, both theoretically and experimentally, single-wavelength and multiwavelength digital holographic microscopy (DHM) using telecentric and nontelecentric configurations in transmission and reflection modes. A single-wavelength telecentric imaging system in DHM was originally proposed to circumvent the residual parabolic phase distortion due to the microscope objective (MO) in standard nontelecentric DHM configurations. However, telecentric configurations cannot compensate for higher order phase aberrations. As an extension to the telecentric and nontelecentric arrangements in single-wavelength DHM (SW-DHM), we propose multiple-wavelength telecentric DHM (MW-TDHM) in reflection and transmission modes. The advantages of MW-TDHM configurations are to extend the vertical measurement range without phase ambiguity and optically remove the parabolic phase distortion caused by the MO in traditional MW-DHM. These configurations eliminate the need for a second reference hologram to subtract the two-phase maps and make digital automatic aberration compensation easier to apply compared to nontelecentric configurations. We also discuss a reconstruction algorithm that eliminates the zero-order and virtual images using spatial filtering and another algorithm that minimizes the intensity of fluctuations using apodization. In addition, we employ two polynomial models using 2D surface fitting to compensate digitally for chromatic aberration (in the multiwavelength case) and for higher order phase aberrations. A custom-developed user-friendly graphical user interface is employed to automate the reconstruction processes for all configurations. Finally, TDHM is used to visualize cells from the highly invasive MDA-MB-231 cultured breast cancer cells.

Comparative study of iterative reconstruction algorithms for missing cone problems in optical diffraction tomography

In optical tomography, there exist certain spatial frequency components that cannot be measured due to the limited projection angles imposed by the numerical aperture of objective lenses. This limitation, often called as the missing cone problem, causes the under-estimation of refractive index (RI) values in tomograms and results in severe elongations of RI distributions along the optical axis. To address this missing cone problem, several iterative reconstruction algorithms have been introduced exploiting prior knowledge such as positivity in RI differences or edges of samples. In this paper, various existing iterative reconstruction algorithms are systematically compared for mitigating the missing cone problem in optical diffraction tomography. In particular, three representative regularization schemes, edge preserving, total variation regularization, and the Gerchberg-Papoulis algorithm, were numerically and experimentally evaluated using spherical beads as well as real biological samples; human red blood cells and hepatocyte cells. Our work will provide important guidelines for choosing the appropriate regularization in ODT.

Diffraction optical tomography using a quantitative phase imaging unit

A simple and practical method to measure three-dimensional (3-D) refractive index (RI) distributions of biological cells is presented. A common-path self-reference interferometry consisting of a compact set of polarizers is attached to a conventional inverted microscope equipped with a beam scanning unit, which can precisely measure multiple 2-D holograms of a sample with high phase stability for various illumination angles, from which accurate 3-D optical diffraction tomograms of the sample can be reconstructed. 3-D RI tomograms of nonbiological samples such as polystyrene microspheres, as well as biological samples including human red blood cells and breast cancer cells, are presented.

Review of quantitative phase-digital holographic microscopy: promising novel imaging technique to resolve neuronal network activity and identify cellular biomarkers of psychiatric disorders

Quantitative phase microscopy (QPM) has recently emerged as a new powerful quantitative imaging technique well suited to noninvasively explore a transparent specimen with a nanometric axial sensitivity. In this review, we expose the recent developments of quantitative phase-digital holographic microscopy (QP-DHM). Quantitative phase-digital holographic microscopy (QP-DHM) represents an important and efficient quantitative phase method to explore cell structure and dynamics. In a second part, the most relevant QPM applications in the field of cell biology are summarized. A particular emphasis is placed on the original biological information, which can be derived from the quantitative phase signal. In a third part, recent applications obtained, with QP-DHM in the field of cellular neuroscience, namely the possibility to optically resolve neuronal network activity and spine dynamics, are presented. Furthermore, potential applications of QPM related to psychiatry through the identification of new and original cell biomarkers that, when combined with a range of other biomarkers, could significantly contribute to the determination of high risk developmental trajectories for psychiatric disorders, are discussed.

Accurate single-shot quantitative phase imaging of biological specimens with telecentric digital holographic microscopy

The advantages of using a telecentric imaging system in digital holographic microscopy (DHM) to study biological specimens are highlighted. To this end, the performances of nontelecentric DHM and telecentric DHM are evaluated from the quantitative phase imaging (QPI) point of view. The evaluated stability of the microscope allows single-shot QPI in DHM by using telecentric imaging systems. Quantitative phase maps of a section of the head of the drosophila melanogaster fly and of red blood cells are obtained via single-shot DHM with no numerical postprocessing. With these maps we show that the use of telecentric DHM provides larger field of view for a given magnification and permits more accurate QPI measurements with less number of computational operations.

High-resolution three-dimensional imaging of red blood cells parasitized by Plasmodium falciparum and in situ hemozoin crystals using optical diffraction tomography

We present high-resolution optical tomographic images of human red blood cells (RBC) parasitized by malaria-inducing Plasmodium falciparum (Pf)-RBCs. Three-dimensional (3-D) refractive index (RI) tomograms are reconstructed by recourse to a diffraction algorithm from multiple two-dimensional holograms with various angles of illumination. These 3-D RI tomograms of Pf-RBCs show cellular and subcellular structures of host RBCs and invaded parasites in fine detail. Full asexual intraerythrocytic stages of parasite maturation (ring to trophozoite to schizont stages) are then systematically investigated using optical diffraction tomography algorithms. These analyses provide quantitative information on the structural and chemical characteristics of individual host Pf-RBCs, parasitophorous vacuole, and cytoplasm. The in situ structural evolution and chemical characteristics of subcellular hemozoin crystals are also elucidated.

Exploring neural cell dynamics with digital holographic microscopy

In this review, we summarize how the new concept of digital optics applied to the field of holographic microscopy has allowed the development of a reliable and flexible digital holographic quantitative phase microscopy (DH-QPM) technique at the nanoscale particularly suitable for cell imaging. Particular emphasis is placed on the original biological information provided by the quantitative phase signal. We present the most relevant DH-QPM applications in the field of cell biology, including automated cell counts, recognition, classification, three-dimensional tracking, discrimination between physiological and pathophysiological states, and the study of cell membrane fluctuations at the nanoscale. In the last part, original results show how DH-QPM can address two important issues in the field of neurobiology, namely, multiple-site optical recording of neuronal activity and noninvasive visualization of dendritic spine dynamics resulting from a full digital holographic microscopy tomographic approach.

Quantitative phase imaging techniques for the study of cell pathophysiology: from principles to applications

A cellular-level study of the pathophysiology is crucial for understanding the mechanisms behind human diseases. Recent advances in quantitative phase imaging (QPI) techniques show promises for the cellular-level understanding of the pathophysiology of diseases. To provide important insight on how the QPI techniques potentially improve the study of cell pathophysiology, here we present the principles of QPI and highlight some of the recent applications of QPI ranging from cell homeostasis to infectious diseases and cancer.

Tomographic imaging via spectral encoding of spatial frequency

Three-dimensional optical tomographic imaging plays an important role in biomedical research and clinical applications. We introduce spectral tomographic imaging (STI) via spectral encoding of spatial frequency principle that not only has the capability for visualizing the three-dimensional object at sub-micron resolution but also providing spatially-resolved quantitative characterization of its structure with nanoscale accuracy for any volume of interest within the object. The theoretical basis and the proof-of-concept numerical simulations are presented to demonstrate the feasibility of spectral tomographic imaging.

High-precision three-dimensional shape reconstruction via digital refocusing in multi-wavelength digital holography

Three-dimensional (3D) shape reconstructions and metrology measurements are often limited by depth-of-field constraints. Current focus-detection-based techniques are insufficient to profile out-of-focus 3D objects with high axial accuracy. Extended-focus imaging (EFI) techniques can improve the range and precision of such measurements. By incorporating digital refocusing with multiwavelength interferometry, a holographic imaging solution is presented in this paper to accurately measure 3D objects over a large depth range. Accuracy and repeatability of the proposed EFI technique are validated by digital simulations and refocusing experiments. A reconstruction example demonstrates the feasibility of high-precision 3D measurements of objects deeper than the system's classical depth of field.

Real-time quantitative visualization of 3D structural information

We demonstrate a novel approach for the real time visualization and quantification of the 3D spatial frequencies in an image domain. Our approach is based on the spectral encoding of spatial frequency principle and permits the formation of an image as a color map in which spatially separated spectral wavelengths correspond to the dominant 3D spatial frequencies of the object. We demonstrate that our approach can visualize and analyze the dominant axial internal structure for each image point in real time and with nanoscale sensitivity to structural changes. Computer modeling and experimental results of instantaneous color visualization and quantification of 3D structures of a model system and biological samples are presented.

Reconstruction in interferometric synthetic aperture microscopy: comparison with optical coherence tomography and digital holographic microscopy

It is shown that the spatial frequencies recorded in interferometric synthetic aperture microscopy do not correspond to exact backscattering [as they do in unistatic synthetic aperture radar (SAR)] and that the reconstruction process based on SAR is therefore based on an approximation. The spatial frequency response is developed based on the three-dimensional coherent transfer function approach and compared with that in optical coherence tomography and digital holographic microscopy.

High-resolution full-field optical coherence microscopy using a Mirau interferometer for the quantitative imaging of biological cells

In this paper quantitative imaging of biological cells using high-resolution full-field optical coherence microscopy (FF-OCM) is reported. The FF-OCM was realized using a swept-source system, a Mirau interferometer, and a CCD camera (a two-dimensional detection unit). A Mirau-interferometric objective lens was used to generate the interferometric signal. The signal was analyzed by a Fourier analysis technique. Optically sectioned amplitude images and a quantitative phase map of biological cells such as onion skin and red blood cells (RBCs) are demonstrated. Further, the refractive index profile of the RBCs is also presented. For the 50× Mirau objective, the experimentally achieved axial and transverse resolution of the present system are 3.8 and 1.2 μm, respectively. The CCD provides parallel detection and measures enface images without X, Y, Z mechanical scanning.

Spatial light interference tomography (SLIT)

We present spatial light interference tomography (SLIT), a label-free method for 3D imaging of transparent structures such as live cells. SLIT uses the principle of interferometric imaging with broadband fields and combines the optical gating due to the micron-scale coherence length with that of the high numerical aperture objective lens. Measuring the phase shift map associated with the object as it is translated through focus provides full information about the 3D distribution associated with the refractive index. Using a reconstruction algorithm based on the Born approximation, we show that the sample structure may be recovered via a 3D, complex field deconvolution. We illustrate the method with reconstructed tomographic refractive index distributions of microspheres, photonic crystals, and unstained living cells.

Focus detection criterion for refocusing in multi-wavelength digital holography

The majority of focus detection criteria reported is based on amplitude contrast. Due to phase wrapping, phase contrast was previously reported unsuitable for focus finding tasks. By taking the advantage of multi-wavelength digital holography, we propose a new focus detection criterion based on phase contrast. Experimental results are presented to prove the feasibility of the developed criterion. Possible applications of the developed technology include inspecting machined surfaces in the auto industry.

Lens-free optical tomographic microscope with a large imaging volume on a chip

We present a lens-free optical tomographic microscope, which enables imaging a large volume of approximately 15 mm(3) on a chip, with a spatial resolution of < 1 μm × < 1 μm × < 3 μm in x, y and z dimensions, respectively. In this lens-free tomography modality, the sample is placed directly on a digital sensor array with, e.g., ≤ 4 mm distance to its active area. A partially coherent light source placed approximately 70 mm away from the sensor is employed to record lens-free in-line holograms of the sample from different viewing angles. At each illumination angle, multiple subpixel shifted holograms are also recorded, which are digitally processed using a pixel superresolution technique to create a single high-resolution hologram of each angular projection of the object. These superresolved holograms are digitally reconstructed for an angular range of ± 50°, which are then back-projected to compute tomograms of the sample. In order to minimize the artifacts due to limited angular range of tilted illumination, a dual-axis tomography scheme is adopted, where the light source is rotated along two orthogonal axes. Tomographic imaging performance is quantified using microbeads of different dimensions, as well as by imaging wild-type Caenorhabditis elegans. Probing a large volume with a decent 3D spatial resolution, this lens-free optical tomography platform on a chip could provide a powerful tool for high-throughput imaging applications in, e.g., cell and developmental biology.

Optical section imaging of the tilted planes by illumination-angle-scanning digital interference holography

A new method of optical imaging that can generate the section images of arbitrarily tilted planes has been developed from illumination-angle-scanning digital interference holography. A set of complex object fields are reconstructed from the holograms captured as the illumination angle is varied with uniform intervals. After the complex fields are modified with phase ramps that match the tilt (relative to the hologram plane) of a desired observation plane, the image of the object sliced along the tilted plane is obtained from their superposition. The axial resolution of a system employing this method is measured with a step height standard, and it is applied to the tomographic inspection of a microelectromechanical system.

Automated three-dimensional microbial sensing and recognition using digital holography and statistical sampling

We overview an approach to providing automated three-dimensional (3D) sensing and recognition of biological micro/nanoorganisms integrating Gabor digital holographic microscopy and statistical sampling methods. For 3D data acquisition of biological specimens, a coherent beam propagates through the specimen and its transversely and longitudinally magnified diffraction pattern observed by the microscope objective is optically recorded with an image sensor array interfaced with a computer. 3D visualization of the biological specimen from the magnified diffraction pattern is accomplished by using the computational Fresnel propagation algorithm. For 3D recognition of the biological specimen, a watershed image segmentation algorithm is applied to automatically remove the unnecessary background parts in the reconstructed holographic image. Statistical estimation and inference algorithms are developed to the automatically segmented holographic image. Overviews of preliminary experimental results illustrate how the holographic image reconstructed from the Gabor digital hologram of biological specimen contains important information for microbial recognition.

Digital holographic microscopy by use of surface plasmon resonance for imaging of cell membranes

A technique called surface plasmon resonance digital holographic microscopy (SPRDHM) for optical imaging of cell membranes is proposed. The intensity and phase distributions of the reflected light that is modulated by the cell membrane in surface plasmon resonance can be simultaneously obtained. The imaging principle and capability are theoretically analyzed and demonstrated by experiments. In addition, the technique is compared with total internal reflection digital holographic microscopy (TIRDHM) in theory and experiment, respectively. The results show that the SPRDHM technique is better in spatial resolution and phase sensitivity than the TIRDHM technique for imaging of cell membranes.

Microscopic imaging and spectroscopy with scattered light

Optical contrast based on elastic scattering interactions between light and matter can be used to probe cellular structure, cellular dynamics, and image tissue architecture. The quantitative nature and high sensitivity of light scattering signals to subtle alterations in tissue morphology, as well as the ability to visualize unstained tissue in vivo, has recently generated significant interest in optical-scatter-based biosensing and imaging. Here we review the fundamental methodologies used to acquire and interpret optical scatter data. We report on recent findings in this field and present current advances in optical scatter techniques and computational methods. Cellular and tissue data enabled by current advances in optical scatter spectroscopy and imaging stand to impact a variety of biomedical applications including clinical tissue diagnosis, in vivo imaging, drug discovery, and basic cell biology.

Quantitative SLM-based Differential Interference Contrast imaging

We describe the implementation of quantitative Differential Interference Contrast (DIC) Microscopy using a spatial light modulator (SLM) as a flexible Fourier filter in the optical path. The experimental arrangement allows for the all-electronic acquisition of multiple phase shifted DIC-images at video rates which are analyzed to yield the optical path length variation of the sample. The resolution of the technique is analyzed by retrieving the phase profiles of polystyrene spheres in immersion oil, and the method is then applied for quantitative imaging of biological samples. By reprogramming the diffractive structure displayed at the SLM it is possible to record the whole set of phase shifted DIC images simultaneously in different areas of the same camera chip. This allows for quantitative snap-shot imaging of a sample, which has applications for the investigation of dynamic processes.

Optical Computing: A 60-Year Adventure

Optical computing is a very interesting 60-year old field of research. This paper gives a brief historical review of the life of optical computing from the early days until today. Optical computing generated a lot of enthusiasm in the sixties with major breakthroughs opening a large number of perspectives. The period between 1980 and 2000 could be called the golden age with numerous new technologies and innovating optical processors designed and constructed for real applications. Today the field of optical computing is not ready to die, it has evolved and its results benefit to new research topics such as nanooptics, biophotonics, or communication systems.