Structured illumination multimodal 3D-resolved quantitative phase and fluorescence sub-diffraction microscopy

Single-shot quantitative phase-fluorescence imaging using cross-grating wavefront microscopy

The article introduces an optical microscopy technique capable of simultaneously acquiring quantitative fluorescence and phase (or equivalently wavefront) images with a single camera sensor, avoiding any delay between both images, or registration of images acquired separately. The method is based on the use of a 2-dimensional diffraction grating (aka cross-grating) positioned at a millimeter distance from a 2-color camera. Fluorescence and wavefront images are extracted from the two color channels of the camera, and retrieved by image demodulation. The applicability of the method is illustrated on various samples, namely fluorescent micro-beads, bacteria and mammalian cells.

Snapshot compressive structured illumination microscopy

We propose a snapshot compressive structured illumination microscopy (SoSIM) system to increase the number of reconstructed resolution-enhanced (RE) images per second and reduce the data bandwidth by capturing compressed measurements. In this system, multiple low-resolution images are encoded by a high-speed digital micro-mirror device with random binary masks. These images are then captured by a low-speed camera as a snapshot compressed measurement. Following this, we adopt an efficient deep neural network to reconstruct nine images with different structured illumination patterns from a single measurement. The reconstructed images are then combined into a single-frame RE image using the method of spectral synthesis in the frequency domain. When the camera operates at 100 frames per second (fps), we can eventually recover dynamic RE videos at the same speed with 100 fps.

Multi-harmonic structured illumination-based optical diffraction tomography

Imaging speed and spatial resolution are key factors in optical diffraction tomography (ODT), while they are mutually exclusive in 3D refractive index imaging. This paper presents a multi-harmonic structured illumination-based optical diffraction tomography (MHSI-ODT) to acquire 3D refractive index (RI) maps of transparent samples. MHSI-ODT utilizes a digital micromirror device (DMD) to generate structured illumination containing multiple harmonics. For each structured illumination orientation, four spherical spectral crowns are solved from five phase-shifted holograms, meaning that the acquisition of each spectral crown costs 1.25 raw images. Compared to conventional SI-ODT, which retrieves two spectral crowns from three phase-shifted raw images, MHSI-ODT enhances the imaging speed by 16.7% in 3D RI imaging. Meanwhile, MHSI-ODT exploits both the 1st-order and the 2nd-order harmonics; therefore, it has a better intensity utilization of structured illumination. We demonstrated the performance of MHSI-ODT by rendering the 3D RI distributions of 5 µm polystyrene (PS) microspheres and biological samples.

Structured illumination contrast transfer function for high resolution quantitative phase imaging

We report a sub-diffraction resolution imaging of non-fluorescent samples through quantitative phase imaging. This is achieved through a novel application of structured illumination microscopy (SIM), a super-resolution imaging technique established primarily for fluorescence microscopy. Utilizing our contrast transfer function formalism with SIM, we extract the high spatial frequency components of the phase profile from the defocused intensity images, enabling the reconstruction of a quantitative phase image with a frequency spectrum that surpasses the diffraction limit imposed by the imaging system. Our approach offers several advantages including a deterministic, phase-unwrapping-free algorithm and an easily implementable, non-interferometric setup. We validate the proposed technique for high-resolution phase imaging through both simulation and experimental results, demonstrating a two-fold enhancement in resolution. A lateral resolution of 0.814 µm is achieved for the phase imaging of human cheek cells using a 0.42 NA objective lens and an illumination wavelength of 660 nm, highlighting the efficacy of our approach for high-resolution quantitative phase imaging.

Polarization differential interference contrast microscopy with physics-inspired plug-and-play denoiser for single-shot high-performance quantitative phase imaging

We present single-shot high-performance quantitative phase imaging with a physics-inspired plug-and-play denoiser for polarization differential interference contrast (PDIC) microscopy. The quantitative phase is recovered by the alternating direction method of multipliers (ADMM), balancing total variance regularization and a pre-trained dense residual U-net (DRUNet) denoiser. The custom DRUNet uses the Tanh activation function to guarantee the symmetry requirement for phase retrieval. In addition, we introduce an adaptive strategy accelerating convergence and explicitly incorporating measurement noise. After validating this deep denoiser-enhanced PDIC microscopy on simulated data and phantom experiments, we demonstrated high-performance phase imaging of histological tissue sections. The phase retrieval by the denoiser-enhanced PDIC microscopy achieves significantly higher quality and accuracy than the solution based on Fourier transforms or the iterative solution with total variance regularization alone.

Structured illumination phase and fluorescence microscopy for bioimaging

This study presents a dual-modality microscopic imaging approach that combines quantitative phase microscopy and fluorescence microscopy based on structured illumination (SI) to provide structural and functional information for the same sample. As the first imaging modality, structured illumination digital holographic microscopy (SI-DHM) is implemented along the transmission beam path. SI-DHM acts as a label-free, noninvasive approach and provides high-contrast and quantitative phase images utilizing the refractive index contrast of the inner structures of samples against the background. As the second imaging modality, structured illumination (fluorescence) microscopy (SIM) is constructed along the reflection beam path. SIM utilizes fluorescent labeling and provides super-resolution images for specific functional structures of samples. We first experimentally demonstrated phase imaging of SI-DHM on rice leaves and fluorescence (SIM) imaging on mouse kidney sections. Then, we demonstrated dual-modality imaging of biological samples, using DHM to acquire the overall cell morphology and SIM to obtain specific functional structures. These results prove that the proposed technique is of great importance in biomedical studies, such as providing insight into cell physiology by visualizing and quantifying subcellular structures.

Single capture bright field and off-axis digital holographic microscopy

We report on a single capture approach for simultaneous incoherent bright field (BF) and laser-based quantitative phase imaging (QPI). Common-path digital holographic microscopy (DHM) is implemented in parallel with BF imaging within the optical path of a commercial optical microscope to achieve spatially multiplexed recording of white light images and digital off-axis holograms, which are subsequently numerically demultiplexed. The performance of the proposed multimodal concept is firstly determined by investigations on microspheres. Then, the application for label-free dual-mode QPI and BF imaging of living pancreatic tumor cells is demonstrated.

Fluholoscopy-Compact and Simple Platform Combining Fluorescence and Holographic Microscopy

The combination of different imaging modalities into single imaging platforms has a strong potential in biomedical sciences as it permits the analysis of complementary properties of the target sample. Here, we report on an extremely simple, cost-effective, and compact microscope platform for achieving simultaneous fluorescence and quantitative phase imaging modes with the capability of working in a single snapshot. It is based on the use of a single illumination wavelength to both excite the sample's fluorescence and provide coherent illumination for phase imaging. After passing the microscope layout, the two imaging paths are separated using a bandpass filter, and the two imaging modes are simultaneously obtained using two digital cameras. We first present calibration and analysis of both fluorescence and phase imaging modalities working independently and, later on, experimental validation for the proposed common-path dual-mode imaging platform considering static (resolution test targets, fluorescent micro-beads, and water-suspended lab-made cultures) as well as dynamic (flowing fluorescent beads, human sperm cells, and live specimens from lab-made cultures) samples.

Quantitative Phase Imaging: Recent Advances and Expanding Potential in Biomedicine

Quantitative phase imaging (QPI) is a label-free, wide-field microscopy approach with significant opportunities for biomedical applications. QPI uses the natural phase shift of light as it passes through a transparent object, such as a mammalian cell, to quantify biomass distribution and spatial and temporal changes in biomass. Reported in cell studies more than 60 years ago, ongoing advances in QPI hardware and software are leading to numerous applications in biology, with a dramatic expansion in utility over the past two decades. Today, investigations of cell size, morphology, behavior, cellular viscoelasticity, drug efficacy, biomass accumulation and turnover, and transport mechanics are supporting studies of development, physiology, neural activity, cancer, and additional physiological processes and diseases. Here, we review the field of QPI in biology starting with underlying principles, followed by a discussion of technical approaches currently available or being developed, and end with an examination of the breadth of applications in use or under development. We comment on strengths and shortcomings for the deployment of QPI in key biomedical contexts and conclude with emerging challenges and opportunities based on combining QPI with other methodologies that expand the scope and utility of QPI even further.

Multi-moded high-index contrast optical waveguide for super-contrast high-resolution label-free microscopy

The article elucidates the physical mechanism behind the generation of superior-contrast and high-resolution label-free images using an optical waveguide. Imaging is realized by employing a high index contrast multi-moded waveguide as a partially coherent light source. The modes provide near-field illumination of unlabeled samples, thereby repositioning the higher spatial frequencies of the sample into the far-field. These modes coherently scatter off the sample with different phases and are engineered to have random spatial distributions within the integration time of the camera. This mitigates the coherent speckle noise and enhances the contrast (2-10) × as opposed to other imaging techniques. Besides, the coherent scattering of the different modes gives rise to fluctuations in intensity. The technique demonstrated here is named chip-based Evanescent Light Scattering (cELS). The concepts introduced through this work are described mathematically and the high-contrast image generation process using a multi-moded waveguide as the light source is explained. The article then explores the feasibility of utilizing fluctuations in the captured images along with fluorescence-based techniques, like intensity-fluctuation algorithms, to mitigate poor-contrast and diffraction-limited resolution in the coherent imaging regime. Furthermore, a straight waveguide is demonstrated to have limited angular diversity between its multiple modes and therefore, for isotropic sample illumination, a multiple-arms waveguide geometry is used. The concepts introduced are validated experimentally via high-contrast label-free imaging of weakly scattering nanosized specimens such as extra-cellular vesicles (EVs), liposomes, nanobeads and biological cells such as fixed and live HeLa cells.

Recent Progress in the Correlative Structured Illumination Microscopy

The super-resolution imaging technique of structured illumination microscopy (SIM) enables the mixing of high-frequency information into the optical transmission domain via light-source modulation, thus breaking the optical diffraction limit. Correlative SIM, which combines other techniques with SIM, offers more versatility or higher imaging resolution than traditional SIM. In this review, we first briefly introduce the imaging mechanism and development trends of conventional SIM. Then, the principles and recent developments of correlative SIM techniques are reviewed. Finally, the future development directions of SIM and its correlative microscopies are presented.

Multimodal on-chip nanoscopy and quantitative phase imaging reveals the nanoscale morphology of liver sinusoidal endothelial cells

Visualization of three-dimensional (3D) morphological changes in the subcellular structures of a biological specimen is a major challenge in life science. Here, we present an integrated chip-based optical nanoscopy combined with quantitative phase microscopy (QPM) to obtain 3D morphology of liver sinusoidal endothelial cells (LSEC). LSEC have unique morphology with small nanopores (50-300 nm in diameter) in the plasma membrane, called fenestrations. The fenestrations are grouped in discrete clusters, which are around 100 to 200 nm thick. Thus, imaging and quantification of fenestrations and sieve plate thickness require resolution and sensitivity of sub-100 nm along both the lateral and the axial directions, respectively. In chip-based nanoscopy, the optical waveguides are used both for hosting and illuminating the sample. The fluorescence signal is captured by an upright microscope, which is converted into a Linnik-type interferometer to sequentially acquire both superresolved images and phase information of the sample. The multimodal microscope provided an estimate of the fenestration diameter of 119 ± 53 nm and average thickness of the sieve plates of 136.6 ± 42.4 nm, assuming the constant refractive index of cell membrane to be 1.38. Further, LSEC were treated with cytochalasin B to demonstrate the possibility of precise detection in the cell height. The mean phase value of the fenestrated area in normal and treated cells was found to be 161 ± 50 mrad and 109 ± 49 mrad, respectively. The proposed multimodal technique offers nanoscale visualization of both the lateral size and the thickness map, which would be of broader interest in the fields of cell biology and bioimaging.

Structured illumination microscopy with partially coherent illumination for phase and fluorescent imaging

This study presents a partially coherent illumination based (PCI-based) SIM apparatus for dual-modality (phase and fluorescent) microscopic imaging. The partially coherent illumination (PCI) is generated by placing a rotating diffuser on a monochromatic laser beam, which suppresses speckle noise in the dual-modality images and endows the apparatus with sound sectioning capability. With this system, label-free quantitative phase and super-resolved/sectioned fluorescent images can be obtained for the same sample. We have demonstrated the superiority of the system in phase imaging of transparent cells with high endogenous contrast and in a quantitative manner. In the meantime, we have also demonstrated fluorescent imaging of fluorescent beads, rat tail crosscut, wheat anther, and hibiscus pollen with super-resolution and optical sectioning. We envisage that the proposed method can be applied to many fields, including but not limited to biomedical, industrial, chemistry fields.

Common-path intrinsically achromatic optical diffraction tomography

In this work we propose an open-top like common-path intrinsically achromatic optical diffraction tomography system. It operates as a total-shear interferometer and employs Ronchi-type amplitude diffraction grating, positioned in between the camera and the tube lens without an additional 4f system, generating three-beam interferograms with achromatic second harmonic. Such configuration makes the proposed system low cost, compact and immune to vibrations. We present the results of the measurements of 3D-printed cell phantom using laser diode (coherent) and superluminescent diode (partially coherent) light sources. Broadband light sources can be naturally employed without the need for any cumbersome compensation because of the intrinsic achromaticity of the interferometric recording (holograms generated by -1st and +1st conjugated diffraction orders are not affected by the illumination wavelength). The results show that the decreased coherence offers much reduced coherent noise and higher fidelity tomographic reconstruction especially when applied nonnegativity constraint regularization procedure.

Label-Free and Quantitative Dry Mass Monitoring for Single Cells during In Situ Culture

Quantitative measurement of single cells can provide in-depth information about cell morphology and metabolism. However, current live-cell imaging techniques have a lack of quantitative detection ability. Herein, we proposed a label-free and quantitative multichannel wide-field interferometric imaging (MWII) technique with femtogram dry mass sensitivity to monitor single-cell metabolism long-term in situ culture. We demonstrated that MWII could reveal the intrinsic status of cells despite fluctuating culture conditions with 3.48 nm optical path difference sensitivity, 0.97 fg dry mass sensitivity and 2.4% average maximum relative change (maximum change/average) in dry mass. Utilizing the MWII system, different intrinsic cell growth characteristics of dry mass between HeLa cells and Human Cervical Epithelial Cells (HCerEpiC) were studied. The dry mass of HeLa cells consistently increased before the M phase, whereas that of HCerEpiC increased and then decreased. The maximum growth rate of HeLa cells was 11.7% higher than that of HCerEpiC. Furthermore, HeLa cells were treated with Gemcitabine to reveal the relationship between single-cell heterogeneity and chemotherapeutic efficacy. The results show that cells with higher nuclear dry mass and nuclear density standard deviations were more likely to survive the chemotherapy. In conclusion, MWII was presented as a technique for single-cell dry mass quantitative measurement, which had significant potential applications for cell growth dynamics research, cell subtype analysis, cell health characterization, medication guidance and adjuvant drug development.

Limited-angle tomographic phase microscopy utilizing confocal scanning fluorescence microscopy

We present a multimodal imaging technique, combining tomographic phase microscopy with limited angular projection range and number, and two-channel spinning-disk confocal scanning fluorescence microscopy. This technique allows high-accuracy 3D refractive index (RI) profiling of live cells in spite of the missing projections. The cellular outer shape and its interior organelles measured by the confocal fluorescence imaging not only specify the cell in molecular levels, but also provide the 3D distributions of the whole cell as well as its organelles. We take these additional 3D morphological details as constraints in Gerchberg-Papoulis-based optical diffraction tomography algorithm. We then obtain an accurate 3D RI tomogram, even with a sparse angular range having a small number of perspective projections, otherwise providing low-accuracy RI reconstruction. Then, we obtain both cellular molecular specificity and inner RI values of the cell and its organelles. We compare the reconstructed 3D RI profiles of various samples, demonstrating the superiority of the proposed technique.

Label-free three-dimensional observations and quantitative characterisation of on-chip vasculogenesis using optical diffraction tomography

Label-free, three-dimensional (3D) quantitative observations of on-chip vasculogenesis were achieved using optical diffraction tomography. Exploiting 3D refractive index maps as an intrinsic imaging contrast, the vascular structures, multicellular activities, and subcellular organelles of endothelial cells were imaged and analysed throughout vasculogenesis to characterise mature vascular networks without exogenous labelling.

Holotomography: Refractive Index as an Intrinsic Imaging Contrast for 3-D Label-Free Live Cell Imaging

Live cell imaging provides essential information in the investigation of cell biology and related pathophysiology. Refractive index (RI) can serve as intrinsic optical imaging contrast for 3-D label-free and quantitative live cell imaging, and provide invaluable information to understand various dynamics of cells and tissues for the study of numerous fields. Recently significant advances have been made in imaging methods and analysis approaches utilizing RI, which are now being transferred to biological and medical research fields, providing novel approaches to investigate the pathophysiology of cells. To provide insight into how RI can be used as an imaging contrast for imaging of biological specimens, here we provide the basic principle of RI-based imaging techniques and summarize recent progress on applications, ranging from microbiology, hematology, infectious diseases, hematology, and histopathology.

Digital Holographic Multimodal Cross-Sectional Fluorescence and Quantitative Phase Imaging System

We present a multimodal imaging system based on simple off-axis digital holography, for simultaneous recording and retrieval of cross-sectional fluorescence and quantitative phase imaging of the biological specimen. Synergism in the imaging capabilities can be achieved by incorporating two off-axis digital holographic microscopes integrated to record different information at the same time. The cross-sectional fluorescence imaging is realized by a common-path configuration of the single-shot off-axis incoherent digital holographic system. The quantitative phase imaging, on the other hand, is achieved by another off-axis coherent digital holographic microscopy operating in transmission mode. The fundamental characteristics of the proposed multimodal system are confirmed by performing various experiments on fluorescent beads and fluorescent protein-labeled living cells of the moss Physcomitrella patens lying at different axial depth positions. Furthermore, the cross-sectional live fluorescence and phase imaging of the fluorescent beads are demonstrated by the proposed multimodal system. The experimental results presented here corroborate the feasibility of the proposed system and indicate its potential in the applications to analyze the functional and structural behavior of biological cells and tissues.

Fourier ptychography: current applications and future promises

Traditional imaging systems exhibit a well-known trade-off between the resolution and the field of view of their captured images. Typical cameras and microscopes can either "zoom in" and image at high-resolution, or they can "zoom out" to see a larger area at lower resolution, but can rarely achieve both effects simultaneously. In this review, we present details about a relatively new procedure termed Fourier ptychography (FP), which addresses the above trade-off to produce gigapixel-scale images without requiring any moving parts. To accomplish this, FP captures multiple low-resolution, large field-of-view images and computationally combines them in the Fourier domain into a high-resolution, large field-of-view result. Here, we present details about the various implementations of FP and highlight its demonstrated advantages to date, such as aberration recovery, phase imaging, and 3D tomographic reconstruction, to name a few. After providing some basics about FP, we list important details for successful experimental implementation, discuss its relationship with other computational imaging techniques, and point to the latest advances in the field while highlighting persisting challenges.

Common-path multimodal three-dimensional fluorescence and phase imaging system

<p>A stable multimodal system is developed by combining two common-path digital holographic microscopes (DHMs): coherent and incoherent, for simultaneous recording and retrieval of three-dimensional (3-D) phase and 3-D fluorescence imaging (FI), respectively, of a biological specimen. The 3-D FI is realized by a single-shot common-path off-axis fluorescent DHM developed recently by our group. In addition, we accomplish, the phase imaging by another single-shot, highly stable common-path off-axis DHM based on a beam splitter. In this DHM configuration, a beam splitter is used to divide the incoming object beam into two beams. One beam serves as the object beam carrying the useful information of the object under study, whereas another beam is spatially filtered at its Fourier plane by using a pinhole and it serves as a reference beam. This DHM setup, owing to a common-path geometry, is less vibration-sensitive and compact, having a similar field of view but with high temporal phase stability in comparison to a two-beam Mach-Zehnder-type DHM. The performance of the proposed common-path DHM and the multimodal system is verified by conducting various experiments on fluorescent microspheres and fluorescent protein-labeled living cells of the moss <italic>Physcomitrella patens</italic>. Moreover, the potential capability of the proposed multimodal system for 3-D live fluorescence and phase imaging of the fluorescent beads is also demonstrated. The obtained experimental results corroborate the feasibility of the proposed multimodal system and indicate its potential applications for the analysis of functional and structural behaviors of a biological specimen and enhancement of the understanding of physiological mechanisms and various biological diseases.</p>.

Quantitative phase microscopy with enhanced contrast and improved resolution through ultra-oblique illumination (UO-QPM)

Recent developments in phase contrast microscopy have enabled the label-free visualization of certain organelles due to their distinct morphological features, making this method an attractive alternative in the study of cellular dynamics. However tubular structures such as endoplasmic reticulum (ER) networks and complex dynamics such as the fusion and fission of mitochondria, due to their low phase contrast, still need fluorescent labeling to be adequately imaged. In this article, we report a quantitative phase microscope with ultra-oblique illumination that enables us to see those structures and their dynamics with high contrast for the first time without labeling. The imaging capability was validated through comparison to the fluorescence images with the same field-of-view. The high image resolution (~270 nm) was validated using both beads and cellular structures. Furthermore, we were able to record the vibration of ER networks at a frame rate of 250 Hz. We additionally show complex cellular processes such as remodeling of the mitochondria networks through fusion and fission and vesicle transportation along the ER without labels. Our high spatial and temporal resolution allowed us to observe mitochondria "spinning", which has not been reported before, further demonstrating the advantages of the proposed method.

Adaptive wavefront correction structured illumination holographic tomography

In this study, a novel adaptive wavefront correction (AWC) technique is implemented on a compactly developed structured illumination holographic tomography (SI-HT) system. We propose a mechanical movement-free compact scanning architecture for SI-HT systems with AWC, implemented by designing and displaying a series of computer-generated holograms (CGH) composed of blazed grating with phase Fresnel lens on a phase-only spatial light modulator (SLM). In the proposed SI-HT, the aberrations of the optical system are sensed by digital holography and are used to design the CGH-based AWC to compensate the phase aberrations of the tomographic imaging system. The proposed method was validated using a standard Siemens star target, its potential application was demonstrated using a live candida rugosa sample, and its label-free three-dimensional refractive index profile was generated at its subcellular level. The experimental results obtained reveal the ability of the proposed method to enhance the imaging performance in both lateral and axial directions.

Shear Modulus Measurement by Quantitative Phase Imaging and Correlation with Atomic Force Microscopy

Many approaches have been developed to characterize cell elasticity. Among these, atomic force microscopy (AFM) combined with modeling has been widely used to characterize cellular compliance. However, such approaches are often limited by the difficulties associated with using a specific instrument and by the complexity of analyzing the measured data. More recently, quantitative phase imaging (QPI) has been applied to characterize cellular stiffness by using an effective spring constant. This metric was further correlated to mass distribution (disorder strength) within the cell. However, these measurements are difficult to compare to AFM-derived measurements of Young's modulus. Here, we describe, to our knowledge, a new way of analyzing QPI data to directly retrieve the shear modulus. Our approach enables label-free measurement of cellular mechanical properties that can be directly compared to values obtained from other rheological methods. To demonstrate the technique, we measured shear modulus and phase disorder strength using QPI, as well as Young's modulus using AFM, across two breast cancer cell-line populations dosed with three different concentrations of cytochalasin D, an actin-depolymerizing toxin. Comparison of QPI-derived and AFM moduli shows good agreement between the two measures and further agrees with theory. Our results suggest that QPI is a powerful tool for cellular biophysics because it allows for optical quantitative measurements of cell mechanical properties.

Speckle-structured illumination for 3D phase and fluorescence computational microscopy

High-content biological microscopy targets high-resolution imaging across large fields-of-view, often achieved by computational imaging approaches. Previously, we demonstrated 2D multimodal high-content microscopy via structured illumination microscopy (SIM) with resolution > 2 × the diffraction limit, using speckle illumination from Scotch tape. In this work, we extend the method to 3D by leveraging the fact that the speckle illumination is in fact a 3D structured pattern. We use both a coherent and an incoherent imaging model to develop algorithms for joint retrieval of the 3D super-resolved fluorescent and complex-field distributions of the sample. Our reconstructed images resolve features beyond the physical diffraction-limit set by the system's objective and demonstrate 3D multimodal imaging with ∼ 0.6 × 0.6 × 6   μ m³ resolution over a volume of ∼ 314 × 500 × 24   μ m³.

Low-coherent optical diffraction tomography by angle-scanning illumination

Temporally low-coherent optical diffraction tomography (ODT) is proposed and demonstrated based on angle-scanning Mach-Zehnder interferometry. Using a digital micromirror device based on diffractive tilting, the full-field interference of incoherent light is successfully maintained during every angle-scanning sequences. Further, current ODT reconstruction principles for temporally incoherent illuminations are thoroughly reviewed and developed. Several limitations of incoherent illumination are also discussed, such as the nondispersive assumption, optical sectioning capacity and illumination angle limitation. Using the proposed setup and reconstruction algorithms, low-coherent ODT imaging of plastic microspheres, human red blood cells and rat pheochromocytoma cells is experimentally demonstrated.

Computational structured illumination for high-content fluorescence and phase microscopy

High-content biological microscopy targets high-resolution imaging across large fields-of-view (FOVs). Recent works have demonstrated that computational imaging can provide efficient solutions for high-content microscopy. Here, we use speckle structured illumination microscopy (SIM) as a robust and cost-effective solution for high-content fluorescence microscopy with simultaneous high-content quantitative phase (QP). This multi-modal compatibility is essential for studies requiring cross-correlative biological analysis. Our method uses laterally-translated Scotch tape to generate high-resolution speckle illumination patterns across a large FOV. Custom optimization algorithms then jointly reconstruct the sample's super-resolution fluorescent (incoherent) and QP (coherent) distributions, while digitally correcting for system imperfections such as unknown speckle illumination patterns, system aberrations and pattern translations. Beyond previous linear SIM works, we achieve resolution gains of 4× the objective's diffraction-limited native resolution, resulting in 700 nm fluorescence and 1.2 μm QP resolution, across a FOV of 2 × 2.7 mm 2 , giving a space-bandwidth product (SBP) of 60 megapixels.

Large field-of-view phase and fluorescence mesoscope with microscopic resolution

Phase and fluorescence are complementary contrasts that are commonly used in biology. However, the coupling of these two modalities is traditionally limited to high magnification and complex imaging systems. For statistical studies of biological populations, a large field-of-view is required. We describe a 30  mm2 field-of-view dual-modality mesoscope with a 4-μm resolution. The potential of the system to address biological questions is illustrated on white blood cell numeration in whole blood and multiwavelength imaging of the human osteosarcoma (U2-OS) cells.

Optical excitation and detection of neuronal activity

Optogenetics has emerged as an exciting tool for manipulating neural activity, which in turn, can modulate behavior in live organisms. However, detecting the response to the optical stimulation requires electrophysiology with physical contact or fluorescent imaging at target locations, which is often limited by photobleaching and phototoxicity. In this paper, we show that phase imaging can report the intracellular transport induced by optogenetic stimulation. We developed a multimodal instrument that can both stimulate cells with subcellular spatial resolution and detect optical pathlength (OPL) changes with nanometer scale sensitivity. We found that OPL fluctuations following stimulation are consistent with active organelle transport. Furthermore, the results indicate a broadening in the transport velocity distribution, which is significantly higher in stimulated cells compared to optogenetically inactive cells. It is likely that this label-free, contactless measurement of optogenetic response will provide an enabling approach to neuroscience.

A Wearable Fiberless Optical Sensor for Continuous Monitoring of Cerebral Blood Flow in Mice

Continuous and longitudinal monitoring of cerebral blood flow (CBF) in animal models provides information for studying the mechanisms and interventions of various cerebral diseases. Since anesthesia may affect brain hemodynamics, researchers have been seeking wearable devices for use in conscious animals. We present a wearable diffuse speckle contrast flowmeter (DSCF) probe for monitoring CBF variations in mice. The DSCF probe consists of a small low-power near-infrared laser diode as a point source and an ultra-small low-power CMOS camera as a 2D detector array, which can be affixed on a mouse head. The movement of red blood cells in brain cortex (i.e., CBF) produces spatial fluctuations of laser speckles, which are captured by the camera. The DSCF system was calibrated using tissue phantoms and validated in a human forearm and mouse brains for continuous monitoring of blood flow increases and decreases against the established technologies. Significant correlations were observed among these measurements (R² ≥ 0.80, p < 10^-5). This small fiberless probe has the potential to be worn by a freely moving conscious mouse. Moreover, the flexible source-detector configuration allows for varied probing depths up to ~8 mm, which is sufficient for transcranially detecting CBF in the cortices of rodents and newborn infants.

Single-pixel phase and fluorescence microscope

Multimodal microscopes either use multiple cameras or a single camera to multiplex different modes spatially. The former needs expertise demanding alignment and the latter suffers from limited spatial resolution. Here, we report an alignment-free full-resolution simultaneous fluorescence and phase imaging approach using single-pixel detectors. By combining reference-free interferometry with single-pixel imaging scheme, we employ structured illumination to encode the phase and fluorescence of the sample into two single-pixel detection arms, and then conduct reconstruction computationally from the illumination patterns and recorded correlated measurements. The recovered fluorescence and phase images are inherently aligned thanks to single-pixel imaging scheme. To validate the proposed method, we built a proof-of-concept setup for first imaging the phase of an etched glass with given etching depth and then imaging the phase and fluorescence of the quantum dot sample. This method holds great potential for multispectral fluorescence microscopy with additional single-pixel detectors or a spectrometer. Besides, this cost-efficient multimodal system might find broad applications in biomedical science and material science.

Molecular and biophysical analysis of apoptosis using a combined quantitative phase imaging and fluorescence resonance energy transfer microscope

Apoptotic mechanisms are often dysregulated in cancerous phenotypes. Additionally, many anticancer treatments induce apoptosis and necrosis, and the monitoring of this apoptotic activity can allow researchers to identify therapeutic efficiency. Here, we introduce a microscope which combines quantitative phase imaging (QPI) with the ability to detect molecular events via fluorescence (or Förster) resonance energy transfer (FRET). The system was applied to study cells undergoing apoptosis to correlate the onset of apoptotic enzyme activity as observed using a FRET-based apoptosis sensor with whole cell morphological changes analyzed via QPI. The QPI data showed changes in cell disorder strength during the initiation of apoptotic enzymatic activity.

Combining Three-Dimensional Quantitative Phase Imaging and Fluorescence Microscopy for the Study of Cell Pathophysiology

Quantitative phase imaging (QPI) has emerged as one of the powerful imaging tools for the study of live cells in a non-invasive manner. In particular, multimodal approaches combining QPI and fluorescence microscopic techniques have been recently developed for superior spatiotemporal resolution as well as high molecular specificity. In this review, we briefly summarize recent advances in three-dimensional QPI combined with fluorescence techniques for the correlative study of cell pathophysiology. Through this review, biologists and clinicians can be provided with insights on this rapidly growing field of research and may find broader applications to investigate unrevealed nature in cell physiology and related diseases.

Measurements of three-dimensional refractive index tomography and membrane deformability of live erythrocytes from Pelophylax nigromaculatus

Unlike mammalian erythrocytes, amphibian erythrocytes have distinct morphological features including large cell sizes and the presence of nuclei. The sizes of the cytoplasm and nuclei of erythrocytes vary significantly over different species, their environments, or pathophysiology, which makes hematological studies important for investigating amphibian species. Here, we present a label-free three-dimensional optical quantification of individual amphibian erythrocytes from frogs Pelophylax nigromaculatus (Rana nigromaculata). Using optical diffraction tomography, we measured three-dimensional refractive index (RI) tomograms of the cells, which clearly distinguished the cytoplasm and nuclei of the erythrocytes. From the measured RI tomograms, we extracted the relevant biochemical parameters of the cells, including hemoglobin contents and hemoglobin concentrations. Furthermore, we measured dynamic membrane fluctuations and investigated the mechanical properties of the cell membrane. From the statistical and correlative analysis of these retrieved parameters, we investigated interspecific differences between frogs and previously studied mammals.

Super-resolution three-dimensional fluorescence and optical diffraction tomography of live cells using structured illumination generated by a digital micromirror device

We present a multimodal approach for measuring the three-dimensional (3D) refractive index (RI) and fluorescence distributions of live cells by combining optical diffraction tomography (ODT) and 3D structured illumination microscopy (SIM). A digital micromirror device is utilized to generate structured illumination patterns for both ODT and SIM, which enables fast and stable measurements. To verify its feasibility and applicability, the proposed method is used to measure the 3D RI distribution and 3D fluorescence image of various samples, including a cluster of fluorescent beads, and the time-lapse 3D RI dynamics of fluorescent beads inside a HeLa cell, from which the trajectory of the beads in the HeLa cell is analyzed using spatiotemporal correlations.

Label-free non-invasive quantitative measurement of lipid contents in individual microalgal cells using refractive index tomography

Microalgae are promising candidates for biofuel production due to their high lipid content. To facilitate utilization of the microalgae for biofuel, rapid quantification of the lipid contents in microalgae is necessary. However, conventional methods based on the chemical extraction of lipids require a time-consuming destructive extraction process. Here, we demonstrate label-free, non-invasive, rapid quantification of the lipid contents in individual micro-algal cells measuring the three-dimensional refractive index tomograms. We measure three-dimensional refractive index distributions within Nannochloropsis oculata cells and find that lipid droplets are identifiable in tomograms by their high refractive index. In addition, we alter N. oculata under nitrogen deficiency by measuring the volume, lipid weight, and dry cell weight of individual cells. Characterization of individual cells allows correlative analysis between the lipid content and size of individual cells.

Digital holography and its multidimensional imaging applications: a review

In this review, we introduce digital holographic techniques and recent progress in multidimensional sensing by using digital holography. Digital holography is an interferometric imaging technique that does not require an imaging lens and can be used to perform simultaneous imaging of multidimensional information, such as three-dimensional structure, dynamics, quantitative phase, multiple wavelengths and polarization state of light. The technique can also obtain a holographic image of nonlinear light and a three-dimensional image of incoherent light with a single-shot exposure. The holographic recording ability of this technique has enabled a variety of applications.

Coded aperture structured illumination digital holographic microscopy for superresolution imaging

This paper proposes a coded aperture structured illumination (CASI) technique in digital holographic microscopy (DHM). A CASI wave is generated using two binary phase codes (0° and 120°) for spatial phase shifting. The generated CASI wave then interferes with a reference wave to form a coded Fresnel hologram at a single exposure with compressive sensing (CS) to avoid the temporal phase-shifting process of the structured illumination (SI). The CS algorithm is applied to retrieve the missing data of decoded phase-shifted SI-modulated waves, which are used to separate overlapped spatial frequencies for obtaining a larger spatial frequency coverage to provide superresolution imaging. Two phase-only spatial light modulators are applied to generate a directional SI pattern for obtaining a coded aperture with a suitable size to perform one-shot acquisition in the DHM system.

Three-dimensional correlative single-cell imaging utilizing fluorescence and refractive index tomography

Cells alter the path of light, a fact that leads to well-known aberrations in single cell or tissue imaging. Optical diffraction tomography (ODT) measures the biophysical property that causes these aberrations, the refractive index (RI). ODT is complementary to fluorescence imaging and does not require any markers. The present study introduces RI and fluorescence tomography with optofluidic rotation (RAFTOR) of suspended cells, facilitating the segmentation of the 3D-correlated RI and fluorescence data for a quantitative interpretation of the nuclear RI. The technique is validated with cell phantoms and used to confirm a lower nuclear RI for HL60 cells. Furthermore, the nuclear inversion of adult mouse photoreceptor cells is observed in the RI distribution. The applications shown confirm predictions of previous studies and illustrate the potential of RAFTOR to improve our understanding of cells and tissues.

Integral refractive index imaging of flowing cell nuclei using quantitative phase microscopy combined with fluorescence microscopy

We suggest a new multimodal imaging technique for quantitatively measuring the integral (thickness-average) refractive index of the nuclei of live biological cells in suspension. For this aim, we combined quantitative phase microscopy with simultaneous 2-D fluorescence microscopy. We used 2-D fluorescence microscopy to localize the nucleus inside the quantitative phase map of the cell, as well as for measuring the nucleus radii. As verified offline by both 3-D confocal fluorescence microscopy and 2-D fluorescence microscopy while rotating the cells during flow, the nucleus of cells in suspension that are not during division can be assumed to be an ellipsoid. The entire shape of a cell in suspension can be assumed to be a sphere. Then, the cell and nucleus 3-D shapes can be evaluated based on their in-plain radii available from the 2-D phase and fluorescent measurements, respectively. Finally, the nucleus integral refractive index profile is calculated. We demonstrate the new technique on cancer cells, obtaining nucleus refractive index values that are lower than those of the cytoplasm, coinciding with recent findings. We believe that the proposed technique has the potential to be used for flow cytometry, where full 3-D refractive index tomography is too slow to be implemented during flow.

Three-dimensional label-free imaging and analysis of Pinus pollen grains using optical diffraction tomography

The structure of pollen grains is related to the reproductive function of the plants. Here, three-dimensional (3D) refractive index maps were obtained for individual conifer pollen grains using optical diffraction tomography (ODT). The 3D morphological features of pollen grains from pine trees were investigated using measured refractive index maps, in which distinct substructures were clearly distinguished and analyzed. Morphological and physiochemical parameters of the pollen grains were quantified from the obtained refractive index (RI) maps and used to quantitatively study the interspecific differences of pollen grains from different strains. Our results demonstrate that ODT can assess the structure of pollen grains. This label-free and rapid 3D imaging approach may provide a new platform for understanding the physiology of pollen grains.

Structured illumination microscopy for dual-modality 3D sub-diffraction resolution fluorescence and refractive-index reconstruction

Though structured illumination (SI) microscopy is a popular imaging technique conventionally associated with fluorescent super-resolution, recent works have suggested its applicability towards sub-diffraction resolution coherent imaging with quantitative endogenous biological contrast. Here, we demonstrate that SI can efficiently integrate together the principles of fluorescent super-resolution and coherent synthetic aperture to achieve 3D dual-modality sub-diffraction resolution, fluorescence and refractive-index (RI) visualizations of biological samples. We experimentally demonstrate this framework by introducing a SI microscope capable of 3D sub-diffraction resolution fluorescence and RI imaging, and verify its biological visualization capabilities by experimentally reconstructing 3D RI/fluorescence visualizations of fluorescent calibration microspheres as well as alveolar basal epithelial adenocarcinoma (A549) and human colorectal adenocarcinmoa (HT-29) cells, fluorescently stained for F-actin. This demonstration may suggest SI as an especially promising imaging technique to enable future biological studies that explore synergistically operating biophysical/biochemical and molecular mechanisms at sub-diffraction resolutions.

Correlative three-dimensional fluorescence and refractive index tomography: bridging the gap between molecular specificity and quantitative bioimaging

Optical diffraction tomography (ODT) provides label-free three-dimensional (3D) refractive index (RI) measurement of biological samples. However, due to the nature of the RI values of biological specimens, ODT has limited access to molecular specific information. Here, we present an optical setup combining ODT with three-channel 3D fluorescence microscopy, to enhance the molecular specificity of the 3D RI measurement. The 3D RI distribution and 3D deconvoluted fluorescence images of HeLa cells and NIH-3T3 cells are measured, and the cross-correlative analysis between RI and fluorescence of live cells are presented.