Lensless light-field imaging through diffuser encoding

CFZA camera: a high-resolution lensless imaging technique based on compound Fresnel zone aperture

In lensless imaging using a Fresnel zone aperture (FZA), it is generally believed that the resolution is limited by the outermost ring breadth of the FZA. The limitation has the potential to be broken according to the multi-order property of binary FZAs. In this Letter, we propose to use a high-order component of the FZA as the point spread function (PSF) to develop a high-order transfer function backpropagation (HBP) algorithm to enhance the resolution. The proportion of high-order diffraction energy is low, leading to severe defocus noise in the reconstructed image. To address this issue, we propose a Compound FZA (CFZA), which merges two partial FZAs operating at different orders as the mask to strike a balance between the noise and resolution. Experimental results verify that the CFZA-based camera has a resolution that is double that of a traditional FZA-based camera with an identical outer ring breadth and can be reconstructed with high quality by a single HBP without calibration. Our method offers a cost-effective solution for achieving high-resolution imaging, expanding the potential applications of FZA-based lensless imaging in a variety of areas.

Reconfigurable Microlens Array Enables Tunable Imaging Based on Shape Memory Polymers

Microlens arrays (MLAs) with a tunable imaging ability are core components of advanced micro-optical systems. Nevertheless, tunable MLAs generally suffer from high power consumption, an undeformable rigid body, large and complex systems, or limited focal length tunability. The combination of reconfigurable smart materials with MLAs may lead to distinct advantages including programmable deformation, remote manipulation, and multimodal tunability. However, unlike photopolymers that permit flexible structuring, the fabrication of tunable MLAs and compound eyes (CEs) based on transparent smart materials is still rare. In this work, we report reconfigurable MLAs that enable tunable imaging based on shape memory polymers (SMPs). The smart MLAs with closely packed 200 × 200 microlenses (40.0 μm in size) are fabricated via a combined technology that involves wet etching-assisted femtosecond laser direct writing of MLA templates on quartz, soft lithography for MLA duplication using SMPs, and the mechanical heat setting for programmable reconfiguration. By stretching or squeezing the shape memory MLAs at the transition temperature (80 °C), the size, profiles, and spatial distributions of the microlenses can be programmed. When the MLA is stretched from 0 to 120% (area ratio), the focal length is increased from 116 to 283 μm. As a proof of concept, reconfigurable MLAs and a 3D CE with a tunable field of view (FOV, 160-0°) have been demonstrated in which the thermally triggered shape memory deformation has been employed for tunable imaging. The reconfigurable MLAs and CEs with a tunable focal length and adjustable FOV may hold great promise for developing smart micro-optical systems.

Background inhibited and speed-loss-free volumetric imaging in vivo based on structured-illumination Fourier light field microscopy

Benefiting from its advantages in fast volumetric imaging for recording biodynamics, Fourier light field microscopy (FLFM) has a wide range of applications in biomedical research, especially in neuroscience. However, the imaging quality of the FLFM is always deteriorated by both the out-of-focus background and the strong scattering in biological samples. Here we propose a structured-illumination and interleaved-reconstruction based Fourier light field microscopy (SI-FLFM), in which we can filter out the background fluorescence in FLFM without sacrificing imaging speed. We demonstrate the superiority of our SI-FLFM in high-speed, background-inhibited volumetric imaging of various biodynamics in larval zebrafish and mice in vivo. The signal-to-background ratio (SBR) is improved by tens of times. And the volumetric imaging speed can be up to 40 Hz, avoiding artifacts caused by temporal under-sampling in conventional structured illumination microscopy. These suggest that our SI-FLFM is suitable for applications of weak fluorescence signals but high imaging speed requirements.

Learned lensless 3D camera

Single-shot three-dimensional (3D) imaging with compact device footprint, high imaging quality, and fast processing speed is challenging in computational imaging. Mask-based lensless imagers, which replace the bulky optics with customized thin optical masks, are portable and lightweight, and can recover 3D object from a snap-shot image. Existing lensless imaging typically requires extensive calibration of its point spread function and heavy computational resources to reconstruct the object. Here we overcome these challenges and demonstrate a compact and learnable lensless 3D camera for real-time photorealistic imaging. We custom designed and fabricated the optical phase mask with an optimized spatial frequency support and axial resolving ability. We developed a simple and robust physics-aware deep learning model with adversarial learning module for real-time depth-resolved photorealistic reconstructions. Our lensless imager does not require calibrating the point spread function and has the capability to resolve depth and "see-through" opaque obstacles to image features being blocked, enabling broad applications in computational imaging.

High-resolution ghost imaging through complex scattering media via a temporal correction

In this Letter, we propose high-resolution ghost imaging (GI) through complex scattering media using temporal correction. We provide evidence that the theoretical description about GI based on spatially correlated beams is still incomplete and cannot work in complex scenarios. We complete the description of temporal correction of beam correlations in GI. The optical experiments demonstrate that high-resolution ghost images can always be retrieved by using the rectified temporally corrected beam correlation algorithm even in complex, dynamic, and highly strong scattering environments where conventional GI cannot work. By using the proposed method, the quality of the retrieved ghost images through complex scattering media can be enhanced effectively as the number of realizations increases, which cannot be achieved by conventional GI. The established general framework provides optical insights beyond the current understanding of GI, and the rectified theory and experimental results would represent a key step toward applications of GI over a wide range of free-space wave propagation environments.

Compact light field photography towards versatile three-dimensional vision

Inspired by natural living systems, modern cameras can attain three-dimensional vision via multi-view geometry like compound eyes in flies, or time-of-flight sensing like echolocation in bats. However, high-speed, accurate three-dimensional sensing capable of scaling over an extensive distance range and coping well with severe occlusions remains challenging. Here, we report compact light field photography for acquiring large-scale light fields with simple optics and a small number of sensors in arbitrary formats ranging from two-dimensional area to single-point detectors, culminating in a dense multi-view measurement with orders of magnitude lower dataload. We demonstrated compact light field photography for efficient multi-view acquisition of time-of-flight signals to enable snapshot three-dimensional imaging with an extended depth range and through severe scene occlusions. Moreover, we show how compact light field photography can exploit curved and disconnected surfaces for real-time non-line-of-sight 3D vision. Compact light field photography will broadly benefit high-speed 3D imaging and open up new avenues in various disciplines.

Light field imaging typically requires large format detectors and yet often compromises resolution or speed. Here, compact light field photography is presented to lift both restrictions to see through and around severe occlusions in 3D and real time.

Toward Perfect Optical Diffusers: Dielectric Huygens' Metasurfaces with Critical Positional Disorder

Conventional optical diffusers, such as thick volume scatterers (Rayleigh scattering) or microstructured surface scatterers (geometric scattering), lack the potential for on-chip integration and are thus incompatible with next-generation photonic devices. Dielectric Huygens' metasurfaces, on the other hand, consist of 2D arrangements of resonant dielectric nanoparticles and therefore constitute a promising material platform for ultrathin and highly efficient photonic devices. When the nanoparticles are arranged in a random but statistically specific fashion, diffusers with exceptional properties are expected to come within reach. This work explores how dielectric Huygens' metasurfaces can implement wavelength-selective diffusers with negligible absorption losses and nearly Lambertian scattering profiles that are largely independent of the angle and polarization of incident waves. The combination of tailored positional disorder with a carefully balanced electric and magnetic response of the nanoparticles is shown to be an integral requirement for the operation as a diffuser. The proposed metasurfaces' directional scattering performance is characterized both experimentally and numerically, and their usability in wavefront-shaping applications is highlighted. Since the metasurfaces operate on the principles of Mie scattering and are embedded in a glassy environment, they may easily be incorporated in integrated photonic devices, fiber optics, or mechanically robust augmented reality displays.

Mirror-enhanced scanning light-field microscopy for long-term high-speed 3D imaging with isotropic resolution

Various biological behaviors can only be observed in 3D at high speed over the long term with low phototoxicity. Light-field microscopy (LFM) provides an elegant compact solution to record 3D information in a tomographic manner simultaneously, which can facilitate high photon efficiency. However, LFM still suffers from the missing-cone problem, leading to degraded axial resolution and ringing effects after deconvolution. Here, we propose a mirror-enhanced scanning LFM (MiSLFM) to achieve long-term high-speed 3D imaging at super-resolved axial resolution with a single objective, by fully exploiting the extended depth of field of LFM with a tilted mirror placed below samples. To establish the unique capabilities of MiSLFM, we performed extensive experiments, we observed various organelle interactions and intercellular interactions in different types of photosensitive cells under extremely low light conditions. Moreover, we demonstrated that superior axial resolution facilitates more robust blood cell tracking in zebrafish larvae at high speed.

GEOMScope: Large Field-of-view 3D Lensless Microscopy with Low Computational Complexity

Imaging systems with miniaturized device footprint, real-time processing speed and high resolution three-dimensional (3D) visualization are critical to broad biomedical applications such as endoscopy. Most of existing imaging systems rely on bulky lenses and mechanically refocusing to perform 3D imaging. Here, we demonstrate GEOMScope, a lensless single-shot 3D microscope that forms image through a single layer of thin microlens array and reconstructs objects through an innovative algorithm combining geometrical-optics-based pixel back projection and background suppressions. We verify the effectiveness of GEOMScope on resolution target, fluorescent particles and volumetric objects. Comparing to other widefield lensless imaging devices, we significantly reduce the required computational resource and increase the reconstruction speed by orders of magnitude. This enables us to image and recover large volume 3D object in high resolution with near real-time processing speed. Such a low computational complexity is attributed to the joint design of imaging optics and reconstruction algorithms, and a joint application of geometrical optics and machine learning in the 3D reconstruction. More broadly, the excellent performance of GEOMScope in imaging resolution, volume, and reconstruction speed implicates that geometrical optics could greatly benefit and play an important role in computational imaging.