Improved quantitative phase imaging in lensless microscopy by single-shot multi-wavelength illumination using a fast convergence algorithm

Ptychographic lens-less birefringence microscopy using a mask-modulated polarization image sensor

Birefringence, an inherent characteristic of optically anisotropic materials, is widely utilized in various imaging applications ranging from material characterizations to clinical diagnosis. Polarized light microscopy enables high-resolution, high-contrast imaging of optically anisotropic specimens, but it is associated with mechanical rotations of polarizer/analyzer and relatively complex optical designs. Here, we present a form of lens-less polarization-sensitive microscopy capable of complex and birefringence imaging of transparent objects without an optical lens and any moving parts. Our method exploits an optical mask-modulated polarization image sensor and single-input-state LED illumination design to obtain complex and birefringence images of the object via ptychographic phase retrieval. Using a camera with a pixel size of 3.45 μm, the method achieves birefringence imaging with a half-pitch resolution of 2.46 μm over a 59.74 mm2 field-of-view, which corresponds to a space-bandwidth product of 9.9 megapixels. We demonstrate the high-resolution, large-area, phase and birefringence imaging capability of our method by presenting the phase and birefringence images of various anisotropic objects, including a monosodium urate crystal, and excised mouse eye and heart tissues.

Single-shot wavelength-multiplexed phase microscopy under Gabor regime in a regular microscope embodiment

Phase imaging microscopy under Gabor regime has been recently reported as an extremely simple, low cost and compact way to update a standard bright-field microscope with coherent sensing capabilities. By inserting coherent illumination in the microscope embodiment and producing a small defocus distance of the sample at the input plane, the digital sensor records an in-line Gabor hologram of the target sample, which is then numerically post-processed to finally achieve the sample's quantitative phase information. However, the retrieved phase distribution is affected by the two well-known drawbacks when dealing with Gabor's regime, that is, coherent noise and twin image disturbances. Here, we present a single-shot technique based on wavelength multiplexing for mitigating these two effects. A multi-illumination laser source (including 3 diode lasers) illuminates the sample and a color digital sensor (conventional RGB color camera) is used to record the wavelength-multiplexed Gabor hologram in a single exposure. The technique is completed by presenting a novel algorithm based on a modified Gerchberg-Saxton kernel to finally retrieve an enhanced quantitative phase image of the sample, enhanced in terms of coherent noise removal and twin image minimization. Experimental validations are performed in a regular Olympus BX-60 upright microscope using a 20X 0.46NA objective lens and considering static (resolution test targets) and dynamic (living spermatozoa) phase samples.

Multi-Illumination Single-Holographic-Exposure Lensless Fresnel (MISHELF) Microscopy: Principles and Biomedical Applications

Lensless holographic microscopy (LHM) comes out as a promising label-free technique since it supplies high-quality imaging and adaptive magnification in a lens-free, compact and cost-effective way. Compact sizes and reduced prices of LHMs make them a perfect instrument for point-of-care diagnosis and increase their usability in limited-resource laboratories, remote areas, and poor countries. LHM can provide excellent intensity and phase imaging when the twin image is removed. In that sense, multi-illumination single-holographic-exposure lensless Fresnel (MISHELF) microscopy appears as a single-shot and phase-retrieved imaging technique employing multiple illumination/detection channels and a fast-iterative phase-retrieval algorithm. In this contribution, we review MISHELF microscopy through the description of the principles, the analysis of the performance, the presentation of the microscope prototypes and the inclusion of the main biomedical applications reported so far.

Projected refractive index framework for multi-wavelength phase retrieval

Multi-wavelength phase retrieval provides a competitive solution to lensless holographic imaging that features a low-cost, compact design and high data acquisition speed. However, the existence of phase wraps poses a unique challenge for iterative reconstruction, and the resulting algorithms often suffer from limited generalizability and increased computational complexity. Here, we propose a projected refractive index framework for multi-wavelength phase retrieval that directly recovers the amplitude and unwrapped phase of the object. General assumptions are linearized and integrated into the forward model. Based on an inverse problem formulation, physical constraints and sparsity priors are incorporated, which ensures imaging quality under noisy measurements. We experimentally demonstrate high-quality quantitative phase imaging on a lensless on-chip holographic imaging system using three color LEDs.

Lensfree on-chip microscopy based on single-plane phase retrieval

We propose a novel single-plane phase retrieval method to realize high-quality sample reconstruction for lensfree on-chip microscopy. In our method, complex wavefield reconstruction is modeled as a quadratic minimization problem, where total variation and joint denoising regularization are designed to keep a balance of artifact removal and resolution enhancement. In experiment, we built a 3D-printed field-portable platform to validate the imaging performance of our method, where resolution chart, dynamic target, transparent cell, polystyrene beads, and stained tissue sections are employed for the imaging test. Compared to state-of-the-art methods, our method eliminates image degradation and obtains a higher imaging resolution. Different from multi-wavelength or multi-height phase retrieval methods, our method only utilizes a single-frame intensity data record to accomplish high-fidelity reconstruction of different samples, which contributes a simple, robust, and data-efficient solution to design a resource-limited lensfree on-chip microscope. We believe that it will become a useful tool for telemedicine and point-of-care application.

Robust multi-angle structured illumination lensless microscopy via illumination angle calibration

Multi-angle structured illumination lensless (MASIL) microscopy enables high-resolution image recovery over a large field of view. Successful image recovery of MASIL microscopy, however, relies on an accurate knowledge of the multi-angle illumination. System misalignments and slight deviations from the true illumination angle may result in image artifacts in reconstruction. Here we report a MASIL microscopy system that is robust against illumination misalignment. To calibrate the illumination angles, we design and use a double-sided mask, which is a glass wafer fabricated with a ring-array pattern on the upper surface and a disk-array pattern on the lower surface. As such, the illumination angles can be decoded from the captured images by estimating the relative displacement of the two patterns. We experimentally demonstrate that this system can achieve successful image recovery without any prior knowledge of the illumination angles. The reported approach provides a simple yet robust resolution for wide-field lensless microscopy. It can solve the LED array misalignment problem and calibrate angle-varied illumination for a variety of applications.

A constrained method for lensless coherent imaging of thin samples

Lensless inline holography can produce high-resolution images over a large field of view (FoV). In a previous work [Appl. Opt.60, B38 (2021)APOPAI0003-693510.1364/AO.414976], we showed that (i) the actual FoV can be extrapolated outside of the camera FoV and (ii) the effective resolution of the setup can be several times higher than the resolution of the camera. In this paper, we present a reconstruction method to recover high resolution with an extrapolated FoV image of the phase and the amplitude of a sample from aliased intensity measurements taken at a lower resolution.

Linear diattenuation imaging of biological samples with digital lensless holographic microscopy

A digital lensless holographic microscope (DLHM) sensitive to the linear diattenuation produced by biological samples is reported. The insertion of a linear polarization-states generator and a linear polarization-states analyzer in a typical DLHM setup allows the proper linear diattenuation imaging of microscopic samples. The proposal has been validated for simulated and experimental biological samples containing calcium oxalate crystals extracted from agave leaves and potato starch grains. The performance of the proposed method is similar to that of a traditional polarimetric microscope to obtain linear diattenuation images of microscopic samples but with the advantages of DLHM, such as numerical refocusing, cost effectiveness, and the possibility of field-portable implementation.

Single-exposure multi-wavelength diffraction imaging with blazed grating

Multi-wavelength diffraction imaging is a lensless, high-resolution imaging technology. To avoid multiple exposures and enable high-speed data collection, here an innovative setup for the single-exposure multi-wavelength diffraction imaging based on a blazed grating is proposed. Since the blazed angle varies with the wavelength, the diffraction patterns for the individual wavelengths can be separated from each other and recorded in a single measurement at one time. A method of high-precision position alignment between different wavelength patterns is proposed in our system to achieve good image quality and high resolution. Experiments on a phase-only USAF resolution target and biological samples were carried out to verify the effectiveness of our proposed method. This proposed setup has such advantages as a simpler structure, fast recording, and algorithm robustness.

Design, Calibration, and Application of a Robust, Cost-Effective, and High-Resolution Lensless Holographic Microscope

Lensless holographic microscope (LHM) is an emerging very promising technology that provides high-quality imaging and analysis of biological samples without utilizing any lens for imaging. Due to its small size and reduced price, LHM can be a very useful tool for the point-of-care diagnosis of diseases, sperm assessment, or microfluidics, among others, not only employed in advanced laboratories but also in poor and/or remote areas. Recently, several LHMs have been reported in the literature. However, complete characterization of their optical parameters remains not much presented yet. Hence, we present a complete analysis of the performance of a compact, reduced cost, and high-resolution LHM. In particular, optical parameters such as lateral and axial resolutions, lateral magnification, and field of view are discussed into detail, comparing the experimental results with the expected theoretical values for different layout configurations. We use high-resolution amplitude and phase test targets and several microbeads to characterize the proposed microscope. This characterization is used to define a balanced and matched setup showing a good compromise between the involved parameters. Finally, such a microscope is utilized for visualization of static, as well as dynamic biosamples.

Generalized optimization framework for pixel super-resolution imaging in digital holography

The imaging quality of in-line digital holography is challenged by the twin-image and aliasing effects because sensors only respond to intensity and pixels are of finite size. As a result, phase retrieval and pixel super-resolution techniques serve as two essential ingredients for high-fidelity and high-resolution holographic imaging. In this work, we combine the two as a unified optimization problem and propose a generalized algorithmic framework for pixel-super-resolved phase retrieval. In particular, we introduce the iterative projection algorithms and gradient descent algorithms for solving this problem. The basic building blocks, namely the projection operator and the Wirtinger gradient, are derived and analyzed. As an example, the Wirtinger gradient descent algorithm for pixel-super-resolved phase retrieval, termed as Wirtinger-PSR, is proposed and compared with the classical error-reduction algorithm. The Wirtinger-PSR algorithm is verified with both simulated and experimental data. The proposed framework generalizes well to various physical settings and helps bridging the gap between empirical studies and theoretical analyses.

Mask-modulated lensless imaging via translated structured illumination

Lensless microscopy technique enables high-resolution image recovery over a large field of view. By integrating the concept of phase retrieval, it can also retrieve the lost phase information from intensity-only measurements. Here we report a mask-modulated lensless imaging platform based on translated structured illumination. In the reported platform, we sandwich the object in-between a coded mask and a naked image sensor for lensless data acquisition. An LED array is used to provide angle-varied illumination for projecting a translated structured pattern without involving mechanical scanning. For different LED elements, we acquire the lensless intensity data for recovering the complex-valued object. In the reconstruction process, we employ the regularized ptychographic iterative engine and implement an up-sampling process in the reciprocal space. As demonstrated by experimental results, the reported platform is able to recover complex-valued object images with higher resolution and better quality than previous implementations. Our approach may provide a cost-effective solution for high-resolution and wide field-of-view ptychographic imaging without involving mechanical scanning.

Open-source, cost-effective, portable, 3D-printed digital lensless holographic microscope

In this work, the design, construction, and testing of the most cost-effective digital lensless holographic microscope to date are presented. The architecture of digital lensless holographic microscopy (DLHM) is built by means of a 3D-printed setup and utilizing off-the-shelf materials to produce a DLHM microscope costing US$52.82. For the processing of the recorded in-line holograms, an open-source software specifically developed to process this type of recordings is utilized. The presented DLHM setup has all the degrees of freedom needed to achieve different fields of view, levels of spatial resolution, and 2D scanning of the sample. The feasibility of the presented platform is tested by imaging non-bio and bio samples; the resolution test targets, a section of the head of a Drosophila melanogaster fly, red blood cells, and cheek cells are imaged on the built microscope.

Preprocessing in digital lensless holographic microscopy for intensity reconstructions with enhanced contrast

In this work, a numerical method to enhance the contrast of intensity hologram reconstructions of digital lensless holographic microscopy (DLHM) is presented. The method manipulates the in-line hologram and reference images through mathematical operations between them; additionally, a sharpening operation, functionalized in terms of the parameters of the recording setup, is applied to the said images. The preprocessing of the recorded images produces a modified in-line hologram and a reference wave image from which an intensity reconstruction with a 25% improvement of its contrast, with respect to the conventional reconstruction procedure, is achieved. The method is illustrated with intensity reconstructions of a hologram of a monolayer of polystyrene spheres 1.09 µm in diameter. Finally, the preprocessing method is validated with a modeled hologram, successfully applied to holograms of the section of the head a Drosophila melanogaster fly and its results are contrasted with those obtained via bright-field microscopy.

Cone-shaped optical fiber tip for cost-effective digital lensless holographic microscopy

In this work, the development and application of a cost-effective and robust digital lensless holographic microscopy (DLHM) system is presented. In the simple architecture of DLHM based on a point source and a digital camera, the production of the former is introduced by means of an engineered step-index optical fiber with a cone-shaped end tip. The conventional and regularly expensive point source in DLHM is produced by means of a high-numerical-aperture microscope objective and a metallic wavelength-sized pinhole. The proposed replacement renders to DLHM additional simplicity of building, in addition to mechanical stability and robustness, and further reduces the cost of the microscope. The simplified cost-effective DLHM architecture is utilized for imaging resolution test targets and samples of human blood and pond water, revealing competitive mechanical stability and trustable phase images of the imaged specimens.

Robust autofocusing method for multi-wavelength lensless imaging

Lensless imaging based on multi-wavelength phase retrieval becomes a promising technology widely used as it has simple acquisition, miniaturized size and low-cost setup. However, measuring the sample-to-sensor distance with high accuracy, which is the key for high-resolution reconstruction, is still a challenge. In this work, we propose a multi-wavelength criterion to realize autofocusing modulation, i.e., achieving much higher accuracy in determining the sample-to-sensor distance, compared to the conventional methods. Three beams in different spectrums are adopted to illuminate the sample, and the resulting holograms are recorded by a CCD camera. The patterns calculated by performing back propagation of the recorded holograms, with exhaustively searched sample-to-sensor distance value, are adopted to access the criterion. Image sharpness can be accessed and the optimal sample-to-sensor distance can be finely determined by targeting the valley of the curve given by the criterion. Through our novel multi-wavelength based autofocusing strategy and executing further phase retrieval process, high-resolution images can be finally retrieved. The applicability and robustness of our method is validated both in simulations and experiments. Our technique provides a useful tool for multi-wavelength lensless imaging under limited experimental conditions.

Interference probe ptychography for computational amplitude and phase microscopy

We have developed an approach to Fresnel domain ptychography in which the illumination consists of an interference pattern. This pattern is conveniently created by overlapping two coherent beams at an angle. Only the phase and orientation of the interferometric fringe pattern needs to be scanned to reconstruct a high-fidelity object image, which alleviates the requirements for accurate sample positioning and system stability. As such, the resulting imaging systems can be constructed in an extremely simple and robust way. Object images are reconstructed from recorded Fresnel diffraction data using a modified ptychographical iterative engine. We demonstrate the capabilities of this imaging system by recording images of various biological samples, demonstrating quantitative phase contrast as well as a spatial resolution better than 2.2 μm.

Object plane detection and phase retrieval from single-shot holograms using multi-wavelength in-line holography

Phase retrieval and the twin-image problem in digital in-line holographic microscopy can be resolved by iterative reconstruction routines. However, recovering the phase properties of an object in a hologram requires an object plane to be chosen correctly for reconstruction. In this work, we present a novel multi-wavelength iterative algorithm to determine the object plane using single-shot holograms recorded at multiple wavelengths in an in-line holographic microscope. Using micro-sized objects, we verify the object positioning capabilities of the method for various shapes and derive the phase information using synthetic and experimental data. Experimentally, we built a compact digital in-line holographic microscopy setup around a standard optical microscope with a regular RGB-CCD camera and acquired holograms of micro-spheres, E. coli, and red blood cells, which are illuminated using three lasers operating at 491 nm, 532 nm, and 633 nm, respectively. We demonstrate that our method provides accurate object plane detection and phase retrieval under noisy conditions, e.g., using low-contrast holograms with an inhomogeneous background. This method allows for automatic positioning and phase retrieval suitable for holographic particle velocimetry, and object tracking in biophysical or colloidal research.

Multispectral total-variation reconstruction applied to lens-free microscopy

Lens-free microscopy multispectral acquisitions are processed with an inverse problem approach: a multispectral total variation criterion is defined and minimized with the conjugate gradients method. Reconstruction results show that the method is efficient to recover the phase image of densely packed cells.

Single-shot lensless imaging via simultaneous multi-angle LED illumination

Lensless imaging is a technique that records diffraction patterns without using lenses and recovers the complex field of object via phase retrieval. Robust lensless phase retrieval process usually requires multiple measurements with defocus variation, transverse translation or angle-varied illumination. However, making such diverse measurements is time-consuming and limits the application of lensless setup for dynamic samples. In this paper, we propose a single-shot lensless imaging scheme via simultaneous multi-angle LED illumination. Diffraction patterns under multi-angle lights are recorded by different areas of the sensor within a single shot. An optimization algorithm is applied to utilize the single-shot measurement and retrieve the aliasing information for reconstruction. We first use numerical simulations to evaluate the proposed scheme quantitatively by comparisons with the multi-acquisition case. Then a proof-of-concept lensless setup is built to validate the method by imaging a resolution chart and biological samples, achieving ∼ 4.92 μm half-pitch resolution and ∼ 1.20²mm² field of view (FOV). We also discuss different design tradeoffs and present a 4-frame acquisition scheme (with ∼ 3.48 μm half-pitch resolution and ∼ 2.35 × 2.55 mm² FOV) to show the flexibility of performance enhancement by capturing more measurements.

Single shot multi-wavelength phase retrieval with coherent modulation imaging

A single shot multi-wavelength phase retrieval method is proposed by combining common coherent modulation imaging (CMI) and a low rank mixed-state algorithm together. A radiation beam consisting of multi-wavelength is illuminated on the sample to be observed, and the exiting field is incident on a random phase plate to form speckle patterns, which is the incoherent superposition of diffraction patterns of each wavelength. The exiting complex amplitude of the sample including both the modulus and phase of each wavelength can be reconstructed simultaneously from the recorded diffraction intensity using a low rank mixed-state algorithm. The feasibility of this proposed method was verified with visible light experimentally. This proposed method not only makes CMI realizable with partially coherent illumination but also can extend its application to various traditionally unrelated fields, where several wavelengths should be considered simultaneously.

Effect of counting chamber depth on the accuracy of lensless microscopy for the assessment of boar sperm motility

Sperm motility is one of the most significant parameters in the prediction of male fertility. Until now, both motility analysis using an optical microscope and computer-aided sperm analysis (CASA-Mot) entailed the use of counting chambers with a depth to 20 µm. Chamber depth significantly affects the intrinsic sperm movement, leading to an artificial motility pattern. For the first time, laser microscopy offers the possibility of avoiding this interference with sperm movement. The aims of the present study were to determine the different motility patterns observed in chambers with depths of 10, 20 and 100 µm using a new holographic approach and to compare the results obtained in the 20-µm chamber with those of the laser and optical CASA-Mot systems. The ISAS®3D-Track results showed that values for curvilinear velocity (VCL), straight line velocity, wobble and beat cross frequency were higher for the 100-µm chambers than for the 10- and 20-µm chambers. Only VCL showed a positive correlation between chambers. In addition, Bayesian analysis confirmed that the kinematic parameters observed with the 100-µm chamber were significantly different to those obtained using chambers with depths of 10 and 20 µm. When an optical analyser CASA-Mot system was used, all kinematic parameters, except VCL, were higher with ISAS®3D-Track, but were not relevant after Bayesian analysis. Finally, almost three different three-dimensional motility patterns were recognised. In conclusion, the use of the ISAS®3D-Track allows for the analysis of the natural three-dimensional pattern of sperm movement.

Fourier ptychographic microscopy using wavelength multiplexing

Fourier ptychographic microscopy (FPM) is a recently developed technique stitching low-resolution images in Fourier domain to realize wide-field high-resolution imaging. However, the time-consuming process of image acquisition greatly narrows its applications in dynamic imaging. We report a wavelength multiplexing strategy to speed up the acquisition process of FPM several folds. A proof-of-concept system is built to verify its feasibility. Distinguished from many current multiplexing methods in Fourier domain, we explore the potential of high-speed FPM in spectral domain. Compatible with most existing FPM methods, our strategy provides an approach to high-speed gigapixel microscopy. Several experimental results are also presented to validate the strategy.

Compact, cost-effective and field-portable microscope prototype based on MISHELF microscopy

We report on a reduced cost, portable and compact prototype design of lensless holographic microscope with an illumination/detection scheme based on wavelength multiplexing, working with single hologram acquisition and using a fast convergence algorithm for image processing. All together, MISHELF (initials coming from Multi-Illumination Single-Holographic-Exposure Lensless Fresnel) microscopy allows the recording of three Fresnel domain diffraction patterns in a single camera snap-shot incoming from illuminating the sample with three coherent lights at once. Previous implementations have proposed an illumination/detection procedure based on a tuned (illumination wavelengths centered at the maximum sensitivity of the camera detection channels) configuration but here we report on a detuned (non-centered ones) scheme resulting in prototype miniaturization and cost reduction. Thus, MISHELF microscopy in combination with a novel and fast iterative algorithm allows high-resolution (μm range) phase-retrieved (twin image elimination) quantitative phase imaging of dynamic events (video rate recording speed). The performance of this microscope prototype is validated through experiments using both amplitude (USAF resolution test) and complex (live swine sperm cells and flowing microbeads) samples. The proposed method becomes in an alternative instrument improving some capabilities of existing lensless microscopes.

Achieving magnification smaller than 1 in lensless microscopy by illumination with a convergent wavefront

Lensless or lensfree microscopy is now available commercially. With these new microscopes, it is possible to record images in contact mode with a magnification of 1 or in holographic mode with a magnification larger than 1. In this Letter, we present an original setup that allows us to record the image of an object whose surface is larger than that of the image sensor without placing an optical component between the object and the image sensor.

Pixel super-resolution using wavelength scanning

Undersampling and pixelation affect a number of imaging systems, limiting the resolution of the acquired images, which becomes particularly significant for wide-field microscopy applications. Various super-resolution techniques have been implemented to mitigate this resolution loss by utilizing sub-pixel displacements in the imaging system, achieved, for example, by shifting the illumination source, the sensor array and/or the sample, followed by digital synthesis of a smaller effective pixel by merging these sub-pixel-shifted low-resolution images. Herein, we introduce a new pixel super-resolution method that is based on wavelength scanning and demonstrate that as an alternative to physical shifting/displacements, wavelength diversity can be used to boost the resolution of a wide-field imaging system and significantly increase its space-bandwidth product. We confirmed the effectiveness of this new technique by improving the resolution of lens-free as well as lens-based microscopy systems and developed an iterative algorithm to generate high-resolution reconstructions of a specimen using undersampled diffraction patterns recorded at a few wavelengths covering a narrow spectrum (10-30 nm). When combined with a synthetic-aperture-based diffraction imaging technique, this wavelength-scanning super-resolution approach can achieve a half-pitch resolution of 250 nm, corresponding to a numerical aperture of ~1.0, across a large field of view (>20 mm²). We also demonstrated the effectiveness of this approach by imaging various biological samples, including blood and Papanicolaou smears. Compared with displacement-based super-resolution techniques, wavelength scanning brings uniform resolution improvement in all directions across a sensor array and requires significantly fewer measurements. This technique would broadly benefit wide-field imaging applications that demand larger space-bandwidth products.

Propagation phasor approach for holographic image reconstruction

To achieve high-resolution and wide field-of-view, digital holographic imaging techniques need to tackle two major challenges: phase recovery and spatial undersampling. Previously, these challenges were separately addressed using phase retrieval and pixel super-resolution algorithms, which utilize the diversity of different imaging parameters. Although existing holographic imaging methods can achieve large space-bandwidth-products by performing pixel super-resolution and phase retrieval sequentially, they require large amounts of data, which might be a limitation in high-speed or cost-effective imaging applications. Here we report a propagation phasor approach, which for the first time combines phase retrieval and pixel super-resolution into a unified mathematical framework and enables the synthesis of new holographic image reconstruction methods with significantly improved data efficiency. In this approach, twin image and spatial aliasing signals, along with other digital artifacts, are interpreted as noise terms that are modulated by phasors that analytically depend on the lateral displacement between hologram and sensor planes, sample-to-sensor distance, wavelength, and the illumination angle. Compared to previous holographic reconstruction techniques, this new framework results in five- to seven-fold reduced number of raw measurements, while still achieving a competitive resolution and space-bandwidth-product. We also demonstrated the success of this approach by imaging biological specimens including Papanicolaou and blood smears.