Lensfree super-resolution holographic microscopy using wetting films on a chip

Advancing the science of dynamic airborne nanosized particles using Nano-DIHM

In situ and real-time characterization of aerosols is vital to several fundamental and applied research domains including atmospheric chemistry, air quality monitoring, or climate change studies. To date, digital holographic microscopy is commonly used to characterize dynamic nanosized particles, but optical traps are required. In this study, a novel integrated digital in-line holographic microscope coupled with a flow tube (Nano-DIHM) is demonstrated to characterize particle phase, shape, morphology, 4D dynamic trajectories, and 3D dimensions of airborne particles ranging from the nanoscale to the microscale. We demonstrate the application of Nano-DIHM for nanosized particles (≤200 nm) in dynamic systems without optical traps. The Nano-DIHM allows observation of moving particles in 3D space and simultaneous measurement of each particle's three dimensions. As a proof of concept, we report the real-time observation of 100 nm and 200 nm particles, i.e. polystyrene latex spheres and the mixture of metal oxide nanoparticles, in air and aqueous/solid/heterogeneous phases in stationary and dynamic modes. Our observations are validated by high-resolution scanning/transmission electron microscopy and aerosol sizers. The complete automation of software (Octopus/Stingray) with Nano-DIHM permits the reconstruction of thousands of holograms within an hour with 62.5 millisecond time resolution for each hologram, allowing to explore the complex physical and chemical processes of aerosols.

High-Speed Lens-Free Holographic Sensing of Protein Molecules Using Quantitative Agglutination Assays

Accurate, cost-effective, easy-to-use, and point-of-care sensors for protein biomarker levels are important for disease diagnostics. A cost-effective and compact readout approach that has been used for several diagnostic applications is lens-free holographic microscopy, which provides an ultralarge field of view and submicron resolution when it is coupled with pixel super-resolution techniques. Despite its potential as a diagnostic technique, lens-free microscopy has not previously been applied to quantitative protein molecule sensing in solution, which can simplify sensing protocols and ultimately enable measurements of binding kinetics in physiological conditions. Here, we sense interferon-γ (an immune system biomarker) and NeutrAvidin molecules in solution by combining lens-free microscopy with a one-step bead-based agglutination assay, enabled by a custom high-speed light-emitting diode (LED) array and automated image processing routines. We call this a quantitative large-area binding (QLAB) sensor. The high-speed light source provides, for the first time, pixel super-resolved imaging of >10⁴ 2 μm beads in solution undergoing Brownian motion, without significant motion blur. The automated image processing routines enable the counting of individual beads and clusters, providing a quantitative sensor readout that depends on both bead and analyte concentrations. Fits to the chemical binding theory are provided. For NeutrAvidin, we find a limit of detection (LOD) of <27 ng/mL (450 pM) and a dynamic range of 2-4 orders of magnitude. For mouse interferon-γ, the LOD is <3 ng/mL (200 pM) and the dynamic range is at least 4 orders of magnitude. The QLAB sensor holds promise for point-of-care applications in low-resource communities and where protocol simplicity is important.

A super-resolution scanning algorithm for lensless microfluidic imaging using the dual-line array image sensor

The lensless optical fluid microscopy is of great significance to the miniaturization, portability and low cost development of cell detection instruments. However, the resolution of the cell image collected directly is low, because the physical pixel size of the image sensor is the same order of magnitude as the cell size. To solve this problem, this paper proposes a super-resolution scanning algorithm using a dual-line array sensor and a microfluidic chip. For dual-line array sensor images, the multi-group velocity and acceleration of cells flowing through the line array sensor are calculated. Then the reconstruction model of the super-resolution image is constructed with variable acceleration. By changing the angle between the line array image sensor and the direction of cell flow, the super-resolution image scanning and reconstruction are achieved in both horizontal and vertical directions. In addition, it is necessary to study the row by row extraction algorithm for cell foreground image. In this paper, the dual-line array sensor is implemented by adjusting the acquisition window of the image sensor with a pixel size of 2.2μm. When the tilt angle is 21 degrees, the equivalent pixel size is 0.79μm, improved 2.8 times, and after de-diffraction its average size error was 3.249%. As the angle decreases, the image resolution is higher, but the amount of information is less. This super-resolution scanning algorithm can be integrated on the chip and used with a microfluidic chip to realize on-chip instrument.

Optimized sensing of sparse and small targets using lens-free holographic microscopy

Lens-free holographic microscopy offers sub-micron resolution over an ultra-large field-of-view >20 mm², making it suitable for bio-sensing applications that require the detection of small targets at low concentrations. Various pixel super-resolution techniques have been shown to enhance resolution and boost signal-to-noise ratio (SNR) by combining multiple partially-redundant low-resolution frames. However, it has been unclear which technique performs best for small-target sensing. Here, we quantitatively compare SNR and resolution in experiments using no regularization, cardinal-neighbor regularization, and a novel implementation of sparsity-promoting regularization that uses analytically-calculated gradients from Bayer-pattern image sensors. We find that sparsity-promoting regularization enhances the SNR by ~8 dB compared to the other methods when imaging micron-scale beads with surface coverages up to ~4%.

Highly sensitive lens-free fluorescence imaging device enabled by a complementary combination of interference and absorption filters

We report a lens-free fluorescence imaging device using a composite filter composed of an interference filter and an absorption filter, each applied to one side of a fiber optic plate (FOP). The transmission of angled excitation light through the interference filter is absorbed by the absorption filter. The auto-fluorescence of the absorption filter is reduced by the reflection from the interference filter of normally incident excitation light. As a result, high-performance rejection of excitation light is achieved in a lens-free device. The FOP provides a flat, hard imaging device surface that does not degrade the spatial resolution. We demonstrate excitation rejection of approximately 108:1 at a wavelength of 450 nm in a fabricated lens-free device. The resolution of fluorescence imaging is approximately 12 µm. Time-lapse imaging of cells containing green fluorescent protein was performed in a 5-µm thin-film chamber. The small dimensions of the device allow observation of cell culturing in a CO2 incubator. We also demonstrate that the proposed lens-free filter is compatible with super-resolution bright-field imaging techniques. These features open a way to develop a high-performance, dual-mode, lens-free imaging device that is expected to be a powerful tool for many applications, such as imaging of labeled cells and point-of-care assay.

Lensless digital holographic microscopy and its applications in biomedicine and environmental monitoring

Optical compound microscope has been a major tool in biomedical imaging for centuries. Its performance relies on relatively complicated, bulky and expensive lenses and alignment mechanics. In contrast, the lensless microscope digitally reconstructs microscopic images of specimens without using any lenses, as a result of which it can be made much smaller, lighter and lower-cost. Furthermore, the limited space-bandwidth product of objective lenses in a conventional microscope can be significantly surpassed by a lensless microscope. Such lensless imaging designs have enabled high-resolution and high-throughput imaging of specimens using compact, portable and cost-effective devices to potentially address various point-of-care, global-health and telemedicine related challenges. In this review, we discuss the operation principles and the methods behind lensless digital holographic on-chip microscopy. We also go over various applications that are enabled by cost-effective and compact implementations of lensless microscopy, including some recent work on air quality monitoring, which utilized machine learning for high-throughput and accurate quantification of particulate matter in air. Finally, we conclude with a brief future outlook of this computational imaging technology.

Unconventional methods of imaging: computational microscopy and compact implementations

In the past two decades or so, there has been a renaissance of optical microscopy research and development. Much work has been done in an effort to improve the resolution and sensitivity of microscopes, while at the same time to introduce new imaging modalities, and make existing imaging systems more efficient and more accessible. In this review, we look at two particular aspects of this renaissance: computational imaging techniques and compact imaging platforms. In many cases, these aspects go hand-in-hand because the use of computational techniques can simplify the demands placed on optical hardware in obtaining a desired imaging performance. In the first main section, we cover lens-based computational imaging, in particular, light-field microscopy, structured illumination, synthetic aperture, Fourier ptychography, and compressive imaging. In the second main section, we review lensfree holographic on-chip imaging, including how images are reconstructed, phase recovery techniques, and integration with smart substrates for more advanced imaging tasks. In the third main section we describe how these and other microscopy modalities have been implemented in compact and field-portable devices, often based around smartphones. Finally, we conclude with some comments about opportunities and demand for better results, and where we believe the field is heading.

Wide-field imaging of birefringent synovial fluid crystals using lens-free polarized microscopy for gout diagnosis

Gout is a form of crystal arthropathy where monosodium urate (MSU) crystals deposit and elicit inflammation in a joint. Diagnosis of gout relies on identification of MSU crystals under a compensated polarized light microscope (CPLM) in synovial fluid aspirated from the patient's joint. The detection of MSU crystals by optical microscopy is enhanced by their birefringent properties. However, CPLM partially suffers from the high-cost and bulkiness of conventional lens-based microscopy, and its relatively small field-of-view (FOV) limits the efficiency and accuracy of gout diagnosis. Here we present a lens-free polarized microscope which adopts a novel differential and angle-mismatched polarizing optical design achieving wide-field and high-resolution holographic imaging of birefringent objects with a color contrast similar to that of a standard CPLM. The performance of this computational polarization microscope is validated by imaging MSU crystals made from a gout patient's tophus and steroid crystals used as negative control. This lens-free polarized microscope, with its wide FOV (>20 mm(2)), cost-effectiveness and field-portability, can significantly improve the efficiency and accuracy of gout diagnosis, reduce costs, and can be deployed even at the point-of-care and in resource-limited clinical settings.

PicoMolar level detection of protein biomarkers based on electronic sizing of bead aggregates: theoretical and experimental considerations

We demonstrate a novel method for electronically detecting and quantifying protein biomarkers using microfluidic impedance cytometry. Our biosensor, which consists of gold electrodes micro-fabricated in a microchannel, detects the differences between bead aggregates of varying sizes in a micro-pore sandwiched between two micro channels. We perform a sandwich immunoassay, where the complementary antibody pairs are immobilized on two different bead types, and the presence of antigen results in bead aggregation, the amount of which depends on antigen quantity. When single beads or bead aggregates pass through the impedance sensor, differences in impedance change are detected. In this manuscript, we perform a comprehensive theoretical study on the limits imposed on sensitivity of this technique due to electronic noise and also mass transfer and reaction limits. We also experimentally characterize the performance of this technique by validating the technique on an IgG detection assay. A detection limit at the picoMolar level is demonstrated, thus comparable in sensitivity to a sandwich ELISA.

Lensless Imaging and Sensing

High-resolution optical microscopy has traditionally relied on high-magnification and high-numerical aperture objective lenses. In contrast, lensless microscopy can provide high-resolution images without the use of any focusing lenses, offering the advantages of a large field of view, high resolution, cost-effectiveness, portability, and depth-resolved three-dimensional (3D) imaging. Here we review various approaches to lensless imaging, as well as its applications in biosensing, diagnostics, and cytometry. These approaches include shadow imaging, fluorescence, holography, superresolution 3D imaging, iterative phase recovery, and color imaging. These approaches share a reliance on computational techniques, which are typically necessary to reconstruct meaningful images from the raw data captured by digital image sensors. When these approaches are combined with physical innovations in sample preparation and fabrication, lensless imaging can be used to image and sense cells, viruses, nanoparticles, and biomolecules. We conclude by discussing several ways in which lensless imaging and sensing might develop in the near future.

Bayesian-based aberration correction and numerical diffraction for improved lensfree on-chip microscopy of biological specimens

Lensfree on-chip microscopy is an emerging imaging technique that can be used to visualize and study biological specimens without the need for imaging lens systems. Important issues that can limit the performance of lensfree on-chip microscopy include interferometric aberrations, acquisition noise, and image reconstruction artifacts. In this study, we introduce a Bayesian-based method for performing aberration correction and numerical diffraction that accounts for all three of these issues to improve the effective numerical aperture (NA) and signal-to-noise ratio (SNR) of the reconstructed microscopic image. The proposed method was experimentally validated using the USAF resolution target as well as real waterborne Anabaena flos-aquae samples, demonstrating improvements in NA by ∼25% over the standard method, and improvements in SNR of 2.8 and 8.2 dB in the reconstructed image when compared to the reconstructed images produced using the standard method and a maximum likelihood estimation method, respectively.

Digital diffraction analysis enables low-cost molecular diagnostics on a smartphone

The widespread distribution of smartphones, with their integrated sensors and communication capabilities, makes them an ideal platform for point-of-care (POC) diagnosis, especially in resource-limited settings. Molecular diagnostics, however, have been difficult to implement in smartphones. We herein report a diffraction-based approach that enables molecular and cellular diagnostics. The D3 (digital diffraction diagnosis) system uses microbeads to generate unique diffraction patterns which can be acquired by smartphones and processed by a remote server. We applied the D3 platform to screen for precancerous or cancerous cells in cervical specimens and to detect human papillomavirus (HPV) DNA. The D3 assay generated readouts within 45 min and showed excellent agreement with gold-standard pathology or HPV testing, respectively. This approach could have favorable global health applications where medical access is limited or when pathology bottlenecks challenge prompt diagnostic readouts.

Imaging bacterial 3D motion using digital in-line holographic microscopy and correlation-based de-noising algorithm

Better understanding of bacteria environment interactions in the context of biofilm formation requires accurate 3-dimentional measurements of bacteria motility. Digital Holographic Microscopy (DHM) has demonstrated its capability in resolving 3D distribution and mobility of particulates in a dense suspension. Due to their low scattering efficiency, bacteria are substantially difficult to be imaged by DHM. In this paper, we introduce a novel correlation-based de-noising algorithm to remove the background noise and enhance the quality of the hologram. Implemented in conjunction with DHM, we demonstrate that the method allows DHM to resolve 3-D E. coli bacteria locations of a dense suspension (>107 cells/ml) with submicron resolutions (<0.5 µm) over substantial depth and to obtain thousands of 3D cell trajectories.

Nano-imaging enabled via self-assembly

Imaging object details with length scales below approximately 200 nm has been historically difficult for conventional microscope objective lenses because of their inability to resolve features smaller than one-half the optical wavelength. Here we review some of the recent approaches to surpass this limit by harnessing self-assembly as a fabrication mechanism. Self-assembly can be used to form individual nano- and micro-lenses, as well as to form extended arrays of such lenses. These lenses have been shown to enable imaging with resolutions as small as 50 nm half-pitch using visible light, which is well below the Abbe diffraction limit. Furthermore, self-assembled nano-lenses can be used to boost contrast and signal levels from small nano-particles, enabling them to be detected relative to background noise. Finally, alternative nano-imaging applications of self-assembly are discussed, including three-dimensional imaging, enhanced coupling from light-emitting diodes, and the fabrication of contrast agents such as quantum dots and nanoparticles.

Various on-chip sensors with microfluidics for biological applications

In this paper, we review recent advances in on-chip sensors integrated with microfluidics for biological applications. Since the 1990s, much research has concentrated on developing a sensing system using optical phenomena such as surface plasmon resonance (SPR) and surface-enhanced Raman scattering (SERS) to improve the sensitivity of the device. The sensing performance can be significantly enhanced with the use of microfluidic chips to provide effective liquid manipulation and greater flexibility. We describe an optical image sensor with a simpler platform for better performance over a larger field of view (FOV) and greater depth of field (DOF). As a new trend, we review consumer electronics such as smart phones, tablets, Google glasses, etc. which are being incorporated in point-of-care (POC) testing systems. In addition, we discuss in detail the current optical sensing system integrated with a microfluidic chip.

Biomedical imaging and sensing using flatbed scanners

In this Review, we provide an overview of flatbed scanner based biomedical imaging and sensing techniques. The extremely large imaging field-of-view (e.g., ~600-700 cm(2)) of these devices coupled with their cost-effectiveness provide unique opportunities for digital imaging of samples that are too large for regular optical microscopes, and for collection of large amounts of statistical data in various automated imaging or sensing tasks. Here we give a short introduction to the basic features of flatbed scanners also highlighting the key parameters for designing scientific experiments using these devices, followed by a discussion of some of the significant examples, where scanner-based systems were constructed to conduct various biomedical imaging and/or sensing experiments. Along with mobile phones and other emerging consumer electronics devices, flatbed scanners and their use in advanced imaging and sensing experiments might help us transform current practices of medicine, engineering and sciences through democratization of measurement science and empowerment of citizen scientists, science educators and researchers in resource limited settings.

Tunable vapor-condensed nanolenses

Nanostructured optical components, such as nanolenses, direct light at subwavelength scales to enable, among others, high-resolution lithography, miniaturization of photonic circuits, and nanoscopic imaging of biostructures. A major challenge in fabricating nanolenses is the appropriate positioning of the lens with respect to the sample while simultaneously ensuring it adopts the optimal size and shape for the intended use. One application of particular interest is the enhancement of contrast and signal-to-noise ratio in the imaging of nanoscale objects, especially over wide fields-of-view (FOVs), which typically come with limited resolution and sensitivity for imaging nano-objects. Here we present a self-assembly method for fabricating time- and temperature-tunable nanolenses based on the condensation of a polymeric liquid around a nanoparticle, which we apply to the high-throughput on-chip detection of spheroids smaller than 40 nm, rod-shaped particles with diameter smaller than 20 nm, and biofunctionalized nanoparticles, all across an ultralarge FOV of >20 mm(2). Previous nanoparticle imaging efforts across similar FOVs have detected spheroids no smaller than 100 nm, and therefore our results demonstrate the detection of particles >15-fold smaller in volume, which in free space have >240 times weaker Rayleigh scattering compared to the particle sizes detected in earlier wide-field imaging work. This entire platform, with its tunable nanolens condensation and wide-field imaging functions, is also miniaturized into a cost-effective and portable device, which might be especially important for field use, mobile sensing, and diagnostics applications, including, for example, the measurement of viral load in bodily fluids.

Optical detection and sizing of single nanoparticles using continuous wetting films

The physical interaction between nanoscale objects and liquid interfaces can create unique optical properties, enhancing the signatures of the objects with subwavelength features. Here we show that the evaporation on a wetting substrate of a polymer solution containing submicrometer or nanoscale particles creates liquid microlenses that arise from the local deformations of the continuous wetting film. These microlenses have properties similar to axicon lenses that are known to create beams with a long depth of focus. This enhanced depth of focus allows detection of single nanoparticles using a low-magnification microscope objective lens, achieving a relatively wide field-of-view, while also lifting the constraints on precise focusing onto the object plane. Hence, by creating these liquid axicon lenses through spatial deformations of a continuous thin wetting film, we transfer the challenge of imaging individual nanoparticles to detecting the light focused by these lenses. As a proof of concept, we demonstrate the detection and sizing of single nanoparticles (100 and 200 nm), CpGV granuloviruses, as well as Staphylococcus epidermidis bacteria over a wide field-of-view of 5.10 × 3.75 mm(2) using a 5× objective lens with a numerical aperture of 0.15. In addition to conventional lens-based microscopy, this continuous wetting-film-based approach is also applicable to lens-free computational on-chip imaging, which can be used to detect single nanoparticles over a large field-of-view of >20-30 mm(2). These results could be especially useful for high-throughput field analysis of nanoscale objects using compact and cost-effective microscope designs.

Wide-field optical detection of nanoparticles using on-chip microscopy and self-assembled nanolenses

The direct observation of nanoscale objects is a challenging task for optical microscopy because the scattering from an individual nanoparticle is typically weak at optical wavelengths. Electron microscopy therefore remains one of the gold standard visualization methods for nanoparticles, despite its high cost, limited throughput and restricted field-of-view. Here, we describe a high-throughput, on-chip detection scheme that uses biocompatible wetting films to self-assemble aspheric liquid nanolenses around individual nanoparticles to enhance the contrast between the scattered and background light. We model the effect of the nanolens as a spatial phase mask centred on the particle and show that the holographic diffraction pattern of this effective phase mask allows detection of sub-100 nm particles across a large field-of-view of >20 mm2. As a proof-of-concept demonstration, we report on-chip detection of individual polystyrene nanoparticles, adenoviruses and influenza A (H1N1) viral particles.

Optical imaging techniques for point-of-care diagnostics

Improving access to effective and affordable healthcare has long been a global endeavor. In this quest, the development of cost-effective and easy-to-use medical testing equipment that enables rapid and accurate diagnosis is essential to reduce the time and costs associated with healthcare services. To this end, point-of-care (POC) diagnostics plays a crucial role in healthcare delivery in both developed and developing countries by bringing medical testing to patients, or to sites near patients. As the diagnosis of a wide range of diseases, including various types of cancers and many endemics, relies on optical techniques, numerous compact and cost-effective optical imaging platforms have been developed in recent years for use at the POC. Here, we review the state-of-the-art optical imaging techniques that can have a significant impact on global health by facilitating effective and affordable POC diagnostics.

On-chip biomedical imaging

Lab-on-a-chip systems have been rapidly emerging to pave the way toward ultra-compact, efficient, mass producible and cost-effective biomedical research and diagnostic tools. Although such microfluidic and microelectromechanical systems have achieved high levels of integration, and are capable of performing various important tasks on the same chip, such as cell culturing, sorting and staining, they still rely on conventional microscopes for their imaging needs. Recently, several alternative on-chip optical imaging techniques have been introduced, which have the potential to substitute conventional microscopes for various lab-on-a-chip applications. Here we present a critical review of these recently emerging on-chip biomedical imaging modalities, including contact shadow imaging, lens-free holographic microscopy, fluorescent on-chip microscopy and lens-free optical tomography.

Imaging without lenses: achievements and remaining challenges of wide-field on-chip microscopy

We discuss unique features of lens-free computational imaging tools and report some of their emerging results for wide-field on-chip microscopy, such as the achievement of a numerical aperture (NA) of ∼0.8-0.9 across a field of view (FOV) of more than 20 mm(2) or an NA of ∼0.1 across a FOV of ∼18 cm(2), which corresponds to an image with more than 1.5 gigapixels. We also discuss the current challenges that these computational on-chip microscopes face, shedding light on their future directions and applications.

Maskless imaging of dense samples using pixel super-resolution based multi-height lensfree on-chip microscopy

Lensfree in-line holographic microscopy offers sub-micron resolution over a large field-of-view (e.g., ~24 mm2) with a cost-effective and compact design suitable for field use. However, it is limited to relatively low-density samples. To mitigate this limitation, we demonstrate an on-chip imaging approach based on pixel super-resolution and phase recovery, which iterates among multiple lensfree intensity measurements, each having a slightly different sample-to-sensor distance. By digitally aligning and registering these lensfree intensity measurements, phase and amplitude images of dense and connected specimens can be iteratively reconstructed over a large field-of-view of ~24 mm2 without the use of any spatial masks. We demonstrate the success of this multi-height in-line holographic approach by imaging dense Papanicolaou smears (i.e., Pap smears) and blood samples.

Theoretical and experimental demonstration of resolution beyond the Rayleigh limit by FINCH fluorescence microscopic imaging

Fresnel Incoherent Correlation Holography (FINCH) enables holograms to be recorded from incoherent light with just a digital camera and spatial light modulator. We previously described its application to general three dimensional incoherent imaging and specifically to fluorescence microscopy, wherein one complex hologram contains the three dimensional information in the field of view, obviating the need for scanning or serial sectioning. We have now further analyzed FINCH in view of linear system theory and in comparison to conventional coherent and incoherent two dimensional imaging systems. We demonstrate, theoretically and experimentally, improved resolution by FINCH, when compared to conventional imaging.