Wavefront shaping for imaging-based flow velocity measurements through distortions using a Fresnel guide star

Scattering Reduction and Axial Resolution Enhancement in Light-Sheet Fluorescence Microscopy

Light-sheet fluorescence microscopy (LSFM) provides an ideal tool for long-term observation of live specimens due to its low photodamage and fast volumetric imaging speed. The wavefront distortions in the illumination path of LSFM will reduce the intensity and broaden the light-sheet thickness, thereby degrading the image quality. We propose to use the wavefront shaping technique to reduce the scattering effect and shrink the light-sheet thickness. Scanning the refocused laser beam to generate LS improves both the fluorescence intensity and the axial resolution. The axial resolution can be further enhanced by subtracting the two images captured via double scanning the samples with the refocused beam and the uncorrected scattered beam for each slice. The axial resolution is improved from 2.2 ± 0.3 to 1.5 ± 0.2 μm across the field of view of 270 μm × 270 μm. The effectiveness of the wavefront shaping subtraction method is demonstrated by imaging fluorescent beads and Aspergillus conidiophores behind a scattering medium.

Real-time complex light field generation through a multi-core fiber with deep learning

The generation of tailored complex light fields with multi-core fiber (MCF) lensless microendoscopes is widely used in biomedicine. However, the computer-generated holograms (CGHs) used for such applications are typically generated by iterative algorithms, which demand high computation effort, limiting advanced applications like fiber-optic cell manipulation. The random and discrete distribution of the fiber cores in an MCF induces strong spatial aliasing to the CGHs, hence, an approach that can rapidly generate tailored CGHs for MCFs is highly demanded. We demonstrate a novel deep neural network-CoreNet, providing accurate tailored CGHs generation for MCFs at a near video rate. The CoreNet is trained by unsupervised learning and speeds up the computation time by two magnitudes with high fidelity light field generation compared to the previously reported CGH algorithms for MCFs. Real-time generated tailored CGHs are on-the-fly loaded to the phase-only spatial light modulator (SLM) for near video-rate complex light fields generation through the MCF microendoscope. This paves the avenue for real-time cell rotation and several further applications that require real-time high-fidelity light delivery in biomedicine.

Nonlinear microscopy using impulsive stimulated Brillouin scattering for high-speed elastography

The impulsive stimulated Brillouin microscopy promises fast, non-contact measurements of the elastic properties of biological samples. The used pump-probe approach employs an ultra-short pulse laser and a cw laser to generate Brillouin signals. Modeling of the microscopy technique has already been carried out partially, but not for biomedical applications. The nonlinear relationship between pulse energy and Brillouin signal amplitude is proven with both simulations and experiments. Tayloring of the excitation parameters on the biologically relevant polyacrylamide hydrogels outline sub-ms temporal resolutions at a relative precision of <1%. Brillouin microscopy using the impulsive stimulated scattering therefore exhibits high potential for the measurements of viscoelastic properties of cells and tissues.

Feasibility of Optical Flow Field Measurements of the Coolant in a Grinding Machine

For industrial grinding processes, the workpiece cooling by metalworking fluids, which strongly influences the workpiece surface layer quality, is not yet fully understood. This leads to high efforts for the empirical determination of suitable cooling parameters, increasing the part manufacturing costs. To close the knowledge gap, a measurement method for the metalworking fluid flow field near the grinding wheel is desired. However, the varying curved surfaces of the liquid phase result in unpredictable light deflections and reflections, which impede optical flow measurements. In order to investigate the yet unknown optical measurement capabilities achievable under these conditions, shadowgraphy in combination with a pattern correlation technique and particle image velocimetry (PIV) are applied in a grinding machine. The results show that particle image velocimetry enables flow field measurements inside the laminar metalworking fluid jet, whereby the shadowgraph imaging velocimetry complements these measurements since it is in particular suitable for regions with spray-like flow regimes. As a conclusion, optical flow field measurements of the metalworking fluid flow in a running grinding machine are shown to be feasible.

Benchmarking analysis of computer generated holograms for complex wavefront shaping using pixelated phase modulators

Wavefront shaping with spatial light modulators (SLMs) enables aberration correction, especially for light control through complex media, like biological tissues and multimode fibres. High-fidelity light field shaping is associated with the calculation of computer generated holograms (CGHs), of which there are a variety of algorithms. The achievable performance of CGH algorithms depends on various parameters. In this paper, four different algorithms for CGHs are presented and compared for complex light field generation. Two iterative, double constraint Gerchberg-Saxton and direct search, and the two analytical, superpixel and phase encoding, algorithms are investigated. For each algorithm, a parameter study is performed varying the modulator's pixel number and phase resolution. The analysis refers to mode field generation in multimode fibre endoscopes and communication. This enables generality by generating specific mode combinations according to certain spatial frequency power spectra. Thus, the algorithms are compared varying spatial frequencies applied to different implementation scenarios. Our results demonstrate that the choice of algorithms has a significant impact on the achievable performance. This comprehensive study provides the required guide for CGH algorithm selection, improving holographic systems towards multimode fibre endoscopy and communications.

Stereoscopic particle image velocimetry in inhomogeneous refractive index fields of combustion flows

Particle image velocimetry (PIV) measurements in reactive flows are disturbed by inhomogeneous refractive index fields, which cause measurement deviations in particle positions due to light refraction. The resulting measurement errors are known for standard PIV, but the measurement errors for stereoscopic PIV are still unknown. Therefore, for comparison, the velocity errors for standard and stereoscopic PIV are analyzed in premixed propane flames with different Reynolds numbers. For this purpose, ray-tracing simulations based on the time-averaged inhomogeneous refractive index fields of the studied non-swirled flame flows measured by the background-oriented Schlieren technique are performed to quantify the resulting position errors of the particles. In addition, the performance of the volumetric self-calibration relevant to tomographic PIV is analyzed with respect to the remaining position errors of the particles within the flames. The position errors cause significant standard PIV errors of 2% for the velocity component radial to the burner symmetry axis. Stereoscopic PIV measurements result in measurement errors of up to 3% radial to the burner axis and 13% for the velocity component perpendicular to the measurement plane. Due to the lower refractive index gradients in the axial direction, no significant velocity errors are observed for the axial velocity component. For the investigated flame configurations, the position errors and velocity errors increase with the Reynolds numbers. However, this dependence needs to be verified for other flame configurations such as swirled flame flows.

Anti-scattering light focusing by fast wavefront shaping based on multi-pixel encoded digital-micromirror device

Speed and enhancement are the two most important metrics for anti-scattering light focusing by wavefront shaping (WS), which requires a spatial light modulator with a large number of modulation modes and a fast speed of response. Among the commercial modulators, the digital-micromirror device (DMD) is the sole solution providing millions of modulation modes and a pattern rate higher than 20 kHz. Thus, it has the potential to accelerate the process of anti-scattering light focusing with a high enhancement. Nevertheless, modulating light in a binary mode by the DMD restricts both the speed and enhancement seriously. Here, we propose a multi-pixel encoded DMD-based WS method by combining multiple micromirrors into a single modulation unit to overcome the drawbacks of binary modulation. In addition, to efficiently optimize the wavefront, we adopted separable natural evolution strategies (SNES), which could carry out a global search against a noisy environment. Compared with the state-of-the-art DMD-based WS method, the proposed method increased the speed of optimization and enhancement of focus by a factor of 179 and 16, respectively. In our demonstration, we achieved 10 foci with homogeneous brightness at a high speed and formed W- and S-shape patterns against the scattering medium. The experimental results suggest that the proposed method will pave a new avenue for WS in the applications of biomedical imaging, photon therapy, optogenetics, dynamic holographic display, etc.

Distortion correction for particle image velocimetry using multiple-input deep convolutional neural network and Hartmann-Shack sensing

Aberrations degrade the accuracy of quantitative, imaging-based measurements, like particle image velocimetry (PIV). Adaptive optical elements can in principle correct the wavefront distortions, but are limited by their technical specifications. Here we propose an actuator-free correction based on a multiple-input deep convolutional neural network which uses an additional input from a wavefront sensor to correct time-varying distortions. It is applied for imaging flow velocimetry to conduct measurements through a fluctuating air-water phase boundary. Dataset for neural network is generated by an experimental setup with a deformable mirror. Correction performance of trained model is estimated in terms of image quality, which is improved significantly, and flow measurement results, where the errors induced by the distortion from fluctuating phase boundary can be corrected by 82 %. The technique has the potential to replace classical closed-loop adaptive optical systems where the performance of the actuators is not sufficient.

Complex Wavefront Shaping through a Multi-Core Fiber

Wavefront shaping through a multi-core fiber (MCF) is turning into an attractive method for endoscopic imaging and optical cell-manipulation on a chip. However, the discrete distribution and the low number of cores induce pixelated phase modulation, becoming an obstacle for delivering complex light field distributions through MCFs. We demonstrate a novel phase retrieval algorithm named Core–Gerchberg–Saxton (Core-GS) employing the captured core distribution map to retrieve tailored modulation hologram for the targeted intensity distribution at the distal far-field. Complex light fields are reconstructed through MCFs with high fidelity up to 96.2%. Closed-loop control with experimental feedback denotes the capability of the Core-GS algorithm for precise intensity manipulation of the reconstructed light field. Core-GS provides a robust way for wavefront shaping through MCFs; it facilitates the MCF becoming a vital waveguide in endoscopic and lab-on-a-chip applications.

In situ measurement of the isoplanatic patch for imaging through intact bone

Wavefront-shaping (WS) enables imaging through scattering tissues like bone, which is important for neuroscience and bone-regeneration research. WS corrects for the optical aberrations at a given depth and field-of-view (FOV) within the sample; the extent of the validity of which is limited to a region known as the isoplanatic patch (IP). Knowing this parameter helps to estimate the number of corrections needed for WS imaging over a given FOV. In this paper, we first present direct transmissive measurement of murine skull IP using digital optical phase conjugation based focusing. Second, we extend our previously reported phase accumulation ray tracing (PART) method to provide in-situ in-silico estimation of IP, called correlative PART (cPART). Our results show an IP range of 1 to 3 μm for mice within an age range of 8 to 14 days old and 1.00 ± 0.25 μm in a 12-week old adult skull. Consistency between the two measurement approaches indicates that cPART can be used to approximate the IP before a WS experiment, which can be used to calculate the number of corrections required within a given field of view.

Medical Imaging of Microrobots: Toward In Vivo Applications

Medical microrobots (MRs) have been demonstrated for a variety of non-invasive biomedical applications, such as tissue engineering, drug delivery, and assisted fertilization, among others. However, most of these demonstrations have been carried out in in vitro settings and under optical microscopy, being significantly different from the clinical practice. Thus, medical imaging techniques are required for localizing and tracking such tiny therapeutic machines when used in medical-relevant applications. This review aims at analyzing the state of the art of microrobots imaging by critically discussing the potentialities and limitations of the techniques employed in this field. Moreover, the physics and the working principle behind each analyzed imaging strategy, the spatiotemporal resolution, and the penetration depth are thoroughly discussed. The paper deals with the suitability of each imaging technique for tracking single or swarms of MRs and discusses the scenarios where contrast or imaging agent's inclusion is required, either to absorb, emit, or reflect a determined physical signal detected by an external system. Finally, the review highlights the existing challenges and perspective solutions which could be promising for future in vivo applications.

Video-rate lensless endoscope with self-calibration using wavefront shaping

Lensless fiber endoscopes are of great importance for keyhole imaging. Coherent fiber bundles (CFB) can be used in endoscopes as remote phased arrays to capture images. One challenge is to image at high speed while correcting aberrations induced by the CFB. We propose the combination of digital optical phase conjugation, using a spatial light modulator, with fast scanning, for which a 2D galvo scanner and an adaptive lens are employed. We achieve the transmission of laser and image scanning through the CFB. Video-rate imaging at 20 Hz in 2D with subcellular resolution is demonstrated in 3D with 1 Hz. The sub-millimeter-diameter scanning endoscope has a great potential in biomedicine, for manipulation, e.g., in optogenetics, as well as in imaging.

Noise suppression for ballistic-photons based on compressive in-line holographic imaging through an inhomogeneous medium

Noise suppression is one of the most important tasks in imaging through inhomogeneous mediums. Here, we proposed a denoising approach based on compressive in-line holography for imaging through an inhomogeneous medium. A reference-beam-free system with a low-cost continuous-wave laser is presented. The suppression against the noise, which is brought by the scattering photons, is presented in simulations using the proposed algorithm. The noise immunity is demonstrated in lensless imaging behind a random phase mask with an optical depth of 1.42 by single exposure, as well as behind a ground glass with an optical depth of 6.38 by multiple exposures.

Physical Layer Security in Multimode Fiber Optical Networks

The light propagation through a multimode fiber is used to increase information security during data transmission without the need for cryptographic approaches. The use of an inverse precoding method in a multimode fiber-optic communication network is based on mode-dependent losses on the physical layer. This leads to an asymmetry between legitimate (Bob) and illegitimate (Eve) recipients of messages, resulting in significant SNR advantage for Bob. In combination with dynamic mode channel changes, there are defined hurdles for Eve to reconstruct a sent message even in a worst-case scenario in which she knows the channel completely. This is the first time that physical layer security has been investigated in a fiber optical network based on measured transmission matrices. The results show that messages can be sent securely using traditional communication techniques. The technology introduced is a step towards the development of cyber physical systems with increased security.

Impulsive stimulated Brillouin microscopy for non-contact, fast mechanical investigations of hydrogels

The mechanical properties of tissues and cells are increasingly recognized as an important feature for the understanding of pathological processes and as a diagnostic tool in biomedicine. Impulsive stimulated Brillouin scattering (ISBS) is promising to overcome shortcomings of other measurement methods such as invasiveness, low spatial resolution and long acquisition time. In this paper, we present for the first time ISBS measurements of hydrogels, which are model materials for biological samples. We demonstrate ISBS measurements discriminating hydrogels of different stiffness. ISBS measurements with lateral resolution close to cellular level are presented. These results underline that ISBS microscopy has a high potential for biomedical applications.

Holographic lensless fiber endoscope with needle size using self-calibration

Endoscopes enable optical keyhole access in many applications for instance in biomedicine. In general, coherent fiber bundles (CFB) are used in conjunction with rigid lens systems which determine a fixed image plane. However, the lens system limits the minimum diameter of the endoscope typically to several millimeters. Additionally, only pixelated two-dimensional amplitude patterns can be transferred due to phase scrambling between adjacent cores. These limitations can be overcome by digital optical elements. Thus, in principle thinner, lensless, holographic endoscopes with a three-dimensional adjustable focus for imaging and illumination can be realized. So far, several techniques based on single mode CFB and multi mode fibers (MMF) have been presented. However, these techniques require access to both sides of the fiber, in order to calibrate the bending and temperature sensitive phase distortion, which is not possible in a real application. We present the feasibility of an in-situ calibration and compensation of a CFB with single sided access. A lensless endoscope with a diameter of only 500 µm, a spatial resolution around 1 µm and video rate capability is realized.

Transmission Matrix Measurement of Multimode Optical Fibers by Mode-Selective Excitation Using One Spatial Light Modulator

Multimode fibers (MMF) are promising candidates to increase the data rate while reducing the space required for optical fiber networks. However, their use is hampered by mode mixing and other effects, leading to speckled output patterns. This can be overcome by measuring the transmission matrix (TM) of a multimode fiber. In this contribution, a mode-selective excitation of complex amplitudes is performed with only one phase-only spatial light modulator. The light field propagating through the fiber is measured holographically and is analyzed by a rapid decomposition method. This technique requires a small amount of measurements N, which corresponds to the degree of freedom of the fiber. The TM determines the amplitude and phase relationships of the modes, which allows us to understand the mode scrambling processes in the MMF and can be used for mode division multiplexing.

Optogenetic Stimulation of Human Neural Networks Using Fast Ferroelectric Spatial Light Modulator—Based Holographic Illumination

The generation and application of human stem-cell-derived functional neural circuits promises novel insights into neurodegenerative diseases. These networks are often studied using stem-cell derived random neural networks in vitro, with electrical stimulation and recording using multielectrode arrays. However, the impulse response function of networks is best obtained with spatiotemporally well-defined stimuli, which electrical stimulation does not provide. Optogenetics allows for the functional control of genetically altered cells with light stimuli at high spatiotemporal resolution. Current optogenetic investigations of neural networks are often conducted using full field illumination, potentially masking important functional information. This can be avoided using holographically shaped illumination. In this article, we present a digital holographic illumination setup with a spatial resolution of about 8 µm, which suffices for the stimulation of single neurons, and offers a temporal resolution of less than 0.6 ms. With this setup, we present preliminary single-cell stimulation recording of stem-cell derived induced human neurons in a random neural network. This will offer the opportunity for further studies on connectivity in such networks.

Self-calibration of lensless holographic endoscope using programmable guide stars

Coherent fiber bundle (CFB)-based endoscopes enable optical keyhole access in applications such as biophotonics. In conjunction with objective lenses, CFBs allow imaging of intensity patterns. In contrast, digital optical phase conjugation enables lensless holographic endoscopes for the generation of pixelation-free arbitrary light patterns. For real-world applications, however, this requires a non-invasive in situ calibration of the complex optical transfer function of the CFB with only single-sided access. We show that after an initial calibration in a forward direction, a differential phase measurement of the back-reflected light allows for tracking and compensating of bending-induced phase distortions. Furthermore, we present a novel in situ calibration procedure based on a programmable guide star, which requires access to only one side of the fiber.

Spiral phase mask shadow-imaging for 3D-measurement of flow fields

Particle tracking velocimetry (PTV) is a valuable tool for microfluidic analysis. Especially mixing processes and the environmental interaction of fluids on a microscopic scale are of particular importance for pharmaceutical and biomedical applications. However, currently applied techniques suffer from the lag of instantaneous depth information. Here we present a scan-free, shadow-imaging PTV-technique for 3D trajectory and velocity measurement of flow fields in micro-channels with 2 µm spatial resolution. By using an incoherent light source, one camera and a spatial light modulator (LCoS-SLM) that generates double-images of the seeding particle shadows, it is a simply applicable and highly scalable technique.