Guidestar-free image-guided wavefront shaping

Ptychographic lensless coherent endomicroscopy through a flexible fiber bundle

Conventional fiber-bundle-based endoscopes allow minimally invasive imaging through flexible multi-core fiber (MCF) bundles by placing a miniature lens at the distal tip and using each core as an imaging pixel. In recent years, lensless imaging through MCFs was made possible by correcting the core-to-core phase distortions pre-measured in a calibration procedure. However, temporally varying wavefront distortions, for instance, due to dynamic fiber bending, pose a challenge for such approaches. Here, we demonstrate a coherent lensless imaging technique based on intensity-only measurements insensitive to core-to-core phase distortions. We leverage a ptychographic reconstruction algorithm to retrieve the phase and amplitude profiles of reflective objects placed at a distance from the fiber tip, using as input a set of diffracted intensity patterns reflected from the object when the illumination is scanned over the MCF cores. Our approach thus utilizes an acquisition process equivalent to confocal microendoscopy, only replacing the single detector with a camera.

Experimental demonstration of scene-based cophasing in optical synthetic aperture imaging using the SPGD algorithm

Large-aperture telescopes based on optical synthetic aperture imaging are investigated for recent high-resolution spaceborne observations. An enabling technique of aperture synthesis is a cophasing method to suppress a piston-tip-tilt error between sub-apertures. This paper proposes a scene-based cophasing technique using the stochastic parallel gradient descent (SPGD) algorithm, assuming application to high-resolution Earth observation. A significant advantage of the SPGD algorithm is a model-less cophasing capability based on extended scenes, but the simultaneous scene-based piston-tip-tilt correction between multiple apertures has not been demonstrated. In this paper, we developed a tabletop synthetic aperture imaging system with 37 sub-apertures and demonstrated extended-scene-based piston-tip-tilt control by optimizing applied voltages to 111 actuators simultaneously. The demonstration experiments used not only static scenes but also a time-varying dynamic scene for observation targets. In every measurement, the proposed scene-based approach reduced the initially defined piston-tip-tilt errors, and the image sharpness significantly improved, although the correction rate in the dynamic scene observation was slower. Finally, this paper discusses the influence of scene dynamics on image-based cophasing.

Noninvasive holographic imaging through dynamically scattering media

We present a noninvasive method for quantitative phase imaging through dynamically scattering media. A complex amplitude object, illuminated with coherent light, is captured through a dynamically scattering medium and a variable coded aperture, without the need for interferometric measurements or imaging optics. The complex amplitude of the object is computationally retrieved from intensity images that use multiple coded aperture patterns, employing a stochastic gradient descent algorithm. We demonstrate the proposed method both numerically and experimentally.

Adaptive optical imaging with entangled photons

Adaptive optics (AO) has revolutionized imaging in fields from astronomy to microscopy by correcting optical aberrations. In label-free microscopes, however, conventional AO faces limitations because of the absence of a guide star and the need to select an optimization metric specific to the sample and imaging process. Here, we propose an AO approach leveraging correlations between entangled photons to directly correct the point spread function. This guide star-free method is independent of the specimen and imaging modality. We demonstrate the imaging of biological samples in the presence of aberrations using a bright-field imaging setup operating with a source of spatially entangled photon pairs. Our approach performs better than conventional AO in correcting specific aberrations, particularly those involving substantial defocus. Our work improves AO for label-free microscopy and could play a major role in the development of quantum microscopes.

Performance enhancement in wavefront shaping of multiply scattered light: a review

Significance

In nonballistic regime, optical scattering impedes high-resolution imaging through/inside complex media, such as milky liquid, fog, multimode fiber, and biological tissues, where confocal and multiphoton modalities fail. The significant tissue inhomogeneity-induced distortions need to be overcome and a technique referred as optical wavefront shaping (WFS), first proposed in 2007, has been becoming a promising solution, allowing for flexible and powerful light control. Understanding the principle and development of WFS may inspire exciting innovations for effective optical manipulation, imaging, stimulation, and therapy at depths in tissue or tissue-like complex media.

Aim

We aim to provide insights about what limits the WFS towards biomedical applications, and how recent efforts advance the performance of WFS among different trade-offs.

Approach

By differentiating the two implementation directions in the field, i.e., precompensation WFS and optical phase conjugation (OPC), improvement strategies are summarized and discussed.

Results

For biomedical applications, improving the speed of WFS is most essential in both directions, and a system-compatible wavefront modulator driven by fast apparatus is desired. In addition to that, algorithm efficiency and adaptability to perturbations/noise is of concern in precompensation WFS, while for OPC significant improvements rely heavily on integrating physical mechanisms and delicate system design for faster response and higher energy gain.

Conclusions

Substantial improvements in WFS implementations, from the aspects of physics, engineering, and computing, have inspired many novel and exciting optical applications that used to be optically inaccessible. It is envisioned that continuous efforts in the field can further advance WFS towards biomedical applications and guide our vision into deep biological tissues.

Wavefront shaping improves the transparency of the scattering media: a review

Significance

Wavefront shaping (WFS) can compensate for distortions by optimizing the wavefront of the input light or reversing the transmission matrix of the media. It is a promising field of research. A thorough understanding of principles and developments of WFS is important for optical research.

Aim

To provide insight into WFS for researchers who deal with scattering in biomedicine, imaging, and optical communication, our study summarizes the basic principles and methods of WFS and reviews recent progress.

Approach

The basic principles, methods of WFS, and the latest applications of WFS in focusing, imaging, and multimode fiber (MMF) endoscopy are described. The practical challenges and prospects of future development are also discussed.

Results

Data-driven learning-based methods are opening up new possibilities for WFS. High-resolution imaging through MMFs can support small-diameter endoscopy in the future.

Conclusion

The rapid development of WFS over the past decade has shown that the best solution is not to avoid scattering but to find ways to correct it or even use it. WFS with faster speed, more optical modes, and more modulation degrees of freedom will continue to drive exciting developments in various fields.

NeuWS: Neural wavefront shaping for guidestar-free imaging through static and dynamic scattering media

Diffraction-limited optical imaging through scattering media has the potential to transform many applications such as airborne and space-based imaging (through the atmosphere), bioimaging (through skin and human tissue), and fiber-based imaging (through fiber bundles). Existing wavefront shaping methods can image through scattering media and other obscurants by optically correcting wavefront aberrations using high-resolution spatial light modulators-but these methods generally require (i) guidestars, (ii) controlled illumination, (iii) point scanning, and/or (iv) statics scenes and aberrations. We propose neural wavefront shaping (NeuWS), a scanning-free wavefront shaping technique that integrates maximum likelihood estimation, measurement modulation, and neural signal representations to reconstruct diffraction-limited images through strong static and dynamic scattering media without guidestars, sparse targets, controlled illumination, nor specialized image sensors. We experimentally demonstrate guidestar-free, wide field-of-view, high-resolution, diffraction-limited imaging of extended, nonsparse, and static/dynamic scenes captured through static/dynamic aberrations.

Speckle-correlation imaging through a kaleidoscopic multimode fiber

Speckle-correlation imaging techniques are widely used for noninvasive imaging through complex scattering media. While light propagation through multimode fibers and scattering media share many analogies, reconstructing images through multimode fibers from speckle correlations remains an unsolved challenge. Here, we exploit a kaleidoscopic memory effect emerging in square-core multimode fibers and demonstrate fluorescence imaging with no prior knowledge on the fiber. Experimentally, our approach simply requires to translate random speckle patterns at the input of a square-core fiber and to measure the resulting fluorescence intensity with a bucket detector. The image of the fluorescent object is then reconstructed from the autocorrelation of the measured signal by solving an inverse problem. This strategy does not require the knowledge of the fragile deterministic relation between input and output fields, which makes it promising for the development of flexible minimally invasive endoscopes.

Single photon single pixel imaging into thick scattering medium

Imaging into thick scattering medium is a long-standing challenge. Beyond the quasi-ballistic regime, multiple scattering scrambles the spatiotemporal information of incident/emitted light, making canonical imaging based on light focusing nearly impossible. Diffusion optical tomography (DOT) is one of the most popular approach to look inside scattering medium, but quantitatively inverting the diffusion equation is ill-posed, and prior information of the medium is typically necessary, which is nontrivial to obtain. Here, we show theoretically and experimentally that, by synergizing the one-way light scattering characteristic of single pixel imaging with ultrasensitive single photon detection and a metric-guided image reconstruction, single photon single pixel imaging can serve as a simple and powerful alternative to DOT for imaging into thick scattering medium without prior knowledge or inverting the diffusion equation. We demonstrated an image resolution of 12 mm inside a 60 mm thick (∼ 78 mean free paths) scattering medium.

Multi-target object scattering imaging with intensity correlation of structured illumination

Imaging through scattering layers based on the optical memory effect (OME) concept has been widely investigated in recent years. Among many scattering scenarios, it is very important to recover hidden targets with proper spatial distribution in the scene where multiple targets out of the OME range exist. In this Letter, we put forward a method for multi-target object scattering imaging. With the help of intensity correlation between the structured illumination patterns and recorded speckle images, the relative position of all hidden targets can be obtained and the movement of the targets within the OME range can be tracked. We experimentally implement scattering imaging with 16 targets and the motion tracking of them. Our results present a significant advance in a large field of view scattering imaging with multiple targets.

Optical memory effect of excised cataractous human crystalline lenses

Cataracts increase the amount of scattered light in the crystalline lens producing low-contrast retinal images and causing vision impairment. The Optical Memory Effect is a wave correlation of coherent fields, which can enable imaging through scattering media. In this work, we characterize the scattering properties of excised human crystalline lenses by measuring their optical memory effect and other objective scattering parameters, finding the relationship between them. This work has the potential to help fundus imaging techniques through cataracts as well as the non-invasive correction of vision through cataracts.

Learned end-to-end high-resolution lensless fiber imaging towards real-time cancer diagnosis

Recent advances in label-free histology promise a new era for real-time diagnosis in neurosurgery. Deep learning using autofluorescence is promising for tumor classification without histochemical staining process. The high image resolution and minimally invasive diagnostics with negligible tissue damage is of great importance. The state of the art is raster scanning endoscopes, but the distal lens optics limits the size. Lensless fiber bundle endoscopy offers both small diameters of a few 100 microns and the suitability as single-use probes, which is beneficial in sterilization. The problem is the inherent honeycomb artifacts of coherent fiber bundles (CFB). For the first time, we demonstrate an end-to-end lensless fiber imaging with exploiting the near-field. The framework includes resolution enhancement and classification networks that use single-shot CFB images to provide both high-resolution imaging and tumor diagnosis. The well-trained resolution enhancement network not only recovers high-resolution features beyond the physical limitations of CFB, but also helps improving tumor recognition rate. Especially for glioblastoma, the resolution enhancement network helps increasing the classification accuracy from 90.8 to 95.6%. The novel technique enables histological real-time imaging with lensless fiber endoscopy and is promising for a quick and minimally invasive intraoperative treatment and cancer diagnosis in neurosurgery.

Deviation-based wavefront correction using the SPGD algorithm for high-resolution optical remote sensing

Model-free image-based wavefront correction techniques, such as the stochastic parallel gradient descent (SPGD) algorithm, will be useful in achieving diffraction-limited optical performance in near-future optical remote sensing systems. One difficulty facing the image-based method is that the correction performance depends on the evaluation metric and the evaluated scene. We propose several evaluation functions and investigate the relationship between the optimization speed and the scene textures for each metric in the SPGD algorithm. Based on the simulation results, the study experimentally compared wavefront correction performance using four cost functions and two extended aerial images. Consequently, we found that the deviation-based cost function allowed efficient wavefront correction for versatile extended scenes. In addition, observing extended scenes with distinct structures can facilitate correction speed. Furthermore, we numerically validated this approach in a segmented-aperture imaging system for large telescopes. We believe that the presented approach allows us to realize spaceborne remote sensing with unprecedented high angular resolution.

Wavefront shaping: A versatile tool to conquer multiple scattering in multidisciplinary fields

Optical techniques offer a wide variety of applications as light-matter interactions provide extremely sensitive mechanisms to probe or treat target media. Most of these implementations rely on the usage of ballistic or quasi-ballistic photons to achieve high spatial resolution. However, the inherent scattering nature of light in biological tissues or tissue-like scattering media constitutes a critical obstacle that has restricted the penetration depth of non-scattered photons and hence limited the implementation of most optical techniques for wider applications. In addition, the components of an optical system are usually designed and manufactured for a fixed function or performance. Recent advances in wavefront shaping have demonstrated that scattering- or component-induced phase distortions can be compensated by optimizing the wavefront of the input light pattern through iteration or by conjugating the transmission matrix of the scattering medium. This offers unprecedented opportunities in many applications to achieve controllable optical delivery or detection at depths or dynamically configurable functionalities by using scattering media to substitute conventional optical components. In this article, the recent progress of wavefront shaping in multidisciplinary fields is reviewed, from optical focusing and imaging with scattering media, functionalized devices, modulation of mode coupling, and nonlinearity in multimode fiber to multimode fiber-based applications. Apart from insights into the underlying principles and recent advances in wavefront shaping implementations, practical limitations and roadmap for future development are discussed in depth. Looking back and looking forward, it is believed that wavefront shaping holds a bright future that will open new avenues for noninvasive or minimally invasive optical interactions and arbitrary control inside deep tissues. The high degree of freedom with multiple scattering will also provide unprecedented opportunities to develop novel optical devices based on a single scattering medium (generic or customized) that can outperform traditional optical components.

Incoherent optical phase conjugation

Optical phase conjugation is a known technique for optically reproducing an object behind a scattering medium. Here we present digital optical phase conjugation through scattering media with spatially and temporally incoherent light. This enables us to eliminate the inevitable light coherence and the need for interferometric measurement for optical phase conjugation. Moreover, we show a method for suppressing background noise, which is critical in incoherent optical phase conjugation. We numerically and experimentally demonstrate the proposed method with background suppression.

Calibration-free speckle matrix imaging

Unknown speckle patterns can be used to image targets embedded in complex scattering media 100 times faster than previous techniques based on carefully calibrated illuminations.

Beam Formation and Vernier Steering Off of a Rough Surface

Wavefront shaping can refocus light after it reflects from an optically rough surface. One proposed use case of this effect is in indirect imaging; if any rough surface could be turned into an illumination source, objects out of the direct line of sight could be illuminated. In this paper, we demonstrate the superior performance of a genetic algorithm compared to other iterative feedback-based wavefront shaping algorithms in achieving reflective inverse diffusion for a focal plane system. Next, the ability to control the pointing direction of the refocused beam with high precision over a narrow angular range is demonstrated, though the challenge of increasing the overall scanning range of the refocused beam remains. The method of beam steering demonstrated in this paper could act as a vernier adjustment to a coarse adjustment offered by another method.