Angular-spectrum modeling of focusing light inside scattering media by optical phase conjugation

High-fidelity multi-channel optical information transmission through scattering media

High-fidelity optical information transmission through strongly scattering media is challenging, but is crucial for the applications such as the free-space optical communication in a haze or fog. Binarizing optical information can somehow suppress the disruptions caused by light scattering. However, this method gives a compromised communication throughput. Here, we propose high-fidelity multiplexing anti-scattering transmission (MAST). MAST encodes multiple bits into a complex-valued pattern, loads the complex-valued pattern to an optical field through modulation, and finally employs a scattering matrix-assisted retrieval technique to reconstruct the original information from the speckle patterns. In our demonstration, we multiplexed three channels and MAST achieved a high-fidelity transmission of 3072 (= 1024× 3) bits data per transmission and average transmission error as small as 0.06%.

Wavefront shaping improves the transparency of the scattering media: a review

Significance

Wavefront shaping (WFS) can compensate for distortions by optimizing the wavefront of the input light or reversing the transmission matrix of the media. It is a promising field of research. A thorough understanding of principles and developments of WFS is important for optical research.

Aim

To provide insight into WFS for researchers who deal with scattering in biomedicine, imaging, and optical communication, our study summarizes the basic principles and methods of WFS and reviews recent progress.

Approach

The basic principles, methods of WFS, and the latest applications of WFS in focusing, imaging, and multimode fiber (MMF) endoscopy are described. The practical challenges and prospects of future development are also discussed.

Results

Data-driven learning-based methods are opening up new possibilities for WFS. High-resolution imaging through MMFs can support small-diameter endoscopy in the future.

Conclusion

The rapid development of WFS over the past decade has shown that the best solution is not to avoid scattering but to find ways to correct it or even use it. WFS with faster speed, more optical modes, and more modulation degrees of freedom will continue to drive exciting developments in various fields.

Roadmap for phase change materials in photonics and beyond

Phase Change Materials (PCMs) have demonstrated tremendous potential as a platform for achieving diverse functionalities in active and reconfigurable micro-nanophotonic devices across the electromagnetic spectrum, ranging from terahertz to visible frequencies. This comprehensive roadmap reviews the material and device aspects of PCMs, and their diverse applications in active and reconfigurable micro-nanophotonic devices across the electromagnetic spectrum. It discusses various device configurations and optimization techniques, including deep learning-based metasurface design. The integration of PCMs with Photonic Integrated Circuits and advanced electric-driven PCMs are explored. PCMs hold great promise for multifunctional device development, including applications in non-volatile memory, optical data storage, photonics, energy harvesting, biomedical technology, neuromorphic computing, thermal management, and flexible electronics.

Extended angular-spectrum modeling (EASM) of light energy transport in scattering media

The exact modeling of light transport in scattering media is critical in biological imaging, free-space communication, and phosphor-converted lighting. Angular spectrum is proved to be a fast and effective approach to reconstructing the wavefront dynamics during the propagation in scattering media, however, finding it difficult in acquiring the wavefront and energy change simultaneously. Besides, conventional methods for energy tracing, such as the Monte Carlo method, are inefficient in speed and hard to simulate the wavefront change. Here, we propose an extended angular-spectrum modeling (EASM) approach using tenuous scattering approximate solutions to obtain a time-efficient and accurate method for reconstruction of energy and wavefront dynamics in various scattering media. The generality of our method is numerically simulated and experimentally verified with a set of scattering media with different properties. EASM has a time advantage under the guarantee of calculation accuracy, especially when calculating several thickness changes after the calculation model is established. Furthermore, multi-layered media can also be simulated by EASM with a good precision. The results suggest that EASM performs certain computations more efficiently than the conventional method and thus provides an effective and flexible calculation tool for scattering media.

Numerical simulation of phase-optimized light beams in two-dimensional scattering media

Manipulating the incident wavefront in biomedical applications to enhance the penetration depth and energy delivery in scattering media such as biological tissue has gained a lot of attention in recent years. However, focusing inside scattering media and examining the electromagnetic field inside the medium still is an elaborate task. This is where electromagnetic field simulations that model the wavefront shaping process can help us understand how the focal near field evolves at different depths. Here we use a two-step beam synthesis method to simulate the scattering of complex incident wavefronts by well-characterized media. The approach uses plane wave electromagnetic near-field solutions in combination with an angular spectrum approach to model different light beams. We apply this approach to various two-dimensional scattering media and investigate the focus intensity over depth while scanning with and without phase optimization. We find that the scanned non-optimized beams have two regions characterized by exponential decays. The absolute progression of the focus intensity over depth for phase-optimized beams using all channels can be described by solutions of the radiative transfer theory. Furthermore, the average enhancement factor over depth of the phase-optimized focus intensity compared to that without optimization is investigated for different numerical apertures and scattering media. Our results show that, albeit the incident beam is diffusively scattered, the theoretical enhancement for a large number of optimization channels cannot be reached due to correlations between the channels. An increase in focus depth and an increase in the numerical aperture reduces the difference between the expected theoretical and simulated enhancement factors.

Deep-learning based photon-efficient 3D and reflectivity imaging with a 64 × 64 single-photon avalanche detector array

A single photon avalanche diode (SPAD) is a high sensitivity detector that can work under weak echo signal conditions (≤1 photon per pixel). The measured digital signals can be used to invert the range and reflectivity images of the target with photon-efficient imaging reconstruction algorithm. However, the existing photon-efficient imaging reconstruction algorithms are susceptible to noise, which leads to poor quality of the reconstructed range and reflectivity images of target. In this paper, a non-local sparse attention encoder (NLSA-Encoder) neural network is proposed to extract the 3D information to reconstruct both the range and reflectivity images of target. The proposed network model can effectively reduce the influence of noise in feature extraction and maintain the capability of long-range correlation feature extraction. In addition, the network is optimized for reconstruction speed to achieve faster reconstruction without performance degradation, compared with other existing deep learning photon-efficient imaging reconstruction methods. The imaging performance is verified through numerical simulation, near-field indoor and far-field outdoor experiments with a 64 × 64 SPAD array. The experimental results show that the proposed network model can achieve better results in terms of the reconstruction quality of range and reflectivity images, as well as reconstruction speed.

Anti-scattering light focusing with full-polarization digital optical phase conjugation based on digital micromirror devices

The high resolution of optical imaging and optogenetic stimulation in the deep tissue requires focusing light against strong scattering with high contrast. Digital optical phase conjugation (DOPC) has emerged recently as a promising solution for this requirement, because of its short latency. A digital micromirror device (DMD) in the implementation of DOPC enables a large number of modulation modes and a high speed of modulation both of which are important when dealing with a highly dynamic scattering medium. Here, we propose full-polarization DOPC (fpDOPC) in which two DMDs simultaneously modulate the two orthogonally polarized components of the optical field, respectively, to mitigate the effect of depolarization caused by strong scattering. We designed a simple system to overcome the difficulty of alignment encountered when modulating two polarized components independently. Our simulation and experiment showed that fpDOPC could generate a high-contrast focal spot, even though the polarization of light had been highly randomized by scattering. In comparison with the conventional method of modulating the polarization along a particular direction, fpDOPC can improve the peak to background ratio of the focal spot by a factor of two. This new technique has good potential in applications such as high-contrast light focusing in vivo.

Physics-based neural network for non-invasive control of coherent light in scattering media

Optical imaging through complex media, such as biological tissues or fog, is challenging due to light scattering. In the multiple scattering regime, wavefront shaping provides an effective method to retrieve information; it relies on measuring how the propagation of different optical wavefronts are impacted by scattering. Based on this principle, several wavefront shaping techniques were successfully developed, but most of them are highly invasive and limited to proof-of-principle experiments. Here, we propose to use a neural network approach to non-invasively characterize and control light scattering inside the medium and also to retrieve information of hidden objects buried within it. Unlike most of the recently-proposed approaches, the architecture of our neural network with its layers, connected nodes and activation functions has a true physical meaning as it mimics the propagation of light in our optical system. It is trained with an experimentally-measured input/output dataset built from a series of incident light patterns and corresponding camera snapshots. We apply our physics-based neural network to a fluorescence microscope in epi-configuration and demonstrate its performance through numerical simulations and experiments. This flexible method can include physical priors and we show that it can be applied to other systems as, for example, non-linear or coherent contrast mechanisms.

Enhance the delivery of light energy ultra-deep into turbid medium by controlling multiple scattering photons to travel in open channels

Multiple light scattering is considered as the major limitation for deep imaging and focusing in turbid media. In this paper, we present an innovative method to overcome this limitation and enhance the delivery of light energy ultra-deep into turbid media with significant improvement in focusing. Our method is based on a wide-field reflection matrix optical coherence tomography (RM-OCT). The time-reversal decomposition of the RM is calibrated with the Tikhonov regularization parameter in order to get more accurate reversal results deep inside the scattering sample. We propose a concept named model energy matrix, which provides a direct mapping of light energy distribution inside the scattering sample. To the best of our knowledge, it is the first time that a method to measure and quantify the distribution of beam intensity inside a scattering sample is demonstrated. By employing the inversion of RM to find the matched wavefront and shaping with a phase-only spatial light modulator, we succeeded in both focusing a beam deep (~9.6 times of scattering mean free path, SMFP) inside the sample and increasing the delivery of light energy by an order of magnitude at an ultra-deep (~14.4 SMFP) position. This technique provides a powerful tool to understand the propagation of photon in a scattering medium and opens a new way to focus light inside biological tissues.

Focusing light into scattering media with ultrasound-induced field perturbation

Focusing light into scattering media, although challenging, is highly desirable in many realms. With the invention of time-reversed ultrasonically encoded (TRUE) optical focusing, acousto-optic modulation was demonstrated as a promising guidestar mechanism for achieving noninvasive and addressable optical focusing into scattering media. Here, we report a new ultrasound-assisted technique, ultrasound-induced field perturbation optical focusing, abbreviated as UFP. Unlike in conventional TRUE optical focusing, where only the weak frequency-shifted first-order diffracted photons due to acousto-optic modulation are useful, here UFP leverages the brighter zeroth-order photons diffracted by an ultrasonic guidestar as information carriers to guide optical focusing. We find that the zeroth-order diffracted photons, although not frequency-shifted, do have a field perturbation caused by the existence of the ultrasonic guidestar. By detecting and time-reversing the differential field of the frequency-unshifted photons when the ultrasound is alternately ON and OFF, we can focus light to the position where the field perturbation occurs inside the scattering medium. We demonstrate here that UFP optical focusing has superior performance to conventional TRUE optical focusing, which benefits from the more intense zeroth-order photons. We further show that UFP optical focusing can be easily and flexibly developed into double-shot realization or even single-shot realization, which is desirable for high-speed wavefront shaping. This new method upsets conventional thinking on the utility of an ultrasonic guidestar and broadens the horizon of light control in scattering media. We hope that it provides a more efficient and flexible mechanism for implementing ultrasound-guided wavefront shaping.

High-fidelity spatial mode transmission through a 1-km-long multimode fiber via vectorial time reversal

The large number of spatial modes supported by standard multimode fibers is a promising platform for boosting the channel capacity of quantum and classical communications by orders of magnitude. However, the practical use of long multimode fibers is severely hampered by modal crosstalk and polarization mixing. To overcome these challenges, we develop and experimentally demonstrate a vectorial time reversal technique, which is accomplished by digitally pre-shaping the wavefront and polarization of the forward-propagating signal beam to be the phase conjugate of an auxiliary, backward-propagating probe beam. Here, we report an average modal fidelity above 80% for 210 Laguerre-Gauss and Hermite-Gauss modes by using vectorial time reversal over an unstabilized 1-km-long fiber. We also propose a practical and scalable spatial-mode-multiplexed quantum communication protocol over long multimode fibers to illustrate potential applications that can be enabled by our technique.

The use of long multimode fibers for multiplexed quantum communication is hindered by modal crosstalk and polarisation mixing. Here, the authors use an auxiliary laser beam sent backwards from Bob to Alice, allowing her to pre-compensate for the spatial distortions and polarisation scrambling.

Dynamic multimodal holograms of conjugated organogels via dithering mask lithography

Polymeric materials have been used to realize optical systems that, through periodic variations of their structural or optical properties, interact with light-generating holographic signals. Complex holographic systems can also be dynamically controlled through exposure to external stimuli, yet they usually contain only a single type of holographic mode. Here, we report a conjugated organogel that reversibly displays three modes of holograms in a single architecture. Using dithering mask lithography, we realized two-dimensional patterns with varying cross-linking densities on a conjugated polydiacetylene. In protic solvents, the organogel contracts anisotropically to develop optical and structural heterogeneities along the third dimension, displaying holograms in the form of three-dimensional full parallax signals, both in fluorescence and bright-field microscopy imaging. In aprotic solvents, these heterogeneities diminish as organogels expand, recovering the two-dimensional periodicity to display a third hologram mode based on iridescent structural colours. Our study presents a next-generation hologram manufacturing method for multilevel encryption technologies.

Ultra-thin boundary layer for high-accuracy simulations of light propagation

The modified Born series method is currently one of the most efficient methods available for simulating light scattering in large inhomogeneous media. However, to achieve high accuracy, the method requires thick gradually absorbing layers around the simulation domain. Here, we introduce new boundary conditions, combining a padding-free acyclic convolution with an ultra-thin boundary layer. Our new boundary conditions minimize the wrap-around and reflection artefacts originating from the edges of the simulation domain, while also greatly reducing the computational costs and the memory requirements of the method. Our GPU-accelerated Matlab implementation is available on GitHub.

Single-shot time-reversed optical focusing into and through scattering media

Optical time reversal can focus light through or into scattering media, which raises a new possibility for conquering optical diffusion. Because optical time reversal must be completed within the correlation time of speckles, enhancing the speed of time-reversed optical focusing is important for practical applications. Although employing faster digital devices for time-reversal helps, more efficient methodologies are also desired. Here, we report a single-shot time-reversed optical focusing method to minimize the wavefront measurement time. In our approach, all information requisite for optical time reversal is extracted from a single-shot hologram, and hence no other preconditions or measurements are required. In particular, we demonstrate the first realization of single-shot time-reversed ultrasonically encoded (TRUE) optical focusing into scattering media. By using the minimum amount of measurement, this work breaks the fundamental speed limit of digitally based time reversal for focusing into and through scattering media, and constitutes an important step toward high-speed wavefront shaping applications.

Fighting against fast speckle decorrelation for light focusing inside live tissue by photon frequency shifting

Focusing light inside live tissue by digital optical phase conjugation (DOPC) has been intensively investigated due to its potential biomedical applications in deep-tissue imaging, optogenetics, microsurgery, and phototherapy. However, fast physiological motions in a live animal, such as blood flow and respiratory motions, produce undesired photon perturbation and thus inevitably deteriorate the performance of light focusing. Here, we develop a photon-frequency-shifting DOPC method to fight against fast physiological motions by switching the states of a guide star at a distinctive frequency. Therefore, the photons tagged by the guide star are well detected at the specific frequency, separating them from the photons perturbed by fast motions. Light focusing was demonstrated in both phantoms in vitro and mice in vivo with substantially improved focusing contrast. This work puts a new perspective on light focusing inside live tissue and promises wide biomedical applications.

Structured light beams created through a multimode fiber via virtual Fourier filtering based on digital optical phase conjugation

Digital optical phase conjugation (DOPC) is a newly developed technique in wavefront shaping to control light propagation through complex media. Currently, DOPC has been demonstrated for the reconstruction of two- and three-dimensional targets and enabled important applications in many areas. Nevertheless, the reconstruction results are only phase conjugated to the original input targets. Herein, we demonstrate that DOPC could be further developed for creating structured light beams through a multimode fiber (MMF). By applying annular filtering in the virtual Fourier domain of the acquired speckle field, we realize the creation of the quasi-Bessel and donut beams through the MMF. In principle, arbitrary amplitude and/or phase circular symmetry filtering could be performed in the Fourier domain, thus generating the corresponding point spread functions. We expect that the reported technique can be useful for super-resolution endoscopic imaging and optical manipulation through MMFs.

Intelligently optimized digital optical phase conjugation with particle swarm optimization

Wavefront shaping (WFS) based on digital optical phase conjugation (DOPC) has gained major interest in focusing light through or inside scattering media. However, the quality of DOPC is greatly limited by imperfections of the system in a complicated and coupled way. In this Letter, we incorporate the concept of global optimization to solve this problem comprehensively for the first time, to the best of our knowledge. An automatic and intelligent optimization framework for DOPC techniques is proposed, leveraging the global optimization ability of particle swarm optimization (PSO). We demonstrate the general and powerful ability of the proposed approach in a series of DOPC-related experiments for focusing through and inside scattering media. This novel work can improve the OPC quality greatly and simplify the development of a high-performance DOPC system, which may open up a new avenue for the general scientific community to benefit from DOPC-based WFS in their potential applications.

Fast 3D movement of a laser focusing spot behind scattering media by utilizing optical memory effect and optical conjugate planes

Controlling light propagation intentionally through turbid media such as ground glass or biological tissue has been demonstrated for many useful applications. Due to random scattering effect, one of the important goals is to draw a desired shape behind turbid media with a swift and precise method. Feedback wavefront shaping method which is known as a very effective approach to focus the light, is restricted by slow optimization process for obtaining multiple spots. Here we propose a technique to implement feedback wavefront shaping with optical memory effect and optical 4f system to speedy move focus spot and form shapes in 3D space behind scattering media. Starting with only one optimization process to achieve a focusing spot, the advantages of the optical configuration and full digital control allow us to move the focus spot with high quality at the speed of SLM frame rate. Multiple focusing spots can be achieved simultaneously by combining multiple phase patterns on a single SLM. By inheriting the phase patterns in the initial focusing process, we can enhance the intensity of the focusing spot at the edge of memory effect in with 50% reduction in optimization time. With a new focusing spot, we have two partially overlapped memory effect regions, expanding our 3D scanning range. With fast wavefront shaping devices, our proposed technique could potentially find appealing applications with biological tissues.

Theoretical Study on Pressure Damage Based on Clinical Purpura during the Laser Irradiation of Port Wine Stains with Real Complex Vessels

Port wine stains (PWSs) are congenital dermal vascular lesions composed of a hyperdilated vasculature. Purpura represented by local hemorrhage from water vaporization in blood during laser therapy of PWS is typically considered a clinical feedback, but with a low cure rate. In this study, light propagation and heat deposition in skin and PWSs is simulated by a tetrahedron-based Monte Carlo method fitted to curved bio-tissues. A curvature-corrected pressure damage model was established to accurately evaluate the relationship between purpura-bleeding area (rate) and laser therapy strategy for real complex vessels. Results showed that the standard deviation of Gaussian curvature of the vessel wall has negative relation with the fluence threshold of vessel rupture, but has positive relation with the effective laser fluence of vessel damage. This finding indicated the probable reason for the poor treatment of PWS, that is, considering purpura formation as a treatment end point (TEP) only leads to partial removal of vascular lesions. Instead, appropriate purpura area ratio with marked effects or rehabilitation should be adopted as TEP. The quantitative correlation between the fluence of a pulsed dye laser and the characteristics of vascular lesions can provide personalized and precise guidance for clinical treatments.

Focusing light inside live tissue using reversibly switchable bacterial phytochrome as a genetically encoded photochromic guide star

Focusing light deep by engineering wavefronts toward guide stars inside scattering media has potential biomedical applications in imaging, manipulation, stimulation, and therapy. However, the lack of endogenous guide stars in biological tissue hinders its translations to in vivo applications. Here, we use a reversibly switchable bacterial phytochrome protein as a genetically encoded photochromic guide star (GePGS) in living tissue to tag photons at targeted locations, achieving light focusing inside the tissue by wavefront shaping. As bacterial phytochrome-based GePGS absorbs light differently upon far-red and near-infrared illumination, a large dynamic absorption contrast can be created to tag photons inside tissue. By modulating the GePGS at a distinctive frequency, we suppressed the competition between GePGS and tissue motions and formed tight foci inside mouse tumors in vivo and acute mouse brain tissue, thus improving light delivery efficiency and specificity. Spectral multiplexing of GePGS proteins with different colors is an attractive possibility.

Histopathology Feature Mining and Association with Hyperspectral Imaging for the Detection of Squamous Neoplasia

Hyperspectral imaging (HSI) is a noninvasive optical modality that holds promise for early detection of tongue lesions. Spectral signatures generated by HSI contain important diagnostic information that can be used to predict the disease status of the examined biological tissue. However, the underlying pathophysiology for the spectral difference between normal and neoplastic tissue is not well understood. Here, we propose to leverage digital pathology and predictive modeling to select the most discriminative features from digitized histological images to differentiate tongue neoplasia from normal tissue, and then correlate these discriminative pathological features with corresponding spectral signatures of the neoplasia. We demonstrated the association between the histological features quantifying the architectural features of neoplasia on a microscopic scale, with the spectral signature of the corresponding tissue measured by HSI on a macroscopic level. This study may provide insight into the pathophysiology underlying the hyperspectral dataset.

Development of a beam propagation method to simulate the point spread function degradation in scattering media

Scattering is one of the main issues that limit the imaging depth in deep tissue optical imaging. To characterize the role of scattering, we have developed a forward model based on the beam propagation method and established the link between the macroscopic optical properties of the media and the statistical parameters of the phase masks applied to the wavefront. Using this model, we have analyzed the degradation of the point-spread function of the illumination beam in the transition regime from ballistic to diffusive light transport. Our method provides a wave-optic simulation toolkit to analyze the effects of scattering on image quality degradation in scanning microscopy. Our open-source implementation is available at https://github.com/BUNPC/Beam-Propagation-Method.