1
|
Peard N, Ayyer K, Chapman HN. Ab initio spatial phase retrieval via intensity triple correlations. OPTICS EXPRESS 2023; 31:25082-25092. [PMID: 37475321 DOI: 10.1364/oe.495920] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/22/2023] [Accepted: 07/01/2023] [Indexed: 07/22/2023]
Abstract
Second-order intensity correlations from incoherent emitters can reveal the Fourier transform modulus of their spatial distribution, but retrieving the phase to enable completely general Fourier inversion to real space remains challenging. Phase retrieval via the third-order intensity correlations has relied on special emitter configurations which simplified an unaddressed sign problem in the computation. Without a complete treatment of this sign problem, the general case of retrieving the Fourier phase from a truly arbitrary configuration of emitters is not possible. In this paper, a general method for ab initio phase retrieval via the intensity triple correlations is described. Simulations demonstrate accurate phase retrieval for clusters of incoherent emitters which could be applied to imaging stars or fluorescent atoms and molecules. With this work, it is now finally tractable to perform Fourier inversion directly and reconstruct images of arbitrary arrays of independent emitters via far-field intensity correlations alone.
Collapse
|
2
|
Feng BY, Guo H, Xie M, Boominathan V, Sharma MK, Veeraraghavan A, Metzler CA. NeuWS: Neural wavefront shaping for guidestar-free imaging through static and dynamic scattering media. SCIENCE ADVANCES 2023; 9:eadg4671. [PMID: 37379386 DOI: 10.1126/sciadv.adg4671] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/28/2022] [Accepted: 05/23/2023] [Indexed: 06/30/2023]
Abstract
Diffraction-limited optical imaging through scattering media has the potential to transform many applications such as airborne and space-based imaging (through the atmosphere), bioimaging (through skin and human tissue), and fiber-based imaging (through fiber bundles). Existing wavefront shaping methods can image through scattering media and other obscurants by optically correcting wavefront aberrations using high-resolution spatial light modulators-but these methods generally require (i) guidestars, (ii) controlled illumination, (iii) point scanning, and/or (iv) statics scenes and aberrations. We propose neural wavefront shaping (NeuWS), a scanning-free wavefront shaping technique that integrates maximum likelihood estimation, measurement modulation, and neural signal representations to reconstruct diffraction-limited images through strong static and dynamic scattering media without guidestars, sparse targets, controlled illumination, nor specialized image sensors. We experimentally demonstrate guidestar-free, wide field-of-view, high-resolution, diffraction-limited imaging of extended, nonsparse, and static/dynamic scenes captured through static/dynamic aberrations.
Collapse
Affiliation(s)
- Brandon Y Feng
- Department of Computer Science, The University of Maryland, College Park, College Park, MD 20742, USA
| | - Haiyun Guo
- Department of Electrical and Computer Engineering, Rice University, Houston, TX 77005, USA
| | - Mingyang Xie
- Department of Computer Science, The University of Maryland, College Park, College Park, MD 20742, USA
| | - Vivek Boominathan
- Department of Electrical and Computer Engineering, Rice University, Houston, TX 77005, USA
| | - Manoj K Sharma
- Department of Electrical and Computer Engineering, Rice University, Houston, TX 77005, USA
| | - Ashok Veeraraghavan
- Department of Electrical and Computer Engineering, Rice University, Houston, TX 77005, USA
| | - Christopher A Metzler
- Department of Computer Science, The University of Maryland, College Park, College Park, MD 20742, USA
| |
Collapse
|
3
|
Zhang J, Jing Z, Zhao S, Wang X, Ma G, Wang Y, Zhao Y, Liu R, Li F. Multi-target object scattering imaging with intensity correlation of structured illumination. OPTICS LETTERS 2023; 48:1486-1489. [PMID: 36946959 DOI: 10.1364/ol.483308] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/14/2022] [Accepted: 02/10/2023] [Indexed: 06/18/2023]
Abstract
Imaging through scattering layers based on the optical memory effect (OME) concept has been widely investigated in recent years. Among many scattering scenarios, it is very important to recover hidden targets with proper spatial distribution in the scene where multiple targets out of the OME range exist. In this Letter, we put forward a method for multi-target object scattering imaging. With the help of intensity correlation between the structured illumination patterns and recorded speckle images, the relative position of all hidden targets can be obtained and the movement of the targets within the OME range can be tracked. We experimentally implement scattering imaging with 16 targets and the motion tracking of them. Our results present a significant advance in a large field of view scattering imaging with multiple targets.
Collapse
|
4
|
Scoring-Based Genetic Algorithm for Wavefront Shaping to Optimize Multiple Objectives. J Imaging 2023; 9:jimaging9020049. [PMID: 36826968 PMCID: PMC9963249 DOI: 10.3390/jimaging9020049] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2022] [Revised: 02/13/2023] [Accepted: 02/15/2023] [Indexed: 02/22/2023] Open
Abstract
We present a scoring-based genetic algorithm (SBGA) for wavefront shaping to optimize multiple objectives at a time. The algorithm is able to find one feasible solution despite having to optimize multiple objectives. We employ the algorithm to generate multiple focus points simultaneously and allocate their intensities as desired. We then introduce a third objective to confine light focusing only to desired targets and prevent irradiation in neighboring regions. Through simulations and experiments, we demonstrate the algorithm's ease of implementation and flexibility to control the search direction. This algorithm can potentially be applied to improve biomedical imaging, optogenetics, and optical trapping.
Collapse
|
5
|
Abstract
Remitted waves are used for sensing and imaging in diverse diffusive media from the Earth's crust to the human brain. Separating the source and detector increases the penetration depth of light, but the signal strength decreases rapidly, leading to a poor signal-to-noise ratio. Here, we show, experimentally and numerically, that wavefront shaping a laser beam incident on a diffusive sample enables an enhancement of remission by an order of magnitude at depths of up to 10 transport mean free paths. We develop a theoretical model which predicts the maximal remission enhancement. Our analysis reveals a significant improvement in the sensitivity of remitted waves to local changes of absorption deep inside diffusive media. This work illustrates the potential of coherent wavefront control for noninvasive diffuse wave imaging applications, such as diffuse optical tomography and functional near-infrared spectroscopy.
Collapse
|
6
|
Jauregui-Sánchez Y, Penketh H, Bertolotti J. Tracking moving objects through scattering media via speckle correlations. Nat Commun 2022; 13:5779. [PMID: 36182942 PMCID: PMC9526741 DOI: 10.1038/s41467-022-33470-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2022] [Accepted: 09/16/2022] [Indexed: 11/23/2022] Open
Abstract
Scattering can rapidly degrade our ability to form an optical image, to the point where only speckle-like patterns can be measured. Truly non-invasive imaging through a strongly scattering obstacle is difficult, and usually reliant on a computationally intensive numerical reconstruction. In this work we show that, by combining the cross-correlations of the measured speckle pattern at different times, it is possible to track a moving object with minimal computational effort and over a large field of view. Imaging though strongly scattering media is challenging and computationally intensive. Here, the authors show that tracking of moving objects can be achieved with minimal computational effort by combining cross-correlations of the measured speckle pattern at different times.
Collapse
Affiliation(s)
- Y Jauregui-Sánchez
- Physics and Astronomy Department, University of Exeter, Stocker Road, Exeter, EX4 4QL, UK.
| | - H Penketh
- Physics and Astronomy Department, University of Exeter, Stocker Road, Exeter, EX4 4QL, UK
| | - J Bertolotti
- Physics and Astronomy Department, University of Exeter, Stocker Road, Exeter, EX4 4QL, UK
| |
Collapse
|
7
|
Yang J, He Q, Liu L, Qu Y, Shao R, Song B, Zhao Y. Anti-scattering light focusing by fast wavefront shaping based on multi-pixel encoded digital-micromirror device. LIGHT, SCIENCE & APPLICATIONS 2021; 10:149. [PMID: 34285183 PMCID: PMC8292544 DOI: 10.1038/s41377-021-00591-w] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/03/2021] [Revised: 06/18/2021] [Accepted: 07/04/2021] [Indexed: 05/05/2023]
Abstract
Speed and enhancement are the two most important metrics for anti-scattering light focusing by wavefront shaping (WS), which requires a spatial light modulator with a large number of modulation modes and a fast speed of response. Among the commercial modulators, the digital-micromirror device (DMD) is the sole solution providing millions of modulation modes and a pattern rate higher than 20 kHz. Thus, it has the potential to accelerate the process of anti-scattering light focusing with a high enhancement. Nevertheless, modulating light in a binary mode by the DMD restricts both the speed and enhancement seriously. Here, we propose a multi-pixel encoded DMD-based WS method by combining multiple micromirrors into a single modulation unit to overcome the drawbacks of binary modulation. In addition, to efficiently optimize the wavefront, we adopted separable natural evolution strategies (SNES), which could carry out a global search against a noisy environment. Compared with the state-of-the-art DMD-based WS method, the proposed method increased the speed of optimization and enhancement of focus by a factor of 179 and 16, respectively. In our demonstration, we achieved 10 foci with homogeneous brightness at a high speed and formed W- and S-shape patterns against the scattering medium. The experimental results suggest that the proposed method will pave a new avenue for WS in the applications of biomedical imaging, photon therapy, optogenetics, dynamic holographic display, etc.
Collapse
Affiliation(s)
- Jiamiao Yang
- Department of Instrument Science and Engineering, School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University, 200240, Shanghai, China
- Shanghai Center for Brain Science and Brain-Inspired Technology, 200031, Shanghai, China
| | - Qiaozhi He
- Department of Instrument Science and Engineering, School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University, 200240, Shanghai, China
| | - Linxian Liu
- Department of Instrument Science and Engineering, School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University, 200240, Shanghai, China.
- School of Automation and Software Engineering, Shanxi University, 030006, Taiyuan, China.
| | - Yuan Qu
- Department of Instrument Science and Engineering, School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University, 200240, Shanghai, China
| | - Rongjun Shao
- Department of Instrument Science and Engineering, School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University, 200240, Shanghai, China
| | - Bowen Song
- Beijing Advanced Innovation Center for Biomedical Engineering, Key Laboratory for Biomechanics and Mechanobiology of Ministry of Education, School of Engineering Medicine, Beihang University, 100191, Beijing, China
| | - Yanyu Zhao
- Beijing Advanced Innovation Center for Biomedical Engineering, Key Laboratory for Biomechanics and Mechanobiology of Ministry of Education, School of Engineering Medicine, Beihang University, 100191, Beijing, China.
| |
Collapse
|
8
|
Yeminy T, Katz O. Guidestar-free image-guided wavefront shaping. SCIENCE ADVANCES 2021; 7:7/21/eabf5364. [PMID: 34138733 PMCID: PMC8133752 DOI: 10.1126/sciadv.abf5364] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/02/2020] [Accepted: 03/29/2021] [Indexed: 05/17/2023]
Abstract
Optical imaging through scattering media is a fundamental challenge in many applications. Recently, breakthroughs such as imaging through biological tissues and looking around corners have been obtained via wavefront-shaping approaches. However, these require an implanted guidestar for determining the wavefront correction, controlled coherent illumination, and most often raster scanning of the shaped focus. Alternative novel computational approaches that exploit speckle correlations avoid guidestars and wavefront control but are limited to small two-dimensional objects contained within the "memory-effect" correlation range. Here, we present a new concept, image-guided wavefront shaping, allowing widefield noninvasive, guidestar-free, incoherent imaging through highly scattering layers, without illumination control. The wavefront correction is found even for objects that are larger than the memory-effect range, by blindly optimizing image quality metrics. We demonstrate imaging of extended objects through highly scattering layers and multicore fibers, paving the way for noninvasive imaging in various applications, from microscopy to endoscopy.
Collapse
Affiliation(s)
- Tomer Yeminy
- Department of Applied Physics, The Hebrew University of Jerusalem, Jerusalem 9190401, Israel
| | - Ori Katz
- Department of Applied Physics, The Hebrew University of Jerusalem, Jerusalem 9190401, Israel.
| |
Collapse
|
9
|
Arjmand P, Katz O, Gigan S, Guillon M. Three-dimensional broadband light beam manipulation in forward scattering samples. OPTICS EXPRESS 2021; 29:6563-6581. [PMID: 33726175 DOI: 10.1364/oe.412640] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/16/2020] [Accepted: 12/18/2020] [Indexed: 06/12/2023]
Abstract
Focusing light into highly disordered biological tissue is a major challenge in optical microscopy and biomedical imaging due to scattering. However, correlations in the scattering matrix, known as "memory effects", can be used to improve imaging capabilities. Here we discuss theoretically and numerically the possibility to achieve three-dimensional ultrashort laser focusing and scanning inside forward scattering media, beyond the scattering mean free path, by simultaneously taking advantage of the angular and the chromato-axial memory effects. The numerical model is presented in details, is validated within the state of the art theoretical and experimental framework and is finally used to propose a scheme for focusing ultra-short laser pulses in depth through forward scattering media.
Collapse
|
10
|
Compressive Sensing Imaging Based on Modulation of Atmospheric Scattering Medium. APPLIED SCIENCES-BASEL 2020. [DOI: 10.3390/app10134466] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Long-distance imaging in time-varying scattering media, such as atmosphere, is a significant challenge. Light is often heavily diffused while propagating through scattering media, because of which the clear imaging of objects concealed by media becomes difficult. In this study, instead of suppressing diffusion by multiple scattering, we used natural randomness of wave propagation through atmospheric scattering media as an optimal and instantaneous compressive imaging mechanism. A mathematical model of compressive imaging based on the modulation of atmospheric scattering media was established. By using the Monte Carlo method, the atmospheric modulation matrix was obtained, and the numerical simulation of modulation imaging of atmospheric scattering media was performed. Comparative experiments show that the atmospheric matrix can achieve the same modulation effect as the Hadamard and Gaussian random matrices. The effectiveness of the proposed optical imaging approach was demonstrated experimentally by loading the atmospheric measurement matrix onto a digital micromirror device to perform single pixel compressive sensing measurements. Our work provides a new direction to ongoing research in the field of imaging through scattering media.
Collapse
|
11
|
A trade-off between speckle size and intensity enhancement of a focal point behind a scattering layer. Sci Rep 2019; 9:11256. [PMID: 31375775 PMCID: PMC6677741 DOI: 10.1038/s41598-019-47679-3] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/21/2019] [Accepted: 07/10/2019] [Indexed: 11/09/2022] Open
Abstract
Focusing light through highly scattering materials by modifying the phase profile of the illuminating beam has attracted a great deal of attention in the past decade paving the way towards novel applications. Here we report on a tradeoff between two seemingly independent quantities of critical importance in the focusing process: the size of the focal point obtained behind a scattering medium and the maximum achievable intensity of such focal point. We theoretically derive and experimentally demonstrate the practical limits of intensity enhancement of the focal point and relate them to the intrinsic properties of the scattering phenomenon. We demonstrate that the intensity enhancement limitation becomes dominant when the focusing plane gets closer to the scattering layer thus limiting the ability to obtain tight focusing at high contrast, which has direct relevance for the many applications exploring scattering materials as a platform for high resolution focusing and imaging.
Collapse
|
12
|
Daniel A, Oron D, Silberberg Y. Light focusing through scattering media via linear fluorescence variance maximization, and its application for fluorescence imaging. OPTICS EXPRESS 2019; 27:21778-21786. [PMID: 31510248 DOI: 10.1364/oe.27.021778] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/24/2019] [Accepted: 07/02/2019] [Indexed: 05/24/2023]
Abstract
We demonstrate focusing and imaging through a scattering medium without access to the fluorescent object by using wavefront shaping. Our concept is based on utilizing the spatial fluorescence contrast which naturally exists in the hidden target object. By scanning the angle of incidence of the illuminating laser beam and maximizing the variation of the detected fluorescence signal from the object, as measured by a bucket detector at the front of the scattering medium, we are able to generate a tightly focused excitation spot. Thereafter, an image is obtained by scanning the focus over the object within the memory effect range. The requirements for applicability of the method and the comparison with speckle-correlation based focusing methods are discussed.
Collapse
|