1
|
Dejkameh A, Nebling R, Locans U, Kim HS, Mochi I, Ekinci Y. Recovery of spatial frequencies in coherent diffraction imaging in the presence of a central obscuration. Ultramicroscopy 2024; 258:113912. [PMID: 38217894 DOI: 10.1016/j.ultramic.2023.113912] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/12/2023] [Revised: 12/08/2023] [Accepted: 12/19/2023] [Indexed: 01/15/2024]
Abstract
Coherent diffraction imaging (CDI) and its scanning version, ptychography, are lensless imaging approaches used to iteratively retrieve a sample's complex scattering amplitude from its measured diffraction patterns. These imaging methods are most useful in extreme ultraviolet (EUV) and X-ray regions of the electromagnetic spectrum, where efficient imaging optics are difficult to manufacture. CDI relies on high signal-to-noise ratio diffraction data to recover the phase, but increasing the flux can cause saturation effects on the detector. A conventional solution to this problem is to place a beam stop in front of the detector. The pixel masking method is a common solution to the problem of missing frequencies due to a beam stop. This paper describes the information redundancy in the recorded data set and expands on how the reconstruction algorithm can exploit this redundancy to estimate the missing frequencies. Thereafter, we modify the size of the beam stop in experimental and simulation data to assess the impact of the missing frequencies, investigate the extent to which the lost portion of the diffraction spectrum can be recovered, and quantify the effect of the beam stop on the image quality. The experimental findings and simulations conducted for EUV imaging demonstrate that when using a beam stop, the numerical aperture of the condenser is a crucial factor in the recovery of lost frequencies. Our thorough investigation of the reconstructed images provides information on the overall quality of reconstruction and highlights the vulnerable frequencies if the beam stop size is larger than the extent of the illumination NA. The outcome of this study can be applied to other sources of frequency loss, and it will contribute to the improvement of experiments and reconstruction algorithms in CDI.
Collapse
Affiliation(s)
- Atoosa Dejkameh
- ETH Zürich, Rämistrasse 101, Zürich, 8092, Switzerland; Paul Scherrer Institute (PSI), Forschungsstrasse 111, Villigen, 5232, Switzerland.
| | - Ricarda Nebling
- ETH Zürich, Rämistrasse 101, Zürich, 8092, Switzerland; Paul Scherrer Institute (PSI), Forschungsstrasse 111, Villigen, 5232, Switzerland
| | - Uldis Locans
- Paul Scherrer Institute (PSI), Forschungsstrasse 111, Villigen, 5232, Switzerland
| | - Hyun-Su Kim
- Paul Scherrer Institute (PSI), Forschungsstrasse 111, Villigen, 5232, Switzerland
| | - Iacopo Mochi
- Paul Scherrer Institute (PSI), Forschungsstrasse 111, Villigen, 5232, Switzerland
| | - Yasin Ekinci
- Paul Scherrer Institute (PSI), Forschungsstrasse 111, Villigen, 5232, Switzerland
| |
Collapse
|
2
|
Oh J, Hugonnet H, Park Y. Non-interferometric stand-alone single-shot holographic camera using reciprocal diffractive imaging. Nat Commun 2023; 14:4870. [PMID: 37573340 PMCID: PMC10423261 DOI: 10.1038/s41467-023-40019-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2022] [Accepted: 07/07/2023] [Indexed: 08/14/2023] Open
Abstract
An ideal holographic camera measures the amplitude and phase of the light field so that the focus can be numerically adjusted after the acquisition, and depth information about an imaged object can be deduced. The performance of holographic cameras based on reference-assisted holography is significantly limited owing to their vulnerability to vibration and complex optical configurations. Non-interferometric holographic cameras can resolve these issues. However, existing methods require constraints on an object or measurement of multiple-intensity images. In this paper, we present a holographic image sensor that reconstructs the complex amplitude of scattered light from a single-intensity image using reciprocal diffractive imaging. We experimentally demonstrate holographic imaging of three-dimensional diffusive objects and suggest its potential applications by imaging a variety of samples under both static and dynamic conditions.
Collapse
Affiliation(s)
- Jeonghun Oh
- Department of Physics, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, 34141, Republic of Korea
- KAIST Institute for Health Science and Technology, Daejeon, 34141, Republic of Korea
| | - Herve Hugonnet
- Department of Physics, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, 34141, Republic of Korea
- KAIST Institute for Health Science and Technology, Daejeon, 34141, Republic of Korea
| | - YongKeun Park
- Department of Physics, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, 34141, Republic of Korea.
- KAIST Institute for Health Science and Technology, Daejeon, 34141, Republic of Korea.
- Tomocube, Inc., Daejeon, 34051, Republic of Korea.
| |
Collapse
|
3
|
Barmherzig DA, Sun J. Towards practical holographic coherent diffraction imaging via maximum likelihood estimation. OPTICS EXPRESS 2022; 30:6886-6906. [PMID: 35299464 DOI: 10.1364/oe.445015] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/04/2021] [Accepted: 01/13/2022] [Indexed: 06/14/2023]
Abstract
A new algorithmic framework is developed for holographic coherent diffraction imaging (HCDI) based on maximum likelihood estimation (MLE). This method provides superior image reconstruction results for various practical HCDI settings, such as when data is highly corrupted by Poisson shot noise and when low-frequency data is missing due to occlusion from a beamstop apparatus. This method is also highly robust in that it can be implemented using a variety of standard numerical optimization algorithms, and requires fewer constraints on the physical HCDI setup compared to current algorithms. The mathematical framework developed using MLE is also applicable beyond HCDI to any holographic imaging setup where data is corrupted by Poisson shot noise.
Collapse
|
4
|
Bai C, Zhou M, Min J, Dang S, Yu X, Zhang P, Peng T, Yao B. Robust contrast-transfer-function phase retrieval via flexible deep learning networks. OPTICS LETTERS 2019; 44:5141-5144. [PMID: 31674951 DOI: 10.1364/ol.44.005141] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/20/2019] [Accepted: 09/22/2019] [Indexed: 06/10/2023]
Abstract
By exploiting the total variation (TV) regularization scheme and the contrast transfer function (CTF), a phase map can be retrieved from single-distance coherent diffraction images via the sparsity of the investigated object. However, the CTF-TV phase retrieval algorithm often struggles in the presence of strong noise, since it is based on the traditional compressive sensing optimization problem. Here, convolutional neural networks, a powerful tool from machine learning, are used to regularize the CTF-based phase retrieval problems and improve the recovery performance. This proposed method, the CTF-Deep phase retrieval algorithm, was tested both via simulations and experiments. The results show that it is robust to noise and fast enough for high-resolution applications, such as in optical, x-ray, or terahertz imaging.
Collapse
|
5
|
Butola M, Rajora S, Khare K. Phase retrieval with complexity guidance. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA. A, OPTICS, IMAGE SCIENCE, AND VISION 2019; 36:202-211. [PMID: 30874099 DOI: 10.1364/josaa.36.000202] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/11/2018] [Accepted: 12/14/2018] [Indexed: 06/09/2023]
Abstract
Iterative phase retrieval methods based on the Gerchberg-Saxton (GS) or Fienup algorithm typically show stagnation artifacts even after a large number of iterations. We introduce a complexity parameter ζ that can be computed directly from the Fourier magnitude data and provides a measure of fluctuations in the desired phase retrieval solution. It is observed that when initiated with a constant or a uniformly random phase map, the complexity of the Fienup solution containing stagnation artifacts stabilizes at a numerical value that is higher than ζ. We propose a modified Fienup algorithm that uses a controlled sparsity-enhancing step such that in every iteration the complexity of the resulting guess solution is explicitly made close to ζ. This approach, which we refer to as complexity-guided phase retrieval, is seen to provide an artifact-free phase retrieval solution within a few hundred iterations. Numerical illustrations are provided for both amplitude as well as phase objects with and without Poisson noise introduced in the Fourier intensity data. The complexity-guidance concept may potentially be combined with a variety of phase retrieval algorithms and can enable several practical applications.
Collapse
|
6
|
Compressive sampling based on frequency saliency for remote sensing imaging. Sci Rep 2017; 7:6539. [PMID: 28747669 PMCID: PMC5529464 DOI: 10.1038/s41598-017-06834-4] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2017] [Accepted: 06/19/2017] [Indexed: 11/16/2022] Open
Abstract
In saliency-based compressive sampling (CS) for remote sensing image signals, the saliency information of images is used to allocate more sensing resources to salient regions than to non-salient regions. However, the pulsed cosine transform method can generate large errors in the calculation of saliency information because it uses only the signs of the coefficients of the discrete cosine transform for low-resolution images. In addition, the reconstructed images can exhibit blocking effects because blocks are used as the processing units in CS. In this work, we propose a post-transform frequency saliency CS method that utilizes transformed post-wavelet coefficients to calculate the frequency saliency information of images in the post-wavelet domain. Specifically, the wavelet coefficients are treated as the pixels of a block-wise megapixel sensor. Experiments indicate that the proposed method yields better-quality images and outperforms conventional saliency-based methods in three aspects: peak signal-to-noise ratio, mean structural similarity index, and visual information fidelity.
Collapse
|
7
|
Das B, Bisht NS, Vinu RV, Singh RK. Lensless complex amplitude image retrieval through a visually opaque scattering medium. APPLIED OPTICS 2017; 56:4591-4597. [PMID: 29047587 DOI: 10.1364/ao.56.004591] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/07/2017] [Accepted: 05/02/2017] [Indexed: 06/07/2023]
Abstract
We propose and experimentally demonstrate lensless complex amplitude image retrieval through a visually opaque scattering medium from spatially fluctuating fields using intensity measurement and a phase-retrieval algorithm. The complex amplitude information of the hidden object is encoded in the form of a real and nonnegative amplitude function represented as an interference pattern. A single charge coupled device (CCD) image of the scattered light collected through a visually opaque optical diffuser contains enough information to digitally regenerate the interference pattern. Furthermore, a lensless configuration is implemented which eliminates any possible aberration effects associated with optical components, and this further has promising applications where the use of imaging optics is not feasible. Experimental results for the recovery of complex fields corresponding to optical vortices of two different topological charges are presented.
Collapse
|
8
|
Villanueva-Perez P, Arcadu F, Cloetens P, Stampanoni M. Contrast-transfer-function phase retrieval based on compressed sensing. OPTICS LETTERS 2017; 42:1133-1136. [PMID: 28295066 DOI: 10.1364/ol.42.001133] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/23/2023]
Abstract
We report on a new contrast-transfer-function (CTF) phase-retrieval method based on the alternating direction method of multipliers (ADMMs), which allows us to exploit any compressed sensing regularization scheme reflecting the sparsity of the investigated object. The proposed iterative algorithm retrieves accurate phase maps from highly noisy single-distance projection microscopy data and is characterized by a stable convergence, not bounded to the prior knowledge of the object support or to the initialization strategy. Experiments on simulated and real datasets show that ADMM-CTF yields reconstructions with a substantial lower amount of artifacts and enhanced signal-to-noise ratio compared to the standard analytical inversion.
Collapse
|
9
|
Ryu D, Wang Z, He K, Zheng G, Horstmeyer R, Cossairt O. Subsampled phase retrieval for temporal resolution enhancement in lensless on-chip holographic video. BIOMEDICAL OPTICS EXPRESS 2017; 8:1981-1995. [PMID: 28663877 PMCID: PMC5480592 DOI: 10.1364/boe.8.001981] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/14/2016] [Revised: 02/22/2017] [Accepted: 02/23/2017] [Indexed: 05/30/2023]
Abstract
On-chip holographic video is a convenient way to monitor biological samples simultaneously at high spatial resolution and over a wide field-of-view. However, due to the limited readout rate of digital detector arrays, one often faces a tradeoff between the per-frame pixel count and frame rate of the captured video. In this report, we propose a subsampled phase retrieval (SPR) algorithm to overcome the spatial-temporal trade-off in holographic video. Compared to traditional phase retrieval approaches, our SPR algorithm uses over an order of magnitude less pixel measurements while maintaining suitable reconstruction quality. We use an on-chip holographic video setup with pixel sub-sampling to experimentally demonstrate a factor of 5.5 increase in sensor frame rate while monitoring the in vivo movement of Peranema microorganisms.
Collapse
Affiliation(s)
- Donghun Ryu
- Electrical Engineering, California Institute of Technology, Pasadena, CA 91125,
USA
| | - Zihao Wang
- Electrical Engineering and Computer Science, Northwestern University, Evanston, IL 60208,
USA
| | - Kuan He
- Electrical Engineering and Computer Science, Northwestern University, Evanston, IL 60208,
USA
| | - Guoan Zheng
- Biomedical Engineering, University of Connecticut, Storrs, CT 06269,
USA
| | - Roarke Horstmeyer
- Charité Medical School, Humboldt University of Berlin, Berlin 10117,
Germany
- Future address: Biomedical Engineering, Duke University, Durham, NC 27708,
USA
| | - Oliver Cossairt
- Electrical Engineering and Computer Science, Northwestern University, Evanston, IL 60208,
USA
| |
Collapse
|
10
|
Li J, Liu Z. Efficient compressed imaging method for a microsatellite optical camera. APPLIED OPTICS 2016; 55:8070-8081. [PMID: 27828048 DOI: 10.1364/ao.55.008070] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
Imaging integrated with compression is considered the holy grail of microsatellite photography because it improves the degree of integration of the camera system, removing the compression system, high capacity storage system, and high-speed image transmission system, which consume lots of resources of the satellite platform. In this paper, we propose an efficient compressed imaging method for remote sensing photography. We consider wavelet coefficients as pixels of a block-wise megapixel sensor (BMPS). We integrate the saliency information stage into the BMPS to perform compressed sampling (CS) in order to further improve imaging performance. In the compressed sensing process, we use transformed postwavelet coefficients to calculate saliency information of images in the postwavelet domain. According to different regions having different saliency information, the corresponding sensing resources are allocated to perform CS. CS can obtain the compressed discrete sparse samples of the original signal at a much lower sample rate than the Nyquist frequency. The discrete samples signal can be reconstructed by a nonlinear recovery algorithm in the ground. Experimental results show that the proposed compressed imaging method outperforms the traditional saliency-based methods in terms of multiple assessment approaches.
Collapse
|