1
|
Luo Z, Wu R, Chen H, Zhen J, Liu M, Zhang H, Luo J, Han D, Yan L, Wu Y. Fast and robust Fourier ptychographic microscopy with position misalignment correction. JOURNAL OF BIOMEDICAL OPTICS 2023; 28:116503. [PMID: 38078152 PMCID: PMC10704086 DOI: 10.1117/1.jbo.28.11.116503] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/18/2023] [Revised: 10/20/2023] [Accepted: 11/13/2023] [Indexed: 12/18/2023]
Abstract
Significance Fourier ptychographic microscopy (FPM) is a new, developing computational imaging technology. It can realize the quantitative phase imaging of a wide field of view and high-resolution (HR) simultaneously by means of multi-angle illumination via a light emitting diode (LED) array, combined with a phase recovery algorithm and the synthetic aperture principle. However, in the FPM reconstruction process, LED position misalignment affects the quality of the reconstructed image, and the reconstruction efficiency of the existing LED position correction algorithms needs to be improved. Aim This study aims to improve the FPM correction method based on simulated annealing (SA) and proposes a position misalignment correction method (AA-C algorithm) using an improved phase recovery strategy. Approach The spectrum function update strategy was optimized by adding an adaptive control factor, and the reconstruction efficiency of the algorithm was improved. Results The experimental results show that the proposed method is effective and robust for position misalignment correction of LED arrays in FPM, and the convergence speed can be improved by 21.2% and 54.9% compared with SC-FPM and PC-FPM, respectively. Conclusions These results can reduce the requirement of the FPM system for LED array accuracy and improve robustness.
Collapse
Affiliation(s)
- Zicong Luo
- Foshan University, School of Physics and Optoelectronic Engineering, Foshan, China
| | - Ruofei Wu
- Foshan University, School of Physics and Optoelectronic Engineering, Foshan, China
| | - Hanbao Chen
- Foshan University, School of Physics and Optoelectronic Engineering, Foshan, China
| | - Junrui Zhen
- Foshan University, School of Physics and Optoelectronic Engineering, Foshan, China
| | - Mingdi Liu
- Foshan University, School of Physics and Optoelectronic Engineering, Foshan, China
| | - Haiqi Zhang
- Foshan University, School of Physics and Optoelectronic Engineering, Foshan, China
| | - Jiaxiong Luo
- Foshan University, School of Physics and Optoelectronic Engineering, Foshan, China
| | - Dingan Han
- Foshan University, School of Physics and Optoelectronic Engineering, Foshan, China
| | - Lisong Yan
- Huazhong University of Science and Technology, School of Optical and Electronic Information, Wuhan, China
| | - Yanxiong Wu
- Foshan University, School of Physics and Optoelectronic Engineering, Foshan, China
- Ji Hua Laboratory, Foshan, China
| |
Collapse
|
2
|
Guo C, Jiang S, Yang L, Song P, Pirhanov A, Wang R, Wang T, Shao X, Wu Q, Cho YK, Zheng G. Depth-multiplexed ptychographic microscopy for high-throughput imaging of stacked bio-specimens on a chip. Biosens Bioelectron 2023; 224:115049. [PMID: 36623342 DOI: 10.1016/j.bios.2022.115049] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2022] [Revised: 12/15/2022] [Accepted: 12/26/2022] [Indexed: 01/01/2023]
Abstract
Imaging a large number of bio-specimens at high speed is essential for many biomedical applications. The common strategy is to place specimens at different lateral positions and image them sequentially. Here we report a new on-chip imaging strategy, termed depth-multiplexed ptychographic microscopy (DPM), for parallel imaging and sensing at high speed. Different from the common strategy, DPM stacks multiple specimens in the axial direction and images the entire z-stack all at once. In our prototype platform, we modify a low-cost car mirror for programmable steering of the incident laser beam. A blood-coated image sensor is then placed underneath the stacked sample for acquiring the resulting diffraction patterns. With the captured images, we perform blind recovery of the incident beam angle and model different layers of the stacked sample as different coded surfaces for object reconstruction. For in vitro experiment, we demonstrate time-lapse cell culture monitoring by imaging 3 stacked microfluidic channels on the coded sensor. For high-throughput cytometric analysis, we image 5 stacked brain sections with a 205-mm2 field of view in ∼50 s. Cytometric analysis is also performed to quantify the cellular proliferation biomarkers on the slides. The DPM approach adds a new degree of freedom for data multiplexing in microscopy, enabling parallel imaging of multiple specimens using a single detector. The demonstrated 6-mm depth of field is among the longest ones in microscopy imaging. The novel depth-multiplexed configuration also complements the miniaturization provided by microfluidics devices, offering a solution for on-chip sensing and imaging with efficient sample handling.
Collapse
Affiliation(s)
- Chengfei Guo
- Hangzhou Institute of Technology, Xidian University, Hangzhou, 311231, China; Department of Biomedical Engineering, University of Connecticut, Storrs, CT, 06269, USA
| | - Shaowei Jiang
- Department of Biomedical Engineering, University of Connecticut, Storrs, CT, 06269, USA
| | - Liming Yang
- Department of Biomedical Engineering, University of Connecticut, Storrs, CT, 06269, USA
| | - Pengming Song
- Department of Biomedical Engineering, University of Connecticut, Storrs, CT, 06269, USA
| | - Azady Pirhanov
- Department of Biomedical Engineering, University of Connecticut, Storrs, CT, 06269, USA
| | - Ruihai Wang
- Department of Biomedical Engineering, University of Connecticut, Storrs, CT, 06269, USA
| | - Tianbo Wang
- Department of Biomedical Engineering, University of Connecticut, Storrs, CT, 06269, USA
| | - Xiaopeng Shao
- Hangzhou Institute of Technology, Xidian University, Hangzhou, 311231, China
| | - Qian Wu
- Department of Pathology and Laboratory Medicine, University of Connecticut Health Centre, Farmington, CT, 06030, USA
| | - Yong Ku Cho
- Department of Chemical & Biomolecular Engineering, University of Connecticut, Storrs, CT, 06269, USA
| | - Guoan Zheng
- Department of Biomedical Engineering, University of Connecticut, Storrs, CT, 06269, USA.
| |
Collapse
|
3
|
Wu R, Luo J, Li J, Chen H, Zhen J, Zhu S, Luo Z, Wu Y. Adaptive correction method of hybrid aberrations in Fourier ptychographic microscopy. JOURNAL OF BIOMEDICAL OPTICS 2023; 28:036006. [PMID: 36923986 PMCID: PMC10010747 DOI: 10.1117/1.jbo.28.3.036006] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/14/2022] [Accepted: 02/22/2023] [Indexed: 06/18/2023]
Abstract
SIGNIFICANCE Fourier ptychographic microscopy (FPM) enables quantitative phase imaging with a large field-of-view and high resolution by acquiring a series of low-resolution intensity images corresponding to different spatial frequencies stitched together in the Fourier domain. However, the presence of various aberrations in an imaging system can significantly degrade the quality of reconstruction results. The imaging performance and efficiency of the existing embedded optical pupil function recovery (EPRY-FPM) aberration correction algorithm are low due to the optimization strategy. AIM An aberration correction method (AA-P algorithm) based on an improved phase recovery strategy is proposed to improve the reconstruction image quality. APPROACH This algorithm uses adaptive modulation factors, which are added while updating iterations to optimize the spectral function and optical pupil function updates of the samples, respectively. The effectiveness of the proposed algorithm is verified through simulations and experiments using an open-source biological sample dataset. RESULTS Experimental results show that the proposed AA-P algorithm in an optical system with hybrid aberrations, recovered complex amplitude images with clearer contours and higher phase contrast. The image reconstruction quality was improved by 82.6% when compared with the EPRY-FPM algorithm. CONCLUSIONS The proposed AA-P algorithm can reconstruct better results with faster convergence, and the recovered optical pupil function can better characterize the aberration of the imaging system. Thus, our method is expected to reduce the strict requirements of wavefront aberration for the current FPM.
Collapse
Affiliation(s)
- Ruofei Wu
- Foshan University, School of Physics and Optoelectronic Engineering, Foshan, China
| | - Jiaxiong Luo
- Foshan University, School of Physics and Optoelectronic Engineering, Foshan, China
| | - Jiancong Li
- Foshan University, School of Physics and Optoelectronic Engineering, Foshan, China
| | - Hanbao Chen
- Foshan University, School of Physics and Optoelectronic Engineering, Foshan, China
| | - Junrui Zhen
- Foshan University, School of Physics and Optoelectronic Engineering, Foshan, China
| | - Sicong Zhu
- Foshan University, School of Physics and Optoelectronic Engineering, Foshan, China
| | - Zicong Luo
- Foshan University, School of Physics and Optoelectronic Engineering, Foshan, China
| | - Yanxiong Wu
- Foshan University, School of Physics and Optoelectronic Engineering, Foshan, China
- Ji Hua Laboratory, Foshan, China
| |
Collapse
|
4
|
Aidukas T, Konda PC, Harvey AR. High-speed multi-objective Fourier ptychographic microscopy. OPTICS EXPRESS 2022; 30:29189-29205. [PMID: 36299099 DOI: 10.1364/oe.466075] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/06/2022] [Accepted: 07/11/2022] [Indexed: 06/16/2023]
Abstract
The ability of a microscope to rapidly acquire wide-field, high-resolution images is limited by both the optical performance of the microscope objective and the bandwidth of the detector. The use of multiple detectors can increase electronic-acquisition bandwidth, but the use of multiple parallel objectives is problematic since phase coherence is required across the multiple apertures. We report a new synthetic-aperture microscopy technique based on Fourier ptychography, where both the illumination and image-space numerical apertures are synthesized, using a spherical array of low-power microscope objectives that focus images onto mutually incoherent detectors. Phase coherence across apertures is achieved by capturing diffracted fields during angular illumination and using ptychographic reconstruction to synthesize wide-field, high-resolution, amplitude and phase images. Compared to conventional Fourier ptychography, the use of multiple objectives reduces image acquisition times by increasing the area for sampling the diffracted field. We demonstrate the proposed scaleable architecture with a nine-objective microscope that generates an 89-megapixel, 1.1 µm resolution image nine-times faster than can be achieved with a single-objective Fourier-ptychographic microscope. New calibration procedures and reconstruction algorithms enable the use of low-cost 3D-printed components for longitudinal biological sample imaging. Our technique offers a route to high-speed, gigapixel microscopy, for example, imaging the dynamics of large numbers of cells at scales ranging from sub-micron to centimetre, with an enhanced possibility to capture rare phenomena.
Collapse
|