1
|
Yao J, Guo Z, Qi D, Xu S, Lin W, Cheng L, Jin C, He Y, Xu N, Pan Z, Mao J, Yao Y, Deng L, Shen Y, Zhao H, Sun Z, Zhang S. Discrete Illumination-Based Compressed Ultrafast Photography for High-Fidelity Dynamic Imaging. ADVANCED SCIENCE (WEINHEIM, BADEN-WURTTEMBERG, GERMANY) 2024; 11:e2403854. [PMID: 39120051 PMCID: PMC11538675 DOI: 10.1002/advs.202403854] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/12/2024] [Revised: 07/03/2024] [Indexed: 08/10/2024]
Abstract
Compressed ultrafast photography (CUP) can capture irreversible or difficult-to-repeat dynamic scenes at the imaging speed of more than one billion frames per second, which is obtained by compressive sensing-based image reconstruction from a compressed 2D image through the discretization of detector pixels. However, an excessively high data compression ratio in CUP severely degrades the image reconstruction quality, thereby restricting its ability to observe ultrafast dynamic scenes with complex spatial structures. To address this issue, a discrete illumination-based CUP (DI-CUP) with high fidelity is reported. In DI-CUP, the dynamic scenes are loaded into an ultrashort laser pulse train with controllable sub-pulse number and time interval, thus the data compression ratio, as well as the overlap between adjacent frames, is greatly decreased and flexibly controlled through the discretization of dynamic scenes based on laser pulse train illumination, and high-fidelity image reconstruction can be realized within the same observation time window. Furthermore, the superior performance of DI-CUP is verified by observing femtosecond laser-induced ablation dynamics and plasma channel evolution, which are hardly resolved in the spatial structures using conventional CUP. It is anticipated that DI-CUP will be widely and dependably used in the real-time observations of various ultrafast dynamics.
Collapse
Affiliation(s)
- Jiali Yao
- State Key Laboratory of Precision SpectroscopySchool of Physics and Electronic ScienceEast China Normal UniversityShanghai200241China
- Present address:
College of ScienceShanghai Institute of TechnologyShanghai201418China
| | - Zihan Guo
- State Key Laboratory of Precision SpectroscopySchool of Physics and Electronic ScienceEast China Normal UniversityShanghai200241China
| | - Dalong Qi
- State Key Laboratory of Precision SpectroscopySchool of Physics and Electronic ScienceEast China Normal UniversityShanghai200241China
| | - Shiyu Xu
- North Night Vision Technology Co. LtdKunming650217China
| | - Wenzhang Lin
- State Key Laboratory of Precision SpectroscopySchool of Physics and Electronic ScienceEast China Normal UniversityShanghai200241China
| | - Long Cheng
- State Key Laboratory of Precision SpectroscopySchool of Physics and Electronic ScienceEast China Normal UniversityShanghai200241China
| | - Chengzhi Jin
- State Key Laboratory of Precision SpectroscopySchool of Physics and Electronic ScienceEast China Normal UniversityShanghai200241China
| | - Yu He
- State Key Laboratory of Precision SpectroscopySchool of Physics and Electronic ScienceEast China Normal UniversityShanghai200241China
| | - Ning Xu
- State Key Laboratory of Precision SpectroscopySchool of Physics and Electronic ScienceEast China Normal UniversityShanghai200241China
| | - Zhen Pan
- State Key Laboratory of Precision SpectroscopySchool of Physics and Electronic ScienceEast China Normal UniversityShanghai200241China
| | - Jiayi Mao
- State Key Laboratory of Precision SpectroscopySchool of Physics and Electronic ScienceEast China Normal UniversityShanghai200241China
| | - Yunhua Yao
- State Key Laboratory of Precision SpectroscopySchool of Physics and Electronic ScienceEast China Normal UniversityShanghai200241China
| | - Lianzhong Deng
- State Key Laboratory of Precision SpectroscopySchool of Physics and Electronic ScienceEast China Normal UniversityShanghai200241China
| | - Yuecheng Shen
- State Key Laboratory of Precision SpectroscopySchool of Physics and Electronic ScienceEast China Normal UniversityShanghai200241China
| | - Heng Zhao
- North Night Vision Technology Co. LtdKunming650217China
| | - Zhenrong Sun
- State Key Laboratory of Precision SpectroscopySchool of Physics and Electronic ScienceEast China Normal UniversityShanghai200241China
| | - Shian Zhang
- State Key Laboratory of Precision SpectroscopySchool of Physics and Electronic ScienceEast China Normal UniversityShanghai200241China
- Collaborative Innovation Center of Extreme OpticsShanxi UniversityTaiyuan030006China
- Joint Research Center of Light Manipulation Science and Photonic Integrated Chip of East China Normal University and Shandong Normal UniversityEast China Normal UniversityShanghai200241China
| |
Collapse
|
2
|
Mishra YN, Wang P, Bauer FJ, Gudipati MS, Wang LV. Single-pulse ultrafast real-time simultaneous planar imaging of femtosecond laser-nanoparticle dynamics in flames. LIGHT, SCIENCE & APPLICATIONS 2024; 13:221. [PMID: 39209815 PMCID: PMC11362337 DOI: 10.1038/s41377-024-01588-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/18/2024] [Revised: 08/13/2024] [Accepted: 08/15/2024] [Indexed: 09/04/2024]
Abstract
The creation of carbonaceous nanoparticles and their dynamics in hydrocarbon flames are still debated in environmental, combustion, and material sciences. In this study, we introduce single-pulse femtosecond laser sheet-compressed ultrafast photography (fsLS-CUP), an ultrafast imaging technique specifically designed to shed light on and capture ultrafast dynamics stemming from interactions between femtosecond lasers and nanoparticles in flames in a single-shot. fsLS-CUP enables the first-time real-time billion frames-per-second (Gfps) simultaneous two-dimensional (2D) imaging of laser-induced fluorescence (LIF) and laser-induced heating (LIH) that are originated from polycyclic aromatic hydrocarbons (PAHs) and soot particles, respectively. Furthermore, fsLS-CUP provides the real-time spatiotemporal map of femtosecond laser-soot interaction as elastic light scattering (ELS) at an astonishing 250 Gfps. In contrast to existing single-shot ultrafast imaging approaches, which are limited to millions of frames per second only and require multiple laser pulses, our method employs only a single pulse and captures the entire dynamics of laser-induced signals at hundreds of Gfps. Using a single pulse does not change the optical properties of nanoparticles for a following pulse, thus allowing reliable spatiotemporal mapping. Moreover, we found that particle inception and growth are derived from precursors. In essence, as an imaging modality, fsLS-CUP offers ultrafast 2D diagnostics, contributing to the fundamental understanding of nanoparticle's inception and broader applications across different fields, such as material science and biomedical engineering.
Collapse
Affiliation(s)
- Yogeshwar Nath Mishra
- Caltech Optical Imaging Laboratory, Andrew and Peggy Cheng Department of Medical Engineering, Department of Electrical Engineering, California Institute of Technology, 1200 East California Boulevard, Mail Code 138-78, Pasadena, CA, 91125, USA
- Science Division, Jet Propulsion Laboratory, California Institute of Technology, 4800 Oak Grove Drive, Pasadena, CA, 91109, USA
- Lehrstuhl für Technische Thermodynamik (LTT) and Erlangen Graduate School in Advanced Optical Technologies (SAOT), Universität Erlangen-Nürnberg, Erlangen, 91058, Germany
| | - Peng Wang
- Caltech Optical Imaging Laboratory, Andrew and Peggy Cheng Department of Medical Engineering, Department of Electrical Engineering, California Institute of Technology, 1200 East California Boulevard, Mail Code 138-78, Pasadena, CA, 91125, USA
| | - Florian J Bauer
- Lehrstuhl für Technische Thermodynamik (LTT) and Erlangen Graduate School in Advanced Optical Technologies (SAOT), Universität Erlangen-Nürnberg, Erlangen, 91058, Germany
| | - Murthy S Gudipati
- Science Division, Jet Propulsion Laboratory, California Institute of Technology, 4800 Oak Grove Drive, Pasadena, CA, 91109, USA
| | - Lihong V Wang
- Caltech Optical Imaging Laboratory, Andrew and Peggy Cheng Department of Medical Engineering, Department of Electrical Engineering, California Institute of Technology, 1200 East California Boulevard, Mail Code 138-78, Pasadena, CA, 91125, USA.
| |
Collapse
|
3
|
Jin C, Xu Y, Qi D, Yao Y, Shen Y, Deng L, Han R, Pan Z, Yao J, He Y, Huang Z, Pan X, Tao H, Sun M, Liu C, Shi J, Liang J, Wang Z, Zhu J, Sun Z, Zhang S. Single-Shot Intensity- and Phase-Sensitive Compressive Sensing-Based Coherent Modulation Ultrafast Imaging. PHYSICAL REVIEW LETTERS 2024; 132:173801. [PMID: 38728719 DOI: 10.1103/physrevlett.132.173801] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/01/2023] [Accepted: 03/21/2024] [Indexed: 05/12/2024]
Abstract
Ultrafast imaging can capture the dynamic scenes with a nanosecond and even femtosecond temporal resolution. Complementarily, phase imaging can provide the morphology, refractive index, or thickness information that intensity imaging cannot represent. Therefore, it is important to realize the simultaneous ultrafast intensity and phase imaging for achieving as much information as possible in the detection of ultrafast dynamic scenes. Here, we report a single-shot intensity- and phase-sensitive compressive sensing-based coherent modulation ultrafast imaging technique, shortened as CS-CMUI, which integrates coherent modulation imaging, compressive imaging, and streak imaging. We theoretically demonstrate through numerical simulations that CS-CMUI can obtain both the intensity and phase information of the dynamic scenes with ultrahigh fidelity. Furthermore, we experimentally build a CS-CMUI system and successfully measure the intensity and phase evolution of a multimode Q-switched laser pulse and the dynamical behavior of laser ablation on an indium tin oxide thin film. It is anticipated that CS-CMUI enables a profound comprehension of ultrafast phenomena and promotes the advancement of various practical applications, which will have substantial impact on fundamental and applied sciences.
Collapse
Affiliation(s)
- Chengzhi Jin
- State Key Laboratory of Precision Spectroscopy, School of Physics and Electronic Science, East China Normal University, Shanghai 200241, China
| | - Yingming Xu
- Key Laboratory of High Power Laser and Physics, Shanghai Institute of Optics and Fine Mechanics, Chinese Academy of Sciences, Shanghai 201800, China
- Research Center for Humanoid Sensing, Zhejiang Lab, Hangzhou 311100, China
| | - Dalong Qi
- State Key Laboratory of Precision Spectroscopy, School of Physics and Electronic Science, East China Normal University, Shanghai 200241, China
| | - Yunhua Yao
- State Key Laboratory of Precision Spectroscopy, School of Physics and Electronic Science, East China Normal University, Shanghai 200241, China
| | - Yuecheng Shen
- State Key Laboratory of Precision Spectroscopy, School of Physics and Electronic Science, East China Normal University, Shanghai 200241, China
| | - Lianzhong Deng
- State Key Laboratory of Precision Spectroscopy, School of Physics and Electronic Science, East China Normal University, Shanghai 200241, China
| | - Ruozhong Han
- State Key Laboratory of Precision Spectroscopy, School of Physics and Electronic Science, East China Normal University, Shanghai 200241, China
| | - Zhen Pan
- State Key Laboratory of Precision Spectroscopy, School of Physics and Electronic Science, East China Normal University, Shanghai 200241, China
| | - Jiali Yao
- State Key Laboratory of Precision Spectroscopy, School of Physics and Electronic Science, East China Normal University, Shanghai 200241, China
| | - Yilin He
- State Key Laboratory of Precision Spectroscopy, School of Physics and Electronic Science, East China Normal University, Shanghai 200241, China
| | - Zhengqi Huang
- State Key Laboratory of Precision Spectroscopy, School of Physics and Electronic Science, East China Normal University, Shanghai 200241, China
| | - Xingchen Pan
- Key Laboratory of High Power Laser and Physics, Shanghai Institute of Optics and Fine Mechanics, Chinese Academy of Sciences, Shanghai 201800, China
| | - Hua Tao
- Key Laboratory of High Power Laser and Physics, Shanghai Institute of Optics and Fine Mechanics, Chinese Academy of Sciences, Shanghai 201800, China
| | - Mingying Sun
- Key Laboratory of High Power Laser and Physics, Shanghai Institute of Optics and Fine Mechanics, Chinese Academy of Sciences, Shanghai 201800, China
| | - Cheng Liu
- Key Laboratory of High Power Laser and Physics, Shanghai Institute of Optics and Fine Mechanics, Chinese Academy of Sciences, Shanghai 201800, China
| | - Junhui Shi
- Research Center for Humanoid Sensing, Zhejiang Lab, Hangzhou 311100, China
| | - Jinyang Liang
- Laboratory of Applied Computational Imaging, Centre Énergie Matériaux Télécommunications, Institut National de la Recherche Scientifique, Varennes, Québec J3X1S2, Canada
| | - Zhiyong Wang
- School of Mathematical Sciences, University of Electronic Science and Technology of China, Chengdu 611731, China
| | - Jianqiang Zhu
- Key Laboratory of High Power Laser and Physics, Shanghai Institute of Optics and Fine Mechanics, Chinese Academy of Sciences, Shanghai 201800, China
| | - Zhenrong Sun
- State Key Laboratory of Precision Spectroscopy, School of Physics and Electronic Science, East China Normal University, Shanghai 200241, China
| | - Shian Zhang
- State Key Laboratory of Precision Spectroscopy, School of Physics and Electronic Science, East China Normal University, Shanghai 200241, China
- Collaborative Innovation Center of Extreme Optics, Shanxi University, Taiyuan 030006, China
- Joint Research Center of Light Manipulation Science and Photonic Integrated Chip of East China Normal University and Shandong Normal University, East China Normal University, Shanghai 200241, China
| |
Collapse
|
4
|
Wang X, Anastasio M, Zhang H, Sakadzic S, Hu S, Gao L. Introducing the Special Issue Honoring Lihong V. Wang, Pioneer in Biomedical Optics. JOURNAL OF BIOMEDICAL OPTICS 2024; 29:S11500. [PMID: 38846410 PMCID: PMC11153774 DOI: 10.1117/1.jbo.29.s1.s11500] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 06/09/2024]
Abstract
The editorial concludes the JBO Special Issue Honoring Lihong V. Wang, outlining Prof. Wang's salient contributions to advancing the field of biomedical optics.
Collapse
Affiliation(s)
- Xueding Wang
- University of Michigan, School of Medicine, Ann Arbor, Michigan, United States
| | - Mark Anastasio
- University of Illinois Urbana - Champaign, The Grainger College of Engineering, Department of Bioengineering, Urbana, Illinois, United States
| | - Hao Zhang
- Northwestern University, Department of Biomedical Engineering, Evanston, Illinois, United States
| | - Sava Sakadzic
- Harvard Medical School, Department of Radiology, Boston, Massachusetts, United States
- Athinoula A. Martinos Center for Biomedical Imaging, Mass General Brigham, Charlestown, Massachusetts, United States
| | - Song Hu
- Washington University in St. Louis, Department of Biomedical Engineering, St. Louis, Missouri, United States
| | - Liang Gao
- University of California Los Angeles, Department of Bioengineering, Los Angeles, California, United States
| |
Collapse
|
5
|
Lai Y, Marquez M, Liang J. Tutorial on compressed ultrafast photography. JOURNAL OF BIOMEDICAL OPTICS 2024; 29:S11524. [PMID: 38292055 PMCID: PMC10826888 DOI: 10.1117/1.jbo.29.s1.s11524] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/22/2023] [Revised: 12/23/2023] [Accepted: 12/28/2023] [Indexed: 02/01/2024]
Abstract
Significance Compressed ultrafast photography (CUP) is currently the world's fastest single-shot imaging technique. Through the integration of compressed sensing and streak imaging, CUP can capture a transient event in a single camera exposure with imaging speeds from thousands to trillions of frames per second, at micrometer-level spatial resolutions, and in broad sensing spectral ranges. Aim This tutorial aims to provide a comprehensive review of CUP in its fundamental methods, system implementations, biomedical applications, and prospect. Approach A step-by-step guideline to CUP's forward model and representative image reconstruction algorithms is presented with sample codes and illustrations in Matlab and Python. Then, CUP's hardware implementation is described with a focus on the representative techniques, advantages, and limitations of the three key components-the spatial encoder, the temporal shearing unit, and the two-dimensional sensor. Furthermore, four representative biomedical applications enabled by CUP are discussed, followed by the prospect of CUP's technical advancement. Conclusions CUP has emerged as a state-of-the-art ultrafast imaging technology. Its advanced imaging ability and versatility contribute to unprecedented observations and new applications in biomedicine. CUP holds great promise in improving technical specifications and facilitating the investigation of biomedical processes.
Collapse
Affiliation(s)
- Yingming Lai
- Université du Québec, Institut National de la Recherche Scientifique, Centre Énergie Matériaux Télécommunications, Laboratory of Applied Computational Imaging, Varennes, Québec, Canada
| | - Miguel Marquez
- Université du Québec, Institut National de la Recherche Scientifique, Centre Énergie Matériaux Télécommunications, Laboratory of Applied Computational Imaging, Varennes, Québec, Canada
| | - Jinyang Liang
- Université du Québec, Institut National de la Recherche Scientifique, Centre Énergie Matériaux Télécommunications, Laboratory of Applied Computational Imaging, Varennes, Québec, Canada
| |
Collapse
|
6
|
Guo Z, Yao J, Qi D, Ding P, Jin C, He Y, Xu N, Zhang Z, Yao Y, Deng L, Wang Z, Sun Z, Zhang S. Flexible and accurate total variation and cascaded denoisers-based image reconstruction algorithm for hyperspectrally compressed ultrafast photography. OPTICS EXPRESS 2023; 31:43989-44003. [PMID: 38178481 DOI: 10.1364/oe.506723] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/26/2023] [Accepted: 11/24/2023] [Indexed: 01/06/2024]
Abstract
Hyperspectrally compressed ultrafast photography (HCUP) based on compressed sensing and time- and spectrum-to-space mappings can simultaneously realize the temporal and spectral imaging of non-repeatable or difficult-to-repeat transient events with a passive manner in single exposure. HCUP possesses an incredibly high frame rate of tens of trillions of frames per second and a sequence depth of several hundred, and therefore plays a revolutionary role in single-shot ultrafast optical imaging. However, due to ultra-high data compression ratios induced by the extremely large sequence depth, as well as limited fidelities of traditional algorithms over the image reconstruction process, HCUP suffers from a poor image reconstruction quality and fails to capture fine structures in complex transient scenes. To overcome these restrictions, we report a flexible image reconstruction algorithm based on a total variation (TV) and cascaded denoisers (CD) for HCUP, named the TV-CD algorithm. The TV-CD algorithm applies the TV denoising model cascaded with several advanced deep learning-based denoising models in the iterative plug-and-play alternating direction method of multipliers framework, which not only preserves the image smoothness with TV, but also obtains more priori with CD. Therefore, it solves the common sparsity representation problem in local similarity and motion compensation. Both the simulation and experimental results show that the proposed TV-CD algorithm can effectively improve the image reconstruction accuracy and quality of HCUP, and may further promote the practical applications of HCUP in capturing high-dimensional complex physical, chemical and biological ultrafast dynamic scenes.
Collapse
|