1
|
Shimada K, Azuma K, Inada Y, Nakagawa K. Optical design of spectral filtering system in sequentially timed all-optical mapping photography for enhancing temporal resolution. THE REVIEW OF SCIENTIFIC INSTRUMENTS 2025; 96:053703. [PMID: 40331838 DOI: 10.1063/5.0240730] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/26/2024] [Accepted: 04/23/2025] [Indexed: 05/08/2025]
Abstract
Ultrafast imaging is crucial for understanding phenomena in the femtosecond to nanosecond time domains. Among ultrafast imaging techniques, sequentially timed all-optical mapping photography utilizing spectral filtering enables single-shot acquisition of ultrafast images with high spatial resolution and high quality. However, conventional designs based on Fourier optics struggle to achieve high temporal resolution while maintaining high pixel resolution, because the spatial-spectral dependence in this configuration makes laser wavelengths within each frame broad, resulting in longer exposure times. Here we propose an optical design that minimizes the bandwidth of laser wavelengths within each frame to achieve high temporal resolution by collimating the beam incident on the diffractive optical element. Numerical analysis showed that increasing the magnification of the imaging system before the diffractive optical element sufficiently narrows the bandwidth within each frame compared to the conventional designs. We experimentally demonstrated the effectiveness of the proposed configuration, achieving a bandwidth of 0.9 nm and a wavelength interval of 2.1 nm. These spectral properties enabled imaging with a 1.4 ps frame interval and an exposure time of 0.8 ps, which is 40% of the exposure time in the conventional Fourier configuration with similar setup parameters. Furthermore, the proposed configuration maintained a high pixel resolution of 480 pixels × 480 pixels for each of the five frames and was successfully applied to visualize laser ablation of glass. This article presents a highly spatiotemporally resolved imaging method for the detailed analysis of ultrafast phenomena such as laser ablation, shockwaves, and electric discharges.
Collapse
Affiliation(s)
- Keitaro Shimada
- Department of Bioengineering, The University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo 113-8656, Japan
| | - Kohei Azuma
- Department of Precision Engineering, The University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo 113-8656, Japan
| | - Yuki Inada
- Electronics and Information Sciences, Saitama University, 255 Shimo-Okubo, Sakura-ku, Saitama-City, Saitama 338-8570, Japan
| | - Keiichi Nakagawa
- Department of Bioengineering, The University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo 113-8656, Japan
- Department of Precision Engineering, The University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo 113-8656, Japan
| |
Collapse
|
2
|
Yao J, Guo Z, Qi D, Xu S, Lin W, Cheng L, Jin C, He Y, Xu N, Pan Z, Mao J, Yao Y, Deng L, Shen Y, Zhao H, Sun Z, Zhang S. Discrete Illumination-Based Compressed Ultrafast Photography for High-Fidelity Dynamic Imaging. ADVANCED SCIENCE (WEINHEIM, BADEN-WURTTEMBERG, GERMANY) 2024; 11:e2403854. [PMID: 39120051 PMCID: PMC11538675 DOI: 10.1002/advs.202403854] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/12/2024] [Revised: 07/03/2024] [Indexed: 08/10/2024]
Abstract
Compressed ultrafast photography (CUP) can capture irreversible or difficult-to-repeat dynamic scenes at the imaging speed of more than one billion frames per second, which is obtained by compressive sensing-based image reconstruction from a compressed 2D image through the discretization of detector pixels. However, an excessively high data compression ratio in CUP severely degrades the image reconstruction quality, thereby restricting its ability to observe ultrafast dynamic scenes with complex spatial structures. To address this issue, a discrete illumination-based CUP (DI-CUP) with high fidelity is reported. In DI-CUP, the dynamic scenes are loaded into an ultrashort laser pulse train with controllable sub-pulse number and time interval, thus the data compression ratio, as well as the overlap between adjacent frames, is greatly decreased and flexibly controlled through the discretization of dynamic scenes based on laser pulse train illumination, and high-fidelity image reconstruction can be realized within the same observation time window. Furthermore, the superior performance of DI-CUP is verified by observing femtosecond laser-induced ablation dynamics and plasma channel evolution, which are hardly resolved in the spatial structures using conventional CUP. It is anticipated that DI-CUP will be widely and dependably used in the real-time observations of various ultrafast dynamics.
Collapse
Affiliation(s)
- Jiali Yao
- State Key Laboratory of Precision SpectroscopySchool of Physics and Electronic ScienceEast China Normal UniversityShanghai200241China
- Present address:
College of ScienceShanghai Institute of TechnologyShanghai201418China
| | - Zihan Guo
- State Key Laboratory of Precision SpectroscopySchool of Physics and Electronic ScienceEast China Normal UniversityShanghai200241China
| | - Dalong Qi
- State Key Laboratory of Precision SpectroscopySchool of Physics and Electronic ScienceEast China Normal UniversityShanghai200241China
| | - Shiyu Xu
- North Night Vision Technology Co. LtdKunming650217China
| | - Wenzhang Lin
- State Key Laboratory of Precision SpectroscopySchool of Physics and Electronic ScienceEast China Normal UniversityShanghai200241China
| | - Long Cheng
- State Key Laboratory of Precision SpectroscopySchool of Physics and Electronic ScienceEast China Normal UniversityShanghai200241China
| | - Chengzhi Jin
- State Key Laboratory of Precision SpectroscopySchool of Physics and Electronic ScienceEast China Normal UniversityShanghai200241China
| | - Yu He
- State Key Laboratory of Precision SpectroscopySchool of Physics and Electronic ScienceEast China Normal UniversityShanghai200241China
| | - Ning Xu
- State Key Laboratory of Precision SpectroscopySchool of Physics and Electronic ScienceEast China Normal UniversityShanghai200241China
| | - Zhen Pan
- State Key Laboratory of Precision SpectroscopySchool of Physics and Electronic ScienceEast China Normal UniversityShanghai200241China
| | - Jiayi Mao
- State Key Laboratory of Precision SpectroscopySchool of Physics and Electronic ScienceEast China Normal UniversityShanghai200241China
| | - Yunhua Yao
- State Key Laboratory of Precision SpectroscopySchool of Physics and Electronic ScienceEast China Normal UniversityShanghai200241China
| | - Lianzhong Deng
- State Key Laboratory of Precision SpectroscopySchool of Physics and Electronic ScienceEast China Normal UniversityShanghai200241China
| | - Yuecheng Shen
- State Key Laboratory of Precision SpectroscopySchool of Physics and Electronic ScienceEast China Normal UniversityShanghai200241China
| | - Heng Zhao
- North Night Vision Technology Co. LtdKunming650217China
| | - Zhenrong Sun
- State Key Laboratory of Precision SpectroscopySchool of Physics and Electronic ScienceEast China Normal UniversityShanghai200241China
| | - Shian Zhang
- State Key Laboratory of Precision SpectroscopySchool of Physics and Electronic ScienceEast China Normal UniversityShanghai200241China
- Collaborative Innovation Center of Extreme OpticsShanxi UniversityTaiyuan030006China
- Joint Research Center of Light Manipulation Science and Photonic Integrated Chip of East China Normal University and Shandong Normal UniversityEast China Normal UniversityShanghai200241China
| |
Collapse
|
3
|
Li Z, Xiao L, Feng Z, Liu Z, Wang D, Lei C. Sequentially timed all-optical mapping photography with quantitative phase imaging capability. OPTICS LETTERS 2024; 49:5059-5062. [PMID: 39270227 DOI: 10.1364/ol.533759] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/25/2024] [Accepted: 08/12/2024] [Indexed: 09/15/2024]
Abstract
Sequentially timed all-optical mapping photography (STAMP) is considered a powerful tool to observe highly dynamic events; however, its application is significantly hindered by its incapability to acquire quantitative phase images. In this work, by integrating diffraction phase microscopy (DPM) and STAMP, we achieve ultrafast single-shot quantitative phase imaging with a frame rate of up to 3.3 trillion fps. The performance of the system is evaluated using a homemade phase module. Experimental results show that the system can accurately record the propagation of laser filamentation in air. We believe our method will greatly enhance the capability of STAMP to measure highly transparent targets.
Collapse
|
4
|
Lai Y, Marquez M, Liang J. Tutorial on compressed ultrafast photography. JOURNAL OF BIOMEDICAL OPTICS 2024; 29:S11524. [PMID: 38292055 PMCID: PMC10826888 DOI: 10.1117/1.jbo.29.s1.s11524] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/22/2023] [Revised: 12/23/2023] [Accepted: 12/28/2023] [Indexed: 02/01/2024]
Abstract
Significance Compressed ultrafast photography (CUP) is currently the world's fastest single-shot imaging technique. Through the integration of compressed sensing and streak imaging, CUP can capture a transient event in a single camera exposure with imaging speeds from thousands to trillions of frames per second, at micrometer-level spatial resolutions, and in broad sensing spectral ranges. Aim This tutorial aims to provide a comprehensive review of CUP in its fundamental methods, system implementations, biomedical applications, and prospect. Approach A step-by-step guideline to CUP's forward model and representative image reconstruction algorithms is presented with sample codes and illustrations in Matlab and Python. Then, CUP's hardware implementation is described with a focus on the representative techniques, advantages, and limitations of the three key components-the spatial encoder, the temporal shearing unit, and the two-dimensional sensor. Furthermore, four representative biomedical applications enabled by CUP are discussed, followed by the prospect of CUP's technical advancement. Conclusions CUP has emerged as a state-of-the-art ultrafast imaging technology. Its advanced imaging ability and versatility contribute to unprecedented observations and new applications in biomedicine. CUP holds great promise in improving technical specifications and facilitating the investigation of biomedical processes.
Collapse
Affiliation(s)
- Yingming Lai
- Université du Québec, Institut National de la Recherche Scientifique, Centre Énergie Matériaux Télécommunications, Laboratory of Applied Computational Imaging, Varennes, Québec, Canada
| | - Miguel Marquez
- Université du Québec, Institut National de la Recherche Scientifique, Centre Énergie Matériaux Télécommunications, Laboratory of Applied Computational Imaging, Varennes, Québec, Canada
| | - Jinyang Liang
- Université du Québec, Institut National de la Recherche Scientifique, Centre Énergie Matériaux Télécommunications, Laboratory of Applied Computational Imaging, Varennes, Québec, Canada
| |
Collapse
|
5
|
Saiki T, Shimada K, Ishijima A, Song H, Qi X, Okamoto Y, Mizushima A, Mita Y, Hosobata T, Takeda M, Morita S, Kushibiki K, Ozaki S, Motohara K, Yamagata Y, Tsukamoto A, Kannari F, Sakuma I, Inada Y, Nakagawa K. Single-shot optical imaging with spectrum circuit bridging timescales in high-speed photography. SCIENCE ADVANCES 2023; 9:eadj8608. [PMID: 38117881 PMCID: PMC10732534 DOI: 10.1126/sciadv.adj8608] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/21/2023] [Accepted: 11/17/2023] [Indexed: 12/22/2023]
Abstract
Single-shot optical imaging based on ultrashort lasers has revealed nonrepetitive processes in subnanosecond timescales beyond the recording range of conventional high-speed cameras. However, nanosecond photography without sacrificing short exposure time and image quality is still missing because of the gap in recordable timescales between ultrafast optical imaging and high-speed electronic cameras. Here, we demonstrate nanosecond photography and ultrawide time-range high-speed photography using a spectrum circuit that produces interval-tunable pulse trains while keeping short pulse durations. We capture a shock wave propagating through a biological cell with a 1.5-ns frame interval and 44-ps exposure time while suppressing image blur. Furthermore, we observe femtosecond laser processing over multiple timescales (25-ps, 2.0-ns, and 1-ms frame intervals), showing that the plasma generated at the picosecond timescale affects subsequent shock wave formation at the nanosecond timescale. Our technique contributes to accumulating data of various fast processes for analysis and to analyzing multi-timescale phenomena as a series of physical processes.
Collapse
Affiliation(s)
- Takao Saiki
- Department of Precision Engineering, The University of Tokyo, Tokyo 113-8656, Japan
| | - Keitaro Shimada
- Department of Bioengineering, The University of Tokyo, Tokyo 113-8656, Japan
| | - Ayumu Ishijima
- PRESTO, Japan Science and Technology Agency, Saitama 332-0012, Japan
- Medical Device Development and Regulation Research Center, The University of Tokyo, Tokyo 113-8656, Japan
| | - Hang Song
- Department of Bioengineering, The University of Tokyo, Tokyo 113-8656, Japan
| | - Xinyi Qi
- Department of Bioengineering, The University of Tokyo, Tokyo 113-8656, Japan
| | - Yuki Okamoto
- Sensing System Research Center, National Institute of Advanced Industrial Science and Technology (AIST) Tsukuba, Ibaraki 305-8564, Japan
| | - Ayako Mizushima
- Department of Electrical Engineering and Information Systems, The University of Tokyo, Tokyo 113-8656, Japan
| | - Yoshio Mita
- Department of Electrical and Electronic Engineering, The University of Tokyo, Tokyo 113-0033, Japan
| | - Takuya Hosobata
- RIKEN Centre for Advanced Photonics (RAP), RIKEN, Saitama 351-0198, Japan
| | - Masahiro Takeda
- RIKEN Centre for Advanced Photonics (RAP), RIKEN, Saitama 351-0198, Japan
| | - Shinya Morita
- School of Engineering, Tokyo Denki University, Tokyo 120-8551, Japan
| | - Kosuke Kushibiki
- Institute of Astronomy, The University of Tokyo, Tokyo 181-0015, Japan
| | - Shinobu Ozaki
- National Astronomical Observatory of Japan (NAOJ), Tokyo 181-8588, Japan
| | - Kentaro Motohara
- Institute of Astronomy, The University of Tokyo, Tokyo 181-0015, Japan
- National Astronomical Observatory of Japan (NAOJ), Tokyo 181-8588, Japan
| | - Yutaka Yamagata
- RIKEN Centre for Advanced Photonics (RAP), RIKEN, Saitama 351-0198, Japan
| | - Akira Tsukamoto
- Department of Applied Physics, National Defense Academy of Japan, Kanagawa 239-8686, Japan
| | - Fumihiko Kannari
- Department of Electronics and Electrical Engineering, Keio University, Kanagawa 223-8522, Japan
| | - Ichiro Sakuma
- Department of Precision Engineering, The University of Tokyo, Tokyo 113-8656, Japan
- Department of Bioengineering, The University of Tokyo, Tokyo 113-8656, Japan
- Medical Device Development and Regulation Research Center, The University of Tokyo, Tokyo 113-8656, Japan
| | - Yuki Inada
- PRESTO, Japan Science and Technology Agency, Saitama 332-0012, Japan
- Electronics and Information Sciences, Saitama University, Saitama 338-8570, Japan
| | - Keiichi Nakagawa
- Department of Precision Engineering, The University of Tokyo, Tokyo 113-8656, Japan
- Department of Bioengineering, The University of Tokyo, Tokyo 113-8656, Japan
- PRESTO, Japan Science and Technology Agency, Saitama 332-0012, Japan
| |
Collapse
|
6
|
Chen M, Liu J, Li P, Gharavi H, Hao Y, Ouyang J, Hu J, Hu L, Hou C, Humar I, Wei L, Yang GZ, Tao G. Fabric computing: Concepts, opportunities, and challenges. Innovation (N Y) 2022; 3:100340. [PMID: 36353672 PMCID: PMC9637982 DOI: 10.1016/j.xinn.2022.100340] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/18/2022] [Accepted: 10/13/2022] [Indexed: 11/08/2022] Open
Abstract
With the advent of the Internet of Everything, people can easily interact with their environments immersively. The idea of pervasive computing is becoming a reality, but due to the inconvenience of carrying silicon-based entities and a lack of fine-grained sensing capabilities for human-computer interaction, it is difficult to ensure comfort, esthetics, and privacy in smart spaces. Motivated by the rapid developments in intelligent fabric technology in the post-Moore era, we propose a novel computing approach that creates a paradigm shift driven by fabric computing and advocate a new concept of non-chip sensing in living spaces. We discuss the core notion and benefits of fabric computing, including its implementation, challenges, and future research opportunities.
Collapse
Affiliation(s)
- Min Chen
- Wuhan National Laboratory for Optoelectronics, and School of Computer Science and Technology, Huazhong University of Science and Technology, Wuhan 430074, China
| | - Jia Liu
- Wuhan National Laboratory for Optoelectronics, and School of Computer Science and Technology, Huazhong University of Science and Technology, Wuhan 430074, China
| | - Pan Li
- Wuhan National Laboratory for Optoelectronics, and School of Computer Science and Technology, Huazhong University of Science and Technology, Wuhan 430074, China
| | - Hamid Gharavi
- National Institute of Standards and Technology (NIST), Gaithersburg, MD 20899-8920, USA
| | - Yixue Hao
- Wuhan National Laboratory for Optoelectronics, and School of Computer Science and Technology, Huazhong University of Science and Technology, Wuhan 430074, China
| | - Jingyu Ouyang
- Wuhan National Laboratory for Optoelectronics, and School of Computer Science and Technology, Huazhong University of Science and Technology, Wuhan 430074, China
| | - Jiayu Hu
- Wuhan National Laboratory for Optoelectronics, and School of Computer Science and Technology, Huazhong University of Science and Technology, Wuhan 430074, China
| | - Long Hu
- Wuhan National Laboratory for Optoelectronics, and School of Computer Science and Technology, Huazhong University of Science and Technology, Wuhan 430074, China
| | - Chong Hou
- Wuhan National Laboratory for Optoelectronics, and School of Computer Science and Technology, Huazhong University of Science and Technology, Wuhan 430074, China
- School of Optics and Electronic Information, Huazhong University of Science and Technology, Wuhan 430074, China
| | - Iztok Humar
- Faculty of Electrical Engineering, University of Ljubljana, Trzaska cesta 25, 1000 Ljubljana, Slovenia
| | - Lei Wei
- School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore 639798, Singapore
| | - Guang-Zhong Yang
- Medical Robotics Institute, Shanghai Jiao Tong University, Shanghai 200030, China
| | - Guangming Tao
- Wuhan National Laboratory for Optoelectronics, and School of Computer Science and Technology, Huazhong University of Science and Technology, Wuhan 430074, China
- State Key Laboratory of Material Processing and Die & Mould Technology, School of Materials Science and Engineering, Huazhong University of Science and Technology, Wuhan 430074, China
| |
Collapse
|
7
|
Huang HY, Guo CS. Simple system for realizing single-shot ultrafast sequential imaging based on spatial multiplexing in-line holography. OPTICS EXPRESS 2022; 30:41613-41623. [PMID: 36366634 DOI: 10.1364/oe.472770] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/08/2022] [Accepted: 10/12/2022] [Indexed: 06/16/2023]
Abstract
We present a simple system for realizing single-shot ultrafast sequential imaging based on spatial multiplexing in-line holography. In this system, we propose to combine a specially designed mini-reflector delay-line array with digital in-line holography. The former including a group of adjustable mini-reflectors can easily generate an array of probe sub-pulses that can be controlled independently in the propagation direction and time delays. The object beams formed by the different sub-pulses will propagate and fall on different recording regions of the image sensor to generate a single-shot spatial-multiplexing in-line hologram. The geometry of the digital in-line holography can simplify the complexity of the system and enable complex amplitude imaging. In addition, the time resolution of this system is limited only by the pulse duration, which allows this system to study the dynamic processes with the femtosecond order. In an experiment about the laser-induced air plasma, our proposed system achieves nine frames sequential holographic images with the frame rate of 7.5 trillion frames per second (Tfps).
Collapse
|
8
|
Zhao J, Li M. Lensless ultrafast optical imaging. LIGHT, SCIENCE & APPLICATIONS 2022; 11:97. [PMID: 35436981 PMCID: PMC9016062 DOI: 10.1038/s41377-022-00789-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
Lensless single-shot ultrafast optical imaging is realized by integrating an acousto-optic programmable dispersive filter with spectrally filtered sequentially time all-optical mapping photography, which enables independent control of frame rate, frame intensity, and exposure time with a simple system design.
Collapse
Affiliation(s)
- Jian Zhao
- Department of Electrical and Computer Engineering, Boston University, Boston, MA, 02215, USA.
| | - Mingsheng Li
- Department of Electrical and Computer Engineering, Boston University, Boston, MA, 02215, USA
| |
Collapse
|