|
1
|
Zhao T, Lei M. Fast, faster, and the fastest structured illumination microscopy. LIGHT, SCIENCE & APPLICATIONS 2024; 13:186. [PMID: 39134519 PMCID: PMC11319336 DOI: 10.1038/s41377-024-01505-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/15/2024]
Abstract
Parallel acquisition-readout structured-illumination microscopy (PAR-SIM) was designed for high-speed raw data acquisition. By utilizing an xy-scan galvo mirror set, the raw data is projected onto different areas of the camera, enabling a fundamentally stupendous information spatial-temporal flux.
Collapse
Affiliation(s)
- Tianyu Zhao
- MOE Key Laboratory for Nonequilibrium Synthesis and Modulation of Condensed Matter, School of Physics, Xi'an Jiaotong University, Xi'an, 710049, China
| | - Ming Lei
- MOE Key Laboratory for Nonequilibrium Synthesis and Modulation of Condensed Matter, School of Physics, Xi'an Jiaotong University, Xi'an, 710049, China.
| |
Collapse
|
|
2
|
Xu X, Wang W, Qiao L, Fu Y, Ge X, Zhao K, Zhanghao K, Guan M, Chen X, Li M, Jin D, Xi P. Ultra-high spatio-temporal resolution imaging with parallel acquisition-readout structured illumination microscopy (PAR-SIM). LIGHT, SCIENCE & APPLICATIONS 2024; 13:125. [PMID: 38806501 PMCID: PMC11133488 DOI: 10.1038/s41377-024-01464-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/10/2023] [Revised: 04/08/2024] [Accepted: 04/24/2024] [Indexed: 05/30/2024]
Abstract
Structured illumination microscopy (SIM) has emerged as a promising super-resolution fluorescence imaging technique, offering diverse configurations and computational strategies to mitigate phototoxicity during real-time imaging of biological specimens. Traditional efforts to enhance system frame rates have concentrated on processing algorithms, like rolling reconstruction or reduced frame reconstruction, or on investments in costly sCMOS cameras with accelerated row readout rates. In this article, we introduce an approach to elevate SIM frame rates and region of interest (ROI) coverage at the hardware level, without necessitating an upsurge in camera expenses or intricate algorithms. Here, parallel acquisition-readout SIM (PAR-SIM) achieves the highest imaging speed for fluorescence imaging at currently available detector sensitivity. By using the full frame-width of the detector through synchronizing the pattern generation and image exposure-readout process, we have achieved a fundamentally stupendous information spatial-temporal flux of 132.9 MPixels · s-1, 9.6-fold that of the latest techniques, with the lowest SNR of -2.11 dB and 100 nm resolution. PAR-SIM demonstrates its proficiency in successfully reconstructing diverse cellular organelles in dual excitations, even under conditions of low signal due to ultra-short exposure times. Notably, mitochondrial dynamic tubulation and ongoing membrane fusion processes have been captured in live COS-7 cell, recorded with PAR-SIM at an impressive 408 Hz. We posit that this novel parallel exposure-readout mode not only augments SIM pattern modulation for superior frame rates but also holds the potential to benefit other complex imaging systems with a strategic controlling approach.
Collapse
Affiliation(s)
- Xinzhu Xu
- Department of Biomedical Engineering, College of Future Technology, Peking University, Beijing, 100871, China
- Wallace H. Coulter Dept. of Biomedical Engineering, Georgia Institute of Technology and Emory University, Atlanta, 30332, GA, USA
- National Biomedical Imaging Center, Peking University, Beijing, 100871, China
- Department of Biomedical Engineering, College of Engineering, Southern University of Science and Technology, Shenzhen, 518055, Guangdong, China
| | - Wenyi Wang
- Department of Biomedical Engineering, College of Future Technology, Peking University, Beijing, 100871, China
- National Biomedical Imaging Center, Peking University, Beijing, 100871, China
- Airy Technologies Co., Ltd., Beijing, 100086, China
| | - Liang Qiao
- Department of Biomedical Engineering, College of Engineering, Southern University of Science and Technology, Shenzhen, 518055, Guangdong, China
- Airy Technologies Co., Ltd., Beijing, 100086, China
| | - Yunzhe Fu
- Department of Biomedical Engineering, College of Future Technology, Peking University, Beijing, 100871, China
- National Biomedical Imaging Center, Peking University, Beijing, 100871, China
| | - Xichuan Ge
- Airy Technologies Co., Ltd., Beijing, 100086, China
| | - Kun Zhao
- Department of Biomedical Engineering, College of Future Technology, Peking University, Beijing, 100871, China
- Wallace H. Coulter Dept. of Biomedical Engineering, Georgia Institute of Technology and Emory University, Atlanta, 30332, GA, USA
| | - Karl Zhanghao
- Department of Biomedical Engineering, College of Engineering, Southern University of Science and Technology, Shenzhen, 518055, Guangdong, China
- Eastern Institute for Advanced Study, Eastern Institute of Technology, Ningbo, Zhejiang, 315200, China
| | - Meiling Guan
- Department of Biomedical Engineering, College of Future Technology, Peking University, Beijing, 100871, China
- National Biomedical Imaging Center, Peking University, Beijing, 100871, China
| | - Xin Chen
- Department of Biomedical Engineering, College of Future Technology, Peking University, Beijing, 100871, China
- National Biomedical Imaging Center, Peking University, Beijing, 100871, China
| | - Meiqi Li
- National Biomedical Imaging Center, Peking University, Beijing, 100871, China
- School of Life Science, Peking University, Beijing, 100871, China
| | - Dayong Jin
- Department of Biomedical Engineering, College of Engineering, Southern University of Science and Technology, Shenzhen, 518055, Guangdong, China.
- Eastern Institute for Advanced Study, Eastern Institute of Technology, Ningbo, Zhejiang, 315200, China.
- Institute for Biomedical Materials and Devices (IBMD), Faculty of Science, University of Technology Sydney, Sydney, NSW, 2007, Australia.
| | - Peng Xi
- Department of Biomedical Engineering, College of Future Technology, Peking University, Beijing, 100871, China.
- National Biomedical Imaging Center, Peking University, Beijing, 100871, China.
- Airy Technologies Co., Ltd., Beijing, 100086, China.
| |
Collapse
|
|
3
|
Ji C, Zhu Y, He E, Liu Q, Zhou D, Xie S, Wu H, Zhang J, Du K, Chen Y, Liu W, Kuang C. Full field-of-view hexagonal lattice structured illumination microscopy based on the phase shift of electro-optic modulators. OPTICS EXPRESS 2024; 32:1635-1649. [PMID: 38297711 DOI: 10.1364/oe.507762] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/12/2023] [Accepted: 12/20/2023] [Indexed: 02/02/2024]
Abstract
High throughput has become an important research direction in the field of super-resolution (SR) microscopy, especially in improving the capability of dynamic observations. In this study, we present a hexagonal lattice structured illumination microscopy (hexSIM) system characterized by a large field of view (FOV), rapid imaging speed, and high power efficiency. Our approach employs spatial light interference to generate a two-dimensional hexagonal SIM pattern, and utilizes electro-optical modulators for high-speed phase shifting. This design enables the achievement of a 210-µm diameter SIM illumination FOV when using a 100×/1.49 objective lens, capturing 2048 × 2048 pixel images at an impressive 98 frames per second (fps) single frame rate. Notably, this method attains a near 100% full field-of-view and power efficiency, with the speed limited only by the camera's capabilities. Our hexSIM demonstrates a substantial 1.73-fold improvement in spatial resolution and necessitates only seven phase-shift images, thus enhancing the imaging speed compared to conventional 2D-SIM.
Collapse
|
|
4
|
Chen X, Zhong S, Hou Y, Cao R, Wang W, Li D, Dai Q, Kim D, Xi P. Superresolution structured illumination microscopy reconstruction algorithms: a review. LIGHT, SCIENCE & APPLICATIONS 2023; 12:172. [PMID: 37433801 DOI: 10.1038/s41377-023-01204-4] [Citation(s) in RCA: 31] [Impact Index Per Article: 15.5] [Reference Citation Analysis] [Abstract] [Grants] [Subscribe] [Scholar Register] [Received: 12/05/2022] [Revised: 05/24/2023] [Accepted: 06/05/2023] [Indexed: 07/13/2023]
Abstract
Structured illumination microscopy (SIM) has become the standard for next-generation wide-field microscopy, offering ultrahigh imaging speed, superresolution, a large field-of-view, and long-term imaging. Over the past decade, SIM hardware and software have flourished, leading to successful applications in various biological questions. However, unlocking the full potential of SIM system hardware requires the development of advanced reconstruction algorithms. Here, we introduce the basic theory of two SIM algorithms, namely, optical sectioning SIM (OS-SIM) and superresolution SIM (SR-SIM), and summarize their implementation modalities. We then provide a brief overview of existing OS-SIM processing algorithms and review the development of SR-SIM reconstruction algorithms, focusing primarily on 2D-SIM, 3D-SIM, and blind-SIM. To showcase the state-of-the-art development of SIM systems and assist users in selecting a commercial SIM system for a specific application, we compare the features of representative off-the-shelf SIM systems. Finally, we provide perspectives on the potential future developments of SIM.
Collapse
Affiliation(s)
- Xin Chen
- Department of Biomedical Engineering, College of Future Technology, Peking University, Beijing, 100871, China
- National Biomedical Imaging Center, Peking University, Beijing, 100871, China
| | - Suyi Zhong
- Department of Biomedical Engineering, College of Future Technology, Peking University, Beijing, 100871, China
- National Biomedical Imaging Center, Peking University, Beijing, 100871, China
| | - Yiwei Hou
- Department of Biomedical Engineering, College of Future Technology, Peking University, Beijing, 100871, China
- National Biomedical Imaging Center, Peking University, Beijing, 100871, China
| | - Ruijie Cao
- Department of Biomedical Engineering, College of Future Technology, Peking University, Beijing, 100871, China
- National Biomedical Imaging Center, Peking University, Beijing, 100871, China
| | - Wenyi Wang
- Department of Biomedical Engineering, College of Future Technology, Peking University, Beijing, 100871, China
- National Biomedical Imaging Center, Peking University, Beijing, 100871, China
| | - Dong Li
- National Laboratory of Biomacromolecules, CAS Center for Excellence in Biomacromolecules, Institute of Biophysics, Chinese Academy of Sciences, Beijing, China
| | - Qionghai Dai
- Department of Automation, Tsinghua University, Beijing, China
- Institute for Brain and Cognitive Sciences, Tsinghua University, Beijing, China
- Beijing Key Laboratory of Multidimension & Multiscale Computational Photography, Tsinghua University, Beijing, China
- Beijing Laboratory of Brain and Cognitive Intelligence, Beijing Municipal Education Commission, Beijing, China
| | - Donghyun Kim
- School of Electrical and Electronic Engineering, Yonsei University, 50 Yonsei-Ro, Seodaemun-Gu, Seoul, 03722, Korea
| | - Peng Xi
- Department of Biomedical Engineering, College of Future Technology, Peking University, Beijing, 100871, China.
- National Biomedical Imaging Center, Peking University, Beijing, 100871, China.
| |
Collapse
|
|
5
|
Tu S, Li X, Wang Y, Gong W, Liu X, Liu Q, Han Y, Kuang C, Liu X, Hao X. High-speed spatially re-modulated structured illumination microscopy. OPTICS LETTERS 2023; 48:2535-2538. [PMID: 37186701 DOI: 10.1364/ol.485929] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/17/2023]
Abstract
Structured illumination microscopy (SIM) allows non-invasive visualization of nanoscale subcellular structures. However, image acquisition and reconstruction become the bottleneck to further improve the imaging speed. Here, we propose a method to accelerate SIM imaging by combining the spatial re-modulation principle with Fourier domain filtering and using measured illumination patterns. This approach enables high-speed, high-quality imaging of dense subcellular structures using a conventional nine-frame SIM modality without phase estimation of the patterns. In addition, seven-frame SIM reconstruction and additional hardware acceleration further improve the imaging speed using our method. Furthermore, our method is also applicable to other spatially uncorrelated illumination patterns, such as distorted sinusoidal, multifocal, and speckle patterns.
Collapse
|
|
6
|
Gong J, Jin Z, Chen H, He J, Zhang Y, Yang X. Super-resolution fluorescence microscopic imaging in pathogenesis and drug treatment of neurological disease. Adv Drug Deliv Rev 2023; 196:114791. [PMID: 37004939 DOI: 10.1016/j.addr.2023.114791] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2022] [Revised: 03/16/2023] [Accepted: 03/19/2023] [Indexed: 04/03/2023]
Abstract
Since super-resolution fluorescence microscopic technology breaks the diffraction limit that has existed for a long time in optical imaging, it can observe the process of synapses formed between nerve cells and the protein aggregation related to neurological disease. Thus, super-resolution fluorescence microscopic imaging has significantly impacted several industries, including drug development and pathogenesis research, and it is anticipated that it will significantly alter the future of life science research. Here, we focus on several typical super-resolution fluorescence microscopic technologies, introducing their benefits and drawbacks, as well as applications in several common neurological diseases, in the hope that their services will be expanded and improved in the pathogenesis and drug treatment of neurological diseases.
Collapse
|