1
|
He H, Zhang Y, Shao Y, Zhang Y, Geng G, Li J, Li X, Wang Y, Bian L, Zhang J, Huang L. Meta-Attention Network Based Spectral Reconstruction with Snapshot Near-Infrared Metasurface. ADVANCED MATERIALS (DEERFIELD BEACH, FLA.) 2024:e2313357. [PMID: 38588507 DOI: 10.1002/adma.202313357] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/08/2023] [Revised: 04/04/2024] [Indexed: 04/10/2024]
Abstract
Near-infrared (NIR) spectral information is important for detecting and analyzing material compositions. However, snapshot NIR spectral imaging systems still pose significant challenges owing to the lack of high-performance NIR filters and bulky setups, preventing effective encoding and integration with mobile devices. This study introduces a snapshot spectral imaging system that employs a compact NIR metasurface featuring 25 distinct C4 symmetry structures. Benefitting from the sufficient spectral variety and low correlation coefficient among these structures, center-wavelength accuracy of 0.05 nm and full width at half maximum accuracy of 0.13 nm are realized. The system maintains good performance within an incident angle of 1°. A novel meta-attention network prior iterative denoising reconstruction (MAN-IDR) algorithm is developed to achieve high-quality NIR spectral imaging. By leveraging the designed metasurface and MAN-IDR, the NIR spectral images, exhibiting precise textures, minimal artifacts in the spatial dimension, and little crosstalk between spectral channels, are reconstructed from a single grayscale recording image. The proposed NIR metasurface and MAN-IDR hold great promise for further integration with smartphones and drones, guaranteeing the adoption of NIR spectral imaging in real-world scenarios such as aerospace, health diagnostics, and machine vision.
Collapse
Affiliation(s)
- Haoyang He
- Beijing Engineering Research Center of Mixed Reality and Advanced Display, Key Laboratory of Photoelectronic Imaging Technology and System of Ministry of Education of China, School of Optics and Photonics, Beijing Institute of Technology, Beijing, 100081, China
| | - Yuzhe Zhang
- MIIT Key Laboratory of Complex-field Intelligent Sensing, Beijing Institute of Technology, Beijing, 100081, China
| | - Yujie Shao
- Beijing Engineering Research Center of Mixed Reality and Advanced Display, Key Laboratory of Photoelectronic Imaging Technology and System of Ministry of Education of China, School of Optics and Photonics, Beijing Institute of Technology, Beijing, 100081, China
| | - Yan Zhang
- Beijing Engineering Research Center of Mixed Reality and Advanced Display, Key Laboratory of Photoelectronic Imaging Technology and System of Ministry of Education of China, School of Optics and Photonics, Beijing Institute of Technology, Beijing, 100081, China
| | - Guangzhou Geng
- Beijing National Laboratory for Condensed Matter Physics, Institute of Physics, Chinese Academy of Science, Beijing, 100191, China
| | - Junjie Li
- Beijing National Laboratory for Condensed Matter Physics, Institute of Physics, Chinese Academy of Science, Beijing, 100191, China
| | - Xin Li
- Beijing Engineering Research Center of Mixed Reality and Advanced Display, Key Laboratory of Photoelectronic Imaging Technology and System of Ministry of Education of China, School of Optics and Photonics, Beijing Institute of Technology, Beijing, 100081, China
| | - Yongtian Wang
- Beijing Engineering Research Center of Mixed Reality and Advanced Display, Key Laboratory of Photoelectronic Imaging Technology and System of Ministry of Education of China, School of Optics and Photonics, Beijing Institute of Technology, Beijing, 100081, China
| | - Liheng Bian
- MIIT Key Laboratory of Complex-field Intelligent Sensing, Beijing Institute of Technology, Beijing, 100081, China
| | - Jun Zhang
- MIIT Key Laboratory of Complex-field Intelligent Sensing, Beijing Institute of Technology, Beijing, 100081, China
| | - Lingling Huang
- Beijing Engineering Research Center of Mixed Reality and Advanced Display, Key Laboratory of Photoelectronic Imaging Technology and System of Ministry of Education of China, School of Optics and Photonics, Beijing Institute of Technology, Beijing, 100081, China
| |
Collapse
|
2
|
Liu S, Zou W, Sha H, Feng X, Chen B, Zhang J, Han S, Li X, Zhang Y. Deep learning-enhanced snapshot hyperspectral confocal microscopy imaging system. OPTICS EXPRESS 2024; 32:13918-13931. [PMID: 38859350 DOI: 10.1364/oe.519045] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/15/2024] [Accepted: 03/17/2024] [Indexed: 06/12/2024]
Abstract
Laser-scanning confocal hyperspectral microscopy is a powerful technique to identify the different sample constituents and their spatial distribution in three-dimensional (3D). However, it suffers from low imaging speed because of the mechanical scanning methods. To overcome this challenge, we propose a snapshot hyperspectral confocal microscopy imaging system (SHCMS). It combined coded illumination microscopy based on a digital micromirror device (DMD) with a snapshot hyperspectral confocal neural network (SHCNet) to realize single-shot confocal hyperspectral imaging. With SHCMS, high-contrast 160-bands confocal hyperspectral images of potato tuber autofluorescence can be collected by only single-shot, which is almost 5 times improvement in the number of spectral channels than previously reported methods. Moreover, our approach can efficiently record hyperspectral volumetric imaging due to the optical sectioning capability. This fast high-resolution hyperspectral imaging method may pave the way for real-time highly multiplexed biological imaging.
Collapse
|
3
|
Mohammadi V, Gouton P, Rossé M, Katakpe KK. Design and Development of Large-Band Dual-MSFA Sensor Camera for Precision Agriculture. SENSORS (BASEL, SWITZERLAND) 2023; 24:64. [PMID: 38202927 PMCID: PMC10780810 DOI: 10.3390/s24010064] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/02/2023] [Revised: 12/11/2023] [Accepted: 12/18/2023] [Indexed: 01/12/2024]
Abstract
The optimal design and construction of multispectral cameras can remarkably reduce the costs of spectral imaging systems and efficiently decrease the amount of image processing and analysis required. Also, multispectral imaging provides effective imaging information through higher-resolution images. This study aimed to develop novel, multispectral cameras based on Fabry-Pérot technology for agricultural applications such as plant/weed separation, ripeness estimation, and disease detection. Two multispectral cameras were developed, covering visible and near-infrared ranges from 380 nm to 950 nm. A monochrome image sensor with a resolution of 1600 × 1200 pixels was used, and two multispectral filter arrays were developed and mounted on the sensors. The filter pitch was 4.5 μm, and each multispectral filter array consisted of eight bands. Band selection was performed using a genetic algorithm. For VIS and NIR filters, maximum RMS values of 0.0740 and 0.0986 were obtained, respectively. The spectral response of the filters in VIS was significant; however, in NIR, the spectral response of the filters after 830 nm decreased by half. In total, these cameras provided 16 spectral images in high resolution for agricultural purposes.
Collapse
Affiliation(s)
| | - Pierre Gouton
- ImViA Laboratory, UFR Sciences et Techniques, University of Burgundy, 21078 Dijon, France; (V.M.); (M.R.); (K.K.K.)
| | | | | |
Collapse
|