1
|
Takhtkeshha N, Mandlburger G, Remondino F, Hyyppä J. Multispectral Light Detection and Ranging Technology and Applications: A Review. SENSORS (BASEL, SWITZERLAND) 2024; 24:1669. [PMID: 38475205 DOI: 10.3390/s24051669] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/01/2023] [Revised: 02/10/2024] [Accepted: 02/10/2024] [Indexed: 03/14/2024]
Abstract
Light Detection and Ranging (LiDAR) is a well-established active technology for the direct acquisition of 3D data. In recent years, the geometric information collected by LiDAR sensors has been widely combined with optical images to provide supplementary spectral information to achieve more precise results in diverse remote sensing applications. The emergence of active Multispectral LiDAR (MSL) systems, which operate on different wavelengths, has recently been revolutionizing the simultaneous acquisition of height and intensity information. So far, MSL technology has been successfully applied for fine-scale mapping in various domains. However, a comprehensive review of this modern technology is currently lacking. Hence, this study presents an exhaustive overview of the current state-of-the-art in MSL systems by reviewing the latest technologies for MSL data acquisition. Moreover, the paper reports an in-depth analysis of the diverse applications of MSL, spanning across fields of "ecology and forestry", "objects and Land Use Land Cover (LULC) classification", "change detection", "bathymetry", "topographic mapping", "archaeology and geology", and "navigation". Our systematic review uncovers the potentials, opportunities, and challenges of the recently emerged MSL systems, which integrate spatial-spectral data and unlock the capability for precise multi-dimensional (nD) mapping using only a single-data source.
Collapse
Affiliation(s)
- Narges Takhtkeshha
- 3D Optical Metrology (3DOM) Unit, Bruno Kessler Foundation (FBK), 38123 Trento, Italy
- Department of Geodesy and Geoinformation, Vienna University of Technology, 1040 Vienna, Austria
| | - Gottfried Mandlburger
- Department of Geodesy and Geoinformation, Vienna University of Technology, 1040 Vienna, Austria
| | - Fabio Remondino
- 3D Optical Metrology (3DOM) Unit, Bruno Kessler Foundation (FBK), 38123 Trento, Italy
| | - Juha Hyyppä
- Department of Photogrammetry and Remote Sensing, Finnish Geospatial Research Institute, National Land Survey of Finland, FI-02150 Espoo, Finland
| |
Collapse
|
2
|
Ray P, Salido-Monzú D, Camenzind SL, Wieser A. Supercontinuum-based hyperspectral LiDAR for precision laser scanning. OPTICS EXPRESS 2023; 31:33486-33499. [PMID: 37859130 DOI: 10.1364/oe.498576] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/04/2023] [Accepted: 09/11/2023] [Indexed: 10/21/2023]
Abstract
Hyperspectral LiDAR enables non-contact mapping of the 3D surface geometry of an object along with its spectral reflectance signature and has proved to be effective for automated point cloud segmentation in various remote sensing applications. The established hyperspectral LiDAR methods offer a range precision of a few mm to a few cm for distances exceeding several meters. We propose a novel approach to hyperspectral LiDAR scanning based on a supercontinuum (SC) coherently broadened from a 780 nm frequency comb. It provides high precision distance measurements along with target reflectance over the 570-970 nm range of the SC output. The distance measurements are carried out by monitoring the differential phase delay of intermode beat notes generated by direct photodetection, while the backscattered light spectrum is acquired using a commercial CCD spectrometer with 0.16 nm resolution across the 400 nm bandwidth of the SC output. We demonstrate a measurement precision below 0.1 mm for a stand-off range up to 50 m on a diffuse target with around 89% reflectance. The measured relative accuracy as compared to a reference interferometer is on the order of 10-5 for distances up to 50 m. Initial results also indicate spectrum-based material classification within a 3D point cloud using a linear support vector machine. The results highlight the potential of this approach for joint high-precision laser scanning and automated material classification.
Collapse
|
3
|
Sivaprakasam V, Lin D, Yetzbacher MK, Gemar HE, Portier JM, Watnik AT. Multi-spectral SWIR lidar for imaging and spectral discrimination through partial obscurations. OPTICS EXPRESS 2023; 31:5443-5457. [PMID: 36823824 DOI: 10.1364/oe.477499] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/06/2022] [Accepted: 12/26/2022] [Indexed: 06/18/2023]
Abstract
We have developed a multi-spectral SWIR lidar system capable of measuring simultaneous spatial-spectral information for imaging and spectral discrimination through partial obscurations. We employ objects in the presence and absence of a series of obscurants to evaluate the capability of the system in classifying the objects of interest based on spectral and range information. We employ a principal component analysis-based algorithm in classifying the objects and quantifying the accuracy of detection under various obscured scenarios. The merits of multi-spectral lidar over hyperspectral imaging are highlighted for target identification in the presence of obscurants.
Collapse
|
4
|
Han Y, Salido-Monzú D, Wieser A. Comb-based multispectral LiDAR providing reflectance and distance spectra. OPTICS EXPRESS 2022; 30:42362-42375. [PMID: 36366691 DOI: 10.1364/oe.473466] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/18/2022] [Accepted: 10/05/2022] [Indexed: 06/16/2023]
Abstract
Multispectral LiDAR enables joint observations of the 3D geometry and material properties of natural targets by combining ToF-based distance measurements with remote spectroscopy. Established multispectral LiDAR solutions provide mm-level range resolution and reflectance estimates of the target material over some tens of spectral channels. We propose a novel multispectral LiDAR approach based on an ultra-broadband frequency comb that enables enhanced remote spectroscopy by resolving relative delays in addition to reflectance. The spectrally-resolved delay and power measurements are transformed into distance and reflectance spectra by differential observations to a common reference object and adequate system calibration. These distance and reflectance spectra encode material information related to the surface and sub-surface composition and small-scale geometry. We develop the proposed comb-based multispectral LiDAR on an implementation covering the spectral range between 580 nm and 900 nm on 2 different spectral configurations with 7 and 33 channels of different spectral width. The performance assessment of the implemented system demonstrates a distance measurement precision better than 0.1 mm on most channels. Table-top probing results on five material specimens show that both the distance and the reflectance spectra alone enable discrimination of material specimens, while the novel distance signature particularly complements reflectance and increases classification accuracy when the material surface exhibits significant reflectance inhomogeneity. Material classification results using a support vector machine with radial basis function kernel demonstrate the potential of this approach for enhanced material classification by combining both signature dimensions.
Collapse
|
5
|
Abstract
Robotics navigation and perception for forest management are challenging due to the existence of many obstacles to detect and avoid and the sharp illumination changes. Advanced perception systems are needed because they can enable the development of robotic and machinery solutions to accomplish a smarter, more precise, and sustainable forestry. This article presents a state-of-the-art review about unimodal and multimodal perception in forests, detailing the current developed work about perception using a single type of sensors (unimodal) and by combining data from different kinds of sensors (multimodal). This work also makes a comparison between existing perception datasets in the literature and presents a new multimodal dataset, composed by images and laser scanning data, as a contribution for this research field. Lastly, a critical analysis of the works collected is conducted by identifying strengths and research trends in this domain.
Collapse
|
6
|
Kaasalainen S, Malkamäki T. Potential of active multispectral lidar for detecting low reflectance targets. OPTICS EXPRESS 2020; 28:1408-1416. [PMID: 32121852 DOI: 10.1364/oe.379491] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/02/2019] [Accepted: 12/13/2019] [Indexed: 06/10/2023]
Abstract
The calibration and sampling of the multispectral Light Detection and Ranging (lidar) intensity is still challenging because the data acquisition has to be optimized for simultaneous 3D measurement, and the intensity retrieval methods need to be fast to enable real-time detection. We have studied the spectral measurement of low reflectance targets with an 8-channel hyperspectral lidar with improved waveform sampling and sensitivity, which now allow the detection of spectral differences even at low reflectance values. Our initial analysis resulted in a classification accuracy greater than 80%, which indicates that the multispectral lidar is able to detect the small differences in target spectral properties when reflectance at two or more channels is compared at the same time.
Collapse
|
7
|
Active Hyperspectral Sensor Based on MEMS Fabry-Pérot Interferometer. SENSORS 2019; 19:s19092192. [PMID: 31083615 PMCID: PMC6539306 DOI: 10.3390/s19092192] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/31/2019] [Revised: 05/04/2019] [Accepted: 05/05/2019] [Indexed: 11/22/2022]
Abstract
An active hyperspectral sensor (AHS) was developed for target detection and classification applications. AHS measures light scattered from a target, illuminated by a broadband near-infrared supercontinuum (SC) light source. Spectral discrimination is based on a voltage-tunable MEMS Fabry-Pérot Interferometer (FPI). The broadband light is filtered by the FPI prior to transmitting, allowing for a high spectral-power density within the eye-safety limits. The approach also allows for a cost-efficient correction of the SC instability, employing a non-dispersive reference detector. A precision of 0.1% and long-term stability better than 0.5% were demonstrated in laboratory tests. The prototype was mounted on a car for field measurements. Several road types and objects were distinguished based on the spectral response of the sensor targeted in front of the car.
Collapse
|
8
|
Zhao H, Wang Z, Jia G, Li X, Zhang Y. Field imaging system for hyperspectral data, 3D structural data and panchromatic image data measurement based on acousto-optic tunable filter. OPTICS EXPRESS 2018; 26:17717-17730. [PMID: 30119582 DOI: 10.1364/oe.26.017717] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/03/2018] [Accepted: 06/20/2018] [Indexed: 06/08/2023]
Abstract
The hyperspectral data and 3D structural data are highly useful in botanical research. But, the two types of information are often acquired separately and hard to be combined. In this work, a novel dual-path configuration based on acousto-optical tunable filter (AOTF) is proposed to acquire an image, structural and hyperspectral information within one acquisition process by a combination of laser triangulation. Under the configuration, the hyperspectral data and the 3D structure can be matched to subpixel level after geometrical calibration. Finally, the obtainment of 3D hyperspectral information in field experiment verifies the feasibility of this imaging system.
Collapse
|
9
|
Terrestrial Hyperspectral Image Shadow Restoration through Lidar Fusion. REMOTE SENSING 2017. [DOI: 10.3390/rs9050421] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|
10
|
Yin K, Zhu R, Zhang B, Jiang T, Chen S, Hou J. Ultrahigh-brightness, spectrally-flat, short-wave infrared supercontinuum source for long-range atmospheric applications. OPTICS EXPRESS 2016; 24:20010-20020. [PMID: 27607609 DOI: 10.1364/oe.24.020010] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
Fiber based supercontinuum (SC) sources with output spectra covering the infrared atmospheric window are very useful in long-range atmospheric applications. It is proven that silica fibers can support the generation of broadband SC sources ranging from the visible to the short-wave infrared region. In this paper, we present the generation of an ultrahigh-brightness spectrally-flat 2-2.5 μm SC source in a cladding pumped thulium-doped fiber amplifier (TDFA) numerically and experimentally. The underlying physical mechanisms behind the SC generation process are investigated firstly with a numerical model which includes the fiber gain and loss, the dispersive and nonlinear effects. Simulation results show that abundant soliton pulses are generated in the TDFA, and they are shifted towards the long wavelength side very quickly with the nonlinearity of Raman soliton self-frequency shift (SSFS), and eventually the Raman SSFS process is halted due to the silica fiber's infrared loss. A spectrally-flat 2-2.5 μm SC source could be generated as the result of the spectral superposition of these abundant soliton pulses. These simulation results correspond qualitatively well to the following experimental results. Then, in the experiment, a cladding pumped large-mode-area TDFA is built for pursuing a high-power 2-2.5 μm SC source. By enhancing the pump strength, the output SC spectrum broadens to the long wavelength side gradually. At the highest pump power, the obtained SC source has a maximum average power of 203.4 W with a power conversion efficiency of 38.7%. It has a 3 dB spectral bandwidth of 545 nm ranging from 1990 to 2535 nm, indicating a power spectral density in excess of 370 mW/nm. Meanwhile, the output SC source has a good beam profile. This SC source, to the best of our knowledge, is the brightest spectrally-flat 2-2.5 μm light source ever reported. It will be highly desirable in a lot of long-range atmospheric applications, such as broad-spectrum LIDAR, free space communication and hyper-spectral imaging.
Collapse
|
11
|
Grönwall C, Steinvall O, Göhler B, Hamoir D. Active and passive imaging of clothes in the NIR and SWIR regions for reflectivity analysis. APPLIED OPTICS 2016; 55:5292-5303. [PMID: 27409302 DOI: 10.1364/ao.55.005292] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
We perform statistical analysis of data from active and passive imaging sensors in the near infrared (NIR) and short wavelength infrared (SWIR) wavelength bands. The data were obtained from measurements performed on clothing in a field campaign and in the laboratory. We show that reflectivity data from active imaging can be fitted to Gaussian functions, although earlier theory proposes gamma-gamma functions. We analyze the reflectivity data collected during the field campaign and compare that data with data obtained in the laboratory. We focus on the added value of active imaging when combined with passive imaging to distinguish different clothes for friend/foe identification.
Collapse
|
12
|
Islam MN, Freeman MJ, Peterson LM, Ke K, Ifarraguerri A, Bailey C, Baxley F, Wager M, Absi A, Leonard J, Baker H, Rucci M. Field tests for round-trip imaging at a 1.4 km distance with change detection and ranging using a short-wave infrared super-continuum laser. APPLIED OPTICS 2016; 55:1584-1602. [PMID: 26974617 DOI: 10.1364/ao.55.001584] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/05/2023]
Abstract
Field tests have been conducted of a broadband illuminator for active hyperspectral imaging (HSI) using a short-wave infrared supercontinuum laser (SWIR-SCL). We demonstrated irradiance comparable to the sun for two-way measurements at a 1.4 km distance between laser and target, and performed change detection and ranging. The experimental results suggest that the range resolution of our method is ∼1.5 cm even at the 1.4 km distance. Hence, we demonstrated the possibility to perform HSI with active broadband illumination using the SWIR-SCL. To our knowledge, this experiment is the first-ever to test two-way propagation of the active HSI illumination over a long distance. The 64 W SWIR-SCL provides near sunlight-equivalent illumination over multiple square meters, and the laser could enable HSI 24 h a day, even under a cloud cover, as well as enhanced capabilities such as change detection and ranging.
Collapse
|
13
|
Boudreau S, Levasseur S, Perilla C, Roy S, Genest J. Chemical detection with hyperspectral lidar using dual frequency combs. OPTICS EXPRESS 2013; 21:7411-7418. [PMID: 23546124 DOI: 10.1364/oe.21.007411] [Citation(s) in RCA: 22] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/02/2023]
Abstract
High-resolution spectral lidar measurements using dual frequency combs as a source is presented. The technique enables the range-resolved measurement of fine spectral features, such as gas absorption lines, provided that a suitable scatterer is present in the scene. Measurements of HCN absorption lines at 20 meters are presented, with a water droplet cloud and a diffusely reflective surface as scatterers.
Collapse
Affiliation(s)
- Sylvain Boudreau
- Centre d’optique, photonique et laser, Université Laval, Québec, QC, G1K 7P4, Canada
| | | | | | | | | |
Collapse
|