1
|
Pitsch C, Walter D, Gasparini L, Bürsing H, Eichhorn M. A Method to Correct the Temporal Drift of Single-Photon Detectors Based on Asynchronous Quantum Ghost Imaging. Sensors (Basel) 2024; 24:2578. [PMID: 38676195 PMCID: PMC11054488 DOI: 10.3390/s24082578] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/22/2024] [Revised: 04/15/2024] [Accepted: 04/16/2024] [Indexed: 04/28/2024]
Abstract
Single-photon detection and timing has attracted increasing interest in recent years due to their necessity in the field of quantum sensing and the advantages of single-quanta detection in the field of low-level light imaging. While simple bucket detectors are mature enough for commercial applications, more complex imaging detectors are still a field of research comprising mostly prototype-level detectors. A major problem in these detectors is the implementation of in-pixel timing circuitry, especially for two-dimensional imagers. One of the most promising approaches is the use of voltage-controlled ring resonators in every pixel. Each of these runs independently based on a voltage supplied by a global reference. However, this yields the problem that the supply voltage can change across the chip which, in turn, changes the period of the ring resonator. Due to additional parasitic effects, this problem can worsen with increasing measurement time, leading to drift in the timing information. We present here a method to identify and correct such temporal drifts in single-photon detectors based on asynchronous quantum ghost imaging. We also show the effect of this correction on recent quantum ghost imaging (QGI) measurement from our group.
Collapse
Affiliation(s)
- Carsten Pitsch
- Fraunhofer Institute of Optronics, System Technologies and Image Exploitation (IOSB), Gutleuthausstr. 1, 76275 Ettlingen, Germany
| | - Dominik Walter
- Fraunhofer Institute of Optronics, System Technologies and Image Exploitation (IOSB), Gutleuthausstr. 1, 76275 Ettlingen, Germany
| | - Leonardo Gasparini
- Fondazione Bruno Kessler, Center for Sensors & Devices, Integrated Readout ASICs & Image Sensors, Via Sommarive 18-Povo, 38123 Trento, Italy
| | - Helge Bürsing
- Fraunhofer Institute of Optronics, System Technologies and Image Exploitation (IOSB), Gutleuthausstr. 1, 76275 Ettlingen, Germany
| | - Marc Eichhorn
- Fraunhofer Institute of Optronics, System Technologies and Image Exploitation (IOSB), Gutleuthausstr. 1, 76275 Ettlingen, Germany
- Institute of Control Systems (IRS), Karlsruhe Institute of Technology, Fritz-Haber-Weg 1, 76131 Karlsruhe, Germany
| |
Collapse
|
2
|
Stateczny A, Halicki A, Specht M, Specht C, Lewicka O. Review of Shoreline Extraction Methods from Aerial Laser Scanning. Sensors (Basel) 2023; 23:s23115331. [PMID: 37300059 DOI: 10.3390/s23115331] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/04/2023] [Revised: 05/31/2023] [Accepted: 06/02/2023] [Indexed: 06/12/2023]
Abstract
Autonomous technologies are increasingly used in various areas of science. The use of unmanned vehicles for hydrographic surveys in shallow coastal areas requires accurate estimation of shoreline position. This is a nontrivial task, which can be performed using a wide range of sensors and methods. The aim of the publication is to review shoreline extraction methods based solely on data from aerial laser scanning (ALS). This narrative review discusses and critically analyses seven publications drawn up in the last ten years. The discussed papers employed nine different shoreline extraction methods based on aerial light detection and ranging (LiDAR) data. It should be noted that unambiguous evaluation of shoreline extraction methods is difficult or impossible. This is because not all of the methods reported achieved accuracy, the methods were assessed on different datasets, the measurements were conducted using different devices, the water areas differed in geometrical and optical properties, the shorelines had different geometries, and the extent of anthropogenic transformation. The methods proposed by the authors were compared with a wide range of reference methods.
Collapse
Affiliation(s)
- Andrzej Stateczny
- Department of Geodesy, Gdańsk University of Technology, Gabriela Narutowicza 11-12, 80-233 Gdańsk, Poland
| | - Armin Halicki
- Marine Technology Ltd., Wiktora Roszczynialskiego 4-6, 81-521 Gdynia, Poland
| | - Mariusz Specht
- Marine Technology Ltd., Wiktora Roszczynialskiego 4-6, 81-521 Gdynia, Poland
- Department of Transport and Logistics, Gdynia Maritime University, Morska 81-87, 81-225 Gdynia, Poland
| | - Cezary Specht
- Department of Geodesy and Oceanography, Gdynia Maritime University, Morska 81-87, 81-225 Gdynia, Poland
| | - Oktawia Lewicka
- Department of Geodesy and Oceanography, Gdynia Maritime University, Morska 81-87, 81-225 Gdynia, Poland
| |
Collapse
|
3
|
Dai Z, Wolf A, Ley PP, Glück T, Sundermeier MC, Lachmayer R. Requirements for Automotive LiDAR Systems. Sensors (Basel) 2022; 22:s22197532. [PMID: 36236631 PMCID: PMC9572322 DOI: 10.3390/s22197532] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/24/2022] [Revised: 09/23/2022] [Accepted: 09/28/2022] [Indexed: 05/25/2023]
Abstract
Light detection and ranging (LiDAR) are fundamental sensors that help driving tasks for autonomous driving at various levels. Commercially available systems come in different specialized design schemes and involve plenty of specifications. In the literature, there are insufficient representations of the technical requirements for LiDAR systems in the automotive context, such as range, detection quality, resolving power, field of view, and eye safety. For this reason, the requirements above require to be derived based on ADAS functions. The requirements for various key LiDAR metrics, including detection range, field of view, angular resolution, and laser safety, are analyzed in this paper. LiDAR systems are available with various radiation patterns that significantly impact on detection range. Therefore, the detection range under various radiation patterns is firstly investigated in this paper. Based on ADAS functions, the required detection range and field of view for LiDAR systems are examined, taking into account various travel speeds to avoid collision and the coverage of the entire lane width. Furthermore, the angular resolution limits are obtained utilizing the KITTI dataset and exemplary 3D detection algorithms. Finally, the maximum detection ranges for the different radiation patterns are compared under the consideration of derived requirements and laser safety.
Collapse
Affiliation(s)
- Zhuoqun Dai
- Institute of Product Development, Leibniz University Hannover, 30823 Garbsen, Germany
| | - Alexander Wolf
- Institute of Product Development, Leibniz University Hannover, 30823 Garbsen, Germany
- Cluster of Excellence PhoenixD (Photonics, Optics, and Engineering-Innovation across Disciplines), Gottfried Wilhelm Leibniz Universität Hannover, Welfengarten 1A, 30167 Hannover, Germany
| | - Peer-Phillip Ley
- Institute of Product Development, Leibniz University Hannover, 30823 Garbsen, Germany
| | - Tobias Glück
- Institute of Product Development, Leibniz University Hannover, 30823 Garbsen, Germany
| | | | - Roland Lachmayer
- Institute of Product Development, Leibniz University Hannover, 30823 Garbsen, Germany
- Cluster of Excellence PhoenixD (Photonics, Optics, and Engineering-Innovation across Disciplines), Gottfried Wilhelm Leibniz Universität Hannover, Welfengarten 1A, 30167 Hannover, Germany
| |
Collapse
|
4
|
Atik ME, Duran Z. An Efficient Ensemble Deep Learning Approach for Semantic Point Cloud Segmentation Based on 3D Geometric Features and Range Images. Sensors (Basel) 2022; 22:6210. [PMID: 36015964 PMCID: PMC9416655 DOI: 10.3390/s22166210] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/29/2022] [Revised: 08/08/2022] [Accepted: 08/15/2022] [Indexed: 06/15/2023]
Abstract
Mobile light detection and ranging (LiDAR) sensor point clouds are used in many fields such as road network management, architecture and urban planning, and 3D High Definition (HD) city maps for autonomous vehicles. Semantic segmentation of mobile point clouds is critical for these tasks. In this study, we present a robust and effective deep learning-based point cloud semantic segmentation method. Semantic segmentation is applied to range images produced from point cloud with spherical projection. Irregular 3D mobile point clouds are transformed into regular form by projecting the clouds onto the plane to generate 2D representation of the point cloud. This representation is fed to the proposed network that produces semantic segmentation. The local geometric feature vector is calculated for each point. Optimum parameter experiments were also performed to obtain the best results for semantic segmentation. The proposed technique, called SegUNet3D, is an ensemble approach based on the combination of U-Net and SegNet algorithms. SegUNet3D algorithm has been compared with five different segmentation algorithms on two challenging datasets. SemanticPOSS dataset includes the urban area, whereas RELLIS-3D includes the off-road environment. As a result of the study, it was demonstrated that the proposed approach is superior to other methods in terms of mean Intersection over Union (mIoU) in both datasets. The proposed method was able to improve the mIoU metric by up to 15.9% in the SemanticPOSS dataset and up to 5.4% in the RELLIS-3D dataset.
Collapse
|
5
|
Nowak R, Kania T, Rutkowski R, Ekiert E. Research and TLS (LiDAR) Construction Diagnostics of Clay Brick Masonry Arched Stairs. Materials (Basel) 2022; 15:552. [PMID: 35057273 DOI: 10.3390/ma15020552] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/28/2021] [Revised: 12/20/2021] [Accepted: 01/03/2022] [Indexed: 11/23/2022]
Abstract
The study presents the terrestrial laser scanning (TLS) diagnostic of the clay brick masonry arched staircase in a historic building. Based on the measurements of the existing arched stair flights, 1:1 scale experimental models with and without stair treads were made. Strength tests of the models were carried out for different concentrated force locations in relation to the supporting structure. Force, deflections and reaction in the upper support of the run were measured during the tests. The influence of the masonry steps on the curved vault on the load capacity and stiffness of the run structure was analyzed. The conducted experimental investigations showed that the key element responsible for the actual load-bearing capacity and stiffness of this type of stair flights were the treads above the masonry arch.
Collapse
|
6
|
Stovall AEL, Masters B, Fatoyinbo L, Yang X. TLSLeAF: automatic leaf angle estimates from single-scan terrestrial laser scanning. New Phytol 2021; 232:1876-1892. [PMID: 34110621 DOI: 10.1111/nph.17548] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/15/2021] [Accepted: 06/04/2021] [Indexed: 06/12/2023]
Abstract
Leaf angle distribution (LAD) in forest canopies affects estimates of leaf area, light interception, and global-scale photosynthesis, but is often simplified to a single theoretical value. Here, we present TLSLeAF (Terrestrial Laser Scanning Leaf Angle Function), an automated open-source method of deriving LADs from terrestrial laser scanning. TLSLeAF produces canopy-scale leaf angle and LADs by relying on gridded laser scanning data. The approach increases processing speed, improves angle estimates, and requires minimal user input. Key features are automation, leaf-wood classification, beta parameter output, and implementation in R to increase accessibility for the ecology community. TLSLeAF precisely estimates leaf angle with minimal distance effects on angular estimates while rapidly producing LADs on a consumer-grade machine. We challenge the popular spherical LAD assumption, showing sensitivity to ecosystem type in plant area index and foliage profile estimates that translate to c. 25% and c. 11% increases in canopy net photosynthesis (c. 25%) and solar-induced chlorophyll fluorescence (c. 11%). TLSLeAF can now be applied to the vast catalog of laser scanning data already available from ecosystems around the globe. The ease of use will enable widespread adoption of the method outside of remote-sensing experts, allowing greater accessibility for addressing ecological hypotheses and large-scale ecosystem modeling efforts.
Collapse
Affiliation(s)
- Atticus E L Stovall
- Biospheric Sciences Lab, NASA Goddard Space Flight Center, Greenbelt, MD, 20771, USA
- Department of Geographical Sciences, University of Maryland, College Park, MD, 20742, USA
- Department of Environmental Sciences, University of Virginia, Charlottesville, VA, 22903, USA
| | - Benjamin Masters
- Department of Environmental Sciences, University of Virginia, Charlottesville, VA, 22903, USA
| | - Lola Fatoyinbo
- Biospheric Sciences Lab, NASA Goddard Space Flight Center, Greenbelt, MD, 20771, USA
| | - Xi Yang
- Department of Environmental Sciences, University of Virginia, Charlottesville, VA, 22903, USA
| |
Collapse
|
7
|
Matsuura A, Dan M, Hirano A, Kiku Y, Torii S, Morita S. Body measurement of riding horses with a versatile tablet-type 3D scanning device. J Equine Sci 2021; 32:73-80. [PMID: 34539208 PMCID: PMC8437753 DOI: 10.1294/jes.32.73] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2020] [Accepted: 06/07/2021] [Indexed: 11/23/2022] Open
Abstract
The measurement of various body dimensions of horses plays a significant role in quality
improvement, genetic breeding, health, and soundness. There has been significant
advancement in the technology for acquiring stereoscopic images with a three-dimensional
(3D) scanner. This study aimed to validate the accuracy of body measurements obtained from
stereoscopic images taken with a 3D scanner. We manually took the following body
measurements for 8 riding horses: height at the withers, height at the back, height at the
croup, chest depth, width of the chest, width of the croup, width of the waist, girth
circumference, cannon circumference, and body length. Using a versatile tablet-type 3D
scanning device, we captured a 3D image of each horse. Relative errors varied from −1.37%
to 6.25%. The correlation coefficient between manual and 3D measurements was significant
for all body measurements (P<0.01) except for width of the waist and cannon
circumference. The low accuracy of cannon circumference (r=0.248) was due to effect of
hair. A simple regression analysis of all body measurements revealed a strong correlation
(P<0.001, R2=0.9994, root-mean-square error [RMSE]=1.522). Notable
advantages of this methodology include high accuracy, good operability, non-contact, high
versatility, and low cost. Further studies are required for the establishment of an
accurate measurement methodology that can scan the whole body in a shorter time.
Collapse
Affiliation(s)
- Akihiro Matsuura
- Department of Animal Science, School of Veterinary Medicine, Kitasato University, Aomori 034-8628, Japan
| | - Maiko Dan
- Department of Animal Science, School of Veterinary Medicine, Kitasato University, Aomori 034-8628, Japan
| | - Aiko Hirano
- Department of Animal Science, School of Veterinary Medicine, Kitasato University, Aomori 034-8628, Japan
| | - Yoshio Kiku
- National Institute of Animal Health (NIAH), National Agriculture and Food Research Organization (NARO), Hokkaido 062-0045, Japan.,Present address: Department of Sustainable Agriculture, College of Agriculture, Food and Environment Sciences, Rakuno Gakuen University, Hokkaido 069-8501, Japan
| | - Suzuka Torii
- Department of Animal Science, School of Veterinary Medicine, Kitasato University, Aomori 034-8628, Japan
| | - Shigeru Morita
- Department of Sustainable Agriculture, College of Agriculture, Food and Environment Sciences, Rakuno Gakuen University, Hokkaido 069-8501, Japan
| |
Collapse
|
8
|
Villa F, Severini F, Madonini F, Zappa F. SPADs and SiPMs Arrays for Long-Range High-Speed Light Detection and Ranging (LiDAR). Sensors (Basel) 2021; 21:3839. [PMID: 34206130 PMCID: PMC8199503 DOI: 10.3390/s21113839] [Citation(s) in RCA: 23] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/30/2021] [Revised: 05/26/2021] [Accepted: 05/28/2021] [Indexed: 01/14/2023]
Abstract
Light Detection and Ranging (LiDAR) is a 3D imaging technique, widely used in many applications such as augmented reality, automotive, machine vision, spacecraft navigation and landing. Achieving long-ranges and high-speed, most of all in outdoor applications with strong solar background illumination, are challenging requirements. In the introduction we review different 3D-ranging techniques (stereo-vision, projection with structured light, pulsed-LiDAR, amplitude-modulated continuous-wave LiDAR, frequency-modulated continuous-wave interferometry), illumination schemes (single point and blade scanning, flash-LiDAR) and time-resolved detectors for LiDAR (EM-CCD, I-CCD, APD, SPAD, SiPM). Then, we provide an extensive review of silicon- single photon avalanche diode (SPAD)-based LiDAR detectors (both commercial products and research prototypes) analyzing how each architecture faces the main challenges of LiDAR (i.e., long ranges, centimeter resolution, large field-of-view and high angular resolution, high operation speed, background immunity, eye-safety and multi-camera operation). Recent progresses in 3D stacking technologies provided an important step forward in SPAD array development, allowing to reach smaller pitch, higher pixel count and more complex processing electronics. In the conclusions, we provide some guidelines for the design of next generation SPAD-LiDAR detectors.
Collapse
Affiliation(s)
- Federica Villa
- Dipartimento di Elettronica, Informazione e Bioingegneria—Politecnico di Milano, Piazza Leonardo da Vinci 32, I-20133 Milano, Italy; (F.S.); (F.M.); (F.Z.)
| | | | | | | |
Collapse
|
9
|
Cha G, Sim SH, Park S, Oh T. LiDAR-Based Bridge Displacement Estimation Using 3D Spatial Optimization. Sensors (Basel) 2020; 20:E7117. [PMID: 33322529 DOI: 10.3390/s20247117] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/12/2020] [Revised: 12/09/2020] [Accepted: 12/10/2020] [Indexed: 11/24/2022]
Abstract
As civil engineering structures become larger, non-contact inspection technology is required to measure the overall shape and size of structures and evaluate safety. Structures are easily exposed to the external environment and may not be able to perform their original functions depending on the continuous load for a long time. Therefore, in this study, we propose a method for estimating the vertical displacement of structures using light detection and ranging, which enables non-contact measurement. The point cloud acquired through laser scanning was rearranged into a three-dimensional space, and internal nodes were created by continuously dividing the space. The generated node has its own location information, and the vertical displacement value was calculated by searching for the node where the deformation occurred. The performance of the proposed displacement estimation technique was verified through static loading experiments, and the octree space partitioning method is expected to be applied and utilized in structural health monitoring.
Collapse
|
10
|
Quan Y, Li M, Zhen Z, Hao Y, Wang B. The Feasibility of Modelling the Crown Profile of Larix olgensis Using Unmanned Aerial Vehicle Laser Scanning Data. Sensors (Basel) 2020; 20:E5555. [PMID: 32998340 DOI: 10.3390/s20195555] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/10/2020] [Revised: 09/24/2020] [Accepted: 09/27/2020] [Indexed: 11/29/2022]
Abstract
Unmanned aerial vehicle (UAV) laser scanning, as an emerging form of near-ground light detection and ranging (LiDAR) remote sensing technology, is widely used for crown structure extraction due to its flexibility, convenience, and high point density. Herein, we evaluated the feasibility of using a low-cost UAV-LiDAR system to extract the fine-scale crown profile of Larix olgensis. Specifically, individual trees were isolated from LiDAR point clouds and then stratified from the point clouds of segmented individual tree crowns at 0.5 m intervals to obtain the width percentiles of each layer as profile points. Four equations (the parabola, Mitscherlich, power, and modified beta equations) were then applied to model the profiles of the entire and upper crown. The results showed that a region-based hierarchical cross-section analysis algorithm can successfully delineate 77.4% of the field-measured trees in high-density (>2400 trees/ha) forest stands. The crown profile generated with the 95th width percentile was adequate when compared with the predicted value of the existing field-based crown profile model (the Pearson correlation coefficient (ρ) was 0.864, root mean square error (RMSE) = 0.3354 m). The modified beta equation yielded slightly better results than the other equations for crown profile fitting and explained 85.9% of the variability in the crown radius for the entire crown and 87.8% of this variability for the upper crown. Compared with the cone and 3D convex hull volumes, the crown volumes predicted by our profile models had significantly smaller errors. The results revealed that the crown profile can be well described by using UAV-LiDAR, providing a novel way to obtain crown profile information without destructive sampling and showing the potential of the use of UAV-LiDAR in future forestry investigations and monitoring.
Collapse
|
11
|
Yang J, Yang T, Wang Z, Jia D, Ge C. A Novel Method of Measuring Instantaneous Frequency of an Ultrafast Frequency Modulated Continuous-Wave Laser. Sensors (Basel) 2020; 20:E3834. [PMID: 32660043 DOI: 10.3390/s20143834] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/20/2020] [Revised: 07/04/2020] [Accepted: 07/07/2020] [Indexed: 01/11/2023]
Abstract
Ultrafast linear frequency modulated continuous-wave (FMCW) lasers are a special category of CW lasers. The linear FMCW laser is the light source for many sensing applications, especially for light detection and ranging (LiDAR). However, systems for the generation of high quality linear FMCW light are limited and diverse in terms of technical approaches and mechanisms. Due to a lack of characterization methods for linear FMCW lasers, it is difficult to compare and judge the generation systems in the same category. We propose a novel scheme for measuring the mapping relationship between instantaneous frequency and time of a FMCW laser based on a modified coherent optical spectrum analyzer (COSA) and digital signal processing (DSP) method. Our method has the potential to measure the instantaneous frequency of a FMCW laser at an unlimited sweep rate. In this paper, we demonstrate how to use this new method to precisely measure a FMCW laser at a large fast sweep rate of 5000 THz/s by both simulation and experiments. We find experimentally that the uncertainty of this method is less than 100 kHz and can be improved further if a frequency feedback servo system is introduced to stabilize the local CW laser.
Collapse
|
12
|
Wang A, Wang M, Jiang K, Cao M, Iwahori Y. A Dual Neural Architecture Combined SqueezeNet with OctConv for LiDAR Data Classification. Sensors (Basel) 2019; 19:E4927. [PMID: 31726726 DOI: 10.3390/s19224927] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/07/2019] [Revised: 11/06/2019] [Accepted: 11/09/2019] [Indexed: 11/17/2022]
Abstract
Light detection and ranging (LiDAR) is a frequently used technique of data acquisition and it is widely used in diverse practical applications. In recent years, deep convolutional neural networks (CNNs) have shown their effectiveness for LiDAR-derived rasterized digital surface models (LiDAR-DSM) data classification. However, many excellent CNNs have too many parameters due to depth and complexity. Meanwhile, traditional CNNs have spatial redundancy because different convolution kernels scan and store information independently. SqueezeNet replaces a part of 3 × 3 convolution kernels in CNNs with 1 × 1 convolution kernels, decomposes the original one convolution layer into two layers, and encapsulates them into a Fire module. This structure can reduce the parameters of network. Octave Convolution (OctConv) pools some feature maps firstly and stores them separately from the feature maps with the original size. It can reduce spatial redundancy by sharing information between the two groups. In this article, in order to improve the accuracy and efficiency of the network simultaneously, Fire modules of SqueezeNet are used to replace the traditional convolution layers in OctConv to form a new dual neural architecture: OctSqueezeNet. Our experiments, conducted using two well-known LiDAR datasets and several classical state-of-the-art classification methods, revealed that our proposed classification approach based on OctSqueezeNet is able to provide competitive advantages in terms of both classification accuracy and computational amount.
Collapse
|
13
|
Disney M. Terrestrial LiDAR: a three-dimensional revolution in how we look at trees. New Phytol 2019; 222:1736-1741. [PMID: 30295928 DOI: 10.1111/nph.15517] [Citation(s) in RCA: 39] [Impact Index Per Article: 7.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/20/2018] [Accepted: 09/30/2018] [Indexed: 06/08/2023]
Abstract
Contents Summary I. Introduction II. Terrestrial laser scanning III. Turning points into trees IV. Current and future applications of TLS V. Conclusions Acknowledgements References SUMMARY: Terrestrial laser scanning (TLS) is providing new, very detailed three-dimensional (3D) measurements of forest canopy structure. The information that TLS measurements can provide in describing detailed, accurate 3D canopy architecture offers fascinating new insights into the variety of tree form, environmental drivers and constraints, and the relationship between form and function, particularly for tall, hard-to-measure trees. TLS measurements are helping to test fundamental ecological theories and enabling new and better exploitation of other measurements and models that depend on 3D structural information. This Tansley insight introduces the background and capabilities of TLS in forest ecology, discusses some of the barriers to progress, and identifies some of the directions for new work.
Collapse
Affiliation(s)
- Mathias Disney
- Department of Geography, UCL, Gower Street, London, WC1E 6BT, UK
- NERC National Centre for Earth Observation (NCEO), UK
| |
Collapse
|
14
|
Schwartz NB, Budsock AM, Uriarte M. Fragmentation, forest structure, and topography modulate impacts of drought in a tropical forest landscape. Ecology 2019; 100:e02677. [PMID: 30825323 DOI: 10.1002/ecy.2677] [Citation(s) in RCA: 20] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/26/2018] [Revised: 01/23/2019] [Accepted: 02/04/2019] [Indexed: 02/02/2023]
Abstract
Climate models predict increases in drought conditions in many parts of the tropics. Yet the response of tropical forests to drought remains highly uncertain, especially with regards to the factors that generate spatial heterogeneity in drought response across landscapes. In this study, we used Landsat imagery to assess the impacts of a severe drought in 2015 across an ~80,000-ha landscape in Puerto Rico. Specifically, we asked whether drought effects varied systematically with topography and with forest age, height, and fragmentation. We quantified drought impacts using anomalies of two vegetation indices, the enhanced vegetation index (EVI) and normalized difference water index (NDWI), and fit random forest models of these metrics including slope, aspect, forest age, canopy height, and two indices of fragmentation as predictors. Drought effects were more severe on drier topographic positions, that is, steeper slopes and southwest-facing aspects, and in second-growth forests. Shorter and more fragmented forests were also more strongly affected by drought. We also assessed which factors were associated with stronger recovery from drought. Factors associated with more negative drought anomalies were also associated with more positive postdrought anomalies, suggesting that increased light availability as a result of drought led to high rates of recovery in forests more severely affected by drought. In general, recovery from drought was rapid across the landscape, with postdrought anomalies at or above average across the study area. This suggests that forests in Puerto Rico might be resilient to a single-year drought, though vulnerability to drought varies depending on forest characteristics and landscape position.
Collapse
Affiliation(s)
- Naomi B Schwartz
- Department of Geography, University of British Columbia, 1984 West Mall, Vancouver, British Columbia, V6T 1Z2, Canada.,Department of Ecology, Evolution, and Behavior, University of Minnesota, 1479 Gortner Avenue, St. Paul, Minnesota, 55108, USA.,Department of Ecology Evolution and Environmental Biology, Columbia University, 1200 Amsterdam Avenue, New York, New York, 10027, USA
| | - Andrew M Budsock
- Department of Ecology Evolution and Environmental Biology, Columbia University, 1200 Amsterdam Avenue, New York, New York, 10027, USA
| | - María Uriarte
- Department of Ecology Evolution and Environmental Biology, Columbia University, 1200 Amsterdam Avenue, New York, New York, 10027, USA
| |
Collapse
|
15
|
Beer M, Haase JF, Ruskowski J, Kokozinski R. Background Light Rejection in SPAD-Based LiDAR Sensors by Adaptive Photon Coincidence Detection. Sensors (Basel) 2018; 18:s18124338. [PMID: 30544791 PMCID: PMC6308528 DOI: 10.3390/s18124338] [Citation(s) in RCA: 37] [Impact Index Per Article: 6.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/30/2018] [Revised: 12/03/2018] [Accepted: 12/06/2018] [Indexed: 11/16/2022]
Abstract
Light detection and ranging (LiDAR) systems based on silicon single-photon avalanche diodes (SPAD) offer several advantages, like the fabrication of system-on-chips with a co-integrated detector and dedicated electronics, as well as low cost and high durability due to well-established CMOS technology. On the other hand, silicon-based detectors suffer from high background light in outdoor applications, like advanced driver assistance systems or autonomous driving, due to the limited wavelength range in the infrared spectrum. In this paper we present a novel method based on the adaptive adjustment of photon coincidence detection to suppress the background light and simultaneously improve the dynamic range. A major disadvantage of fixed parameter coincidence detection is the increased dynamic range of the resulting event rate, allowing good measurement performance only at a specific target reflectance. To overcome this limitation we have implemented adaptive photon coincidence detection. In this technique the parameters of the photon coincidence detection are adjusted to the actual measured background light intensity, giving a reduction of the event rate dynamic range and allowing the perception of high dynamic scenes. We present a 192 × 2 pixel CMOS SPAD-based LiDAR sensor utilizing this technique and accompanying outdoor measurements showing the capability of it. In this sensor adaptive photon coincidence detection improves the dynamic range of the measureable target reflectance by over 40 dB.
Collapse
Affiliation(s)
- Maik Beer
- Fraunhofer Institute for Microelectronic Circuits and Systems, 47057 Duisburg, Germany.
| | - Jan F Haase
- Fraunhofer Institute for Microelectronic Circuits and Systems, 47057 Duisburg, Germany.
| | - Jennifer Ruskowski
- Fraunhofer Institute for Microelectronic Circuits and Systems, 47057 Duisburg, Germany.
| | - Rainer Kokozinski
- Department of Electronic Components and Circuits, University Duisburg-Essen, 47057 Duisburg, Germany.
| |
Collapse
|
16
|
Siebers MH, Edwards EJ, Jimenez-Berni JA, Thomas MR, Salim M, Walker RR. Fast Phenomics in Vineyards: Development of GRover, the Grapevine Rover, and LiDAR for Assessing Grapevine Traits in the Field. Sensors (Basel) 2018; 18:s18092924. [PMID: 30177637 PMCID: PMC6163379 DOI: 10.3390/s18092924] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/23/2018] [Revised: 08/02/2018] [Accepted: 08/25/2018] [Indexed: 11/23/2022]
Abstract
This paper introduces GRover (the grapevine rover), an adaptable mobile platform for the deployment and testing of proximal imaging sensors in vineyards for the non-destructive assessment of trunk and cordon volume and pruning weight. A SICK LMS-400 light detection and ranging (LiDAR) radar mounted on GRover was capable of producing precise (±3 mm) 3D point clouds of vine rows. Vineyard scans of the grapevine variety Shiraz grown under different management systems at two separate locations have demonstrated that GRover is able to successfully reproduce a variety of vine structures. Correlations of pruning weight and vine wood (trunk and cordon) volume with LiDAR scans have resulted in high coefficients of determination (R2 = 0.91 for pruning weight; 0.76 for wood volume). This is the first time that a LiDAR of this type has been extensively tested in vineyards. Its high scanning rate, eye safe laser and ability to distinguish tissue types make it an appealing option for further development to offer breeders, and potentially growers, quantified measurements of traits that otherwise would be difficult to determine.
Collapse
Affiliation(s)
- Matthew H Siebers
- CSIRO Agriculture and Food, Waite Campus, Urrbrae 5064, Adelaide, Australia.
| | - Everard J Edwards
- CSIRO Agriculture and Food, Waite Campus, Urrbrae 5064, Adelaide, Australia.
| | - Jose A Jimenez-Berni
- High Resolution Plant Phenomics Centre (HRPPC), Australian Plant Phenomics Facility (APPF), Cnr Clunies Ross St and Barry Dr, Acton 2601, Canberra, Australia.
- Instituto de Agricultura Sostenible (IAS), Consejo Superior de Investigaciones Científicas (CSIC), 14004 Córdoba, Spain.
- CSIRO Agriculture and Food, CSIRO Black Mountain Science and Innovation Park, Cnr Clunies Ross St and Barry Dr, Acton 2601, Canberra, Australia.
| | - Mark R Thomas
- CSIRO Agriculture and Food, Waite Campus, Urrbrae 5064, Adelaide, Australia.
| | - Michael Salim
- High Resolution Plant Phenomics Centre (HRPPC), Australian Plant Phenomics Facility (APPF), Cnr Clunies Ross St and Barry Dr, Acton 2601, Canberra, Australia.
- CSIRO Agriculture and Food, CSIRO Black Mountain Science and Innovation Park, Cnr Clunies Ross St and Barry Dr, Acton 2601, Canberra, Australia.
| | - Rob R Walker
- CSIRO Agriculture and Food, Waite Campus, Urrbrae 5064, Adelaide, Australia.
| |
Collapse
|
17
|
Lin Y, Jiang M, Pellikka P, Heiskanen J. Recruiting Conventional Tree Architecture Models into State-of-the-Art LiDAR Mapping for Investigating Tree Growth Habits in Structure. Front Plant Sci 2018; 9:220. [PMID: 29515616 PMCID: PMC5826307 DOI: 10.3389/fpls.2018.00220] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/30/2017] [Accepted: 02/05/2018] [Indexed: 06/10/2023]
Abstract
Mensuration of tree growth habits is of considerable importance for understanding forest ecosystem processes and forest biophysical responses to climate changes. However, the complexity of tree crown morphology that is typically formed after many years of growth tends to render it a non-trivial task, even for the state-of-the-art 3D forest mapping technology-light detection and ranging (LiDAR). Fortunately, botanists have deduced the large structural diversity of tree forms into only a limited number of tree architecture models, which can present a-priori knowledge about tree structure, growth, and other attributes for different species. This study attempted to recruit Hallé architecture models (HAMs) into LiDAR mapping to investigate tree growth habits in structure. First, following the HAM-characterized tree structure organization rules, we run the kernel procedure of tree species classification based on the LiDAR-collected point clouds using a support vector machine classifier in the leave-one-out-for-cross-validation mode. Then, the HAM corresponding to each of the classified tree species was identified based on expert knowledge, assisted by the comparison of the LiDAR-derived feature parameters. Next, the tree growth habits in structure for each of the tree species were derived from the determined HAM. In the case of four tree species growing in the boreal environment, the tests indicated that the classification accuracy reached 85.0%, and their growth habits could be derived by qualitative and quantitative means. Overall, the strategy of recruiting conventional HAMs into LiDAR mapping for investigating tree growth habits in structure was validated, thereby paving a new way for efficiently reflecting tree growth habits and projecting forest structure dynamics.
Collapse
Affiliation(s)
- Yi Lin
- Beijing Key Lab of Spatial Information Integration and Its Applications, School of Earth and Space Sciences, Institute of Remote Sensing and GIS, Peking University, Beijing, China
| | - Miao Jiang
- Institute of Mineral Resources Research, China Metallurgical Geology Bureau, Beijing, China
| | - Petri Pellikka
- Department of Geosciences and Geography, University of Helsinki, Helsinki, Finland
| | - Janne Heiskanen
- Department of Geosciences and Geography, University of Helsinki, Helsinki, Finland
| |
Collapse
|
18
|
Grammer B, Draganits E, Gretscher M, Muss U. LiDAR-guided Archaeological Survey of a Mediterranean Landscape: Lessons from the Ancient Greek Polis of Kolophon (Ionia, Western Anatolia). Archaeol Prospect 2017; 24:311-333. [PMID: 29242700 PMCID: PMC5724661 DOI: 10.1002/arp.1572] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/25/2016] [Revised: 01/05/2017] [Accepted: 02/13/2017] [Indexed: 06/07/2023]
Abstract
In 2013, an airborne laser scan survey was conducted in the territory of the Ionian city of Kolophon near the western coast of modern Turkey as part of an archaeological survey project carried out by the Mimar Sinan University of Istanbul (Turkey) and the University of Vienna (Austria). Several light detection and ranging (LiDAR) studies have been carried out in the temperate climate zones of Europe, but only a few in Mediterranean landscapes. Our study is based on the first LiDAR survey carried out for an archaeological purpose in Turkey and one of the first in the Mediterranean that have been planned, measured and filtered especially for archaeological research questions. The interpretation of LiDAR data combined with ground-observations proved extremely useful for the detection and documentation of archaeological remains below Mediterranean evergreen vegetation and dense maquis. This article deals with the methodological aspects of interpreting LiDAR data, using the Kolophon data as a case study. We offer a discussion of the strengths and limitations of LiDAR as an archaeological remote sensing method and suggest a best practice model for interpreting LiDAR data in a Mediterranean context. © 2017 The Authors. Archaeological Prospection published by John Wiley & Sons Ltd.
Collapse
Affiliation(s)
- Benedikt Grammer
- Department of Prehistory and Historical ArchaeologyUniversity of ViennaFranz‐Klein‐Gasse 11190ViennaAustria
| | - Erich Draganits
- Department of Geodynamics and SedimentologyUniversity of ViennaUZA II, Althanstrasse 141090ViennaAustria
- LBI for Archaeological ProspectionHohe Warte 381190ViennaAustria
| | - Martin Gretscher
- Department of Classical ArchaeologyUniversity of ViennaFranz‐Klein Gasse 11190ViennaAustria
| | - Ulrike Muss
- Department of Classical ArchaeologyUniversity of ViennaFranz‐Klein Gasse 11190ViennaAustria
| |
Collapse
|
19
|
Magney TS, Eusden SA, Eitel JUH, Logan BA, Jiang J, Vierling LA. Assessing leaf photoprotective mechanisms using terrestrial LiDAR: towards mapping canopy photosynthetic performance in three dimensions. New Phytol 2014; 201:344-356. [PMID: 24032717 DOI: 10.1111/nph.12453] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/22/2013] [Accepted: 07/18/2013] [Indexed: 06/02/2023]
Abstract
Terrestrial laser scanning (TLS) data allow spatially explicit (x, y, z) laser return intensities to be recorded throughout a plant canopy, which could considerably improve our understanding of how physiological processes vary in three-dimensional space. However, the utility of TLS data for the quantification of plant physiological properties remains largely unexplored. Here, we test whether the laser return intensity of green (532-nm) TLS correlates with changes in the de-epoxidation state of the xanthophyll cycle and photoprotective non-photochemical quenching (NPQ), and compare the ability of TLS to quantify these parameters with the passively measured photochemical reflectance index (PRI). We exposed leaves from five plant species to increasing light intensities to induce NPQ and de-epoxidation of violaxanthin (V) to antheraxanthin (A) and zeaxanthin (Z). At each light intensity, the green laser return intensity (GLRI), narrowband spectral reflectance, chlorophyll fluorescence emission and xanthophyll cycle pigment composition were recorded. Strong relationships between both predictor variables (GLRI, PRI) and both explanatory variables (NPQ, xanthophyll cycle de-epoxidation) were observed. GLRI holds promise to provide detailed (mm) information about plant physiological status to improve our understanding of the patterns and mechanisms driving foliar photoprotection. We discuss the potential for scaling these laboratory data to three-dimensional canopy space.
Collapse
Affiliation(s)
- Troy S Magney
- Geospatial Laboratory for Environmental Dynamics, College of Natural Resources, University of Idaho, 875 Perimeter Drive, MS 1135, Moscow, ID, 83844-1135, USA
- McCall Outdoor Science School, University of Idaho, 1800 University Lane, McCall, ID, 83638, USA
| | - Spencer A Eusden
- Department of Biology, Bowdoin College, 6500 College Station, Brunswick, ME, 04011, USA
| | - Jan U H Eitel
- Geospatial Laboratory for Environmental Dynamics, College of Natural Resources, University of Idaho, 875 Perimeter Drive, MS 1135, Moscow, ID, 83844-1135, USA
- McCall Outdoor Science School, University of Idaho, 1800 University Lane, McCall, ID, 83638, USA
| | - Barry A Logan
- Department of Biology, Bowdoin College, 6500 College Station, Brunswick, ME, 04011, USA
| | - Jingjue Jiang
- Geospatial Laboratory for Environmental Dynamics, College of Natural Resources, University of Idaho, 875 Perimeter Drive, MS 1135, Moscow, ID, 83844-1135, USA
- Computer School, Wuhan University, A519, Wuhan, Hubei, 430072, China
| | - Lee A Vierling
- Geospatial Laboratory for Environmental Dynamics, College of Natural Resources, University of Idaho, 875 Perimeter Drive, MS 1135, Moscow, ID, 83844-1135, USA
- McCall Outdoor Science School, University of Idaho, 1800 University Lane, McCall, ID, 83638, USA
| |
Collapse
|
20
|
Huang CY, Asner GP. Applications of remote sensing to alien invasive plant studies. Sensors (Basel) 2009; 9:4869-89. [PMID: 22408558 PMCID: PMC3291943 DOI: 10.3390/s90604869] [Citation(s) in RCA: 174] [Impact Index Per Article: 11.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/08/2009] [Revised: 06/03/2009] [Accepted: 06/18/2009] [Indexed: 11/18/2022]
Abstract
Biological invasions can affect ecosystems across a wide spectrum of bioclimatic conditions. Therefore, it is often important to systematically monitor the spread of species over a broad region. Remote sensing has been an important tool for large-scale ecological studies in the past three decades, but it was not commonly used to study alien invasive plants until the mid 1990s. We synthesize previous research efforts on remote sensing of invasive plants from spatial, temporal and spectral perspectives. We also highlight a recently developed state-of-the-art image fusion technique that integrates passive and active energies concurrently collected by an imaging spectrometer and a scanning-waveform light detection and ranging (LiDAR) system, respectively. This approach provides a means to detect the structure and functional properties of invasive plants of different canopy levels. Finally, we summarize regional studies of biological invasions using remote sensing, discuss the limitations of remote sensing approaches, and highlight current research needs and future directions.
Collapse
Affiliation(s)
- Cho-ying Huang
- Department of Geomatics, National Cheng Kung University, Tainan 70101, Taiwan
- Office of Arid Lands Studies, University of Arizona, Tucson, AZ 85719, USA
- Author to whom correspondence should be addressed; E-Mail: ; Tel.: +1-886-6-275-7575 × 63840; Fax: +1-886-6-237-5764
| | - Gregory P. Asner
- Department of Global Ecology, Carnegie Institution for Science, Stanford, CA 94305, USA; E-Mail:
| |
Collapse
|
21
|
Zheng G, Moskal LM. Retrieving Leaf Area Index (LAI) Using Remote Sensing: Theories, Methods and Sensors. Sensors (Basel) 2009; 9:2719-45. [PMID: 22574042 PMCID: PMC3348792 DOI: 10.3390/s90402719] [Citation(s) in RCA: 108] [Impact Index Per Article: 7.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/25/2008] [Revised: 04/03/2009] [Accepted: 04/17/2009] [Indexed: 12/04/2022]
Abstract
The ability to accurately and rapidly acquire leaf area index (LAI) is an indispensable component of process-based ecological research facilitating the understanding of gas-vegetation exchange phenomenon at an array of spatial scales from the leaf to the landscape. However, LAI is difficult to directly acquire for large spatial extents due to its time consuming and work intensive nature. Such efforts have been significantly improved by the emergence of optical and active remote sensing techniques. This paper reviews the definitions and theories of LAI measurement with respect to direct and indirect methods. Then, the methodologies for LAI retrieval with regard to the characteristics of a range of remotely sensed datasets are discussed. Remote sensing indirect methods are subdivided into two categories of passive and active remote sensing, which are further categorized as terrestrial, aerial and satellite-born platforms. Due to a wide variety in spatial resolution of remotely sensed data and the requirements of ecological modeling, the scaling issue of LAI is discussed and special consideration is given to extrapolation of measurement to landscape and regional levels.
Collapse
Affiliation(s)
- Guang Zheng
- Remote Sensing and Geospatial Analysis Laboratory and Precision Forestry Cooperative, College of Forest Resources, University of Washington, Box 352100, Seattle, Washington, USA 98195-2100; E-Mail: (G.Z.)
| | | |
Collapse
|