1
|
Jeong S, Shin H, Kim MJ, Kang D, Lee S, Oh S. Enhancing LiDAR Mapping with YOLO-Based Potential Dynamic Object Removal in Autonomous Driving. SENSORS (BASEL, SWITZERLAND) 2024; 24:7578. [PMID: 39686115 DOI: 10.3390/s24237578] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/25/2024] [Revised: 11/24/2024] [Accepted: 11/25/2024] [Indexed: 12/18/2024]
Abstract
In this study, we propose an enhanced LiDAR-based mapping and localization system that utilizes a camera-based YOLO (You Only Look Once) algorithm to detect and remove dynamic objects, such as vehicles, from the mapping process. GPS, while commonly used for localization, often fails in urban environments due to signal blockages. To address this limitation, our system integrates YOLOv4 with LiDAR, enabling the removal of dynamic objects to improve map accuracy and localization in high-traffic areas. Existing methods using LiDAR segmentation for map matching often suffer from missed detections and false positives, degrading performance. Our approach leverages YOLOv4's robust object detection capabilities to eliminate potentially dynamic objects while retaining static environmental features, such as buildings, to enhance map accuracy and reliability. The proposed system was validated using a mid-size SUV equipped with LiDAR and camera sensors. The experimental results demonstrate significant improvements in map-matching and localization performance, particularly in urban environments. The system achieved RMSE (Root Mean Square Error) reductions compared to conventional methods, with RMSE values decreasing from 0.9870 to 0.9724 in open areas and from 1.3874 to 1.1217 in urban areas. These findings highlight the ability of the Vision + LiDAR + NDT method to enhance localization performance in both simple and complex environments. By addressing the challenges of dynamic obstacles, the proposed system effectively improves the accuracy and robustness of autonomous navigation in high-traffic settings without relying on GPS.
Collapse
Affiliation(s)
- Seonghark Jeong
- Propulsion Division, GM Korea Company, Incheon 21344, Republic of Korea
| | - Heeseok Shin
- Convergence Major for Intelligent Drone, Sejong University, Seoul 05006, Republic of Korea
| | - Myeong-Jun Kim
- Graduate School of Automotive Mobility, Kookmin University, Seoul 02707, Republic of Korea
| | - Dongwan Kang
- Hanwha Aerospace, Seongnam 13488, Republic of Korea
| | - Seangwock Lee
- Graduate School of Automotive Mobility, Kookmin University, Seoul 02707, Republic of Korea
| | - Sangki Oh
- Department of Automotive Engineering, Gyeonggi University of Science and Technology, Siheung 15073, Republic of Korea
| |
Collapse
|
2
|
Palacín J, Rubies E, Clotet E. A Retrospective Analysis of Indoor CO 2 Measurements Obtained with a Mobile Robot during the COVID-19 Pandemic. SENSORS (BASEL, SWITZERLAND) 2024; 24:3102. [PMID: 38793956 PMCID: PMC11125027 DOI: 10.3390/s24103102] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/16/2024] [Revised: 05/08/2024] [Accepted: 05/09/2024] [Indexed: 05/26/2024]
Abstract
This work presents a retrospective analysis of indoor CO2 measurements obtained with a mobile robot in an educational building after the COVID-19 lockdown (May 2021), at a time when public activities resumed with mandatory local pandemic restrictions. The robot-based CO2 measurement system was assessed as an alternative to the deployment of a net of sensors in a building in the pandemic period, in which there was a global stock outage of CO2 sensors. The analysis of the obtained measurements confirms that a mobile system can be used to obtain interpretable information on the CO2 levels inside the rooms of a building during a pandemic outbreak.
Collapse
Affiliation(s)
- Jordi Palacín
- Automation and Robotics Laboratory (ARL), Universitat de Lleida, 25001 Lleida, Spain (E.C.)
| | | | | |
Collapse
|
3
|
Fagundes LA, Caldeira AG, Quemelli MB, Martins FN, Brandão AS. Analytical Formalism for Data Representation and Object Detection with 2D LiDAR: Application in Mobile Robotics. SENSORS (BASEL, SWITZERLAND) 2024; 24:2284. [PMID: 38610495 PMCID: PMC11013966 DOI: 10.3390/s24072284] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/04/2024] [Revised: 03/08/2024] [Accepted: 04/02/2024] [Indexed: 04/14/2024]
Abstract
In mobile robotics, LASER scanners have a wide spectrum of indoor and outdoor applications, both in structured and unstructured environments, due to their accuracy and precision. Most works that use this sensor have their own data representation and their own case-specific modeling strategies, and no common formalism is adopted. To address this issue, this manuscript presents an analytical approach for the identification and localization of objects using 2D LiDARs. Our main contribution lies in formally defining LASER sensor measurements and their representation, the identification of objects, their main properties, and their location in a scene. We validate our proposal with experiments in generic semi-structured environments common in autonomous navigation, and we demonstrate its feasibility in multiple object detection and identification, strictly following its analytical representation. Finally, our proposal further encourages and facilitates the design, modeling, and implementation of other applications that use LASER scanners as a distance sensor.
Collapse
Affiliation(s)
- Leonardo A. Fagundes
- Robotics Specialization Center (NERo), Department of Electrical Engineering, Federal University of Viçosa, Viçosa 36570-000, MG, Brazil (A.G.C.); (M.B.Q.)
- Graduate Program in Computer Science, Department of Informatics, Federal University of Viçosa, Viçosa 36570-000, MG, Brazil
| | - Alexandre G. Caldeira
- Robotics Specialization Center (NERo), Department of Electrical Engineering, Federal University of Viçosa, Viçosa 36570-000, MG, Brazil (A.G.C.); (M.B.Q.)
| | - Matheus B. Quemelli
- Robotics Specialization Center (NERo), Department of Electrical Engineering, Federal University of Viçosa, Viçosa 36570-000, MG, Brazil (A.G.C.); (M.B.Q.)
- Graduate Program in Computer Science, Department of Informatics, Federal University of Viçosa, Viçosa 36570-000, MG, Brazil
| | - Felipe N. Martins
- Sensors and Smart Systems Group, Institute of Engineering, Hanze University of Applied Sciences, 9747 AS Groningen, The Netherlands;
| | - Alexandre S. Brandão
- Robotics Specialization Center (NERo), Department of Electrical Engineering, Federal University of Viçosa, Viçosa 36570-000, MG, Brazil (A.G.C.); (M.B.Q.)
- Graduate Program in Computer Science, Department of Informatics, Federal University of Viçosa, Viçosa 36570-000, MG, Brazil
| |
Collapse
|
4
|
Palacín J, Rubies E, Bitriá R, Clotet E. Path Planning of a Mobile Delivery Robot Operating in a Multi-Story Building Based on a Predefined Navigation Tree. SENSORS (BASEL, SWITZERLAND) 2023; 23:8795. [PMID: 37960494 PMCID: PMC10648392 DOI: 10.3390/s23218795] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/04/2023] [Revised: 10/21/2023] [Accepted: 10/25/2023] [Indexed: 11/15/2023]
Abstract
Planning the path of a mobile robot that must transport and deliver small packages inside a multi-story building is a problem that requires a combination of spatial and operational information, such as the location of origin and destination points and how to interact with elevators. This paper presents a solution to this problem, which has been formulated under the following assumptions: (1) the map of the building's floors is available; (2) the position of all origin and destination points is known; (3) the mobile robot has sensors to self-localize on the floors; (4) the building is equipped with remotely controlled elevators; and (5) all doors expected in a delivery route will be open. We start by defining a static navigation tree describing the weighted paths in a multi-story building. We then proceed to describe how this navigation tree can be used to plan the route of a mobile robot and estimate the total length of any delivery route using Dijkstra's algorithm. Finally, we show simulated routing results that demonstrate the effectiveness of this proposal when applied to an autonomous delivery robot operating in a multi-story building.
Collapse
Affiliation(s)
- Jordi Palacín
- Robotics Laboratory, Universitat de Lleida, Jaume II, 69, 25001 Lleida, Spain (R.B.)
| | | | | | | |
Collapse
|