1
|
Dao TK, Ngo TG, Pan JS, Nguyen TTT, Nguyen TT. Enhancing Path Planning Capabilities of Automated Guided Vehicles in Dynamic Environments: Multi-Objective PSO and Dynamic-Window Approach. Biomimetics (Basel) 2024; 9:35. [PMID: 38248609 PMCID: PMC10813721 DOI: 10.3390/biomimetics9010035] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2023] [Revised: 11/20/2023] [Accepted: 11/21/2023] [Indexed: 01/23/2024] Open
Abstract
Automated guided vehicles (AGVs) are vital for optimizing the transport of material in modern industry. AGVs have been widely used in production, logistics, transportation, and commerce, enhancing productivity, lowering labor costs, improving energy efficiency, and ensuring safety. However, path planning for AGVs in complex and dynamic environments remains challenging due to the computation of obstacle avoidance and efficient transport. This study proposes a novel approach that combines multi-objective particle swarm optimization (MOPSO) and the dynamic-window approach (DWA) to enhance AGV path planning. Optimal AGV trajectories considering energy consumption, travel time, and collision avoidance were used to model the multi-objective functions for dealing with the outcome-feasible optimal solution. Empirical findings and results demonstrate the approach's effectiveness and efficiency, highlighting its potential for improving AGV navigation in real-world scenarios.
Collapse
Affiliation(s)
- Thi-Kien Dao
- Fujian Provincial Key Laboratory of Big Data Mining and Applications, Fujian University of Technology, Fuzhou 350118, China;
- School of Computer Science and Mathematics, Fujian University of Technology, Fuzhou 350118, China
- Multimedia Communications Laboratory, University of Information Technology, Ho Chi Minh City 700000, Vietnam
- Vietnam National University, Ho Chi Minh City 700000, Vietnam
| | - Truong-Giang Ngo
- Faculty of Computer Science and Engineering, Thuyloi University, Hanoi 116705, Vietnam
| | - Jeng-Shyang Pan
- College of Computer Science and Engineering, Shandong University of Science and Technology, Qingdao 266510, China;
| | - Thi-Thanh-Tan Nguyen
- Faculty of Information Technology, Electric Power University, Hanoi 100000, Vietnam;
| | - Trong-The Nguyen
- Fujian Provincial Key Laboratory of Big Data Mining and Applications, Fujian University of Technology, Fuzhou 350118, China;
- School of Computer Science and Mathematics, Fujian University of Technology, Fuzhou 350118, China
- Multimedia Communications Laboratory, University of Information Technology, Ho Chi Minh City 700000, Vietnam
| |
Collapse
|
2
|
Ye X, Deng Z, Shi Y, Shen W. Toward Energy-Efficient Routing of Multiple AGVs with Multi-Agent Reinforcement Learning. Sensors (Basel) 2023; 23:5615. [PMID: 37420781 DOI: 10.3390/s23125615] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/26/2023] [Revised: 06/04/2023] [Accepted: 06/11/2023] [Indexed: 07/09/2023]
Abstract
This paper presents a multi-agent reinforcement learning (MARL) algorithm to address the scheduling and routing problems of multiple automated guided vehicles (AGVs), with the goal of minimizing overall energy consumption. The proposed algorithm is developed based on the multi-agent deep deterministic policy gradient (MADDPG) algorithm, with modifications made to the action and state space to fit the setting of AGV activities. While previous studies overlooked the energy efficiency of AGVs, this paper develops a well-designed reward function that helps to optimize the overall energy consumption required to fulfill all tasks. Moreover, we incorporate the e-greedy exploration strategy into the proposed algorithm to balance exploration and exploitation during training, which helps it converge faster and achieve better performance. The proposed MARL algorithm is equipped with carefully selected parameters that aid in avoiding obstacles, speeding up path planning, and achieving minimal energy consumption. To demonstrate the effectiveness of the proposed algorithm, three types of numerical experiments including the ϵ-greedy MADDPG, MADDPG, and Q-Learning methods were conducted. The results show that the proposed algorithm can effectively solve the multi-AGV task assignment and path planning problems, and the energy consumption results show that the planned routes can effectively improve energy efficiency.
Collapse
Affiliation(s)
- Xianfeng Ye
- School of Mechanical Science and Engineering, Huazhong University of Science and Technology, Wuhan 430074, China
| | - Zhiyun Deng
- School of Mechanical Science and Engineering, Huazhong University of Science and Technology, Wuhan 430074, China
| | - Yanjun Shi
- Department of Mechanical Engineering, Dalian University of Technology, Dalian 116023, China
| | - Weiming Shen
- School of Mechanical Science and Engineering, Huazhong University of Science and Technology, Wuhan 430074, China
| |
Collapse
|
3
|
Vakaruk S, Karamchandani A, Sierra-García JE, Mozo A, Gómez-Canaval S, Pastor A. Transformers for Multi-Horizon Forecasting in an Industry 4.0 Use Case. Sensors (Basel) 2023; 23:3516. [PMID: 37050575 PMCID: PMC10098670 DOI: 10.3390/s23073516] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/17/2023] [Revised: 03/16/2023] [Accepted: 03/24/2023] [Indexed: 06/19/2023]
Abstract
Recently, a novel approach in the field of Industry 4.0 factory operations was proposed for a new generation of automated guided vehicles (AGVs) that are connected to a virtualized programmable logic controller (PLC) via a 5G multi-access edge-computing (MEC) platform to enable remote control. However, this approach faces a critical challenge as the 5G network may encounter communication disruptions that can lead to AGV deviations and, with this, potential safety risks and workplace issues. To mitigate this problem, several works have proposed the use of fixed-horizon forecasting techniques based on deep-learning models that can anticipate AGV trajectory deviations and take corrective maneuvers accordingly. However, these methods have limited prediction flexibility for the AGV operator and are not robust against network instability. To address this limitation, this study proposes a novel approach based on multi-horizon forecasting techniques to predict the deviation of remotely controlled AGVs. As its primary contribution, the work presents two new versions of the state-of-the-art transformer architecture that are well-suited to the multi-horizon prediction problem. We conduct a comprehensive comparison between the proposed models and traditional deep-learning models, such as the long short-term memory (LSTM) neural network, to evaluate the performance and capabilities of the proposed models in relation to traditional deep-learning architectures. The results indicate that (i) the transformer-based models outperform LSTM in both multi-horizon and fixed-horizon scenarios, (ii) the prediction accuracy at a specific time-step of the best multi-horizon forecasting model is very close to that obtained by the best fixed-horizon forecasting model at the same step, (iii) models that use a time-sequence structure in their inputs tend to perform better in multi-horizon scenarios compared to their fixed horizon counterparts and other multi-horizon models that do not consider a time topology in their inputs, and (iv) our experiments showed that the proposed models can perform inference within the required time constraints for real-time decision making.
Collapse
Affiliation(s)
- Stanislav Vakaruk
- Departamento de Sistemas Informáticos, Escuela Técnica Superior de Sistemas Informáticos, Universidad Politécnica de Madrid, 28031 Madrid, Spain; (S.V.); (A.K.); (S.G.-C.); (A.P.)
| | - Amit Karamchandani
- Departamento de Sistemas Informáticos, Escuela Técnica Superior de Sistemas Informáticos, Universidad Politécnica de Madrid, 28031 Madrid, Spain; (S.V.); (A.K.); (S.G.-C.); (A.P.)
| | - Jesús Enrique Sierra-García
- Departamento de Ingeniería Electromecánica, Escuela Politécnica Superior, Universidad de Burgos, 09006 Burgos, Spain;
| | - Alberto Mozo
- Departamento de Sistemas Informáticos, Escuela Técnica Superior de Sistemas Informáticos, Universidad Politécnica de Madrid, 28031 Madrid, Spain; (S.V.); (A.K.); (S.G.-C.); (A.P.)
| | - Sandra Gómez-Canaval
- Departamento de Sistemas Informáticos, Escuela Técnica Superior de Sistemas Informáticos, Universidad Politécnica de Madrid, 28031 Madrid, Spain; (S.V.); (A.K.); (S.G.-C.); (A.P.)
| | - Antonio Pastor
- Departamento de Sistemas Informáticos, Escuela Técnica Superior de Sistemas Informáticos, Universidad Politécnica de Madrid, 28031 Madrid, Spain; (S.V.); (A.K.); (S.G.-C.); (A.P.)
- Telefónica I+D., 28050 Madrid, Spain
| |
Collapse
|
4
|
Hu E, He J, Shen S. A dynamic integrated scheduling method based on hierarchical planning for heterogeneous AGV fleets in warehouses. Front Neurorobot 2023; 16:1053067. [PMID: 36699949 PMCID: PMC9868608 DOI: 10.3389/fnbot.2022.1053067] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/25/2022] [Accepted: 12/14/2022] [Indexed: 01/11/2023] Open
Abstract
In modern industrial warehouses, heterogeneous and flexible fleets of automated guided vehicles (AGVs) are widely used to improve transport efficiency. However, as their scale and limit of battery capacity increase, the complexity of dynamic scheduling also increases dramatically. The problem is to assign tasks and determine detailed paths to AGVs to keep the multi-AGV system running efficiently and sustainedly. In this context, a mixed-integer linear programming (MILP) model is formulated. A hierarchical planning method is used, which decomposes the integrated problem into two levels: the upper-level task-assignment problem and the lower-level path-planning problem. A hybrid discrete state transition algorithm (HDSTA) based on an elite solution set and the Tabu List method is proposed to solve the dynamic scheduling problem to minimize the sum of the costs of requests and the tardiness costs of conflicts for the overall system. The efficacy of our method is investigated by computational experiments using real-world data.
Collapse
|
5
|
Shao Y, Fan Z, Zhu B, Zhou M, Chen Z, Lu J. A Novel Pallet Detection Method for Automated Guided Vehicles Based on Point Cloud Data. Sensors (Basel) 2022; 22:8019. [PMID: 36298370 PMCID: PMC9607538 DOI: 10.3390/s22208019] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/09/2022] [Revised: 10/04/2022] [Accepted: 10/18/2022] [Indexed: 06/16/2023]
Abstract
Automated guided vehicles are widely used in warehousing environments for automated pallet handling, which is one of the fundamental parts to construct intelligent logistics systems. Pallet detection is a critical technology for automated guided vehicles, which directly affects production efficiency. A novel pallet detection method for automated guided vehicles based on point cloud data is proposed, which consists of five modules including point cloud preprocessing, key point extraction, feature description, surface matching and point cloud registration. The proposed method combines the color with the geometric features of the pallet point cloud and constructs a new Adaptive Color Fast Point Feature Histogram (ACFPFH) feature descriptor by selecting the optimal neighborhood adaptively. In addition, a new surface matching method called the Bidirectional Nearest Neighbor Distance Ratio-Approximate Congruent Triangle Neighborhood (BNNDR-ACTN) is proposed. The proposed method overcomes the problems of current methods such as low efficiency, poor robustness, random parameter selection, and being time-consuming. To verify the performance, the proposed method is compared with the traditional and modified Iterative Closest Point (ICP) methods in two real-world cases. The results show that the Root Mean Square Error (RMSE) is reduced to 0.009 and the running time is reduced to 0.989 s, which demonstrates that the proposed method has faster registration speed while maintaining higher registration accuracy.
Collapse
Affiliation(s)
- Yiping Shao
- College of Mechanical Engineering, Zhejiang University of Technology, Hangzhou 310023, China
- Noblelift Intelligent Equipment Co., Ltd., Huzhou 313100, China
| | - Zhengshuai Fan
- College of Mechanical Engineering, Zhejiang University of Technology, Hangzhou 310023, China
| | - Baochang Zhu
- Noblelift Intelligent Equipment Co., Ltd., Huzhou 313100, China
| | - Minlong Zhou
- Noblelift Intelligent Equipment Co., Ltd., Huzhou 313100, China
| | - Zhihui Chen
- College of Mechanical Engineering, Zhejiang University of Technology, Hangzhou 310023, China
| | - Jiansha Lu
- College of Mechanical Engineering, Zhejiang University of Technology, Hangzhou 310023, China
| |
Collapse
|
6
|
Stetter R. A Fuzzy Virtual Actuator for Automated Guided Vehicles. Sensors (Basel) 2020; 20:E4154. [PMID: 32722582 DOI: 10.3390/s20154154] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/01/2020] [Revised: 07/21/2020] [Accepted: 07/24/2020] [Indexed: 11/16/2022]
Abstract
In the last decades, virtual sensors have found increasing attention in the research community. Virtual sensors employ mathematical models and different sources of information such as actuator states or sensors, which are already existing in a system, in order to generate virtual measurements. Additionally, in recent years, the concept of virtual actuators has been proposed by leading researchers. Virtual actuators are parts of a fault-tolerant control strategy and aim to accommodate faults and to achieve a safe operation of a faulty plant. This paper describes a novel concept for a fuzzy virtual actuator applied to an automated guided vehicle (AGV). The application of fuzzy logic rules allows integrating expert knowledge or experimental data into the decision making of the virtual actuator. The AGV under consideration disposes of an innovative steering concept, which leads to considerable advantages in terms of maneuverability, but requires an elaborate control system. The application of the virtual actuator allows the accommodation of several possible faults, such as a slippery surface under one of the drive modules of the AGV.
Collapse
|
7
|
Puppim de Oliveira D, Pereira Neves Dos Reis W, Morandin Junior O. A Qualitative Analysis of a USB Camera for AGV Control. Sensors (Basel) 2019; 19:s19194111. [PMID: 31547572 PMCID: PMC6806178 DOI: 10.3390/s19194111] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/17/2019] [Revised: 09/11/2019] [Accepted: 09/13/2019] [Indexed: 11/16/2022]
Abstract
The increasing use of Automated Guided Vehicles (AGV) in the industry points to a search for better techniques and technologies to adapt to market requirements. Proper position control and movement give an AGV greater movement accuracy and greater lateral oscillations stability and vibration. It leads to smaller corridors and leaner plants, to more relaxed shipment devices, and to greater safety in the transport of fragile loads, for instance. AGV control techniques are not new, but new sensors’ applications are possible, such as USB cameras. In this sense, it is necessary to ensure the sensor is adequate to control system requirements. This work addresses AGVs driven by passive floor demarcations. It presents a qualitative analysis of a USB camera as sensors for AGV control, not yet a common industrial application. We performed the experiments with a small AGV prototype on an eight-shaped lane, varying both camera parameters and AGV parameters, such as linear speed. The AGV uses a USB camera with different image processing settings—different morphological filters structuring elements shapes and sizes, and three different image resolutions—to analyze the factors that affect line detection and control processing. This paper’s main contribution is a qualitative and quantitative analysis for the different sensor configurations. In addition, it discusses the influence sources on camera image as a position sensor. Furthermore, the experiments confirm sensor pertinence for the proposed control system.
Collapse
Affiliation(s)
- Diogo Puppim de Oliveira
- TEAR - Laboratório de Estratégias de Automação e Robótica, Department of Computing, Federal University of São Carlos, São Carlos, SP 13565-905, Brazil.
| | - Wallace Pereira Neves Dos Reis
- TEAR - Laboratório de Estratégias de Automação e Robótica, Department of Computing, Federal University of São Carlos, São Carlos, SP 13565-905, Brazil.
- Federal Institute of Science, Education and Technology of Rio de Janeiro - IFRJ, campus Volta Redonda, Volta Redonda, RJ 27215-350, Brazil.
| | - Orides Morandin Junior
- TEAR - Laboratório de Estratégias de Automação e Robótica, Department of Computing, Federal University of São Carlos, São Carlos, SP 13565-905, Brazil.
| |
Collapse
|