1
|
Wang M, Wang Q, Wang Z, Gao Y, Wang J, Cui C, Li Y, Ding Z, Wang K, Xu C, Gao F. Unlocking aerobatic potential of quadcopters: Autonomous freestyle flight generation and execution. Sci Robot 2025; 10:eadp9905. [PMID: 40238922 DOI: 10.1126/scirobotics.adp9905] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2024] [Accepted: 03/18/2025] [Indexed: 04/18/2025]
Abstract
Quadcopter drones are capable of executing complex aerobatic maneuvers when controlled manually by skilled pilots but are limited to simple aerobatic actions when flying autonomously in open spaces. As such, this study introduces a comprehensive system that enables drones to generate and execute sophisticated aerobatic maneuvers in complex environments with dense obstacle distributions. A universal representation is proposed, succinctly capturing flight as a series of discrete aerobatic intentions. These intentions consist of topology and attitude changes, which can be combined in various ways to describe intricate flight maneuvers. A spatial-temporal joint optimization trajectory planner is also introduced to generate dynamically feasible trajectories that are as smooth as possible and devoid of collisions. In addition, we investigate unique yaw sensitivity issues in aerobatic flight and identify the inherent influence of differential flatness singularities on yaw rotations while avoiding associated dynamics issues. A series of ablation studies confirmed the necessity of these spatial-temporal joint optimization and yaw compensation strategies. Additional simulations and physical experiments validated the stability and feasibility of our proposed system for improving uncrewed aerial flight. The proposed system enables drones to autonomously achieve flight performance usually reserved for professional pilots, unlocking boundless potential for aerobatic flight evolution in uncrewed aerial vehicles.
Collapse
Affiliation(s)
- Mingyang Wang
- Institute of Cyber-Systems and Control, College of Control Science and Engineering, Zhejiang University, Hangzhou, China
- Huzhou Institute of Zhejiang University, Huzhou, China
| | - Qianhao Wang
- Institute of Cyber-Systems and Control, College of Control Science and Engineering, Zhejiang University, Hangzhou, China
- Huzhou Institute of Zhejiang University, Huzhou, China
| | - Ze Wang
- Huzhou Institute of Zhejiang University, Huzhou, China
- College of Optical Science and Engineering, Zhejiang University, Hangzhou, China
| | - Yuman Gao
- Institute of Cyber-Systems and Control, College of Control Science and Engineering, Zhejiang University, Hangzhou, China
- Huzhou Institute of Zhejiang University, Huzhou, China
| | - Jingping Wang
- Institute of Cyber-Systems and Control, College of Control Science and Engineering, Zhejiang University, Hangzhou, China
- Huzhou Institute of Zhejiang University, Huzhou, China
| | - Can Cui
- Institute of Cyber-Systems and Control, College of Control Science and Engineering, Zhejiang University, Hangzhou, China
- Huzhou Institute of Zhejiang University, Huzhou, China
| | - Yuan Li
- Institute of Cyber-Systems and Control, College of Control Science and Engineering, Zhejiang University, Hangzhou, China
- Huzhou Institute of Zhejiang University, Huzhou, China
| | - Ziming Ding
- Institute of Cyber-Systems and Control, College of Control Science and Engineering, Zhejiang University, Hangzhou, China
- Huzhou Institute of Zhejiang University, Huzhou, China
| | - Kaiwei Wang
- College of Optical Science and Engineering, Zhejiang University, Hangzhou, China
| | - Chao Xu
- Institute of Cyber-Systems and Control, College of Control Science and Engineering, Zhejiang University, Hangzhou, China
- Huzhou Institute of Zhejiang University, Huzhou, China
| | - Fei Gao
- Institute of Cyber-Systems and Control, College of Control Science and Engineering, Zhejiang University, Hangzhou, China
- Huzhou Institute of Zhejiang University, Huzhou, China
- Differential Robotics Technology Co., Ltd., Hangzhou, China
| |
Collapse
|
2
|
Lai J, Wu Z, Ren Z, Chen C, Tan Q, Xie S. A Lyapunov-Based Framework for Trajectory Planning of Wheeled Vehicle Using Imitation Learning. IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING 2025; 22:12118-12133. [DOI: 10.1109/tase.2025.3541409] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/04/2025]
Affiliation(s)
- Jialun Lai
- School of Automation, Guangdong University of Technology, Guangzhou, Guangdong, China
| | - Zongze Wu
- School of Automation, Guangdong University of Technology, Guangzhou, Guangdong, China
| | - Zhigang Ren
- School of Automation, Guangdong University of Technology, Guangzhou, Guangdong, China
| | - Ci Chen
- School of Automation, Guangdong University of Technology, Guangzhou, Guangdong, China
| | - Qi Tan
- School of Automation, Guangdong University of Technology, Guangzhou, Guangdong, China
| | - Shengli Xie
- School of Automation, Guangdong University of Technology, Guangzhou, Guangdong, China
| |
Collapse
|
3
|
Sun W, Sun P, Ding W, Zhao J, Li Y. Gradient-based autonomous obstacle avoidance trajectory planning for B-spline UAVs. Sci Rep 2024; 14:14458. [PMID: 38914778 PMCID: PMC11196686 DOI: 10.1038/s41598-024-65463-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2023] [Accepted: 06/20/2024] [Indexed: 06/26/2024] Open
Abstract
Unmanned aerial vehicles (UAVs) have become the focus of current research because of their practicability in various scenarios. However, current local path planning methods often result in trajectories with numerous sharp or inflection points, which are not ideal for smooth UAV flight. This paper introduces a UAV path planning approach based on distance gradients. The key improvements include generating collision-free paths using collision information from initial trajectories and obstacles. Then, collision-free paths are subsequently optimized using distance gradient information. Additionally, a trajectory time adjustment method is proposed to ensure the feasibility and safety of the trajectory while prioritizing smoothness. The Limited-memory BFGS algorithm is employed to efficiently solve optimal local paths, with the ability to quickly restart the trajectory optimization program. The effectiveness of the proposed method is validated in the Robot Operating System simulation environment, demonstrating its ability to meet trajectory planning requirements for UAVs in complex unknown environments with high dynamics. Moreover, it surpasses traditional UAV trajectory planning methods in terms of solution speed, trajectory length, and data volume.
Collapse
Affiliation(s)
- Wei Sun
- School of Geomatics, Liaoning Technical University, Fuxin, 12300, Liaoning, China
| | - Pengxiang Sun
- School of Geomatics, Liaoning Technical University, Fuxin, 12300, Liaoning, China.
| | - Wei Ding
- School of Geomatics, Liaoning Technical University, Fuxin, 12300, Liaoning, China
| | - Jingang Zhao
- School of Geomatics, Liaoning Technical University, Fuxin, 12300, Liaoning, China
| | - Yadan Li
- School of Geomatics, Liaoning Technical University, Fuxin, 12300, Liaoning, China
| |
Collapse
|
4
|
Zhu H, Li B, Tong R, Yin H, Zhu C. Position Checking-Based Sampling Approach Combined with Attraction Point Local Optimization for Safe Flight of UAVs. SENSORS (BASEL, SWITZERLAND) 2024; 24:2157. [PMID: 38610368 PMCID: PMC11014284 DOI: 10.3390/s24072157] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/01/2024] [Revised: 03/19/2024] [Accepted: 03/25/2024] [Indexed: 04/14/2024]
Abstract
Trading off the allocation of limited computational resources between front-end path generation and back-end trajectory optimization plays a key role in improving the efficiency of unmanned aerial vehicle (UAV) motion planning. In this paper, a sampling-based kinodynamic planning method that can reduce the computational cost as well as the risks of UAV flight is proposed. Firstly, an initial trajectory connecting the start and end points without considering obstacles is generated. Then, a spherical space is constructed around the topological vertices of the environment, based on the intersections of the trajectory with the obstacles. Next, some unnecessary sampling points, as well as node rewiring, are discarded by the designed position-checking strategy to minimize the computational cost and reduce the risks of UAV flight. Finally, in order to make the planning framework adaptable to complex scenarios, the strategies for selecting different attraction points according to the environment are designed, which further ensures the safe flight of the UAV while improving the success rate of the front-end trajectory. Simulations and real-world experiment comparisons are conducted on a vision-based platform to verify the performance of the proposed method.
Collapse
Affiliation(s)
- Hai Zhu
- School of Control Science and Engineering, Tiangong University, Tianjin 300387, China; (H.Z.); (R.T.); (H.Y.)
| | - Baoquan Li
- School of Control Science and Engineering, Tiangong University, Tianjin 300387, China; (H.Z.); (R.T.); (H.Y.)
| | - Ruiyang Tong
- School of Control Science and Engineering, Tiangong University, Tianjin 300387, China; (H.Z.); (R.T.); (H.Y.)
| | - Haolin Yin
- School of Control Science and Engineering, Tiangong University, Tianjin 300387, China; (H.Z.); (R.T.); (H.Y.)
| | - Canlin Zhu
- School of Communications and Information Engineering, Nanjing University of Posts and Telecommunications, Nanjing 210003, China;
| |
Collapse
|
5
|
Liang Q, Wang Z, Yin Y, Xiong W, Zhang J, Yang Z. Autonomous aerial obstacle avoidance using LiDAR sensor fusion. PLoS One 2023; 18:e0287177. [PMID: 37379288 PMCID: PMC10306222 DOI: 10.1371/journal.pone.0287177] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2023] [Accepted: 05/30/2023] [Indexed: 06/30/2023] Open
Abstract
The obstacle avoidance problem of unmanned aerial vehicle (UAV) mainly refers to the design of a method that can safely reach the target point from the starting point in an unknown flight environment. In this paper, we mainly propose an obstacle avoidance method composed of three modules: environment perception, algorithm obstacle avoidance and motion control. Our method realizes the function of reasonable and safe obstacle avoidance of UAV in low-altitude complex environments. Firstly, we use the light detection and ranging (LiDAR) sensor to perceive obstacles around the environment. Next, the sensor data is processed by the vector field histogram (VFH) algorithm to output the desired speed of drone flight. Finally, the expected speed value is sent to the quadrotor flight control and realizes autonomous obstacle avoidance flight of the drone. We verify the effectiveness and feasibility of the proposed method in 3D simulation environment.
Collapse
Affiliation(s)
- Qing Liang
- School Of Electronic Engineering, Xi’an University Of Posts And Telecommunications, Xi’an, Shaanxi Province, China
| | - Zilong Wang
- School Of Electronic Engineering, Xi’an University Of Posts And Telecommunications, Xi’an, Shaanxi Province, China
| | - Yafang Yin
- School Of Electronic Engineering, Xi’an University Of Posts And Telecommunications, Xi’an, Shaanxi Province, China
| | - Wei Xiong
- School Of Information Engineering, Xi’an FANYI University, Xi’an, Shaanxi Province, China
| | - Jingjing Zhang
- School Of Electronic Engineering, Xi’an University Of Posts And Telecommunications, Xi’an, Shaanxi Province, China
| | - Ziyi Yang
- School Of Electronic Engineering, Xi’an University Of Posts And Telecommunications, Xi’an, Shaanxi Province, China
| |
Collapse
|
6
|
Yang Y, Hou Z, Chen H, Lu P. DRL-based Path Planner and its Application in Real Quadrotor with LIDAR. J INTELL ROBOT SYST 2023. [DOI: 10.1007/s10846-023-01819-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/16/2023]
|
7
|
Re-planning of Quadrotors Under Disturbance Based on Meta Reinforcement Learning. J INTELL ROBOT SYST 2023. [DOI: 10.1007/s10846-022-01788-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/18/2023]
|
8
|
Narkhede KS, Kulkarni AM, Thanki DA, Poulakakis I. A Sequential MPC Approach to Reactive Planning for Bipedal Robots Using Safe Corridors in Highly Cluttered Environments. IEEE Robot Autom Lett 2022. [DOI: 10.1109/lra.2022.3204367] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Affiliation(s)
- Kunal S. Narkhede
- Department of Mechanical Engineering, University of Delaware, Newark, DE, USA
| | | | - Dhruv A. Thanki
- Department of Mechanical Engineering, University of Delaware, Newark, DE, USA
| | - Ioannis Poulakakis
- Department of Mechanical Engineering, University of Delaware, Newark, DE, USA
| |
Collapse
|
9
|
Chen P, Jiang Y, Dang Y, Yu T, Liang R. Real-Time Efficient Trajectory Planning for Quadrotor Based on Hard Constraints. J INTELL ROBOT SYST 2022. [DOI: 10.1007/s10846-022-01662-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
|
10
|
Zhou X, Wen X, Wang Z, Gao Y, Li H, Wang Q, Yang T, Lu H, Cao Y, Xu C, Gao F. Swarm of micro flying robots in the wild. Sci Robot 2022; 7:eabm5954. [PMID: 35507682 DOI: 10.1126/scirobotics.abm5954] [Citation(s) in RCA: 30] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/25/2023]
Abstract
Aerial robots are widely deployed, but highly cluttered environments such as dense forests remain inaccessible to drones and even more so to swarms of drones. In these scenarios, previously unknown surroundings and narrow corridors combined with requirements of swarm coordination can create challenges. To enable swarm navigation in the wild, we develop miniature but fully autonomous drones with a trajectory planner that can function in a timely and accurate manner based on limited information from onboard sensors. The planning problem satisfies various task requirements including flight efficiency, obstacle avoidance, and inter-robot collision avoidance, dynamical feasibility, swarm coordination, and so on, thus realizing an extensible planner. Furthermore, the proposed planner deforms trajectory shapes and adjusts time allocation synchronously based on spatial-temporal joint optimization. A high-quality trajectory thus can be obtained after exhaustively exploiting the solution space within only a few milliseconds, even in the most constrained environment. The planner is finally integrated into the developed palm-sized swarm platform with onboard perception, localization, and control. Benchmark comparisons validate the superior performance of the planner in trajectory quality and computing time. Various real-world field experiments demonstrate the extensibility of our system. Our approach evolves aerial robotics in three aspects: capability of cluttered environment navigation, extensibility to diverse task requirements, and coordination as a swarm without external facilities.
Collapse
Affiliation(s)
- Xin Zhou
- State Key Laboratory of Industrial Control and Technology, Zhejiang University, Hangzhou, China.,Huzhou Institute of Zhejiang University, Huzhou, China
| | - Xiangyong Wen
- State Key Laboratory of Industrial Control and Technology, Zhejiang University, Hangzhou, China.,Huzhou Institute of Zhejiang University, Huzhou, China
| | - Zhepei Wang
- State Key Laboratory of Industrial Control and Technology, Zhejiang University, Hangzhou, China.,Huzhou Institute of Zhejiang University, Huzhou, China
| | - Yuman Gao
- State Key Laboratory of Industrial Control and Technology, Zhejiang University, Hangzhou, China.,Huzhou Institute of Zhejiang University, Huzhou, China
| | - Haojia Li
- Department of Electronic and Computer Engineering, Hong Kong University of Science and Technology, Hongkong, China
| | - Qianhao Wang
- State Key Laboratory of Industrial Control and Technology, Zhejiang University, Hangzhou, China.,Huzhou Institute of Zhejiang University, Huzhou, China
| | - Tiankai Yang
- State Key Laboratory of Industrial Control and Technology, Zhejiang University, Hangzhou, China.,Huzhou Institute of Zhejiang University, Huzhou, China
| | - Haojian Lu
- State Key Laboratory of Industrial Control and Technology, Zhejiang University, Hangzhou, China
| | - Yanjun Cao
- Huzhou Institute of Zhejiang University, Huzhou, China
| | - Chao Xu
- State Key Laboratory of Industrial Control and Technology, Zhejiang University, Hangzhou, China.,Huzhou Institute of Zhejiang University, Huzhou, China
| | - Fei Gao
- State Key Laboratory of Industrial Control and Technology, Zhejiang University, Hangzhou, China.,Huzhou Institute of Zhejiang University, Huzhou, China
| |
Collapse
|
11
|
Cao K, Cao M, Yuan S, Xie L. DIRECT: A Differential Dynamic Programming Based Framework for Trajectory Generation. IEEE Robot Autom Lett 2022. [DOI: 10.1109/lra.2022.3142744] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
|
12
|
Wang L, Xu H, Zhang Y, Shen S. Neither Fast nor Slow: How to Fly Through Narrow Tunnels. IEEE Robot Autom Lett 2022. [DOI: 10.1109/lra.2022.3154024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
13
|
Greeff M, Zhou S, Schoellig AP. Fly Out the Window: Exploiting Discrete-Time Flatness for Fast Vision-Based Multirotor Flight. IEEE Robot Autom Lett 2022. [DOI: 10.1109/lra.2022.3154008] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
|
14
|
A Survey of Multi-Agent Cross Domain Cooperative Perception. ELECTRONICS 2022. [DOI: 10.3390/electronics11071091] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/01/2023]
Abstract
Intelligent unmanned systems for ground, sea, aviation, and aerospace application are important research directions for the new generation of artificial intelligence in China. Intelligent unmanned systems are also important carriers of interactive mapping between physical space and cyberspace in the process of the digitization of human society. Based on the current domestic and overseas development status of unmanned systems for ground, sea, aviation, and aerospace application, this paper reviewed the theoretical problems and research trends of multi-agent cross-domain cooperative perception. The scenarios of multi-agent cooperative perception tasks in different areas were deeply investigated and analyzed, the scientific problems of cooperative perception were analyzed, and the development direction of multi-agent cooperative perception theory research for solving the challenges of the complex environment, interactive communication, and cross-domain tasks was expounded.
Collapse
|
15
|
Sun W, Tang G, Hauser K. Fast UAV Trajectory Optimization Using Bilevel Optimization With Analytical Gradients. IEEE T ROBOT 2021. [DOI: 10.1109/tro.2021.3076454] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
|
16
|
Kong F, Xu W, Cai Y, Zhang F. Avoiding Dynamic Small Obstacles With Onboard Sensing and Computation on Aerial Robots. IEEE Robot Autom Lett 2021. [DOI: 10.1109/lra.2021.3101877] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
17
|
Wu Y, Ding Z, Xu C, Gao F. External Forces Resilient Safe Motion Planning for Quadrotor. IEEE Robot Autom Lett 2021. [DOI: 10.1109/lra.2021.3110316] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
|
18
|
Zhou X, Wang Z, Ye H, Xu C, Gao F. EGO-Planner: An ESDF-Free Gradient-Based Local Planner for Quadrotors. IEEE Robot Autom Lett 2021. [DOI: 10.1109/lra.2020.3047728] [Citation(s) in RCA: 20] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
19
|
Robust and Efficient Trajectory Replanning Based on Guiding Path for Quadrotor Fast Autonomous Flight. REMOTE SENSING 2021. [DOI: 10.3390/rs13050972] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Path planning is one of the key parts of unmanned aerial vehicle (UAV) fast autonomous flight in an unknown cluttered environment. However, real-time and stability remain a significant challenge in the field of path planning. To improve the robustness and efficiency of the path planning method in complex environments, this paper presents RETRBG, a robust and efficient trajectory replanning method based on the guiding path. Firstly, a safe guiding path is generated by using an improved A* and path pruning method, which is used to perceive the narrow space in its surrounding environment. Secondly, under the guidance of the path, a guided kinodynamic path searching method (GKPS) is devised to generate a safe, kinodynamically feasible and minimum-time initial path. Finally, an adaptive optimization function with two modes is proposed to improve the optimization quality in complex environments, which selects the optimization mode to optimize the smoothness and safety of the path according to the perception results of the guiding path. The experimental results demonstrate that the proposed method achieved good performance both in different obstacle densities and different resolutions. Compared with the other state-of-the-art methods, the quality and success rate of the planning result are significantly improved.
Collapse
|
20
|
Wang Z, Zhou X, Xu C, Chu J, Gao F. Alternating Minimization Based Trajectory Generation for Quadrotor Aggressive Flight. IEEE Robot Autom Lett 2020. [DOI: 10.1109/lra.2020.3003871] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
|