A review of quadrotor: An underactuated mechanical system

Reinforcement learning-based formation-surrounding control for multiple quadrotor UAVs pursuit-evasion games

This paper proposes a reinforcement learning-based formation-surrounding control method for multiple quadrotor unmanned aerial vehicles (UAVs) pursuit-evasion (MPE) games system subject to external disturbances. In the framework of the MPE games, the pursuers aim to equally surround the evaders which try to avoid being surrounded when forming the desired formation. By constructing position and attitude tracking error subsystems of quadrotor UAV, this paper proposes two control strategies which combines the feedforward control technique and reinforcement learning (RL) method. First, two novel cost functions are presented for the quadrotor UAV with external disturbances. Then, two control schemes based on RL have been developed to guarantee the stability of the tracking error subsystem. Subsequently, two critic-only neural networks (NN) weight update laws that only satisfy finite excitation conditions are proposed to estimate the optimal cost function. Furthermore, Nash equilibrium for multiple quadrotor UAVs is achieved by means of RL strategy to solve the Hamilton-Jacobi-Isaacs (HJI) equations. And the property of equally surrounding is proved for the first time by utilizing Euler's formula in this paper. Finally, the numerical simulation results are given to show the effectiveness and superior performance of the proposed control method.

Evaluating the Forest Ecosystem through a Semi-Autonomous Quadruped Robot and a Hexacopter UAV

Accurate and timely monitoring is imperative to the resilience of forests for economic growth and climate regulation. In the UK, forest management depends on citizen science to perform tedious and time-consuming data collection tasks. In this study, an unmanned aerial vehicle (UAV) equipped with a light sensor and positioning capabilities is deployed to perform aerial surveying and to observe a series of forest health indicators (FHIs) which are inaccessible from the ground. However, many FHIs such as burrows and deadwood can only be observed from under the tree canopy. Hence, we take the initiative of employing a quadruped robot with an integrated camera as well as an external sensing platform (ESP) equipped with light and infrared cameras, computing, communication and power modules to observe these FHIs from the ground. The forest-monitoring time can be extended by reducing computation and conserving energy. Therefore, we analysed different versions of the YOLO object-detection algorithm in terms of accuracy, deployment and usability by the EXP to accomplish an extensive low-latency detection. In addition, we constructed a series of new datasets to train the YOLOv5x and YOLOv5s for recognising FHIs. Our results reveal that YOLOv5s is lightweight and easy to train for FHI detection while performing close to real-time, cost-effective and autonomous forest monitoring.

Auto-Tuning of Attitude Control System for Heterogeneous Multirotor UAS

This paper presents a heterogeneous configuration of the multirotor unmanned aerial system (UAS) that features the combined characteristics of the helicopter and quadrotor in a single multirotor design, featuring the endurance and energy efficiency similar to a helicopter, while keeping the mechanical simplicity, control, and manoeuvrability of the standard quadrotor. Power needed for a rotorcraft to hover has the inverse relation with the rotor disc. Therefore, multiple small rotors of the quadrotor are energetically outperformed by a large rotor of the helicopter, for a similar size. Designing the stable control system for such a dynamically complex multirotor configuration remains the main challenge as the studies previously carried out on these designs have successfully demonstrated energy efficiency but at the cost of degraded attitude control. Advancements in the energetics of the multirotor results in enhanced endurance and range that could be highly effective in remote operation applications. However, a stable control system is required for accurate positioning. In this paper, a cascaded PID control approach is proposed to provide the control solution for this heterogeneous multirotor. Automatic tuning is proposed to design the PID controller for each loop of the cascade structure. A relay feedback experiment is conducted in a controlled environment, followed by identification of the open-loop frequency response and estimation of dynamics. Subsequently, PID controllers are tuned through approximated models with the help of tuning rules. A custom-designed flight controller is used to experimentally implement the proposed control structure. Presented experimental results demonstrate the efficacy of the proposed control strategy for heterogeneous multirotor UAS.

Quadrotor Attitude Control by Fractional-Order Fuzzy Particle Swarm Optimization-Based Active Disturbance Rejection Control

In this paper, Active Disturbance Rejection Control (ADRC) is utilized in the attitude control of a quadrotor aircraft to address the problem of attitude destabilization in flight control caused by parameter uncertainties and external disturbances. Considering the difficulty of optimizing the parameter of ADRC, a fractional-order fuzzy particle swarm optimization (FOFPSO) algorithm is proposed to optimize the parameters of ADRC for quadrotor aircraft. Simultaneously, the simulation experiment is designed, which compares with the optimized performance of traditional particle swarm optimization (PSO), fuzzy article swarm optimization (FPSO) and adaptive genetic algorithm-particle swarm optimization (AGA-PSO). In addition, the turbulent wind field model is established to verify the disturbance rejection performance of the controller. Finally, the designed controller is deployed to the actual hardware platform by using the model-based design method. The results show that the controller has a small overshoot and stronger disturbance rejection ability after the parameters are optimized by the proposed algorithm.

AUV Trajectory Tracking Models and Control Strategies: A Review

Autonomous underwater vehicles (AUVs) have been widely used to perform underwater tasks. Due to the environmental disturbances, underactuated problems, system constraints, and system coupling, AUV trajectory tracking control is challenging. Thus, further investigation of dynamic characteristics and trajectory tracking control methods of the AUV motion system will be of great importance to improve underwater task performance. An AUV controller must be able to cope with various challenges with the underwater vehicle, adaptively update the reference model, and overcome unexpected deviations. In order to identify modeling strategies and the best control practices, this paper presents an overview of the main factors of control-oriented models and control strategies for AUVs. In modeling, two fields are considered: (i) models that come from simplifications of Fossen’s equations; and (ii) system identification models. For each category, a brief description of the control-oriented modeling strategies is given. In the control field, three relevant aspects are considered: (i) significance of AUV trajectory tracking control, (ii) control strategies; and (iii) control performance. For each aspect, the most important features are explained. Furthermore, in the aspect of control strategies, mathematical modeling study and physical experiment study are introduced in detail. Finally, with the aim of establishing the acceptability of the reported modeling and control techniques, as well as challenges that remain open, a discussion and a case study are presented. The literature review shows the development of new control-oriented models, the research in the estimation of unknown inputs, and the development of more innovative control strategies for AUV trajectory tracking systems are still open problems that must be addressed in the short term.

Model-Free-Based Single-Dimension Fuzzy SMC Design for Underactuated Quadrotor UAV

The underactuated quadrotor unmanned aerial vehicle (UAV) is one of the nonlinear systems that have few actuators as compared to the degree of freedom (DOF); thus, it is a strenuous task to stabilize its attitude and positions. Moreover, an induction of unmodelled dynamic factors and uncertainties make it more difficult to control its maneuverability. In this paper, a model-free based single-dimension fuzzy sliding mode control (MFSDF-SMC) is proposed to control the attitude and positions of underactuated quadrotor UAV. The paper discusses the kinematic and dynamic models with unmodelled dynamic factors and unknown external disturbances. These unmodelled factors and disturbances may lead the quadrotor towards failure in tracking specific trajectory and may also generate some serious transient and steady-state issues. Furthermore, to avoid the problem of gimbal lock, the model is amalgamated with hyperbolic function to resolve the singularity issues dully developed due to Newton Euler’s dynamic modeling. The simulation results performed for MFSDF-SMC using MATLAB software R2020a are compared with conventional sliding mode control, fuzzy-based sliding control and single-dimension fuzzy-based sliding mode control without a model-free approach. The design and implementation of the model-free single dimension-based fuzzy sliding mode control (MFSDF-SMC) with an updated Lyapunov stability theorem is presented in this work. It is observed that MFSDF-SMC produces robust trajectory performance therefore, and the manuscript suggests the experimental setup to test the proposed algorithm in a noisy environment keeping the same conditions. The verification of the equipment used and its effective demonstration is also available for the reader within the manuscript.

A review on drones controlled in real-time

This paper presents related literature review on drones or unmanned aerial vehicles that are controlled in real-time. Systems in real-time control create more deterministic response such that tasks are guaranteed to be completed within a specified time. This system characteristic is very much desirable for drones that are now required to perform more sophisticated tasks. The reviewed materials presented were chosen to highlight drones that are controlled in real time, and to include technologies used in different applications of drones. Progress has been made in the development of highly maneuverable drones for applications such as monitoring, aerial mapping, military combat, agriculture, etc. The control of such highly maneuverable vehicles presents challenges such as real-time response, workload management, and complex control. This paper endeavours to discuss real-time aspects of drones control as well as possible implementation of real-time flight control system to enhance drones performance.