A Hierarchical Framework for Quadruped Robots Gait Planning Based on DDPG

Trajectory Tracking Control of Variable Sweep Aircraft Based on Reinforcement Learning

An incremental deep deterministic policy gradient (IDDPG) algorithm is devised for the trajectory tracking control of a four-wing variable sweep (FWVS) aircraft with uncertainty. The IDDPG algorithm employs the line-of-sight (LOS) method for path tracking, formulates a reward function based on position and attitude errors, and integrates long short-term memory (LSTM) units into IDDPG algorithm to enhance its adaptability to environmental changes during flight. Finally, environmental disturbance factors are introduced in simulation to validate the designed controller's ability to track climbing trajectories of morphing aircraft in the presence of uncertainty.

Special Issue: Design and Control of a Bio-Inspired Robot

Bionics, the interdisciplinary field that draws inspiration from nature to design and develop innovative technologies, has paved the way for the creation of "bio-inspired robots" [...].

A Hierarchical Control Strategy for a Rigid-Flexible Coupled Hexapod Bio-Robot

The motion process of legged robots contains not only rigid-body motion but also flexible motion with elastic deformation of the legs, especially for heavy loads. Hence, the characteristics of the flexible components and their interactions with the rigid components need to be considered. In this paper, a hierarchical control strategy for robots with rigid-flexible coupling characteristics is proposed. This strategy involves (1) leg force prediction based on real-time motion trajectories and feedforward compensation for the error caused by flexible components; (2) building upon the centroid dynamics model of the rigid-body chassis, the centroid trajectories (centroid angular momentum (CAM) and centroid linear momentum (CLM)) and the body trajectory are taken into account to derive the optimal drive torque for maintaining body stability; (3) finally, the precise force control of the hydraulic drive units is achieved through the sliding mode control algorithm, integrating the dynamic model of the flexible legs. The proposed methods are validated on a giant hexapod robot weighing 3.5 tons, demonstrating that the introduced approach can reduce the robot's vibrations.