Rough terrain mapping and classification for foothold selection in a walking robot

Hyperspectral Imaging for Mobile Robot Navigation

The article presents the application of a hyperspectral camera in mobile robot navigation. Hyperspectral cameras are imaging systems that can capture a wide range of electromagnetic spectra. This feature allows them to detect a broader range of colors and features than traditional cameras and to perceive the environment more accurately. Several surface types, such as mud, can be challenging to detect using an RGB camera. In our system, the hyperspectral camera is used for ground recognition (e.g., grass, bumpy road, asphalt). Traditional global path planning methods take the shortest path length as the optimization objective. We propose an improved A* algorithm to generate the collision-free path. Semantic information makes it possible to plan a feasible and safe path in a complex off-road environment, taking traveling time as the optimization objective. We presented the results of the experiments for data collected in a natural environment. An important novelty of this paper is using a modified nearest neighbor method for hyperspectral data analysis and then using the data for path planning tasks in the same work. Using the nearest neighbor method allows us to adjust the robotic system much faster than using neural networks. As our system is continuously evolving, we intend to examine the performance of the vehicle on various road surfaces, which is why we sought to create a classification system that does not require a prolonged learning process. In our paper, we aimed to demonstrate that the incorporation of a hyperspectral camera can not only enhance route planning but also aid in the determination of parameters such as speed and acceleration.

Legged locomotion over irregular terrains: state of the art of human and robot performance

Legged robotic technologies have moved out of the lab to operate in real environments, characterized by a wide variety of unpredictable irregularities and disturbances, all this in close proximity with humans. Demonstrating the ability of current robots to move robustly and reliably in these conditions is becoming essential to prove their safe operation. Here, we report an in-depth literature review aimed at verifying the existence of common or agreed protocols and metrics to test the performance of legged system in realistic environments. We primarily focused on three types of robotic technologies, i.e., hexapods, quadrupeds and bipeds. We also included a comprehensive overview on human locomotion studies, being it often considered the gold standard for performance, and one of the most important sources of bioinspiration for legged machines. We discovered that very few papers have rigorously studied robotic locomotion under irregular terrain conditions. On the contrary, numerous studies have addressed this problem on human gait, being nonetheless of highly heterogeneous nature in terms of experimental design. This lack of agreed methodology makes it challenging for the community to properly assess, compare and predict the performance of existing legged systems in real environments. On the one hand, this work provides a library of methods, metrics and experimental protocols, with a critical analysis on the limitations of the current approaches and future promising directions. On the other hand, it demonstrates the existence of an important lack of benchmarks in the literature, and the possibility of bridging different disciplines, e.g., the human and robotic, towards the definition of standardized procedures that will boost not only the scientific development of better bioinspired solutions, but also their market uptake.

Terrain Perception Using Wearable Parrot-Inspired Companion Robot, KiliRo

Research indicates that deaths due to fall incidents are the second leading cause of unintentional injury deaths in the world. Death by fall due to a person texting or talking on mobile phones while walking, impaired vision, unexpected terrain changes, low balance, weakness, and chronic conditions has increased drastically over the past few decades. Particularly, unexpected terrain changes would many times lead to severe injuries and sometimes death even in healthy individuals. To tackle this problem, a warning system to alert the person of the imminent danger of a fall can be developed. This paper describes a solution for such a warning system used in our bio-inspired wearable pet robot, KiliRo. It is a terrain perception system used to classify the terrain based on visual features obtained from processing the images captured by a camera and notify the wearer of terrain changes while walking. The parrot-inspired KiliRo robot can twist its head and the camera up to 180 degrees to obtain visual feedback for classification. Feature extraction is followed by K-nearest neighbor for terrain classification. Experiments were conducted to establish the efficacy and validity of the proposed approach in classifying terrain changes. The results indicate an accuracy of over 95% across five terrain types, namely pedestrian pathway, road, grass, interior, and staircase.

Biomimetic Aquatic Robots Based on Fluid-Driven Actuators: A Review

Biomimetic aquatic robots are a promising solution for marine applications such as internal pipe inspection, beach safety, and animal observation because of their strong manoeuvrability and low environmental damage. As the application field of robots has changed from a structured known environment to an unstructured and unknown territory, the disadvantage of the low efficiency of the propeller propulsion has become more crucial. Among the various actuation methods of biomimetic robots, many researchers have utilised fluid actuation as fluid is clean, environmentally friendly, and easy to obtain. This paper presents a literature review of the locomotion mode, actuation method, and typical works on fluid-driven bionic aquatic robots. The actuator and structural material selection is then discussed, followed by research direction and application prospects of fluid-driven bionic aquatic robots.

Continuous Online Adaptation of Bioinspired Adaptive Neuroendocrine Control for Autonomous Walking Robots

Walking animals can continuously adapt their locomotion to deal with unpredictable changing environments. They can also take proactive steps to avoid colliding with an obstacle. In this study, we aim to realize such features for autonomous walking robots so that they can efficiently traverse complex terrains. To achieve this, we propose novel bioinspired adaptive neuroendocrine control. In contrast to conventional locomotion control methods, this approach does not require robot and environmental models, exteroceptive feedback, or multiple learning trials. It integrates three main modular neural mechanisms, relying only on proprioceptive feedback and short-term memory, namely: 1) neural central pattern generator (CPG)-based control; 2) an artificial hormone network (AHN); and 3) unsupervised input correlation-based learning (ICO). The neural CPG-based control creates insect-like gaits, while the AHN can continuously adapt robot joint movement individually with respect to the terrain during the stance phase using only the torque feedback. In parallel, the ICO generates short-term memory for proactive obstacle negotiation during the swing phase, allowing the posterior legs to step over the obstacle before hitting it. The control approach is evaluated on a bioinspired hexapod robot walking on complex unpredictable terrains (e.g., gravel, grass, and extreme random stepfield). The results show that the robot can successfully perform energy-efficient autonomous locomotion and online continuous adaptation with proactivity to overcome such terrains. Since our adaptive neural control approach does not require a robot model, it is general and can be applied to other bioinspired walking robots to achieve a similar adaptive, autonomous, and versatile function.

Insect-Inspired Robots: Bridging Biological and Artificial Systems

This review article aims to address common research questions in hexapod robotics. How can we build intelligent autonomous hexapod robots that can exploit their biomechanics, morphology, and computational systems, to achieve autonomy, adaptability, and energy efficiency comparable to small living creatures, such as insects? Are insects good models for building such intelligent hexapod robots because they are the only animals with six legs? This review article is divided into three main sections to address these questions, as well as to assist roboticists in identifying relevant and future directions in the field of hexapod robotics over the next decade. After an introduction in section (1), the sections will respectively cover the following three key areas: (2) biomechanics focused on the design of smart legs; (3) locomotion control; and (4) high-level cognition control. These interconnected and interdependent areas are all crucial to improving the level of performance of hexapod robotics in terms of energy efficiency, terrain adaptability, autonomy, and operational range. We will also discuss how the next generation of bioroboticists will be able to transfer knowledge from biology to robotics and vice versa.

Hexagonal Grid-Based Framework for Mobile Robot Navigation

The paper addresses the problem of mobile robots’ navigation using a hexagonal lattice. We carried out experiments in which we used a vehicle equipped with a set of sensors. Based on the data, a traversable map was created. The experimental results proved that hexagonal maps of an environment can be easily built based on sensor readings. The path planning method has many advantages: the situation in which obstacles surround the position of the robot or the target is easily detected, and we can influence the properties of the path, e.g., the distance from obstacles or the type of surface can be taken into account. A path can be smoothed more easily than with a rectangular grid.

AQuRo: A Cat-like Adaptive Quadruped Robot With Novel Bio-Inspired Capabilities

There are currently many quadruped robots suited to a wide range of applications, but traversing some terrains, such as vertical ladders, remains an open challenge. There is still a need to develop adaptive robots that can walk and climb efficiently. This paper presents an adaptive quadruped robot that, by mimicking feline structure, supports several novel capabilities. We design a novel paw structure and several point-cloud-based sensory structures incorporating a quad-composite time-of-flight sensor and a dual-laser range finder. The proposed robot is equipped with physical and cognitive capabilities which include: 1) a dynamic-density topological map building with attention model, 2) affordance perception using the topological map, and 3) a neural-based locomotion model. The novel capabilities show strong integration between locomotion and internal–external sensory information, enabling short-term adaptations in response to environmental changes. The robot performed well in several situations: walking on natural terrain, walking with a leg malfunction, avoiding a sudden obstacle, climbing a vertical ladder. Further, we consider current problems and future development.

What Lies Beneath One’s Feet? Terrain Classification Using Inertial Data of Human Walk

The objective of this study was to investigate if the inertial data collected from normal human walk can be used to reveal the underlying terrain types. For this purpose, we recorded the gait patterns of normal human walk on six different terrain types with variation in hardness and friction using body mounted inertial sensors. We collected accelerations and angular velocities of 40 healthy subjects with two smartphones embedded inertial measurement units (MPU-6500) attached at two different body locations (chest and lower back). The recorded data were segmented with stride based segmentation approach and 194 tempo-spectral features were computed for each stride. We trained two machine learning classifiers, namely random forest and support vector machine, and cross validated the results with 10-fold cross-validation strategy. The classification tasks were performed on indoor–outdoor terrains, hard–soft terrains, and a combination of binary, ternary, quaternary, quinary and senary terrains. From the experimental results, the classification accuracies of 97% and 92% were achieved for indoor–outdoor and hard–soft terrains, respectively. The classification results for binary, ternary, quaternary, quinary and senary class classification were 96%, 94%, 92%, 90%, and 89%, respectively. These results demonstrate that the stride data collected with the low-level signals of a single IMU can be used to train classifiers and predict terrain types with high accuracy. Moreover, the problem at hand can be solved invariant of sensor type and sensor location.

Learning the Cost Function for Foothold Selection in a Quadruped Robot

This paper is focused on designing a cost function of selecting a foothold for a physical quadruped robot walking on rough terrain. The quadruped robot is modeled with Denavit–Hartenberg (DH) parameters, and then a default foothold is defined based on the model. Time of Flight (TOF) camera is used to perceive terrain information and construct a 2.5D elevation map, on which the terrain features are detected. The cost function is defined as the weighted sum of several elements including terrain features and some features on the relative pose between the default foothold and other candidates. It is nearly impossible to hand-code the weight vector of the function, so the weights are learned using Supporting Vector Machine (SVM) techniques, and the training data set is generated from the 2.5D elevation map of a real terrain under the guidance of experts. Four candidate footholds around the default foothold are randomly sampled, and the expert gives the order of such four candidates by rotating and scaling the view for seeing clearly. Lastly, the learned cost function is used to select a suitable foothold and drive the quadruped robot to walk autonomously across the rough terrain with wooden steps. Comparing to the approach with the original standard static gait, the proposed cost function shows better performance.

Towards dynamic alternating tripod trotting of a pony-sized hexapod robot for disaster rescuing based on multi-modal impedance control

Hexapod robots are well suited for disaster rescuing tasks due to their stability and load capability. However, most current hexapod robots still rely on static gaits that largely limit their locomotion speed. This paper introduces a hierarchical control strategy to realize a dynamic alternating tripod trotting gait for a hexapod robot based on multi-modal impedance control. At the low level, a position-based impedance controller is developed to realize an adjustable compliant behavior for each leg. At the high level, a new gait controller is developed to generate a stable alternating tripod trotting gait, in which a gait state machine, a leg compliance modulation strategy, and a close-looped body attitude stabilizer are imposed. As a result, the alternating tripod trotting of the hexapod robot can be synchronized as the running of a bipedal robot with stable body attitude. Moreover, this control strategy was verified by experiments on a newly designed pony-sized disaster rescuing robot, HexbotIV, which successfully achieved a dynamic trotting gait with ability to resist the disturbances of mildly uneven terrains. Our control strategy as well as the experimental study can be a valuable reference for other hexapod robots and thus paves a way to the practical deployment of disaster rescuing robots.

A terrain description method for traversability analysis based on elevation grid map

Terrain traversability analysis is a challenging problem for mobile robots to adapt to complex environments, including the detection of cluttered obstacles, potholes, or even slopes. With the accurate distance information, using distance sensors such as three-dimensional light detection and ranging (LiDAR) for terrain description becomes a preferred choice. In this article, a terrain description method for traversability analysis based on elevation grid map is presented. After the elevation grid map is generated, the ground is segmented with the aid of a height difference kernel and the non-ground grids in the map are then clustered. The terrain description features, including height index, roughness, and slope angle, are calculated and estimated. The slope angle is estimated using random sample consensus (RANSAC) and least squares method, and specifically, the roughness is combined to eliminate false slopes. Experimental results verified the effectiveness of the proposed method.

Leg placement algorithm for foot impact force minimization

Walking is considered to be a rather complicated task for autonomous robots. Sustaining dynamic stability, adopting different gaits, and calculating correct foot placement are a necessity to overcome irregular terrain, various environments and completing a range of assignments. Besides that, certain assignments require that robots have to walk on fragile surfaces without damaging it. Furthermore, under some other circumstances, if walking is careless, robots could suffer damage caused by the impact of the terrain. Foot placement, leg motion speed must be controlled to avoid braking surface or even sensors on robot’s feet. In this article, a simple leg placement algorithm is proposed that controls hexapod robot’s leg speed. Thus, force dependence on leg motion speed and step height has been measured by using a piezoelectric sensor. Then, by using leg placement algorithm, we show that the reduction of the impact force between robot’s foot and surface is possible. Using this algorithm, robot feet’s impact force with the surface can be minimized to almost 0 N.

Efficient motion generation for a six-legged robot walking on irregular terrain via integrated foothold selection and optimization-based whole-body planning

In this paper, an efficient motion planning method is proposed for a six-legged robot walking on irregular terrain. The method provides the robot with fast-generated free-gait motions to traverse the terrain with medium irregularities. We first of all introduce our six-legged robot with legs in parallel mechanism. After that, we decompose the motion planning problem into two main steps: first is the foothold selection based on a local footstep cost map, in which both terrain features and the robot mobility are considered; second is a whole-body configuration planner which casts the problem into a general convex optimization problem. Such decomposition reduces the complexity of the motion planning problem. Along with the two-step planner, discussions are also given in terms of the robot-environmental relationship, convexity of constraints and robot rotation integration. Both simulations and experiments are carried out on typical irregular terrains. The results demonstrate effectiveness of the planning method.

A Novel Identification Methodology for the Coordinate Relationship between a 3D Vision System and a Legged Robot

Coordinate identification between vision systems and robots is quite a challenging issue in the field of intelligent robotic applications, involving steps such as perceiving the immediate environment, building the terrain map and planning the locomotion automatically. It is now well established that current identification methods have non-negligible limitations such as a difficult feature matching, the requirement of external tools and the intervention of multiple people. In this paper, we propose a novel methodology to identify the geometric parameters of 3D vision systems mounted on robots without involving other people or additional equipment. In particular, our method focuses on legged robots which have complex body structures and excellent locomotion ability compared to their wheeled/tracked counterparts. The parameters can be identified only by moving robots on a relatively flat ground. Concretely, an estimation approach is provided to calculate the ground plane. In addition, the relationship between the robot and the ground is modeled. The parameters are obtained by formulating the identification problem as an optimization problem. The methodology is integrated on a legged robot called "Octopus", which can traverse through rough terrains with high stability after obtaining the identification parameters of its mounted vision system using the proposed method. Diverse experiments in different environments demonstrate our novel method is accurate and robust.