Emergence of robust self-organized undulatory swimming based on local hydrodynamic force sensing

A bioinspired multimotion modality underwater microrobot

Exploring narrow underwater environments presents notable challenges due to the need for flexible movement and robust transition between different motion modalities. Inspired by the pteropod, a small aquatic organism known for its ability to change direction by adjusting the attack angle of its wings, we developed a biomimetic robotic platform called RoboPteropod. This micro-underwater robot, equipped with flexible flapping wings that mimic the propulsive mechanisms of the pteropod, reaches a float velocity of 1.88 body height per second and a forward velocity of 1.2 body length per second, while maintaining a power consumption of merely 580 milliwatts. The ability to dynamically adjust the attack angle of the wings enables smooth transition among various modes (float, move straight, yaw, and pitch) of underwater locomotion, allowing for agile, three-dimensional maneuvering in complex aquatic environments. RoboPteropod offers meaningful potential for detailed exploration of confined and otherwise inaccessible underwater spaces.

Soft Materials and Devices Enabling Sensorimotor Functions in Soft Robots

Sensorimotor functions, the seamless integration of sensing, decision-making, and actuation, are fundamental for robots to interact with their environments. Inspired by biological systems, the incorporation of soft materials and devices into robotics holds significant promise for enhancing these functions. However, current robotics systems often lack the autonomy and intelligence observed in nature due to limited sensorimotor integration, particularly in flexible sensing and actuation. As the field progresses toward soft, flexible, and stretchable materials, developing such materials and devices becomes increasingly critical for advanced robotics. Despite rapid advancements individually in soft materials and flexible devices, their combined applications to enable sensorimotor capabilities in robots are emerging. This review addresses this emerging field by providing a comprehensive overview of soft materials and devices that enable sensorimotor functions in robots. We delve into the latest development in soft sensing technologies, actuation mechanism, structural designs, and fabrication techniques. Additionally, we explore strategies for sensorimotor control, the integration of artificial intelligence (AI), and practical application across various domains such as healthcare, augmented and virtual reality, and exploration. By drawing parallels with biological systems, this review aims to guide future research and development in soft robots, ultimately enhancing the autonomy and adaptability of robots in unstructured environments.

Using deep reinforcement learning to investigate stretch feedback during swimming of the lamprey

Animals have to navigate complex environments and perform intricate swimming maneuvers in the real world. To conquer these challenges, animals evolved a variety of motion control strategies. While it is known that many factors contribute to motion control, we specifically focus on the role of stretch sensory feedback. We investigate how stretch feedback potentially serves as a way to coordinate locomotion, and how different stretch feedback topologies, such as networks spanning varying ranges along the spinal cord, impact the locomotion. We conduct our studies on a simulated robot model of the lamprey consisting of an articulated spine with eleven segments connected by actuated joints. The stretch feedback is modeled with neural networks trained with deep reinforcement learning. We find that the topology of the feedback influences the energy efficiency and smoothness of the swimming, along with various other metrics characterizing the locomotion, such as frequency, amplitude and stride length. By analyzing the learned feedback networks, we highlight the importances of very local, caudally-directed, as well as stretch derivative information. Our results deliver valuable insights into the potential mechanisms and benefits of stretch feedback control and inspire novel decentralized control strategies for complex robots.

Adaptive locomotion of active solids

Active systems composed of energy-generating microscopic constituents are a promising platform to create autonomous functional materials1-16 that can, for example, locomote through complex and unpredictable environments. Yet coaxing these energy sources into useful mechanical work has proved challenging. Here we engineer active solids based on centimetre-scale building blocks that perform adaptive locomotion. These prototypes exhibit a non-variational form of elasticity characterized by odd moduli8,12,17, whose magnitude we predict from microscopics using coarse-grained theories and which we validate experimentally. When interacting with an external environment, these active solids spontaneously undergo limit cycles of shape changes, which naturally lead to locomotion such as rolling and crawling. The robustness of the locomotion is rooted in an emergent feedback loop between the active solid and the environment, which is mediated by elastic deformations and stresses. As a result, our active solids are able to accelerate, adjust their gaits and locomote through a variety of terrains with a similar performance to more complex control strategies implemented by neural networks. Our work establishes active solids as a bridge between materials and robots and suggests decentralized strategies to control the nonlinear dynamics of biological systems8,18-22, soft materials5,6,9,11,12,23-25 and driven nanomechanical devices7,26-30.

FARMS: Framework for Animal and Robot Modeling and Simulation

The study of animal locomotion and neuromechanical control offers valuable insights for advancing research in neuroscience, biomechanics, and robotics. We have developed FARMS (Framework for Animal and Robot Modeling and Simulation), an open-source, interdisciplinary framework, designed to facilitate access to modeling, simulation, and analysis of animal locomotion and bio-inspired robotic systems. By providing an accessible and user-friendly platform, FARMS aims to lower the barriers for researchers to explore the complex interactions between the nervous system, musculoskeletal structures, and their environment. Integrating the MuJoCo physics engine in a modular manner, FARMS enables realistic simulations and fosters collaboration among neuroscientists, biologists, and roboticists. FARMS has already been extensively used to study locomotion in animals such as mice, drosophila, fish, salamanders, and centipedes, serving as a platform to investigate the role of central pattern generators and sensory feedback. This article provides an overview of the FARMS framework, discusses its interdisciplinary approach, showcases its versatility through specific case studies, and highlights its effectiveness in advancing our understanding of locomotion. Overall, the goal of FARMS is to contribute to a deeper understanding of animal locomotion, the development of innovative bio-inspired robotic systems, and promote accessibility in neuromechanical research.

A neuromechanics solution for adjustable robot compliance and accuracy

Robots have to adjust their motor behavior to changing environments and variable task requirements to successfully operate in the real world and physically interact with humans. Thus, robotics strives to enable a broad spectrum of adjustable motor behavior, aiming to mimic the human ability to function in unstructured scenarios. In humans, motor behavior arises from the integrative action of the central nervous system and body biomechanics; motion must be understood from a neuromechanics perspective. Nervous regions such as the cerebellum facilitate learning, adaptation, and coordination of our motor responses, ultimately driven by muscle activation. Muscles, in turn, self-stabilize motion through mechanical viscoelasticity. In addition, the agonist-antagonist arrangement of muscles surrounding joints enables cocontraction, which can be regulated to enhance motion accuracy and adapt joint stiffness, thereby providing impedance modulation and broadening the motor repertoire. Here, we propose a control solution that harnesses neuromechanics to enable adjustable robot motor behavior. Our solution integrates a muscle model that replicates mechanical viscoelasticity and cocontraction together with a cerebellar network providing motor adaptation. The resulting cerebello-muscular controller drives the robot through torque commands in a feedback control loop. Changes in cocontraction modify the muscle dynamics, and the cerebellum provides motor adaptation without relying on prior analytical solutions, driving the robot in different motor tasks, including payload perturbations and operation across unknown terrains. Experimental results show that cocontraction modulates robot stiffness, performance accuracy, and robustness against external perturbations. Through cocontraction modulation, our cerebello-muscular torque controller enables a broad spectrum of robot motor behavior.

Robust undulatory locomotion through neuromechanical adjustments in a dissipative medium

Dissipative environments are ubiquitous in nature, from microscopic swimmers in low-Reynolds-number fluids to macroscopic animals in frictional media. In this study, we consider a mathematical model of a slender elastic locomotor with an internal rhythmic neural pattern generator to examine various undulatory locomotion such as Caenorhabditis elegans swimming and crawling behaviours. By using local mechanical load as mechanosensory feedback, we have found that undulatory locomotion robustly emerges in different rheological media. This progressive behaviour is then characterized as a global attractor through dynamical systems analysis with a Poincaré section. Furthermore, by controlling the mechanosensation, we were able to design the dynamical systems to manoeuvre with progressive, reverse and turning motions as well as apparently random, complex behaviours, reminiscent of those experimentally observed in C. elegans. The mechanisms found in this study, together with our dynamical systems methodology, are useful for deciphering complex animal adaptive behaviours and designing robots capable of locomotion in a wide range of dissipative environments.

Form and function of anguilliform swimming

Anguilliform swimmers are long and narrow animals that propel themselves by undulating their bodies. Observations in nature and recent investigations suggest that anguilliform swimming is highly efficient. However, understanding the underlying reasons for the efficiency of this type of locomotion requires interdisciplinary studies spanning from biology to hydrodynamics. Regrettably, these different fields are rarely discussed together, which hinders our ability to understand the repeated evolution of this swimming mode in vertebrates. This review compiles the current knowledge of the anatomical features that drive anguilliform swimming, compares the resulting kinematics across a wide range of anguilliform swimmers, and describes the resulting hydrodynamic interactions using data from both in vivo experiments and computational studies.

NeuroMechFly v2: simulating embodied sensorimotor control in adult Drosophila

Discovering principles underlying the control of animal behavior requires a tight dialogue between experiments and neuromechanical models. Such models have primarily been used to investigate motor control with less emphasis on how the brain and motor systems work together during hierarchical sensorimotor control. NeuroMechFly v2 expands Drosophila neuromechanical modeling by enabling vision, olfaction, ascending motor feedback and complex terrains that can be navigated using leg adhesion. We illustrate its capabilities by constructing biologically inspired controllers that use ascending feedback to perform path integration and head stabilization. After adding vision and olfaction, we train a controller using reinforcement learning to perform a multimodal navigation task. Finally, we illustrate more bio-realistic modeling involving complex odor plume navigation, and fly-fly following using a connectome-constrained visual network. NeuroMechFly can be used to accelerate the discovery of explanatory models of the nervous system and to develop machine learning-based controllers for autonomous artificial agents and robots.

Symmetry breaking and gait transition induced by hydrodynamic sensory feedback in an anguilliform swimming robot

The goal of this article is to identify and understand the fundamental role of spatial symmetries in the emergence of undulatory swimming using an anguilliform robot. Here, the local torque at the joints of the robot is controlled by a chain of oscillators forming a central pattern generator (CPG). By implementing a symmetric CPG with respect to the transverse plane, motor activation waves are inhibited, preventing the emergence of undulatory swimming and resulting in an oscillatory gait. We show experimentally that the swimmer can recover from the traveling wave inhibition by using distributed fluid force feedback to modulate the phase dynamics of each oscillator. This transition from oscillatory to undulating swimming is characterized by a symmetry breaking in the CPG and the body dynamics. By studying the stability of the oscillator chain, we show that the sensory feedback produces a frequency detuning gradient along the CPG chain while preserving its stability. To explain the origin of the instability, we introduce a toy model where the couplings between the dynamics of the oscillators and the body deformation reinforce the symmetry breaking.

Hydrodynamic Simulation and Experiment of a Self-Adaptive Amphibious Robot Driven by Tracks and Bionic Fins

Amphibious robots have broad prospects in the fields of industry, defense, and transportation. To improve the propulsion performance and reduce operation complexity, a novel bionic amphibious robot, namely AmphiFinbot-II, is presented in this paper. The swimming and walking components adopt a compound drive mechanism, enabling simultaneous control for the rotation of the track and the wave-like motion of the undulating fin. The robot employs different propulsion methods but utilizes the same operation strategy, eliminating the need for mode switching. The structure and the locomotion principle are introduced. The performance of the robot in different motion patterns was analyzed via computational fluid dynamics simulation. The simulation results verified the feasibility of the wave-like swimming mechanism. Physical experiments were conducted for both land and underwater motion, and the results were consistent with the simulation regulation. Both the underwater linear and angular velocity were proportional to the undulating frequency. The robot's maximum linear speed and steering speed on land were 2.26 m/s (2.79 BL/s) and 442°/s, respectively, while the maximum speeds underwater were 0.54 m/s (0.67 BL/s) and 84°/s, respectively. The research findings indicate that the robot possesses outstanding amphibious motion capabilities and a simplistic yet unified control approach, thereby validating the feasibility of the robot's design scheme, and offering a novel concept for the development of high-performance and self-contained amphibious robots.

Research on control strategy of pneumatic soft bionic robot based on improved CPG

To achieve the accuracy and anti-interference of the motion control of the soft robot more effectively, the motion control strategy of the pneumatic soft bionic robot based on the improved Central Pattern Generator (CPG) is proposed. According to the structure and motion characteristics of the robot, a two-layer neural network topology model for the robot is constructed by coupling 22 Hopfield neuron nonlinear oscillators. Then, based on the Adaptive Neuro-Fuzzy Inference System (ANFIS), the membership functions are offline learned and trained to construct the CPG-ANFIS-PID motion control strategy for the robot. Through simulation research on the impact of CPG-ANFIS-PID input parameters on the swimming performance of the robot, it is verified that the control strategy can quickly respond to input parameter changes between different swimming modes, and stably output smooth and continuous dynamic position signals, which has certain advantages. Then, the motion performance of the robot prototype is analyzed experimentally and compared with the simulation results. The results show that the CPG-ANFIS-PID motion control strategy can output coupled waveform signals stably, and control the executing mechanisms of the pneumatic soft bionic robot to achieve biological rhythms motion propulsion waveforms, confirming that the control strategy has accuracy and anti-interference characteristics, and enable the robot have certain maneuverability, flexibility, and environmental adaptability. The significance of this work lies in establishing a CPG-ANFIS-PID control strategy applicable to pneumatic soft bionic robot and proposing a rhythmic motion control method applicable to pneumatic soft bionic robot.

Asymmetric fin shape changes swimming dynamics of ancient marine reptiles' soft robophysical models

Animals have evolved highly effective locomotion capabilities in terrestrial, aerial, and aquatic environments. Over life's history, mass extinctions have wiped out unique animal species with specialized adaptations, leaving paleontologists to reconstruct their locomotion through fossil analysis. Despite advancements, little is known about how extinct megafauna, such as the Ichthyosauria one of the most successful lineages of marine reptiles, utilized their varied morphologies for swimming. Traditional robotics struggle to mimic extinct locomotion effectively, but the emerging soft robotics field offers a promising alternative to overcome this challenge. This paper aims to bridge this gap by studyingMixosauruslocomotion with soft robotics, combining material modeling and biomechanics in physical experimental validation. Combining a soft body with soft pneumatic actuators, the soft robotic platform described in this study investigates the correlation between asymmetrical fins and buoyancy by recreating the pitch torque generated by extinct swimming animals. We performed a comparative analysis of thrust and torque generated byCarthorhyncus,Utatsusaurus,Mixosaurus,Guizhouichthyosaurus, andOphthalmosaurustail fins in a flow tank. Experimental results suggest that the pitch torque on the torso generated by hypocercal fin shapes such as found in model systems ofGuizhouichthyosaurus,MixosaurusandUtatsusaurusproduce distinct ventral body pitch effects able to mitigate the animal's non-neutral buoyancy. This body pitch control effect is particularly pronounced inGuizhouichthyosaurus, which results suggest would have been able to generate high ventral pitch torque on the torso to compensate for its positive buoyancy. By contrast, homocercal fin shapes may not have been conducive for such buoyancy compensation, leaving torso pitch control to pectoral fins, for example. Across the range of the actuation frequencies of the caudal fins tested, resulted in oscillatory modes arising, which in turn can affect the for-aft thrust generated.

Viability leads to the emergence of gait transitions in learning agile quadrupedal locomotion on challenging terrains

Quadruped animals are capable of seamless transitions between different gaits. While energy efficiency appears to be one of the reasons for changing gaits, other determinant factors likely play a role too, including terrain properties. In this article, we propose that viability, i.e., the avoidance of falls, represents an important criterion for gait transitions. We investigate the emergence of gait transitions through the interaction between supraspinal drive (brain), the central pattern generator in the spinal cord, the body, and exteroceptive sensing by leveraging deep reinforcement learning and robotics tools. Consistent with quadruped animal data, we show that the walk-trot gait transition for quadruped robots on flat terrain improves both viability and energy efficiency. Furthermore, we investigate the effects of discrete terrain (i.e., crossing successive gaps) on imposing gait transitions, and find the emergence of trot-pronk transitions to avoid non-viable states. Viability is the only improved factor after gait transitions on both flat and discrete gap terrains, suggesting that viability could be a primary and universal objective of gait transitions, while other criteria are secondary objectives and/or a consequence of viability. Moreover, our experiments demonstrate state-of-the-art quadruped robot agility in challenging scenarios.

Bioinspiration and biomimetics in marine robotics: a review on current applications and future trends

Over the past few years, the research community has witnessed a burgeoning interest in biomimetics, particularly within the marine sector. The study of biomimicry as a revolutionary remedy for numerous commercial and research-based marine businesses has been spurred by the difficulties presented by the harsh maritime environment. Biomimetic marine robots are at the forefront of this innovation by imitating various structures and behaviors of marine life and utilizing the evolutionary advantages and adaptations these marine organisms have developed over millennia to thrive in harsh conditions. This thorough examination explores current developments and research efforts in biomimetic marine robots based on their propulsion mechanisms. By examining these biomimetic designs, the review aims to solve the mysteries buried in the natural world and provide vital information for marine improvements. In addition to illuminating the complexities of these bio-inspired mechanisms, the investigation helps to steer future research directions and possible obstacles, spurring additional advancements in the field of biomimetic marine robotics. Considering the revolutionary potential of using nature's inventiveness to navigate and thrive in one of the most challenging environments on Earth, the current review's conclusion urges a multidisciplinary approach by integrating robotics and biology. The field of biomimetic marine robotics not only represents a paradigm shift in our relationship with the oceans, but it also opens previously unimaginable possibilities for sustainable exploration and use of marine resources by understanding and imitating nature's solutions.

Bioinspired Design and Experimental Validation of an Aquatic Snake Robot

This article presents the design, simulation, and experimental validation of a novel modular aquatic snake robot capable of surface locomotion. The modular structure allows each unit to function independently, facilitating ease of maintenance and adaptability to diverse aquatic environments. Employing the material point method with the moving least squares (MPM-MLS) simulation technique, the robot's dynamic behavior was analyzed, yielding reliable results. The control algorithm, integral to the robot's autonomous navigation, was implemented to enable forward propulsion at high speed, steering, and obstacle detection and avoidance. Extensive testing of the aquatic snake robot was conducted, demonstrating its practical viability. The robot showcased promising swimming capabilities, achieving high speeds and maneuverability. Furthermore, the obstacle detection and avoidance mechanisms were proven effective, showing the robot's ability to navigate through dynamic environments. The presented aquatic snake robot represents an advancement in the field of underwater robotics, offering a modular and versatile solution for tasks ranging from environmental monitoring to search and rescue operations.

A self-organizing robotic aggregate using solid and liquid-like collective states

Designing robotic systems that can change their physical form factor as well as their compliance to adapt to environmental constraints remains a major conceptual and technical challenge. To address this, we introduce the Granulobot, a modular system that blurs the distinction between soft, modular, and swarm robotics. The system consists of gear-like units that each contain a single actuator such that units can self-assemble into larger, granular aggregates using magnetic coupling. These aggregates can reconfigure dynamically and also split into subsystems that might later recombine. Aggregates can self-organize into collective states with solid- and liquid-like properties, thus displaying widely differing compliance. These states can be perturbed locally via actuators or externally via mechanical feedback from the environment to produce adaptive shape-shifting in a decentralized manner. This, in turn, can generate locomotion strategies adapted to different conditions. Aggregates can move over obstacles without using external sensors or coordinates to maintain a steady gait over different surfaces without electronic communication among units. The modular design highlights a physical, morphological form of control that advances the development of resilient robotic systems with the ability to morph and adapt to different functions and conditions.

Design and Reality-Based Modeling Optimization of a Flexible Passive Joint Paddle for Swimming Robots

Rowing motion with paired propellers is an essential actuation mechanism for swimming robots. Previous work in this field has typically employed flexible propellers to generate a net thrust or torque by using changes in the compliance values of flexible structures under the influence of a fluid. The low stiffness values of the flexible structures restrict the upper limit of the oscillation frequency and amplitude, resulting in slow swimming speeds. Furthermore, complex coupling between the fluid and the propeller reduce the accuracy of flexible propeller simulations. A design of a flexible passive joint paddle was proposed in this study, and a dynamics model and simulation of the paddle were experimentally verified. In order to optimize the straight swimming speed, a data-driven model was proposed to improve the simulation accuracy. The effects of the joint number and controller parameters on the robot's straight swimming speed were comprehensively investigated. The multi-joint paddle exhibited significantly improved thrust over the single-joint paddle in a symmetric driving mode. The data-driven model reduced the total error of the simulated data of the propulsive force in the range of control parameters to 0.51%. Swimming speed increased by 3.3 times compared to baseline. These findings demonstrate the utility of the proposed dynamics and data-driven models in the multi-objective design of swimming robots.

Mechanical intelligence simplifies control in terrestrial limbless locomotion

Limbless locomotors, from microscopic worms to macroscopic snakes, traverse complex, heterogeneous natural environments typically using undulatory body wave propagation. Theoretical and robophysical models typically emphasize body kinematics and active neural/electronic control. However, we contend that because such approaches often neglect the role of passive, mechanically controlled processes (those involving "mechanical intelligence"), they fail to reproduce the performance of even the simplest organisms. To uncover principles of how mechanical intelligence aids limbless locomotion in heterogeneous terradynamic regimes, here we conduct a comparative study of locomotion in a model of heterogeneous terrain (lattices of rigid posts). We used a model biological system, the highly studied nematode worm Caenorhabditis elegans, and a robophysical device whose bilateral actuator morphology models that of limbless organisms across scales. The robot's kinematics quantitatively reproduced the performance of the nematodes with purely open-loop control; mechanical intelligence simplified control of obstacle navigation and exploitation by reducing the need for active sensing and feedback. An active behavior observed in C. elegans, undulatory wave reversal upon head collisions, robustified locomotion via exploitation of the systems' mechanical intelligence. Our study provides insights into how neurally simple limbless organisms like nematodes can leverage mechanical intelligence via appropriately tuned bilateral actuation to locomote in complex environments. These principles likely apply to neurally more sophisticated organisms and also provide a design and control paradigm for limbless robots for applications like search and rescue and planetary exploration.

Animal robots in the African wilderness: Lessons learned and outlook for field robotics

In early 2016, we had the opportunity to test a pair of sprawling posture robots, one designed to mimic a crocodile and another designed to mimic a monitor lizard, along the banks of the Nile River in Uganda, Africa. These robots were developed uniquely for a documentary by the BBC called Spy in the Wild and fell at the intersection of our interests in developing robots to study animals and robots for disaster response and other missions in challenging environments. The documentary required that these robots not only walk and swim in the same harsh, natural environments as the animals that they were modeled on and film up close but also move and even look exactly like the real animals from an aesthetic perspective. This pushed us to take a fundamentally different approach to the design and building of biorobots compared with our typical laboratory-residing robots, in addition to collaborating with sculpting artists to enhance our robots' aesthetics. The robots needed to be designed on the basis of a systematic study of data on the model specimens, be fabricated rapidly, and be reliable and robust enough to handle what the wild would throw at them. Here, we share the research efforts of this collaboration, the design specifications of the robots' hardware and software, the lessons learned from testing these robots in the field first hand, and how the eye-opening experience shaped our subsequent work on disaster response robotics and biorobotics for challenging amphibious scenarios.

Control of movement of underwater swimmers: Animals, simulated animates and swimming robots

The control of movement in living organisms represents a fundamental task that the brain has evolved to solve. One crucial aspect is how the nervous system organizes the transformation of sensory information into motor commands. These commands lead to muscle activation and subsequent animal movement, which can exhibit complex patterns. One example of such movement is locomotion, which involves the translation of the entire body through space. Central Pattern Generators (CPGs) are neuronal circuits that provide control signals for these movements. Compared to the intricate circuits found in the brain, CPGs can be simplified into networks of neurons that generate rhythmic activation, coordinating muscle movements. Since the 1990s, researchers have developed numerous models of locomotive circuits to simulate different types of animal movement, including walking, flying, and swimming. Initially, the primary goal of these studies was to construct biomimetic robots. However, it became apparent that simplified CPGs alone were not sufficient to replicate the diverse range of adaptive locomotive movements observed in living organisms. Factors such as sensory modulation, higher-level control, and cognitive components related to learning and memory needed to be considered. This necessitated the use of more complex, high-dimensional circuits, as well as novel materials and hardware, in both modeling and robotics. With advancements in high-power computing, artificial intelligence, big data processing, smart materials, and electronics, the possibility of designing a new generation of true bio-mimetic robots has emerged. These robots have the capability to imitate not only simple locomotion but also exhibit adaptive motor behavior and decision-making. This motivation serves as the foundation for the current review, which aims to analyze existing concepts and models of movement control systems. As an illustrative example, we focus on underwater movement and explore the fundamental biological concepts, as well as the mathematical and physical models that underlie locomotion and its various modulations.

From real-time adaptation to social learning in robot ecosystems

While evolutionary robotics can create novel morphologies and controllers that are well-adapted to their environments, learning is still the most efficient way to adapt to changes that occur on shorter time scales. Learning proposals for evolving robots to date have focused on new individuals either learning a controller from scratch, or building on the experience of direct ancestors and/or robots with similar configurations. Here we propose and demonstrate a novel means for social learning of gait patterns, based on sensorimotor synchronization. Using movement patterns of other robots as input can drive nonlinear decentralized controllers such as CPGs into new limit cycles, hence encouraging diversity of movement patterns. Stable autonomous controllers can then be locked in, which we demonstrate using a quasi-Hebbian feedback scheme. We propose that in an ecosystem of robots evolving in a heterogeneous environment, such a scheme may allow for the emergence of generalist task-solvers from a population of specialists.

Coordinating upper limbs for octave playing on the piano via neuro-musculoskeletal modeling

Understanding the coordination of multiple biomechanical degrees of freedom in biological organisms is crucial for unraveling the neurophysiological control of sophisticated motor tasks. This study focuses on the cooperative behavior of upper-limb motor movements in the context of octave playing on the piano. While the vertebrate locomotor system has been extensively investigated, the coherence and precision timing of rhythmic movements in the upper-limb system remain incompletely understood. Inspired by the spinal cord neuronal circuits (central pattern generator, CPG), a computational neuro-musculoskeletal model is proposed to explore the coordination of upper-limb motor movements during octave playing across varying tempos and volumes. The proposed model incorporates a CPG-based nervous system, a physiologically-informed mechanical body, and a piano environment to mimic human joint coordination and expressiveness. The model integrates neural rhythm generation, spinal reflex circuits, and biomechanical muscle dynamics while considering piano playing quality and energy expenditure. Based on real-world human subject experiments, the model has been refined to study tempo transitions and volume control during piano playing. This computational approach offers insights into the neurophysiological basis of upper-limb motor coordination in piano playing and its relation to expressive features.

The role of hydrodynamics in collective motions of fish schools and bioinspired underwater robots

Collective behaviour defines the lives of many animal species on the Earth. Underwater swarms span several orders of magnitude in size, from coral larvae and krill to tunas and dolphins. Agent-based algorithms have modelled collective movements of animal groups by use of social forces, which approximate the behaviour of individual animals. But details of how swarming individuals interact with the fluid environment are often under-examined. How do fluid forces shape aquatic swarms? How do fish use their flow-sensing capabilities to coordinate with their schooling mates? We propose viewing underwater collective behaviour from the framework of fluid stigmergy, which considers both physical interactions and information transfer in fluid environments. Understanding the role of hydrodynamics in aquatic collectives requires multi-disciplinary efforts across fluid mechanics, biology and biomimetic robotics. To facilitate future collaborations, we synthesize key studies in these fields.

Scaling the tail beat frequency and swimming speed in underwater undulatory swimming

Undulatory swimming is the predominant form of locomotion in aquatic vertebrates. A myriad of animals of different species and sizes oscillate their bodies to propel themselves in aquatic environments with swimming speed scaling as the product of the animal length by the oscillation frequency. Although frequency tuning is the primary means by which a swimmer selects its speed, there is no consensus on the mechanisms involved. In this article, we propose scaling laws for undulatory swimmers that relate oscillation frequency to length by taking into account both the biological characteristics of the muscles and the interaction of the moving swimmer with its environment. Results are supported by an extensive literature review including approximately 1200 individuals of different species, sizes and swimming environments. We highlight a crossover in size around 0.5-1 m. Below this value, the frequency can be tuned between 2-20 Hz due to biological constraints and the interplay between slow and fast muscles. Above this value, the fluid-swimmer interaction must be taken into account and the frequency is inversely proportional to the length of the animal. This approach predicts a maximum swimming speed around 5-10 m.s-1 for large swimmers, consistent with the threshold to prevent bubble cavitation.

Mechanosensory Feedback in Lamprey Swimming Models and Applications in the Field of Spinal Cord Regeneration

The central pattern generator (CPG) in anguilliform swimming has served as a model for examining the neural basis of locomotion. This system has been particularly valuable for the development of mathematical models. As our biological understanding of the neural basis of locomotion has expanded, so too have these models. Recently, there have been significant advancements in our understanding of the critical role that mechanosensory feedback plays in robust locomotion. This work has led to a push in the field of mathematical modeling to incorporate mechanosensory feedback into CPG models. In this perspective piece, we review advances in the development of these models and discuss how newer complex models can support biological investigation. We highlight lamprey spinal cord regeneration as an area that can both inform these models and benefit from them.

Integration of feedforward and feedback control in the neuromechanics of vertebrate locomotion: a review of experimental, simulation and robotic studies

Animal locomotion is the result of complex and multi-layered interactions between the nervous system, the musculo-skeletal system and the environment. Decoding the underlying mechanisms requires an integrative approach. Comparative experimental biology has allowed researchers to study the underlying components and some of their interactions across diverse animals. These studies have shown that locomotor neural circuits are distributed in the spinal cord, the midbrain and higher brain regions in vertebrates. The spinal cord plays a key role in locomotor control because it contains central pattern generators (CPGs) - systems of coupled neuronal oscillators that provide coordinated rhythmic control of muscle activation that can be viewed as feedforward controllers - and multiple reflex loops that provide feedback mechanisms. These circuits are activated and modulated by descending pathways from the brain. The relative contributions of CPGs, feedback loops and descending modulation, and how these vary between species and locomotor conditions, remain poorly understood. Robots and neuromechanical simulations can complement experimental approaches by testing specific hypotheses and performing what-if scenarios. This Review will give an overview of key knowledge gained from comparative vertebrate experiments, and insights obtained from neuromechanical simulations and robotic approaches. We suggest that the roles of CPGs, feedback loops and descending modulation vary among animals depending on body size, intrinsic mechanical stability, time required to reach locomotor maturity and speed effects. We also hypothesize that distal joints rely more on feedback control compared with proximal joints. Finally, we highlight important opportunities to address fundamental biological questions through continued collaboration between experimentalists and engineers.

Locomotor pattern generation and descending control: a historical perspective

The ability to generate and control locomotor movements depends on complex interactions between many areas of the nervous system, the musculoskeletal system, and the environment. How the nervous system manages to accomplish this task has been the subject of investigation for more than a century. In vertebrates, locomotion is generated by neural networks located in the spinal cord referred to as central pattern generators. Descending inputs from the brain stem initiate, maintain, and stop locomotion as well as control speed and direction. Sensory inputs adapt locomotor programs to the environmental conditions. This review presents a comparative and historical overview of some of the neural mechanisms underlying the control of locomotion in vertebrates. We have put an emphasis on spinal mechanisms and descending control.

Contact feedback helps snake robots propel against uneven terrain using vertical bending

Snakes can bend their elongate bodies in various forms to traverse various environments. We understand well how snakes use lateral body bending to push against asperities on flat ground for propulsion, and snake robots can do so effectively. However, snakes can also use vertical bending to push against uneven terrain of large height variation for propulsion, and they can adjust this bending to adapt to novel terrain presumably using mechano-sensing feedback control. Although some snake robots can traverse uneven terrain, few have used vertical bending for propulsion, and how to control this process in novel environments is poorly understood. Here we systematically studied a snake robot with force sensors pushing against large bumps using vertical bending to understand the role of sensory feedback control. We compared a feedforward controller and four feedback controllers that use different sensory information and generate distinct bending patterns and body-terrain interaction. We challenged the robot with increasing backward load and novel terrain geometry that break its contact with the terrain. We further varied how much the feedback control modulated body bending to conform to or push against the terrain to test their effects. Feedforward propagation of vertical bending generated large propulsion when the bending shape matched terrain geometry. However, when perturbations caused loss of contact, the robot easily lost propulsion or had motor overload. Contact feedback control resolved these issues by helping the robot regain contact. Yet excessive conformation interrupted shape propagation and excessive pushing stalled motors frequently. Unlike that using lateral bending, for propulsion generation using vertical bending, body weight that can help maintain contact with the environment but may also overload motors. Our results will help snake robots better traverse uneven terrain with large height variation and can inform how snakes use sensory feedback to control vertical body bending for propulsion.

Central pattern generators evolved for real-time adaptation to rhythmic stimuli

For a robot to be both autonomous and collaborative requires the ability to adapt its movement to a variety of external stimuli, whether these come from humans or other robots. Typically, legged robots have oscillation periods explicitly defined as a control parameter, limiting the adaptability of walking gaits. Here we demonstrate a virtual quadruped robot employing a bio-inspired central pattern generator (CPG) that can spontaneously synchronize its movement to a range of rhythmic stimuli. Multi-objective evolutionary algorithms were used to optimize the variation of movement speed and direction as a function of the brain stem drive and the centre of mass control respectively. This was followed by optimization of an additional layer of neurons that filters fluctuating inputs. As a result, a range of CPGs were able to adjust their gait pattern and/or frequency to match the input period. We show how this can be used to facilitate coordinated movement despite differences in morphology, as well as to learn new movement patterns.

The neuromechanics of animal locomotion: From biology to robotics and back

Robotics and neuroscience are sister disciplines that both aim to understand how agile, efficient, and robust locomotion can be achieved in autonomous agents. Robotics has already benefitted from neuromechanical principles discovered by investigating animals. These include the use of high-level commands to control low-level central pattern generator-like controllers, which, in turn, are informed by sensory feedback. Reciprocally, neuroscience has benefited from tools and intuitions in robotics to reveal how embodiment, physical interactions with the environment, and sensory feedback help sculpt animal behavior. We illustrate and discuss exemplar studies of this dialog between robotics and neuroscience. We also reveal how the increasing biorealism of simulations and robots is driving these two disciplines together, forging an integrative science of autonomous behavioral control with many exciting future opportunities.

Parameter search of a CPG network using a genetic algorithm for a snake robot with tactile sensors moving on a soft floor

When a snake robot explores a collapsed house as a rescue robot, it needs to move through various obstacles, some of which may be made of soft materials, such as mattresses. In this study, we call mattress-like environment as a soft floor, which deforms when some force is added to it. We focused on the central pattern generator (CPG) network as a control for the snake robot to propel itself on the soft floor and constructed a CPG network that feeds back contact information between the robot and the floor. A genetic algorithm was used to determine the parameters of the CPG network suitable for the soft floor. To verify the obtained parameters, comparative simulations were conducted using the parameters obtained for the soft and hard floor, and the parameters were confirmed to be appropriate for each environment. By observing the difference in snake robot’s propulsion depending on the presence or absence of the tactile sensor feedback signal, we confirmed the effectiveness of the tactile sensor considered in the parameter search.

Deep-Learning-Assisted Underwater 3D Tactile Tensegrity

The growth of underwater robotic applications in ocean exploration and research has created an urgent need for effective tactile sensing. Here, we propose an underwater 3-dimensional tactile tensegrity (U3DTT) based on soft self-powered triboelectric nanogenerators and deep-learning-assisted data analytics. This device can measure and distinguish the magnitude, location, and orientation of perturbations in real time from both flow field and interaction with obstacles and provide collision protection for underwater vehicles operation. It is enabled by the structure that mimics terrestrial animals' musculoskeletal systems composed of both stiff bones and stretchable muscles. Moreover, when successfully integrated with underwater vehicles, the U3DTT shows advantages of multiple degrees of freedom in its shape modes, an ultrahigh sensitivity, and fast response times with a low cost and conformability. The real-time 3-dimensional pose of the U3DTT has been predicted with an average root-mean-square error of 0.76 in a water pool, indicating that this developed U3DTT is a promising technology in vehicles with tactile feedback.

In-line swimming dynamics revealed by fish interacting with a robotic mechanism

Schooling in fish is linked to a number of factors such as increased foraging success, predator avoidance, and social interactions. In addition, a prevailing hypothesis is that swimming in groups provides energetic benefits through hydrodynamic interactions. Thrust wakes are frequently occurring flow structures in fish schools as they are shed behind swimming fish. Despite increased flow speeds in these wakes, recent modeling work has suggested that swimming directly in-line behind an individual may lead to increased efficiency. However, only limited data are available on live fish interacting with thrust wakes. Here we designed a controlled experiment in which brook trout, Salvelinus fontinalis, interact with thrust wakes generated by a robotic mechanism that produces a fish-like wake. We show that trout swim in thrust wakes, reduce their tail-beat frequencies, and synchronize with the robotic flapping mechanism. Our flow and pressure field analysis revealed that the trout are interacting with oncoming vortices and that they exhibit reduced pressure drag at the head compared to swimming in isolation. Together, these experiments suggest that trout swim energetically more efficiently in thrust wakes and support the hypothesis that swimming in the wake of one another is an advantageous strategy to save energy in a school.

Touchless interactive teaching of soft robots through flexible bimodal sensory interfaces

In this paper, we propose a multimodal flexible sensory interface for interactively teaching soft robots to perform skilled locomotion using bare human hands. First, we develop a flexible bimodal smart skin (FBSS) based on triboelectric nanogenerator and liquid metal sensing that can perform simultaneous tactile and touchless sensing and distinguish these two modes in real time. With the FBSS, soft robots can react on their own to tactile and touchless stimuli. We then propose a distance control method that enabled humans to teach soft robots movements via bare hand-eye coordination. The results showed that participants can effectively teach a self-reacting soft continuum manipulator complex motions in three-dimensional space through a "shifting sensors and teaching" method within just a few minutes. The soft manipulator can repeat the human-taught motions and replay them at different speeds. Finally, we demonstrate that humans can easily teach the soft manipulator to complete specific tasks such as completing a pen-and-paper maze, taking a throat swab, and crossing a barrier to grasp an object. We envision that this user-friendly, non-programmable teaching method based on flexible multimodal sensory interfaces could broadly expand the domains in which humans interact with and utilize soft robots.

Learning plastic matching of robot dynamics in closed-loop central pattern generators

Animals achieve agile locomotion performance with reduced control effort and energy efficiency by leveraging compliance in their muscles and tendons. However, it is not known how biological locomotion controllers learn to leverage the intelligence embodied in their leg mechanics. Here we present a framework to match control patterns and mechanics based on the concept of short-term elasticity and long-term plasticity. Inspired by animals, we design a robot, Morti, with passive elastic legs. The quadruped robot Morti is controlled by a bioinspired closed-loop central pattern generator that is designed to elastically mitigate short-term perturbations using sparse contact feedback. By minimizing the amount of corrective feedback on the long term, Morti learns to match the controller to its mechanics and learns to walk within 1 h. By leveraging the advantages of its mechanics, Morti improves its energy efficiency by 42% without explicit minimization in the cost function.

Fish-inspired segment models for undulatory steady swimming

Many aquatic animals swim by undulatory body movements and understanding the diversity of these movements could unlock the potential for designing better underwater robots. Here, we analyzed the steady swimming kinematics of a diverse group of fish species to investigate whether their undulatory movements can be represented using a series of interconnected multi-segment models, and if so, to identify the key factors driving the segment configuration of the models. Our results show that the steady swimming kinematics of fishes can be described successfully using parsimonious models, 83% of which had fewer than five segments. In these models, the anterior segments were significantly longer than the posterior segments, and there was a direct link between segment configuration and swimming kinematics, body shape, and Reynolds number. The models representing eel-like fishes with elongated bodies and fishes swimming at high Reynolds numbers had more segments and less segment length variability along the body than the models representing other fishes. These fishes recruited their anterior bodies to a greater extent, initiating the undulatory wave more anteriorly. Two shape parameters, related to axial and overall body thickness, predicted segment configuration with moderate to high success rate. We found that head morphology was a good predictor of its segment length. While there was a large variation in head segments, the length of tail segments was similar across all models. Given that fishes exhibited variable caudal fin shapes, the consistency of tail segments could be a result of an evolutionary constraint tuned for high propulsive efficiency. The bio-inspired multi-segment models presented in this study highlight the key bending points along the body and can be used to decide on the placement of actuators in fish-inspired robots, to model hydrodynamic forces in theoretical and computational studies, or for predicting muscle activation patterns during swimming.

Snakes combine vertical and lateral bending to traverse uneven terrain

Terrestrial locomotion requires generating appropriate ground reaction forces which depend on substrate geometry and physical properties. The richness of positions and orientations of terrain features in the 3D world gives limbless animals like snakes that can bend their body versatility to generate forces from different contact areas for propulsion. Despite many previous studies of how snakes use lateral body bending for propulsion on relatively flat surfaces with lateral contact points, little is known about whether and how much snakes use vertical body bending in combination with lateral bending in 3D terrain. This lack had contributed to snake robots being inferior to animals in stability, efficiency, and versatility when traversing complex 3D environments. Here, to begin to elucidate this, we studied how the generalist corn snake traversed an uneven arena of blocks of random height variation five times its body height. The animal traversed the uneven terrain with perfect stability by propagating 3D bending down its body with little transverse motion (11° slip angle). Although the animal preferred moving through valleys with higher neighboring blocks, it did not prefer lateral bending. Among body-terrain contact regions that potentially provide propulsion, 52% were formed by vertical body bending and 48% by lateral bending. The combination of vertical and lateral bending may dramatically expand the sources of propulsive forces available to limbless locomotors by utilizing various asperities available in 3D terrain. Direct measurements of contact forces are necessary to further understand how snakes coordinate 3D bending along the entire body via sensory feedback to propel through 3D terrain. These studies will open a path to new propulsive mechanisms for snake robots, potentially increasing the performance and versatility in 3D terrain.

Course Control of a Manta Robot Based on Amplitude and Phase Differences

Due to external interference, such as waves, the success of underwater missions depends on the turning performance of the vehicle. Manta rays use two broad pectoral fins for propulsion, which provide better anti-interference ability and turning performance. Inspired by biological yaw modes, we use the phase difference between the pectoral fins to realize fast course adjustment and the amplitude difference to realize precise adjustment. We design a bionic robot with pectoral fins and use phase oscillators to realize rhythmic motion. An expected phase difference transition equation is introduced to realize a fast and smooth transition of the output, and the parameters are adjusted online. We combine the phase difference and amplitude difference yaw modes to realize closed-loop course control. Through course interference and adjustment experiments, it is verified that the combined mode is more effective than a single mode. Finally, a rectangular trajectory swimming experiment demonstrates continuous mobility of the robot under the combined mode.

Hydrodynamical Fingerprint of a Neighbour in a Fish Lateral Line

For fish, swimming in group may be favorable to individuals. Several works reported that in a fish school, individuals sense and adjust their relative position to prevent collisions and maintain the group formation. Also, from a hydrodynamic perspective, relative-position and kinematic synchronisation between adjacent fish may considerably influence their swimming performance. Fish may sense the relative-position and tail-beat phase difference with their neighbors using both vision and the lateral-line system, however, when swimming in dark or turbid environments, visual information may become unavailable. To understand how lateral-line sensing can enable fish to judge the relative-position and phase-difference with their neighbors, in this study, based on a verified three-dimensional computational fluid dynamics approach, we simulated two fish swimming adjacently with various configurations. The lateral-line signal was obtained by sampling the surface hydrodynamic stress. The sensed signal was processed by Fast Fourier Transform (FFT), which is robust to turbulence and environmental flow. By examining the lateral-line pressure and shear-stress signals in the frequency domain, various states of the neighboring fish were parametrically identified. Our results reveal that the FFT-processed lateral-line signals in one fish may potentially reflect the relative-position, phase-differences, and the tail-beat frequency of its neighbor. Our results shed light on the fluid dynamical aspects of the lateral-line sensing mechanism used by fish. Furthermore, the presented approach based on FFT is especially suitable for applications in bioinspired swimming robotics. We provide suggestions for the design of artificial systems consisting of multiple stress sensors for robotic fish to improve their performance in collective operation.

Corollary discharge enables proprioception from lateral line sensory feedback

Animals modulate sensory processing in concert with motor actions. Parallel copies of motor signals, called corollary discharge (CD), prepare the nervous system to process the mixture of externally and self-generated (reafferent) feedback that arises during locomotion. Commonly, CD in the peripheral nervous system cancels reafference to protect sensors and the central nervous system from being fatigued and overwhelmed by self-generated feedback. However, cancellation also limits the feedback that contributes to an animal's awareness of its body position and motion within the environment, the sense of proprioception. We propose that, rather than cancellation, CD to the fish lateral line organ restructures reafference to maximize proprioceptive information content. Fishes' undulatory body motions induce reafferent feedback that can encode the body's instantaneous configuration with respect to fluid flows. We combined experimental and computational analyses of swimming biomechanics and hair cell physiology to develop a neuromechanical model of how fish can track peak body curvature, a key signature of axial undulatory locomotion. Without CD, this computation would be challenged by sensory adaptation, typified by decaying sensitivity and phase distortions with respect to an input stimulus. We find that CD interacts synergistically with sensor polarization to sharpen sensitivity along sensors' preferred axes. The sharpening of sensitivity regulates spiking to a narrow interval coinciding with peak reafferent stimulation, which prevents adaptation and homogenizes the otherwise variable sensor output. Our integrative model reveals a vital role of CD for ensuring precise proprioceptive feedback during undulatory locomotion, which we term external proprioception.

Body Caudal Undulation measured by Soft Sensors and emulated by Soft Artificial Muscles

We propose the use of bio-inspired robotics equipped with soft sensor technologies to gain a better understanding of the mechanics and control of animal movement. Soft robotic systems can be used to generate new hypotheses and uncover fundamental principles underlying animal locomotion and sensory capabilities, which could subsequently be validated using living organisms. Physical models increasingly include lateral body movements, notably back and tail bending, which are necessary for horizontal plane undulation in model systems ranging from fish to amphibians and reptiles. We present a comparative study of the use of physical modeling in conjunction with soft robotics and integrated soft and hyperelastic sensors to monitor local pressures, enabling local feedback control, and discuss issues related to understanding the mechanics and control of undulatory locomotion. A parallel approach combining live animal data with biorobotic physical modeling promises to be beneficial for gaining a better understanding of systems in motion.

Biorobotic insights into neuromechanical coordination of undulatory swimming

Skin sensors on an eel-like robot couple external hydrodynamic pressure with internal neural patterns for robust swimming.