Fins as Mechanosensors for Movement and Touch-Related Behaviors

Hydrodynamic pressure sensing for a biomimetic robotic fish caudal fin integrated with a resistive pressure sensor

Micro-sensors, such as pressure and flow sensors, are usually adopted to attain actual fluid information around swimming biomimetic robotic fish for hydrodynamic analysis and control. However, most of the reported micro-sensors are mounted discretely on body surfaces of robotic fish and it is impossible to analyzed the hydrodynamics between the caudal fin and the fluid. In this work, a biomimetic caudal fin integrated with a resistive pressure sensor is designed and fabricated by laser machined conductive carbon fibre composites. To analyze the pressure exerted on the caudal fin during underwater oscillation, the pressure on the caudal fin is measured under different oscillating frequencies and angles. Then a model developed from Bernoulli equation indicates that the maximum pressure difference is linear to the quadratic power of the oscillating frequency and the maximum oscillating angle. The fluid disturbance generated by caudal fin oscillating increases with an increase of oscillating frequency, resulting in the decrease of the efficiency of converting the kinetic energy of the caudal fin oscillation into the pressure difference on both sides of the caudal fin. However, perhaps due to the longer stability time of the disturbed fluid, this conversion efficiency increases with the increase of the maximum oscillating angle. Additionally, the pressure variation of the caudal fin oscillating with continuous different oscillating angles is also demonstrated to be detected effectively. It is suggested that the caudal fin integrated with the pressure sensor could be used for sensing thein situflow field in real time and analyzing the hydrodynamics of biomimetic robotic fish.

Kinematics and muscle activity of pectoral fins in rainbow trout (Oncorhynchus mykiss) station holding in turbulent flow

Pectoral fins play a crucial role in fish locomotion. Despite fishes living in complex fluid environments that exist in rivers and tidal flows, the role of the pectoral fins in navigating turbulent flows is not well understood. This study investigated the kinematics and muscle activity of pectoral fins in rainbow trout as they held station in the unsteady flows behind a D-section cylinder. We observed two distinct pectoral fin behaviors, one during braking and the other during Kármán gaiting. These behaviors were correlated to whole-body movements in response to the hydrodynamic conditions of specific regions in the cylinder wake. Sustained fin extensions during braking, where the fin was held out to maintain its position away from the body and against the flow, were associated with the cessation of forward body velocity, where the fish avoided the suction region directly downstream of the cylinder. Transient fin extensions and retractions during Kármán gaiting controlled body movements in the cross-stream direction. These two fin behaviors had different patterns of muscle activity. All braking events required recruitment from both the abductor and adductor musculature to actively extend a pectoral fin. In contrast, over 50% of fin extension movements during Kármán gaiting proceed in the absence of muscle activity. We reveal that in unsteady fluid environments, pectoral fin movements are the result of a complex combination of passive and active mechanisms that deviate substantially from canonical labriform locomotion, the implications of which await further work on the integration of sensory and motor systems.

Touchless underwater wall-distance sensing via active proprioception of a robotic flapper

In this work, we explored a bioinspired method for underwater object sensing based on active proprioception. We investigated whether the fluid flows generated by a robotic flapper, while interacting with an underwater wall, can encode the distance information between the wall and the flapper, and how to decode this information using the proprioception within the flapper. Such touchless wall-distance sensing is enabled by the active motion of a flapping plate, which injects self-generated flow to the fluid environment, thus representing a form of active sensing. Specifically, we trained a long short-term memory (LSTM) neural network to predict the wall distance based on the force and torque measured at the base of the flapping plate. In addition, we varied the Rossby number (Ro, or the aspect ratio of the plate) and the dimensionless flapping amplitude (A∗) to investigate how the rotational effects and unsteadiness of self-generated flow respectively affect the accuracy of the wall-distance prediction. Our results show that the median prediction error is within 5% of the plate length for all the wall-distances investigated (up to 40 cm or approximately 2-3 plate lengths depending on theRo); therefore, confirming that the self-generated flow can enable underwater perception. In addition, we show that stronger rotational effects at lowerRolead to higher prediction accuracy, while flow unsteadiness (A∗) only has moderate effects. Lastly, analysis based on SHapley Additive exPlanations (SHAP) indicate that temporal features that are most prominent at stroke reversals likely promotes the wall-distance prediction.

Sensory collectives in natural systems

Groups of animals inhabit vastly different sensory worlds, or umwelten, which shape fundamental aspects of their behaviour. Yet the sensory ecology of species is rarely incorporated into the emerging field of collective behaviour, which studies the movements, population-level behaviours, and emergent properties of animal groups. Here, we review the contributions of sensory ecology and collective behaviour to understanding how animals move and interact within the context of their social and physical environments. Our goal is to advance and bridge these two areas of inquiry and highlight the potential for their creative integration. To achieve this goal, we organise our review around the following themes: (1) identifying the promise of integrating collective behaviour and sensory ecology; (2) defining and exploring the concept of a 'sensory collective'; (3) considering the potential for sensory collectives to shape the evolution of sensory systems; (4) exploring examples from diverse taxa to illustrate neural circuits involved in sensing and collective behaviour; and (5) suggesting the need for creative conceptual and methodological advances to quantify 'sensescapes'. In the final section, (6) applications to biological conservation, we argue that these topics are timely, given the ongoing anthropogenic changes to sensory stimuli (e.g. via light, sound, and chemical pollution) which are anticipated to impact animal collectives and group-level behaviour and, in turn, ecosystem composition and function. Our synthesis seeks to provide a forward-looking perspective on how sensory ecologists and collective behaviourists can both learn from and inspire one another to advance our understanding of animal behaviour, ecology, adaptation, and evolution.

Corollary discharge enables proprioception from lateral line sensory feedback

Animals modulate sensory processing in concert with motor actions. Parallel copies of motor signals, called corollary discharge (CD), prepare the nervous system to process the mixture of externally and self-generated (reafferent) feedback that arises during locomotion. Commonly, CD in the peripheral nervous system cancels reafference to protect sensors and the central nervous system from being fatigued and overwhelmed by self-generated feedback. However, cancellation also limits the feedback that contributes to an animal's awareness of its body position and motion within the environment, the sense of proprioception. We propose that, rather than cancellation, CD to the fish lateral line organ restructures reafference to maximize proprioceptive information content. Fishes' undulatory body motions induce reafferent feedback that can encode the body's instantaneous configuration with respect to fluid flows. We combined experimental and computational analyses of swimming biomechanics and hair cell physiology to develop a neuromechanical model of how fish can track peak body curvature, a key signature of axial undulatory locomotion. Without CD, this computation would be challenged by sensory adaptation, typified by decaying sensitivity and phase distortions with respect to an input stimulus. We find that CD interacts synergistically with sensor polarization to sharpen sensitivity along sensors' preferred axes. The sharpening of sensitivity regulates spiking to a narrow interval coinciding with peak reafferent stimulation, which prevents adaptation and homogenizes the otherwise variable sensor output. Our integrative model reveals a vital role of CD for ensuring precise proprioceptive feedback during undulatory locomotion, which we term external proprioception.

Fish can save energy via proprioceptive sensing

Fish have evolved diverse and robust locomotive strategies to swim efficiently in complex fluid environments. However, we know little, if anything, about how these strategies can be achieved. Although most studies suggest that fish rely on the lateral line system to sense local flow and optimise body undulation, recent work has shown that fish are still able to gain benefits from the local flow even with the lateral line impaired. In this paper, we hypothesise that fish can save energy by extracting vortices shed from their neighbours using only simple proprioceptive sensing with the caudal fin. We tested this hypothesis on both computational and robotic fish by synthesising a central pattern generator (CPG) with feedback, proprioceptive sensing, and reinforcement learning. The CPG controller adjusts the body undulation after receiving feedback from the proprioceptive sensing signal, decoded via reinforcement learning. In our study, we consider potential proprioceptive sensing inputs to consist of low-dimensional signals (e.g. perceived forces) detected from the flow. With simulations on a computational robot and experiments on a robotic fish swimming in unknown dynamic flows, we show that the simple proprioceptive sensing is sufficient to optimise the body undulation to save energy, without any input from the lateral line. Our results reveal a new sensory-motor mechanism in schooling fish and shed new light on the strategy of control for robotic fish swimming in complex flows with high efficiency.

Research Trends and Future Perspectives in Marine Biomimicking Robotics

Mechatronic and soft robotics are taking inspiration from the animal kingdom to create new high-performance robots. Here, we focused on marine biomimetic research and used innovative bibliographic statistics tools, to highlight established and emerging knowledge domains. A total of 6980 scientific publications retrieved from the Scopus database (1950-2020), evidencing a sharp research increase in 2003-2004. Clustering analysis of countries collaborations showed two major Asian-North America and European clusters. Three significant areas appeared: (i) energy provision, whose advancement mainly relies on microbial fuel cells, (ii) biomaterials for not yet fully operational soft-robotic solutions; and finally (iii), design and control, chiefly oriented to locomotor designs. In this scenario, marine biomimicking robotics still lacks solutions for the long-lasting energy provision, which presently hinders operation autonomy. In the research environment, identifying natural processes by which living organisms obtain energy is thus urgent to sustain energy-demanding tasks while, at the same time, the natural designs must increasingly inform to optimize energy consumption.

Learning hydrodynamic signatures through proprioceptive sensing by bioinspired swimmers

Objects moving in water or stationary objects in streams create a vortex wake. Such vortex wakes encode information about the objects and the flow conditions. Underwater robots that often function with constrained sensing capabilities can benefit from extracting this information from vortex wakes. Many species of fish do exactly this, by sensing flow features using their lateral lines as part of their multimodal sensing. To replicate such capabilities in robots, significant research has been devoted to developing artificial lateral line sensors that can be placed on the surface of a robot to detect pressure and velocity gradients. We advance an alternative view of embodied sensing in this paper; the kinematics of a swimmer's body in response to the hydrodynamic forcing by the vortex wake can encode information about the vortex wake. Here we show that using artificial neural networks that take the angular velocity of the body as input, fish-like swimmers can be trained to label vortex wakes which are hydrodynamic signatures of other moving bodies and thus acquire a capability to 'blindly' identify them.

Vortex phase matching as a strategy for schooling in robots and in fish

It has long been proposed that flying and swimming animals could exploit neighbour-induced flows. Despite this it is still not clear whether, and if so how, schooling fish coordinate their movement to benefit from the vortices shed by others. To address this we developed bio-mimetic fish-like robots which allow us to measure directly the energy consumption associated with swimming together in pairs (the most common natural configuration in schooling fish). We find that followers, in any relative position to a near-neighbour, could obtain hydrodynamic benefits if they exhibit a tailbeat phase difference that varies linearly with front-back distance, a strategy we term ‘vortex phase matching’. Experiments with pairs of freely-swimming fish reveal that followers exhibit this strategy, and that doing so requires neither a functioning visual nor lateral line system. Our results are consistent with the hypothesis that fish typically, but not exclusively, use vortex phase matching to save energy.

Whether and how fish might benefit from swimming in schools is an ongoing intriguing debate. Li et al. conduct experiments with biomimetic robots and also with real fish to reveal a new behavioural strategy by which followers can exploit the vortices shed by a near neighbour.

Pectoral fin kinematics and motor patterns are shaped by fin ray mechanosensation during steady swimming in Scarus quoyi

For many fish species, rhythmic movement of the pectoral fins, or forelimbs, drives locomotion. In terrestrial vertebrates, normal limb-based rhythmic gaits require ongoing modulation with limb mechanosensors. Given the complexity of the fluid environment and dexterity of fish swimming through it, we hypothesize that mechanosensory modulation is also critical to normal fin-based swimming. Here, we examined the role of sensory feedback from the pectoral fin rays and membrane on the neuromuscular control and kinematics of pectoral fin-based locomotion. Pectoral fin kinematics and electromyograms of the six major fin muscles of the parrotfish, Scarus quoyi, a high-performance pectoral fin swimmer, were recorded during steady swimming before and after bilateral transection of the sensory nerves extending into the rays and surrounding membrane. Alternating activity of antagonistic muscles was observed and drove the fin in a figure-of-eight fin stroke trajectory before and after nerve transection. After bilateral transections, pectoral fin rhythmicity remained the same or increased. Differences in fin kinematics with the loss of sensory feedback also included fin kinematics with a significantly more inclined stroke plane angle, an increased angular velocity and fin beat frequency, and a transition to the body-caudal fin gait at lower speeds. After transection, muscles were active over a larger proportion of the fin stroke, with overlapping activation of antagonistic muscles rarely observed in the trials of intact fish. The increased overlap of antagonistic muscle activity might stiffen the fin system in order to enhance control and stability in the absence of sensory feedback from the fin rays. These results indicate that fin ray sensation is not necessary to generate the underlying rhythm of fin movement, but contributes to the specification of pectoral fin motor pattern and movement during rhythmic swimming.