Control of climbing behavior in the cockroach, Blaberus discoidalis. II. Motor activities associated with joint movement

The bumpy road ahead: the role of substrate roughness on animal walking and a proposed comparative metric

Outside laboratory conditions and human-made structures, animals rarely encounter flat surfaces. Instead, natural substrates are uneven surfaces with height variation that ranges from the microscopic scale to the macroscopic scale. For walking animals (which we define as encompassing any form of legged movement across the ground, such as walking, running, galloping, etc.), such substrate 'roughness' influences locomotion in a multitude of ways across scales, from roughness that influences how each toe or foot contacts the ground, to larger obstacles that animals must move over or navigate around. Historically, the unpredictability and variability of natural environments has limited the ability to collect data on animal walking biomechanics. However, recent technical advances, such as more sensitive and portable cameras, biologgers, laboratory tools to fabricate rough terrain, as well as the ability to efficiently store and analyze large variable datasets, have expanded the opportunity to study how animals move under naturalistic conditions. As more researchers endeavor to assess walking over rough terrain, we lack a consistent approach to quantifying roughness and contextualizing these findings. This Review summarizes existing literature that examines non-human animals walking on rough terrain and presents a metric for characterizing the relative substrate roughness compared with animal size. This framework can be applied across terrain and body scales, facilitating direct comparisons of walking over rough surfaces in animals ranging in size from ants to elephants.

neuroWalknet, a controller for hexapod walking allowing for context dependent behavior

Decentralized control has been established as a key control principle in insect walking and has been successfully leveraged to account for a wide range of walking behaviors in the proposed neuroWalknet architecture. This controller allows for walking patterns at different velocities in both, forward and backward direction-quite similar to the behavior shown in stick insects-, for negotiation of curves, and for robustly dealing with various disturbances. While these simulations focus on the cooperation of different, decentrally controlled legs, here we consider a set of biological experiments not yet been tested by neuroWalknet, that focus on the function of the individual leg and are context dependent. These intraleg studies deal with four groups of interjoint reflexes. The reflexes are elicited by stimulation of the femoral chordotonal organ (fCO) or groups of campaniform sensilla (CS). Motor output signals are recorded from the alpha-joint, the beta-joint or the gamma-joint of the leg. Furthermore, the influence of these sensory inputs to artificially induced oscillations by application of pilocarpine has been studied. Although these biological data represent results obtained from different local reflexes in different contexts, they fit with and are embedded into the behavior shown by the global structure of neuroWalknet. In particular, a specific and intensively studied behavior, active reaction, has since long been assumed to represent a separate behavioral element, from which it is not clear why it occurs in some situations, but not in others. This question could now be explained as an emergent property of the holistic structure of neuroWalknet which has shown to be able to produce artificially elicited pilocarpine-driven oscillation that can be controlled by sensory input without the need of explicit innate CPG structures. As the simulation data result from a holistic system, further results were obtained that could be used as predictions to be tested in further biological experiments.

A terrain treadmill to study animal locomotion through large obstacles

A challenge to understanding locomotion in complex 3-D terrain with large obstacles is to create tools for controlled, systematic experiments. Recent terrain arenas allow observations at small spatiotemporal scales (∼10 body length or cycles). Here, we create a terrain treadmill to enable high-resolution observation of animal locomotion through large obstacles over large spatiotemporal scales. An animal moves through modular obstacles on an inner sphere, while a rigidly-attached, concentric, transparent outer sphere rotates with the opposite velocity via closed-loop feedback to keep the animal atop. During sustained locomotion, a discoid cockroach moved through pillar obstacles for up to 25 minutes (2500 cycles) over 67 m (1500 body lengths). Over 12 trials totaling∼1 hour, the animal was maintained within a radius of 1 body length (4.5 cm) on top of the sphere 90% of the time. The high-resolution observation enables study of diverse locomotor behaviors and quantification of animal-obstacle interaction.

Cockroaches adjust body and appendages to traverse cluttered large obstacles

To traverse complex terrain, animals often transition between locomotor modes. It is well-known that locomotor transitions can be induced by switching in neural control circuits or driven by a need to minimize metabolic energetic cost. Recent work discovered that locomotor transitions in complex 3-D terrain cluttered with large obstacles can emerge from physical interaction with the environment controlled by the nervous system. For example, to traverse cluttered, stiff grass-like beams, the discoid cockroach often transitions from using a strenuous pitch mode pushing across to using a less strenuous roll mode rolling into and through the gaps, and this transition requires overcoming a potential energy barrier. Previous robotic physical modeling demonstrated that kinetic energy fluctuation of body oscillation from self-propulsion can help overcome the barrier and facilitate this transition. However, the animal was observed to transition even when the barrier still exceeded kinetic energy fluctuation. Here, we further studied whether and how the cockroach makes active adjustments to facilitate this transition to traverse cluttered beams. The animal repeatedly flexed its head and abdomen, reduced hind leg sprawl, and depressed one hind leg and elevated the other during the pitch-to-roll transition, which were absent when running on a flat ground. Using a refined potential energy landscape with additional degrees of freedom to model these adjustments, we found that head flexion did not substantially reduce the transition barrier, whereas leg sprawl reduction did so dramatically. We speculate that head flexion is for sensing the terrain to guide the transition via sensory feedback control.

Self-reconfigurable multilegged robot swarms collectively accomplish challenging terradynamic tasks

Swarms of ground-based robots are presently limited to relatively simple environments, which we attribute in part to the lack of locomotor capabilities needed to traverse complex terrain. To advance the field of terradynamically capable swarming robotics, inspired by the capabilities of multilegged organisms, we hypothesize that legged robots consisting of reversibly chainable modular units with appropriate passive perturbation management mechanisms can perform diverse tasks in variable terrain without complex control and sensing. Here, we report a reconfigurable swarm of identical low-cost quadruped robots (with directionally flexible legs and tail) that can be linked on demand and autonomously. When tasks become terradynamically challenging for individuals to perform alone, the individuals suffer performance degradation. A systematic study of performance of linked units leads to new discoveries of the emergent obstacle navigation capabilities of multilegged robots. We also demonstrate the swarm capabilities through multirobot object transport. In summary, we argue that improvement capabilities of terrestrial swarms of robots can be achieved via the judicious interaction of relatively simple units.

From Motor-Output to Connectivity: An In-Depth Study of in-vitro Rhythmic Patterns in the Cockroach Periplaneta americana

The cockroach is an established model in the study of locomotion control. While previous work has offered important insights into the interplay among brain commands, thoracic central pattern generators, and the sensory feedback that shapes their motor output, there remains a need for a detailed description of the central pattern generators' motor output and their underlying connectivity scheme. To this end, we monitored pilocarpine-induced activity of levator and depressor motoneurons in two types of novel in-vitro cockroach preparations: isolated thoracic ganglia and a whole-chain preparation comprising the thoracic ganglia and the subesophageal ganglion. Our data analyses focused on the motoneuron firing patterns and the coordination among motoneuron types in the network. The burstiness and rhythmicity of the motoneurons were monitored, and phase relations, coherence, coupling strength, and frequency-dependent variability were analyzed. These parameters were all measured and compared among network units both within each preparation and among the preparations. Here, we report differences among the isolated ganglia, including asymmetries in phase and coupling strength, which indicate that they are wired to serve different functions. We also describe the intrinsic default gait and a frequency-dependent coordination. The depressor motoneurons showed mostly similar characteristics throughout the network regardless of interganglia connectivity; whereas the characteristics of the levator motoneurons activity were mostly ganglion-dependent, and influenced by the presence of interganglia connectivity. Asymmetries were also found between the anterior and posterior homolog parts of the thoracic network, as well as between ascending and descending connections. Our analyses further discover a frequency-dependent inversion of the interganglia coordination from alternations between ipsilateral homolog oscillators to simultaneous activity. We present a detailed scheme of the network couplings, formulate coupling rules, and review a previously suggested model of connectivity in light of our new findings. Our data support the notion that the inter-hemiganglia coordination derives from the levator networks and their coupling with local depressor interneurons. Our findings also support a dominant role of the metathoracic ganglion and its ascending output in governing the anterior ganglia motor output during locomotion in the behaving animal.

Neurodynamic modeling of the fruit fly Drosophila melanogaster

This manuscript describes neuromechanical modeling of the fruit fly Drosophila melanogaster in the form of a hexapod robot, Drosophibot, and an accompanying dynamic simulation. Drosophibot is a testbed for real-time dynamical neural controllers modeled after the anatomy and function of the insect nervous system. As such, Drosophibot has been designed to capture features of the animal's biomechanics in order to better test the neural controllers. These features include: dynamically scaling the robot to match the fruit fly by designing its joint elasticity and movement speed; a biomimetic actuator control scheme that converts neural activity into motion in the same way as observed in insects; biomimetic sensing, including proprioception from all leg joints and strain sensing from all leg segments; and passively compliant tarsi that mimic the animal's passive compliance to the walking substrate. We incorporated these features into a dynamical simulation of Drosophibot, and demonstrate that its actuators and sensors perform in an animal-like way. We used this simulation to test a neural walking controller based on anatomical and behavioral data from insects. Finally, we describe Drosophibot's hardware and show that the animal-like features of the simulation transfer to the physical robot.

Motor control of an insect leg during level and incline walking

During walking, the leg motor system must continually adjust to changes in mechanical conditions, such as the inclination of the ground. To understand the underlying control, it is important to know how changes in leg muscle activity relate to leg kinematics (movements) and leg dynamics (forces, torques). Here, we studied these parameters in hindlegs of stick insects (Carausius morosus) during level and uphill/downhill (±45 deg) walking, using a combination of electromyography, 3D motion capture and ground reaction force measurements. We find that some kinematic parameters including leg joint angles and body height vary across walking conditions. However, kinematics vary little compared with dynamics: horizontal leg forces and torques at the thorax-coxa joint (leg protraction/retraction) and femur-tibia joint (leg flexion/extension) tend to be stronger during uphill walking and are reversed in sign during downhill walking. At the thorax-coxa joint, the different mechanical demands are met by adjustments in the timing and magnitude of antagonistic muscle activity. Adjustments occur primarily in the first half of stance after the touch-down of the leg. When insects transition from level to incline walking, the characteristic adjustments in muscle activity occur with the first step of the leg on the incline, but not in anticipation. Together, these findings indicate that stick insects adjust leg muscle activity on a step-by-step basis so as to maintain a similar kinematic pattern under different mechanical demands. The underlying control might rely primarily on feedback from leg proprioceptors signaling leg position and movement.

Force dynamics and synergist muscle activation in stick insects: the effects of using joint torques as mechanical stimuli

Many sensory systems are tuned to specific parameters of behaviors and have effects that are task-specific. We have studied how force feedback contributes to activation of synergist muscles in serially homologous legs of stick insects. Forces were applied using conventional half-sine or ramp and hold functions. We also utilized waveforms of joint torques calculated from experiments in freely walking animals. In all legs, forces applied to either the tarsus (foot) or proximal leg segment (trochanter) activated synergist muscles that generate substrate grip and support, but coupling of the depressor muscle to tarsal forces was weak in the front legs. Activation of trochanteral receptors using ramp and hold functions generated positive feedback to the depressor muscle in all legs when animals were induced to seek substrate grip. However, discharges of the synergist flexor muscle showed adaptation at moderate force levels. In contrast, application of forces using torque waveforms, which do not have a static hold phase, produced sustained discharges in muscle synergies with little adaptation. Firing frequencies reflected the magnitude of ground reaction forces, were graded to changes in force amplitude, and could also be modulated by transient force perturbations added to the waveforms. Comparison of synergist activation by torques and ramp and hold functions revealed a strong influence of force dynamics (dF/d t). These studies support the idea that force receptors can act to tune muscle synergies synchronously to the range of force magnitudes and dynamics that occur in each leg according to their specific use in behavior. NEW & NOTEWORTHY The effects of force receptors (campaniform sensilla) on leg muscles and synergies were characterized in stick insects using both ramp and hold functions and waveforms of joint torques calculated by inverse dynamics. Motor responses were sustained and showed reduced adaptation to the more "natural" and nonlinear torque stimuli. Calculation of the first derivative (dF/d t) of the torque waveforms demonstrated that this difference was correlated with the dynamic sensitivities of the system.

Dynamic traversal of large gaps by insects and legged robots reveals a template

It is well known that animals can use neural and sensory feedback via vision, tactile sensing, and echolocation to negotiate obstacles. Similarly, most robots use deliberate or reactive planning to avoid obstacles, which relies on prior knowledge or high-fidelity sensing of the environment. However, during dynamic locomotion in complex, novel, 3D terrains, such as a forest floor and building rubble, sensing and planning suffer bandwidth limitation and large noise and are sometimes even impossible. Here, we study rapid locomotion over a large gap-a simple, ubiquitous obstacle-to begin to discover the general principles of the dynamic traversal of large 3D obstacles. We challenged the discoid cockroach and an open-loop six-legged robot to traverse a large gap of varying length. Both the animal and the robot could dynamically traverse a gap as large as one body length by bridging the gap with its head, but traversal probability decreased with gap length. Based on these observations, we developed a template that accurately captured body dynamics and quantitatively predicted traversal performance. Our template revealed that a high approach speed, initial body pitch, and initial body pitch angular velocity facilitated dynamic traversal, and successfully predicted a new strategy for using body pitch control that increased the robot's maximal traversal gap length by 50%. Our study established the first template of dynamic locomotion beyond planar surfaces, and is an important step in expanding terradynamics into complex 3D terrains.

Body-terrain interaction affects large bump traversal of insects and legged robots

Small animals and robots must often rapidly traverse large bump-like obstacles when moving through complex 3D terrains, during which, in addition to leg-ground contact, their body inevitably comes into physical contact with the obstacles. However, we know little about the performance limits of large bump traversal and how body-terrain interaction affects traversal. To address these, we challenged the discoid cockroach and an open-loop six-legged robot to dynamically run into a large bump of varying height to discover the maximal traversal performance, and studied how locomotor modes and traversal performance are affected by body-terrain interaction. Remarkably, during rapid running, both the animal and the robot were capable of dynamically traversing a bump much higher than its hip height (up to 4 times the hip height for the animal and 3 times for the robot, respectively) at traversal speeds typical of running, with decreasing traversal probability with increasing bump height. A stability analysis using a novel locomotion energy landscape model explained why traversal was more likely when the animal or robot approached the bump with a low initial body yaw and a high initial body pitch, and why deflection was more likely otherwise. Inspired by these principles, we demonstrated a novel control strategy of active body pitching that increased the robot's maximal traversable bump height by 75%. Our study is a major step in establishing the framework of locomotion energy landscapes to understand locomotion in complex 3D terrains.

Force Sensors in Hexapod Locomotion

Biological systems can provide useful insights into principles of design and control of locomotion that can be applied to legged robots. In this paper we review our work on cockroaches using finite element analysis to model how loads are sensed and regulated in walking and climbing. A number of biological studies have shown that sensors that detect forces in the legs of insects are of particular importance in controlling walking and adapting locomotion to non-horizontal terrains. Our analysis strongly suggests that (i) the system can detect specific force vectors (body load versus propulsion) via sensors located in the leg in positions close to the body and (ii) the system uses this information in positive load feedback to regulate walking movements. These principles and design elements provide examples that can be applied in legged locomotion in walking machines.

Leg Regrowth in Blaberus discoidalis (Discoid Cockroach) following Limb Autotomy versus Limb Severance and Relevance to Neurophysiology Experiments

BACKGROUND

Many insects can regenerate limbs, but less is known about the regrowth process with regard to limb injury type. As part of our neurophysiology education experiments involving the removal of a cockroach leg, 1) the ability of Blaberus discoidalis cockroaches to regenerate a metathoracic leg was examined following autotomy at the femur/trochanter joint versus severance via a transverse coxa-cut, and 2) the neurophysiology of the detached legs with regard to leg removal type was studied by measuring spike firing rate and microstimulation movement thresholds.

LEG REGROWTH RESULTS

First appearance of leg regrowth was after 5 weeks in the autotomy group and 12 weeks in the coxa-cut group. Moreover, regenerated legs in the autotomy group were 72% of full size on first appearance, significantly larger (p<0.05) than coxa-cut legs (29% of full size at first appearance). Regenerated legs in both groups grew in size with each subsequent molt; the autotomy-removed legs grew to full size within 18 weeks, whereas coxa-cut legs took longer than 28 weeks to regrow. Removal of the metathoracic leg in both conditions did not have an effect on mortality compared to matched controls with unmolested legs.

NEUROPHYSIOLOGY RESULTS

Autotomy-removed legs had lower spontaneous firing rates, similar marked increased firing rates upon tactile manipulation of tibial barbs, and a 10% higher electrical microstimulation threshold for movement.

SUMMARY

It is recommended that neurophysiology experiments on cockroach legs remove the limb at autotomy joints instead of coxa cuts, as the leg regenerates significantly faster when autotomized and does not detract from the neurophysiology educational content.

Central-complex control of movement in the freely walking cockroach

To navigate in the world, an animal's brain must produce commands to move, change direction, and negotiate obstacles. In the insect brain, the central complex integrates multiple forms of sensory information and guides locomotion during behaviors such as foraging, climbing over barriers, and navigating to memorized locations. These roles suggest that the central complex influences motor commands, directing the appropriate movement within the current context. Such commands are ultimately carried out by the limbs and must therefore interact with pattern generators and reflex circuits that coordinate them. Recent studies have described how neurons of the central complex encode sensory information: neurons subdivide the space around the animal, encoding the direction or orientation of stimuli used in navigation. Does a similar central-complex code directing movement exist, and if so, how does it effect changes in the control of limbs? Recording from central-complex neurons in freely walking cockroaches (Blaberus discoidalis), we identified classes of movement-predictive cells selective for slow or fast forward walking, left or right turns, or combinations of forward and turning speeds. Stimulation through recording wires produced consistent trajectories of forward walking or turning in these animals, and those that elicited turns also altered an inter-joint reflex to a pattern resembling spontaneous turning. When an animal transitioned to climbing over an obstacle, the encoding of movement in this new context changed for a subset of cells. These results indicate that encoding of movement in the central complex participates in motor control by a distributed, flexible code targeting limb reflex circuits.

Force feedback reinforces muscle synergies in insect legs

The nervous system solves complex biomechanical problems by activating muscles in modular, synergist groups. We have studied how force feedback in substrate grip is integrated with effects of sense organs that monitor support and propulsion in insects. Campaniform sensilla are mechanoreceptors that encode forces as cuticular strains. We tested the hypothesis that integration of force feedback from receptors of different leg segments during grip occurs through activation of specific muscle synergies. We characterized the effects of campaniform sensilla of the feet (tarsi) and proximal segments (trochanter and femur) on activities of leg muscles in stick insects and cockroaches. In both species, mechanical stimulation of tarsal sensilla activated the leg muscle that generates substrate grip (retractor unguis), as well as proximal leg muscles that produce inward pull (tibial flexor) and support/propulsion (trochanteral depressor). Stimulation of campaniform sensilla on proximal leg segments activated the same synergistic group of muscles. In stick insects, the effects of proximal receptors on distal leg muscles changed and were greatly enhanced when animals made active searching movements. In insects, the task-specific reinforcement of muscle synergies can ensure that substrate adhesion is rapidly established after substrate contact to provide a stable point for force generation.

Dynamics of underwater legged locomotion: modeling and experiments on an octopus-inspired robot

This paper studies underwater legged locomotion (ULL) by means of a robotic octopus-inspired prototype and its associated model. Two different types of propulsive actions are embedded into the robot model: reaction forces due to leg contact with the ground and hydrodynamic forces such as the drag arising from the sculling motion of the legs. Dynamic parameters of the model are estimated by means of evolutionary techniques and subsequently the model is exploited to highlight some distinctive features of ULL. Specifically, the separation between the center of buoyancy (CoB)/center of mass and density affect the stability and speed of the robot, whereas the sculling movements contribute to propelling the robot even when its legs are detached from the ground. The relevance of these effects is demonstrated through robotic experiments and model simulations; moreover, by slightly changing the position of the CoB in the presence of the same feed-forward activation, a number of different behaviors (i.e. forward and backward locomotion at different speeds) are achieved.

Terradynamically streamlined shapes in animals and robots enhance traversability through densely cluttered terrain

Many animals, modern aircraft, and underwater vehicles use fusiform, streamlined body shapes that reduce fluid dynamic drag to achieve fast and effective locomotion in air and water. Similarly, numerous small terrestrial animals move through cluttered terrain where three-dimensional, multi-component obstacles like grass, shrubs, vines, and leaf litter also resist motion, but it is unknown whether their body shape plays a major role in traversal. Few ground vehicles or terrestrial robots have used body shape to more effectively traverse environments such as cluttered terrain. Here, we challenged forest-floor-dwelling discoid cockroaches (Blaberus discoidalis) possessing a thin, rounded body to traverse tall, narrowly spaced, vertical, grass-like compliant beams. Animals displayed high traversal performance (79 ± 12% probability and 3.4 ± 0.7 s time). Although we observed diverse obstacle traversal strategies, cockroaches primarily (48 ± 9% probability) used a novel roll maneuver, a form of natural parkour, allowing them to rapidly traverse obstacle gaps narrower than half their body width (2.0 ± 0.5 s traversal time). Reduction of body roundness by addition of artificial shells nearly inhibited roll maneuvers and decreased traversal performance. Inspired by this discovery, we added a thin, rounded exoskeletal shell to a legged robot with a nearly cuboidal body, common to many existing terrestrial robots. Without adding sensory feedback or changing the open-loop control, the rounded shell enabled the robot to traverse beam obstacles with gaps narrower than shell width via body roll. Such terradynamically 'streamlined' shapes can reduce terrain resistance and enhance traversability by assisting effective body reorientation via distributed mechanical feedback. Our findings highlight the need to consider body shape to improve robot mobility in real-world terrain often filled with clutter, and to develop better locomotor-ground contact models to understand interaction with 3D, multi-component terrain.

The role of leg touchdown for the control of locomotor activity in the walking stick insect

Much is known on how select sensory feedback contributes to the activation of different motoneuron pools in the locomotor control system of stick insects. However, even though activation of the stance phase muscles depressor trochanteris, retractor unguis, flexor tibiae and retractor coxae is correlated with the touchdown of the leg, the potential sensory basis of this correlation or its connection to burst intensity remains unknown. In our experiments, we are using a trap door setup to investigate how ground contact contributes to stance phase muscle activation and burst intensity in different stick insect species, and which afferent input is involved in the respective changes. While the magnitude of activation is changed in all of the above stance phase muscles, only the timing of the flexor tibiae muscle is changed if the animal unexpectedly steps into a hole. Individual and combined ablation of different force sensors on the leg demonstrated influence from femoral campaniform sensilla on flexor muscle timing, causing a significant increase in the latencies during control and air steps. Our results show that specific load feedback signals determine the timing of flexor tibiae activation at the swing-to-stance transition in stepping stick insects, but that additional feedback may also be involved in flexor muscle activation during stick insect locomotion. With respect to timing, all other investigated stance phase muscles appear to be under sensory control other than that elicited through touchdown.

A neuromechanical simulation of insect walking and transition to turning of the cockroach Blaberus discoidalis

A neuromechanical simulation of the cockroach Blaberus discoidalis was developed to explore changes in locomotion when the animal transitions from walking straight to turning. The simulation was based upon the biological data taken from three sources. Neural circuitry was adapted from the extensive literature primarily obtained from the studies of neural connections within thoracic ganglia of stick insect and adapted to cockroach. The 3D joint kinematic data on straight, forward walking for cockroach were taken from a paper that describes these movements in all joints simultaneously as the cockroach walked on an oiled-plate tether (Bender et al. in PloS one 5(10):1-15, 2010b). Joint kinematics for turning were only available for some leg joints (Mu and Ritzmann in J Comp Physiol A Neuroethol Sens Neural Behav Physiol 191(11):1037-54, 2005) and thus had to be obtained using the methods that were applied for straight walking by Bender et al. (PloS one 5(10):1-15, 2010b). Once walking, inside turning, and outside turning were characterized, phase and amplitude changes for each joint of each leg were quantified. Apparent reflex reversals and joint activity changes were used to modify sensory coupling pathways between the CPG at each joint of the simulation. Oiled-plate experiments in simulation produced tarsus trajectories in stance similar to those seen in the animal. Simulations including forces that would be experienced if the insect was walking freely (i.e., weight support and friction) again produced similar results. These data were not considered during the design of the simulation, suggesting that the simulation captures some key underlying the principles of walking, turning, and transitioning in the cockroach. In addition, since the nervous system was modeled with realistic neuron models, biologically plausible reflex reversals are simulated, motivating future neurobiological research.

Instantaneous kinematic phase reflects neuromechanical response to lateral perturbations of running cockroaches

Instantaneous kinematic phase calculation allows the development of reduced-order oscillator models useful in generating hypotheses of neuromechanical control. When perturbed, changes in instantaneous kinematic phase and frequency of rhythmic movements can provide details of movement and evidence for neural feedback to a system-level neural oscillator with a time resolution not possible with traditional approaches. We elicited an escape response in cockroaches (Blaberus discoidalis) that ran onto a movable cart accelerated laterally with respect to the animals' motion causing a perturbation. The specific impulse imposed on animals (0.50 [Formula: see text] 0.04 m s[Formula: see text]; mean, SD) was nearly twice their forward speed (0.25 [Formula: see text] 0.06 m s[Formula: see text]. Instantaneous residual phase computed from kinematic phase remained constant for 110 ms after the onset of perturbation, but then decreased representing a decrease in stride frequency. Results from direct muscle action potential recordings supported kinematic phase results in showing that recovery begins with self-stabilizing mechanical feedback followed by neural feedback to an abstracted neural oscillator or central pattern generator. Trials fell into two classes of forward velocity changes, while exhibiting statistically indistinguishable frequency changes. Animals pulled away from the side with front and hind legs of the tripod in stance recovered heading within 300 ms, whereas animals that only had a middle leg of the tripod resisting the pull did not recover within this period. Animals with eight or more legs might be more robust to lateral perturbations than hexapods.

Quantification of gait parameters in freely walking wild type and sensory deprived Drosophila melanogaster

Coordinated walking in vertebrates and multi-legged invertebrates [corrected] such as Drosophila melanogaster requires a complex neural network coupled to sensory feedback. An understanding of this network will benefit from systems such as Drosophila that have the ability to genetically manipulate neural activities. However, the fly's small size makes it challenging to analyze walking in this system. In order to overcome this limitation, we developed an optical method coupled with high-speed imaging that allows the tracking and quantification of gait parameters in freely walking flies with high temporal and spatial resolution. Using this method, we present a comprehensive description of many locomotion parameters, such as gait, tarsal positioning, and intersegmental and left-right coordination for wild type fruit flies. Surprisingly, we find that inactivation of sensory neurons in the fly's legs, to block proprioceptive feedback, led to deficient step precision, but interleg coordination and the ability to execute a tripod gait were unaffected.DOI:http://dx.doi.org/10.7554/eLife.00231.001.

Quantification of gait parameters in freely walking wild type and sensory deprived Drosophila melanogaster

Coordinated walking in vertebrates and multi-legged invertebrates such as Drosophila melanogaster requires a complex neural network coupled to sensory feedback. An understanding of this network will benefit from systems such as Drosophila that have the ability to genetically manipulate neural activities. However, the fly's small size makes it challenging to analyze walking in this system. In order to overcome this limitation, we developed an optical method coupled with high-speed imaging that allows the tracking and quantification of gait parameters in freely walking flies with high temporal and spatial resolution. Using this method, we present a comprehensive description of many locomotion parameters, such as gait, tarsal positioning, and intersegmental and left-right coordination for wild type fruit flies. Surprisingly, we find that inactivation of sensory neurons in the fly's legs, to block proprioceptive feedback, led to deficient step precision, but interleg coordination and the ability to execute a tripod gait were unaffected.

DOI:http://dx.doi.org/10.7554/eLife.00231.001

Most animals need to be able to move to survive. Animals without limbs, such as snakes, move by generating by wave-like contractions along their bodies, whereas limbed animals, such as vertebrates and arthropods, walk by coordinating the movements of multi-jointed arms and legs. Locomotion in limbed animals involves bending each joint within each arm or leg in a coordinated manner, while also ensuring that the movements of all the limbs are coordinated with each other. In bipeds such as humans, for example, it is critical that one leg is in the stance phase when the other leg is in the swing phase. The rules that govern the coordination of limbs also depend on the gait, so the rules for walking are not the same as the rules for running.

The nervous systems of bipeds and other animals that walk solve these problems by using complex neural circuits that coordinate the firing of the relevant motor neurons. Two general mechanisms are used to coordinate the firing of motor neurons. In one mechanism, local interneurons within the central nervous system coordinate motor neuron activities: in vertebrates these interneurons are found in the spinal cord. A second mechanism, termed proprioception, relies on sensory neurons that report the load and joint angles from the arms and legs back to the central nervous system, and thereby influence the firing of the motor neurons. Remarkably, both of these mechanisms, and also the types of neurons that comprise motor neuron circuits, are conserved from arthropods to vertebrates.

Mendes et al. describe a new approach that can be used to analyze how the fruit fly, D. melanogaster, walks on surfaces. They use a combination of an optical touch sensor and high-speed video imaging to follow the body of the fly as it walks, and also to record when and where it places each of its six feet on the surface as it moves. Then, using a software package called FlyWalker, they are able to extract a large of number of parameters that can be used to describe locomotion in adult fruit flies with high temporal and spatial resolution. Many of these parameters have never been measured or studied before.

Mendes et al. show that fruit flies do not display the abrupt transitions in gait that are typically observed in vertebrates. However, they do modify their neural circuits depending on their speed: indeed it appears that flies use subtly different neural circuitry for walking at slow, medium and fast speeds. Moreover, when genetic methods are used to block sensory feedback, the fly is still able to walk, albeit with reduced coordination and precision. Further, the data suggest that proprioception is less important when flies walk faster compared to when they walk more slowly. The next step in this research will be to combine this new method for analyzing locomotion in flies with the wide range of genetic tools that are available for the study of Drosophila: this will allow researchers to explore in greater detail the components of the motor neuron circuitry and their role in coordinated walking.

DOI:http://dx.doi.org/10.7554/eLife.00231.002

Bio-inspired step-climbing in a hexapod robot

Inspired by the observation that the cockroach changes from a tripod gait to a different gait for climbing high steps, we report on the design and implementation of a novel, fully autonomous step-climbing maneuver, which enables a RHex-style hexapod robot to reliably climb a step up to 230% higher than the length of its leg. Similar to the climbing strategy most used by cockroaches, the proposed maneuver is composed of two stages. The first stage is the 'rearing stage,' inclining the body so the front side of the body is raised and it is easier for the front legs to catch the top of the step, followed by the 'rising stage,' maneuvering the body's center of mass to the top of the step. Two infrared range sensors are installed on the front of the robot to detect the presence of the step and its orientation relative to the robot's heading, so that the robot can perform automatic gait transition, from walking to step-climbing, as well as correct its initial tilt approaching posture. An inclinometer is utilized to measure body inclination and to compute step height, thus enabling the robot to adjust its gait automatically, in real time, and to climb steps of different heights and depths successfully. The algorithm is applicable for the robot to climb various rectangular obstacles, including a narrow bar, a bar and a step (i.e. a bar of infinite width). The performance of the algorithm is evaluated experimentally, and the comparison of climbing strategies and climbing behaviors in biological and robotic systems is discussed.

Shifts in a single muscle's control potential of body dynamics are determined by mechanical feedback

Muscles are multi-functional structures that interface neural and mechanical systems. Muscle work depends on a large multi-dimensional space of stimulus (neural) and strain (mechanical) parameters. In our companion paper, we rewrote activation to individual muscles in intact, behaving cockroaches (Blaberus discoidalis L.), revealing a specific muscle's potential to control body dynamics in different behaviours. Here, we use those results to provide the biologically relevant parameters for in situ work measurements. We test four hypotheses about how muscle function changes to provide mechanisms for the observed control responses. Under isometric conditions, a graded increase in muscle stress underlies its linear actuation during standing behaviours. Despite typically absorbing energy, this muscle can recruit two separate periods of positive work when controlling running. This functional change arises from mechanical feedback filtering a linear increase in neural activation into nonlinear work output. Changing activation phase again led to positive work recruitment, but at different times, consistent with the muscle's ability to also produce a turn. Changes in muscle work required considering the natural sequence of strides and separating swing and stance contributions of work. Both in vivo control potentials and in situ work loops were necessary to discover the neuromechanical coupling enabling control.

Activity Patterns and Timing of Muscle Activity in the Forward Walking and Backward Walking Stick Insect Carausius morosus

Understanding how animals control locomotion in different behaviors requires understanding both the kinematics of leg movements and the neural activity underlying these movements. Stick insect leg kinematics differ in forward and backward walking. Describing leg muscle activity in these behaviors is a first step toward understanding the neuronal basis for these differences. We report here the phasing of EMG activities and latencies of first spikes relative to precise electrical measurements of middle leg tarsus touchdown and liftoff of three pairs ( protractor/retractor coxae, levator/depressor trochanteris, extensor/flexor tibiae) of stick insect middle leg antagonistic muscles that play central roles in generating leg movements during forward and backward straight walking. Forward walking stance phase muscle (depressor, flexor, and retractor) activities were tightly coupled to touchdown, beginning on average 93 ms prior to and 9 and 35 ms after touchdown, respectively. Forward walking swing phase muscle (levator, extensor, and protractor) activities were less tightly coupled to liftoff, beginning on average 100, 67, and 37 ms before liftoff, respectively. In backward walking the protractor/retractor muscles reversed their phasing compared with forward walking, with the retractor being active during swing and the protractor during stance. Comparison of intact animal and reduced two- and one-middle-leg preparations during forward straight walking showed only small alterations in overall EMG activity but changes in first spike latencies in most muscles. Changing body height, most likely due to changes in leg joint loading, altered the intensity, but not the timing, of depressor muscle activity.

Electrolytic lesions within central complex neuropils of the cockroach brain affect negotiation of barriers

Animals must negotiate obstacles in their path in order to successfully function within natural environments. These actions require transitions from walking to other behaviors, many of which are more involved than simple reflexes. For these behaviors to be successful, insects must evaluate objects in their path and then use that information to change posture or re-direct leg movements. Some of this control may occur within a region of the brain known as the central complex (CC). We used discrete electrolytic lesions to examine the role of certain sub-regions of the CC in various obstacle negotiation behaviors. We found that cockroaches with lesions to the protocerebral bridge (PB) and ellipsoid body (EB) exhibit abnormalities in turning and dealing with shelf-like objects; whereas, individuals with lesions to the fan-shaped body (FB) and lateral accessory lobe (LAL), exhibit abnormalities of those behaviors as well as climbing over blocks and up walls to a horizontal plane. Abnormalities in block climbing include decreased success rate, changes in climbing strategy, and delayed response to the block. Increases in these abnormal behaviors were significant in individuals with lesions to the FB and LAL. Although turning abnormalities are present in individuals with lesions to the LAL, EB and the lateral region of the FB, there are some differences in how these deficits present. For instance, the turning deficits seen in individuals with lateral FB lesions only occurred when turning in the direction opposite to the side of the brain on which the lesion occurred. By contrast, individuals with lesions to the EB and LAL exhibited turning abnormalities in both directions. Lesions in the medial region of the FB did not result in directional turning deficits, but in abnormalities in block climbing.

The conservation-refugium value of small and disturbed Brazilian Atlantic forest fragments for the endemic ovoviviparous cockroach Monastria biguttata (Insecta: Dictyoptera, Blaberidae, Blaberinae)

The Brazilian Atlantic forest is a biodiversity hotspot and harbors many endemic species showing peculiar and unique traits. However, it has been reduced to less than 8% of its original surface and is distributed in scattered fragments, the great majority of which are smaller than 20 hectares and very disturbed, making it worth asking about their value for conservation. In this paper we assess the refugium value of small fragments to the conservation of one of the endemics of the Atlantic forest, the ovoviviparous cockroach Monastria biguttata. Our results showed that this species was ubiquitous in large and small forest fragments, but never present in plantations or pastures. The population age structure and sex ratio were balanced in every fragment, and total population size in the smallest fragments was at least several hundreds of individuals. Colony size, sex ratio, age structure, and density per piece of dead tree trunk indicated that populations from small fragments were not unbalanced or at risk of extinction. According to the analysis of resource availability, small fragments can provide suitable habitat for this species. In this situation, even very small forest fragments have a high refugium value for some endemic insect species. Considering their number in the landscape, these fragments should be considered with more attention in strategies of biodiversity conservation.

Neuromechanical response of musculo-skeletal structures in cockroaches during rapid running on rough terrain

A musculo-skeletal structure can stabilize rapid locomotion using neural and/or mechanical feedback. Neural feedback results in an altered feedforward activation pattern, whereas mechanical feedback using visco-elastic structures does not require a change in the neural motor code. We selected musculo-skeletal structures in the cockroach (Blaberus discoidalis)because their single motor neuron innervation allows the simplest possible characterization of activation. We ran cockroaches over a track with randomized blocks of heights up to three times the animal's `hip' (1.5 cm),while recording muscle action potentials (MAPs) from a set of putative control musculo-skeletal structures (femoral extensors 178 and 179). Animals experienced significant perturbations in body pitch, roll and yaw, but reduced speed by less than 20%. Surprisingly, we discovered no significant difference in the distribution of the number of MAPs, the interspike interval, burst phase or interburst period between flat and rough terrain trials. During a few very large perturbations or when a single leg failed to make contact throughout stance, neural feedback was detectable as a phase shift of the central rhythm and alteration of MAP number. System level responses of appendages were consistent with a dominant role of mechanical feedback. Duty factors and gait phases did not change for cockroaches running on flat versus rough terrain. Cockroaches did not use a follow-the-leader gait requiring compensatory corrections on a step-by-step basis. Arthropods appear to simplify control on rough terrain by rapid running that uses kinetic energy to bridge gaps between footholds and distributed mechanical feedback to stabilize the body.

Distributed mechanical feedback in arthropods and robots simplifies control of rapid running on challenging terrain

Terrestrial arthropods negotiate demanding terrain more effectively than any search-and-rescue robot. Slow, precise stepping using distributed neural feedback is one strategy for dealing with challenging terrain. Alternatively, arthropods could simplify control on demanding surfaces by rapid running that uses kinetic energy to bridge gaps between footholds. We demonstrate that this is achieved using distributed mechanical feedback, resulting from passive contacts along legs positioned by pre-programmed trajectories favorable to their attachment mechanisms. We used wire-mesh experimental surfaces to determine how a decrease in foothold probability affects speed and stability. Spiders and insects attained high running speeds on simulated terrain with 90% of the surface contact area removed. Cockroaches maintained high speeds even with their tarsi ablated, by generating horizontally oriented leg trajectories. Spiders with more vertically directed leg placement used leg spines, which resulted in more effective distributed contact by interlocking with asperities during leg extension, but collapsing during flexion, preventing entanglement. Ghost crabs, which naturally lack leg spines, showed increased mobility on wire mesh after the addition of artificial, collapsible spines. A bioinspired robot, RHex, was redesigned to maximize effective distributed leg contact, by changing leg orientation and adding directional spines. These changes improved RHex's agility on challenging surfaces without adding sensors or changing the control system.

Dynamics of rapid vertical climbing in cockroaches reveals a template

Rapid, vertically climbing cockroaches produced climbing dynamics similar to geckos, despite differences in attachment mechanism, `foot or toe'morphology and leg number. Given the common pattern in such diverse species,we propose the first template for the dynamics of rapid, legged climbing analogous to the spring-loaded, inverted pendulum used to characterize level running in a diversity of pedestrians. We measured single leg wall reaction forces and center of mass dynamics in death-head cockroaches Blaberus discoidalis, as they ascended a three-axis force plate oriented vertically and coated with glass beads to aid attachment. Cockroaches used an alternating tripod gait during climbs at 19.5±4.2 cm s-1,approximately 5 body lengths s-1. Single-leg force patterns differed significantly from level running. During vertical climbing, all legs generated forces to pull the animal up the plate. Front and middle legs pulled laterally toward the midline. Front legs pulled the head toward the wall,while hind legs pushed the abdomen away. These single-leg force patterns summed to generate dynamics of the whole animal in the frontal plane such that the center of mass cyclically accelerated up the wall in synchrony with cyclical side-to-side motion that resulted from alternating net lateral pulling forces. The general force patterns used by cockroaches and geckos have provided biological inspiration for the design of a climbing robot named RiSE(Robots in Scansorial Environments).

Common motor mechanisms support body load in serially homologous legs of cockroaches in posture and walking

We studied the mechanisms underlying support of body load in posture and walking in serially homologous legs of cockroaches. Activities of the trochanteral extensor muscle in the front or middle legs were recorded neurographically while animals were videotaped. Body load was increased via magnets attached to the thorax and varied through a coil below the substrate. In posture, tonic firing of the slow trochanteral extensor motoneuron (Ds) in each leg was strongly modulated by changing body load. Rapid load increases produced decreases in body height and sharp increments in extensor firing. The peak of extensor activity more closely approximated the maximum velocity of body displacement than the body position. In walking, extensor bursts in front and middle legs were initiated during swing and continued into the stance phase. Moderate tonic increases in body load elicited similar, specific, phase dependent changes in both legs: extensor firing was not altered in swing but was higher after foot placement in stance. These motor adjustments to load are not anticipatory but apparently depend upon sensory feedback. These data are consistent with previous findings in the hind legs and support the idea that body load is countered by common motor mechanisms in serially homologous legs.

Kinematics and motor activity during tethered walking and turning in the cockroach, Blaberus discoidalis

When insects turn from walking straight, their legs have to follow different motor patterns. In order to examine such pattern change precisely, we stimulated single antenna of an insect, thereby initiating its turning behavior, tethered over a lightly oiled glass plate. The resulting behavior included asymmetrical movements of prothoracic and mesothoracic legs. The mesothoracic leg on the inside of the turn (in the apparent direction of turning) extended the coxa-trochanter and femur-tibia joints during swing rather than during stance as in walking, while the outside mesothoracic leg kept a slow walking pattern. Electromyograms in mesothoracic legs revealed consistent changes in the motor neuron activity controlling extension of the coxa-trochanter and femur-tibia joints. In tethered walking, depressor trochanter activity consistently preceded slow extensor tibia activity. This pattern was reversed in the inside mesothoracic leg during turning. Also for turning, extensor and depressor motor neurons of the inside legs were activated in swing phase instead of stance. Turning was also examined in free ranging animals. Although more variable, some trials resembled the pattern generated by tethered animals. The distinct inter-joint and inter-leg coordination between tethered turning and walking, therefore, provides a good model to further study the neural control of changing locomotion patterns.

Insights into age-related locomotor declines from studies of insects

Locomotor deficits frequently accompany aging in animals. These deficits are often caused by degeneration in the nervous and musculoskeletal systems. Insects are an excellent model for age-related behavior studies because they are short-lived and have a reduced nervous system with fewer cells than vertebrates. Furthermore, they are highly mobile and display a complex set of locomotor behaviors. This review presents research that has examined age-related locomotor deficits in insects and discusses the value of these studies to understand aging processes in all animals.

Descending control of body attitude in the cockroach Blaberus discoidalis and its role in incline climbing

Unlike intact animals, cockroaches with bilateral circumoesophageal connective lesions have difficulty climbing up smooth inclines. Typically, they slipped badly or even fell over backward before traveling more than 1.5 body lengths up the incline. The major problem involves increased slippage of the front and sometimes middle legs. Periods of front leg slipping are correlated with excess body elevation that pushes the height of the head to 11 mm above the substrate. Intact animals control body attitude very well on the incline, only rarely rearing above 11 mm. Cockroaches with bilateral circumoesophageal connective lesions spend considerable time above this critical amplitude and slipping increases with amplitude above that value. We conclude that circumoesophageal lesion compromises the insect's ability to control body attitude on the incline and this deficit contributes to the inability of lesioned cockroaches to climb steep inclines. A separate body attitude deficit was noted on steps. Upon climbing to the top of a barrier, intact animals bend their body between the first and second thoracic segments. This action maintains good leg mechanics throughout the climb. Cockroaches with bilateral circumoesophageal connective lesions fail to perform this downward flexion. A beneficial role for similar body flexion in simple robots is described in the Discussion.

Convergent evolution and locomotion through complex terrain by insects, vertebrates and robots

Arthropods are the most successful members of the animal kingdom largely because of their ability to move efficiently through a range of environments. Their agility has not been lost on engineers seeking to design agile legged robots. However, one cannot simply copy mechanical and neural control systems from insects into robotic designs. Rather one has to select the properties that are critical for specific behaviors that the engineer wants to capture in a particular robot. Convergent evolution provides an important clue to the properties of legged locomotion that are critical for success. Arthropods and vertebrates evolved legged locomotion independently. Nevertheless, many neural control properties and mechanical schemes are remarkably similar. Here we describe three aspects of legged locomotion that are found in both insects and vertebrates and that provide enhancements to legged robots. They are leg specialization, body flexion and the development of a complex head structure. Although these properties are commonly seen in legged animals, most robotic vehicles have similar legs throughout, rigid bodies and rudimentary sensors on what would be considered the head region. We describe these convergent properties in the context of robots that we developed to capture the agility of insects in moving through complex terrain.

Load sensing and control of posture and locomotion

This article reviews recent findings on how forces are detected by sense organs of insect legs and how this information is integrated in control of posture and walking. These experiments have focused upon campaniform sensilla, receptors that detect forces as strains in the exoskeleton, and include studies of sensory discharges in freely moving animals and intracellular characterization of connectivity of afferent inputs in the central nervous system. These findings provide insights into how campaniform sensilla can contribute to the adjustment of motor outputs to changes in load. In this review we discuss (1) anatomy of the receptors and their activities in freely moving insects, (2) mechanisms by which inputs are incorporated into motor outputs and (3) the integration of sensory signals of diverse modalities. The discharges of some groups of receptors can encode body load when standing. Responses are also correlated with muscle-generated forces during specific times in walking. These activities can enhance motor outputs through reflexes and can affect the timing of motoneuron firing through inputs to pattern generating interneurons. Flexibility in the system is also provided by interactions of afferent inputs at several levels. These mechanisms can contribute to the adaptability of insect locomotion to diverse terrains and environments.

Walking on a 'peg leg': extensor muscle activities and sensory feedback after distal leg denervation in cockroaches

Previous studies in insects demonstrated that leg coordination changes following complete ablation of distal limb segments. However, normal coordination was restored when small 'peg leg' prostheses were attached to leg stumps to permit substrate contact. We have adapted this paradigm to preserve appropriate leg mass and inertia by severing all nerves and muscle tendons in the femur of the cockroach hind leg and converting the animal's own limb into a peg leg. Recordings of muscle activities and leg movements before and after denervation showed that: (1) the 'peg leg' is actively used in walking and regular bursts occur in motoneurons to leg extensor muscles; (2) driving of motoneuron activity is sufficient to produce 'fictive' bursting in a muscle whose tendon (apodeme) is cut in the ablation; and (3) similar motoneuron activities are found in walking on an oiled glass surface, when the effects of body weight and mechanical coupling are minimized. When distal segments were completely severed in these preparations, leg use and muscle bursting were disrupted but could be restored if the stumps were pressed against the substrate. These results support the hypothesis that feedback from receptors in proximal leg segments indicating forces allows for active leg use in walking.