Route-following ants respond to alterations of the view sequence

Foraging trail traffic rules: a new study method of trajectories of the harvester ants

Harvester ants are one of the most extensively studied groups of ants, especially the group foraging ants, Messor barbarus (Linnaeus, 1767), which construct long-lasting trunk trails. Limited laboratory investigations have delved into head-on encounters along foraging trails involving workers moving in opposing directions, with fewer corresponding studies conducted in the natural environment. To address this gap, we devised an in-field experimental design to induce lane segregation on the foraging trunk trail of M. barbarus. Using an image-based tracking method, we analyzed the foraging behavior of this species to assess the costs associated with head-on encounters and to figure out the natural coexistence of outgoing and returning workers on a bidirectional route. Our results consistently reveal heightened straightness and speed in unidirectional test lanes, accompanied by an elevated foraging rate compared to bidirectional lanes. This suggests a potential impact of head-on collisions on foraging behavior, especially on foraging efficiency. Additionally, Kinematic analysis revealed distinct movement patterns between outbound and inbound flows, particularly low speed and sinuous trajectories of inbounding unladen workers. The study of encounter rates in two traffic systems hints at the plausible utilization of individual memory by workers within trails, underscoring the pivotal role of encounters in information exchange and load transfer.

Adaptive Route Memory Sequences for Insect-Inspired Visual Route Navigation

Visual navigation is a key capability for robots and animals. Inspired by the navigational prowess of social insects, a family of insect-inspired route navigation algorithms-familiarity-based algorithms-have been developed that use stored panoramic images collected during a training route to subsequently derive directional information during route recapitulation. However, unlike the ants that inspire them, these algorithms ignore the sequence in which the training images are acquired so that all temporal information/correlation is lost. In this paper, the benefits of incorporating sequence information in familiarity-based algorithms are tested. To do this, instead of comparing a test view to all the training route images, a window of memories is used to restrict the number of comparisons that need to be made. As ants are able to visually navigate when odometric information is removed, the window position is updated via visual matching information only and not odometry. The performance of an algorithm without sequence information is compared to the performance of window methods with different fixed lengths as well as a method that adapts the window size dynamically. All algorithms were benchmarked on a simulation of an environment used for ant navigation experiments and showed that sequence information can boost performance and reduce computation. A detailed analysis of successes and failures highlights the interaction between the length of the route memory sequence and environment type and shows the benefits of an adaptive method.

Ants integrate proprioception as well as visual context and efference copies to make robust predictions

Forward models are mechanisms enabling an agent to predict the sensory outcomes of its actions. They can be implemented through efference copies: copies of motor signals inhibiting the expected sensory stimulation, literally canceling the perceptual outcome of the predicted action. In insects, efference copies are known to modulate optic flow detection for flight control in flies. Here we investigate whether forward models account for the detection of optic flow in walking ants, and how the latter is integrated for locomotion control. We mounted Cataglyphis velox ants in a virtual reality setup and manipulated the relationship between the ants' movements and the optic flow perceived. Our results show that ants compute predictions of the optic flow expected according to their own movements. However, the prediction is not solely based on efference copies, but involves proprioceptive feedbacks and is fine-tuned by the panorama's visual structure. Mismatches between prediction and perception are computed for each eye, and error signals are integrated to adjust locomotion through the modulation of internal oscillators. Our work reveals that insects' forward models are non-trivial and compute predictions based on multimodal information.

Investigating visual navigation using spiking neural network models of the insect mushroom bodies

Ants are capable of learning long visually guided foraging routes with limited neural resources. The visual scene memory needed for this behaviour is mediated by the mushroom bodies; an insect brain region important for learning and memory. In a visual navigation context, the mushroom bodies are theorised to act as familiarity detectors, guiding ants to views that are similar to those previously learned when first travelling along a foraging route. Evidence from behavioural experiments, computational studies and brain lesions all support this idea. Here we further investigate the role of mushroom bodies in visual navigation with a spiking neural network model learning complex natural scenes. By implementing these networks in GeNN-a library for building GPU accelerated spiking neural networks-we were able to test these models offline on an image database representing navigation through a complex outdoor natural environment, and also online embodied on a robot. The mushroom body model successfully learnt a large series of visual scenes (400 scenes corresponding to a 27 m route) and used these memories to choose accurate heading directions during route recapitulation in both complex environments. Through analysing our model's Kenyon cell (KC) activity, we were able to demonstrate that KC activity is directly related to the respective novelty of input images. Through conducting a parameter search we found that there is a non-linear dependence between optimal KC to visual projection neuron (VPN) connection sparsity and the length of time the model is presented with an image stimulus. The parameter search also showed training the model on lower proportions of a route generally produced better accuracy when testing on the entire route. We embodied the mushroom body model and comparator visual navigation algorithms on a Quanser Q-car robot with all processing running on an Nvidia Jetson TX2. On a 6.5 m route, the mushroom body model had a mean distance to training route (error) of 0.144 ± 0.088 m over 5 trials, which was performance comparable to standard visual-only navigation algorithms. Thus, we have demonstrated that a biologically plausible model of the ant mushroom body can navigate complex environments both in simulation and the real world. Understanding the neural basis of this behaviour will provide insight into how neural circuits are tuned to rapidly learn behaviourally relevant information from complex environments and provide inspiration for creating bio-mimetic computer/robotic systems that can learn rapidly with low energy requirements.

Directed retreat and navigational mechanisms in trail following Formica obscuripes

Ant species exhibit behavioural commonalities when solving navigational challenges for successful orientation and to reach goal locations. These behaviours rely on a shared toolbox of navigational strategies that guide individuals under an array of motivational contexts. The mechanisms that support these behaviours, however, are tuned to each species' habitat and ecology with some exhibiting unique navigational behaviours. This leads to clear differences in how ant navigators rely on this shared toolbox to reach goals. Species with hybrid foraging structures, which navigate partially upon a pheromone-marked column, express distinct differences in their toolbox, compared to solitary foragers. Here, we explore the navigational abilities of the Western Thatching ant (Formica obscuripes), a hybrid foraging species whose navigational mechanisms have not been studied. We characterise their reliance on both the visual panorama and a path integrator for orientation, with the pheromone's presence acting as a non-directional reassurance cue, promoting continued orientation based on other strategies. This species also displays backtracking behaviour, which occurs with a combination of unfamiliar terrestrial cues and the absence of the pheromone, thus operating based upon a combination of the individual mechanisms observed in solitarily and socially foraging species. We also characterise a new form of goalless orientation in these ants, an initial retreating behaviour that is modulated by the forager's path integration system. The behaviour directs disturbed inbound foragers back along their outbound path for a short distance before recovering and reorienting back to the nest.

Neuromorphic sequence learning with an event camera on routes through vegetation

For many robotics applications, it is desirable to have relatively low-power and efficient onboard solutions. We took inspiration from insects, such as ants, that are capable of learning and following routes in complex natural environments using relatively constrained sensory and neural systems. Such capabilities are particularly relevant to applications such as agricultural robotics, where visual navigation through dense vegetation remains a challenging task. In this scenario, a route is likely to have high self-similarity and be subject to changing lighting conditions and motion over uneven terrain, and the effects of wind on leaves increase the variability of the input. We used a bioinspired event camera on a terrestrial robot to collect visual sequences along routes in natural outdoor environments and applied a neural algorithm for spatiotemporal memory that is closely based on a known neural circuit in the insect brain. We show that this method is plausible to support route recognition for visual navigation and more robust than SeqSLAM when evaluated on repeated runs on the same route or routes with small lateral offsets. By encoding memory in a spiking neural network running on a neuromorphic computer, our model can evaluate visual familiarity in real time from event camera footage.

Varieties of visual navigation in insects

The behaviours and cognitive mechanisms animals use to orient, navigate, and remember spatial locations exemplify how cognitive abilities have evolved to suit a number of different mobile lifestyles and habitats. While spatial cognition observed in vertebrates has been well characterised in recent decades, of no less interest are the great strides that have also been made in characterizing and understanding the behavioural and cognitive basis of orientation and navigation in invertebrate models and in particular insects. Insects are known to exhibit remarkable spatial cognitive abilities and are able to successfully migrate over long distances or pinpoint known locations relying on multiple navigational strategies similar to those found in vertebrate models-all while operating under the constraint of relatively limited neural architectures. Insect orientation and navigation systems are often tailored to each species' ecology, yet common mechanistic principles can be observed repeatedly. Of these, reliance on visual cues is observed across a wide number of insect groups. In this review, we characterise some of the behavioural strategies used by insects to solve navigational problems, including orientation over short-distances, migratory heading maintenance over long distances, and homing behaviours to known locations. We describe behavioural research using examples from a few well-studied insect species to illustrate how visual cues are used in navigation and how they interact with non-visual cues and strategies.

Aversive view memories and risk perception in navigating ants

Many ants establish foraging routes through learning views of the visual panorama. Route models have focused primarily on attractive view use, which experienced foragers orient towards to return to known sites. However, aversive views have recently been uncovered as a key component of route learning. Here, Cataglyphis velox rapidly learned aversive views, when associated with a negative outcome, a period of captivity in vegetation, triggering increases in hesitation behavior. These memories were based on the accumulation of experiences over multiple trips with each new experience regulating forager hesitancy. Foragers were also sensitive to captivity time differences, suggesting they possess some mechanism to quantify duration. Finally, we analyzed foragers' perception of risky (i.e. variable) versus stable aversive outcomes by associating two sites along the route with distinct captivity schedules, a fixed or variable duration, with the same mean across training. Foragers exhibited fewer hesitations in response to risky outcomes compared to fixed ones, indicating they perceived risky outcomes as less severe. Results align with a logarithmic relationship between captivity duration and hesitations, suggesting that aversive stimulus perception is a logarithm of its actual value. We discuss how aversive view learning could be executed within the mushroom bodies circuitry following a prediction error rule.

The routes of one-eyed ants suggest a revised model of normal route following

The prevailing account of visually controlled routes is that an ant learns views as it follows a route, while guided by other path-setting mechanisms. Once a set of route views is memorised, the insect follows the route by turning and moving forwards when the view on the retina matches a stored view. We engineered a situation in which this account cannot suffice in order to discover whether there may be additional components to the performance of routes. One-eyed wood ants were trained to navigate a short route in the laboratory, guided by a single black, vertical bar placed in the blinded visual field. Ants thus had to turn away from the route to see the bar. They often turned to look at or beyond the bar and then turned to face in the direction of the goal. Tests in which the bar was shifted to be more peripheral or more frontal than in training produced a corresponding directional change in the ants' paths, demonstrating that they were guided by the bar. Examination of the endpoints of turns towards and away from the bar indicate that ants use the bar for guidance by learning how large a turn-back is needed to face the goal. We suggest that the ants' zigzag paths are, in part, controlled by turns of a learnt amplitude and that these turns are an integral component of visually guided route following.

Looking down: a model for visual route following in flying insects

Insect visual navigation is often assumed to depend on panoramic views of the horizon, and how these change as the animal moves. However, it is known that honey bees can visually navigate in flat, open meadows where visual information at the horizon is minimal, or would remain relatively constant across a wide range of positions. In this paper we hypothesise that these animals can navigate using view memories of the ground. We find that in natural scenes, low resolution views from an aerial perspective of ostensibly self-similar terrain (e.g. within a field of grass) provide surprisingly robust descriptors of precise spatial locations. We propose a new visual route following approach that makes use of transverse oscillations to centre a flight path along a sequence of learned views of the ground. We deploy this model on an autonomous quadcopter and demonstrate that it provides robust performance in the real world on journeys of up to 30 m. The success of our method is contingent on a robust view matching process which can evaluate the familiarity of a view with a degree of translational invariance. We show that a previously developed wavelet based bandpass orientated filter approach fits these requirements well, exhibiting double the catchment area of standard approaches. Using a realistic simulation package, we evaluate the robustness of our approach to variations in heading direction and aircraft height between inbound and outbound journeys. We also demonstrate that our approach can operate using a vision system with a biologically relevant visual acuity and viewing direction.