Three-dimensional models of natural environments and the mapping of navigational information

The relevance of goal directed movement for insect pest control

Efficient locomotion is a fundamental feature and requisite of all insects. Some insects, such as mosquito larvae, travel just a few centimetres, whereas others, such as Bogong moths, migrate over several hundreds of kilometers. Some insects traverse in air, others in water and some on ground. For goal-directed movement, irrespective of body size, the scale at which insects move, or the medium in which they travel, the principles of navigation remain the same. In this article, we discuss some of the visual navigational tasks that insects carry out and highlight the recent techniques developed to reconstruct visual information and track animals with exceptional accuracy. We emphasise the need to understand the visual ecology of insects and to adopt tracking tools and methods to control the movement and spread of insect pests.

Coming home: how visually navigating ants (Myrmecia spp.) pinpoint their nest

Visually navigating Myrmecia foragers approach their nest from distances up to 25 m along well-directed paths, even from locations they have never been before ( Narendra et al., 2013). However, close to the nest, they often spend some time pinpointing the nest entrance, sometimes missing it by centimetres. Here, I investigated what guides homing ants in their attempt to pinpoint the nest entrance. As the ants approach the nest, their behaviour changes. At approximately 1 m from the nest, the ants slow down, their scanning amplitude becomes larger and their path direction changes more frequently. This change in scanning behaviour is not triggered by local olfactory, tactile or visual cues because ants tethered on a trackball 30-50 cm above ground also exhibit it at 0.6 m compared with 1.6 m distance from the nest. Moreover, the ants are able to pinpoint the nest when such local cues are removed by covering the ground around the nest or the nest entrance itself. Myrmecia ants thus rely on information from the global panorama when pinpointing the nest. During learning walks, these ants appear to systematically collect views directed toward and away from the nest ( Jayatilaka et al., 2018). Homing ants indeed change gaze and body axis direction appropriately with a delay when encountering views to the left or to the right of the nest. However, image analysis shows that close to the nest, opponent views with the same orientation become too similar, explaining the growing uncertainty reflected in the ants' increased scanning behaviour during homing.

Heliconius butterflies use wide-field landscape features, but not individual local landmarks, during spatial learning

Spatial learning is vital in foraging ecology. Many hymenopteran insects are adept spatial foragers that rely on visual cues contained within broader wide-field scenes for central place foraging from a central nest. By contrast, for butterflies, which lack central nest sites, visual cue use during spatial foraging is less understood. Heliconius butterflies, however, exhibit stable nocturnal roosts, strong site fidelity and a sophisticated capacity for spatial navigation. This study furthers our understanding of Heliconius spatial learning by testing whether H. erato can associate a spatially informative visual cue with artificial feeders. We explored the relative importance of a visual local landmark compared with broader, wide-field visual cues, through experiments with (i) a fixed rewarded feeder with a local landmark; (ii) a mobile rewarded feeder with the landmark as the sole reliable cue; (iii) the same setup while blocking visual access to external landscape features. Our data suggest that Heliconius butterflies learn static feeder locations without relying on a local individual landmark. Instead, we suggest they integrate broader landscape and celestial cues. This suggests that Heliconius butterflies and central place foraging hymenopterans likely share similar visual navigation strategies, using wide-field, low-resolution views rather than focusing on specific individual landmarks.

Through Hawks’ Eyes: Synthetically Reconstructing the Visual Field of a Bird in Flight

Birds of prey rely on vision to execute flight manoeuvres that are key to their survival, such as intercepting fast-moving targets or navigating through clutter. A better understanding of the role played by vision during these manoeuvres is not only relevant within the field of animal behaviour, but could also have applications for autonomous drones. In this paper, we present a novel method that uses computer vision tools to analyse the role of active vision in bird flight, and demonstrate its use to answer behavioural questions. Combining motion capture data from Harris’ hawks with a hybrid 3D model of the environment, we render RGB images, semantic maps, depth information and optic flow outputs that characterise the visual experience of the bird in flight. In contrast with previous approaches, our method allows us to consider different camera models and alternative gaze strategies for the purposes of hypothesis testing, allows us to consider visual input over the complete visual field of the bird, and is not limited by the technical specifications and performance of a head-mounted camera light enough to attach to a bird’s head in flight. We present pilot data from three sample flights: a pursuit flight, in which a hawk intercepts a moving target, and two obstacle avoidance flights. With this approach, we provide a reproducible method that facilitates the collection of large volumes of data across many individuals, opening up new avenues for data-driven models of animal behaviour.

Visual navigation: properties, acquisition and use of views

Panoramic views offer information on heading direction and on location to visually navigating animals. This review covers the properties of panoramic views and the information they provide to navigating animals, irrespective of image representation. Heading direction can be retrieved by alignment matching between memorized and currently experienced views, and a gradient descent in image differences can lead back to the location at which a view was memorized (positional image matching). Central place foraging insects, such as ants, bees and wasps, conduct distinctly choreographed learning walks and learning flights upon first leaving their nest that are likely to be designed to systematically collect scene memories tagged with information provided by path integration on the direction of and the distance to the nest. Equally, traveling along routes, ants have been shown to engage in scanning movements, in particular when routes are unfamiliar, again suggesting a systematic process of acquiring and comparing views. The review discusses what we know and do not know about how view memories are represented in the brain of insects, how they are acquired and how they are subsequently used for traveling along routes and for pinpointing places.

Looking down: a model for visual route following in flying insects

Insect visual navigation is often assumed to depend on panoramic views of the horizon, and how these change as the animal moves. However, it is known that honey bees can visually navigate in flat, open meadows where visual information at the horizon is minimal, or would remain relatively constant across a wide range of positions. In this paper we hypothesise that these animals can navigate using view memories of the ground. We find that in natural scenes, low resolution views from an aerial perspective of ostensibly self-similar terrain (e.g. within a field of grass) provide surprisingly robust descriptors of precise spatial locations. We propose a new visual route following approach that makes use of transverse oscillations to centre a flight path along a sequence of learned views of the ground. We deploy this model on an autonomous quadcopter and demonstrate that it provides robust performance in the real world on journeys of up to 30 m. The success of our method is contingent on a robust view matching process which can evaluate the familiarity of a view with a degree of translational invariance. We show that a previously developed wavelet based bandpass orientated filter approach fits these requirements well, exhibiting double the catchment area of standard approaches. Using a realistic simulation package, we evaluate the robustness of our approach to variations in heading direction and aircraft height between inbound and outbound journeys. We also demonstrate that our approach can operate using a vision system with a biologically relevant visual acuity and viewing direction.

Movements, embodiment and the emergence of decisions. Insights from insect navigation

We readily infer that animals make decisions, but what this implies is usually not clearly defined. The notion of 'decision-making' ultimately stems from human introspection, and is thus loaded with anthropomorphic assumptions. Notably, the decision is made internally, is based on information, and precedes the goal directed behaviour. Also, making a decision implies that 'something' did it, thus hints at the presence of a cognitive mind, whose existence is independent of the decision itself. This view may convey some truth, but here I take the opposite stance. Using examples from research in insect navigation, this essay highlights how apparent decisions can emerge without a brain, how actions can precede information or how sophisticated goal directed behaviours can be implemented without neural decisions. This perspective requires us to shake off the idea that behaviour is a consequence of the brain; and embrace the concept that movements arise from - as much as participate in - distributed interactions between various computational centres - including the body - that reverberate in closed-loop with the environment. From this perspective we may start to picture how a cognitive mind can be the consequence, rather than the cause, of such neural and body movements.

Many paths, one destination: mapping the movements of a kleptoparasitic spider on the host's web

Kleptoparasitic spiders live and forage in the webs of other spiders. Using vibratory cues generated by the host spider during prey capture, they leave their resting positions in the upper peripheries of the host web and move towards the centre of the web where they feed along with the host spider or steal small pieces of prey. While the triggers for initiating the foraging raids are known, there is little information about the fine-scale trajectory dynamics in this model system. We mapped the movement of the kleptoparasite Argyrodes elevatus in the web of the host Trichonephila clavipes. We filmed the movement of the kleptoparasite spiders and quantified the trajectory shape, speed, heading directions and path revisitation. Our results show that kleptoparasitic spider movement is spatially structured, with higher levels of speed at the peripheries and slower in the centre of the web. We found a high level of variation in trajectory shapes between individuals. We found that the majority of heading orientations were away from the hub suggesting that detouring or repeated approaches are an essential component of kleptoparasite movement strategies. Our results of the revisitation rate also confirm this pattern, where locations close to the hub were revisited more often than in the periphery. The kleptoparasite-host spider system is a promising model to study fine-scale movement patterns in small bounded spaces.

The Antarium: A Reconstructed Visual Reality Device for Ant Navigation Research

We constructed a large projection device (the Antarium) with 20,000 UV-Blue-Green LEDs that allows us to present tethered ants with views of their natural foraging environment. The ants walk on an air-cushioned trackball, their movements are registered and can be fed back to the visual panorama. Views are generated in a 3D model of the ants’ environment so that they experience the changing visual world in the same way as they do when foraging naturally. The Antarium is a biscribed pentakis dodecahedron with 55 facets of identical isosceles triangles. The length of the base of the triangles is 368 mm resulting in a device that is roughly 1 m in diameter. Each triangle contains 361 blue/green LEDs and nine UV LEDs. The 55 triangles of the Antarium have 19,855 Green and Blue pixels and 495 UV pixels, covering 360° azimuth and elevation from −50° below the horizon to +90° above the horizon. The angular resolution is 1.5° for Green and Blue LEDs and 6.7° for UV LEDs, offering 65,536 intensity levels at a flicker frequency of more than 9,000 Hz and a framerate of 190 fps. Also, the direction and degree of polarisation of the UV LEDs can be adjusted through polarisers mounted on the axles of rotary actuators. We build 3D models of the natural foraging environment of ants using purely camera-based methods. We reconstruct panoramic scenes at any point within these models, by projecting panoramic images onto six virtual cameras which capture a cube-map of images to be projected by the LEDs of the Antarium. The Antarium is a unique instrument to investigate visual navigation in ants. In an open loop, it allows us to provide ants with familiar and unfamiliar views, with completely featureless visual scenes, or with scenes that are altered in spatial or spectral composition. In closed-loop, we can study the behavior of ants that are virtually displaced within their natural foraging environment. In the future, the Antarium can also be used to investigate the dynamics of navigational guidance and the neurophysiological basis of ant navigation in natural visual environments.

Vision does not impact walking performance in Argentine ants

Many walking insects use vision for long-distance navigation, but the influence of vision on rapid walking performance that requires close-range obstacle detection and directing the limbs towards stable footholds remains largely untested. We compared Argentine ant (Linepithema humile) workers in light versus darkness while traversing flat and uneven terrain. In darkness, ants reduced flat-ground walking speeds by only 5%. Similarly, the approach speed and time to cross a step obstacle were not significantly affected by lack of lighting. To determine whether tactile sensing might compensate for vision loss, we tracked antennal motion and observed shifts in spatiotemporal activity as a result of terrain structure but not illumination. Together, these findings suggest that vision does not impact walking performance in Argentine ant workers. Our results help contextualize eye variation across ants, including subterranean, nocturnal and eyeless species that walk in complete darkness. More broadly, our findings highlight the importance of integrating vision, proprioception and tactile sensing for robust locomotion in unstructured environments.

Spatial cognition in the context of foraging styles and information transfer in ants

Ants are central-place foragers: they always return to the nest, and this requires the ability to remember relationships between features of the environment, or an individual's path through the landscape. The distribution of these cognitive responsibilities within a colony depends on a species' foraging style. Solitary foraging as well as leader-scouting, which is based on information transmission about a distant targets from scouts to foragers, can be considered the most challenging tasks in the context of ants' spatial cognition. Solitary foraging is found in species of almost all subfamilies of ants, whereas leader-scouting has been discovered as yet only in the Formica rufa group of species (red wood ants). Solitary foraging and leader-scouting ant species, although enormously different in their levels of sociality and ecological specificities, have many common traits of individual cognitive navigation, such as the primary use of visual navigation, excellent visual landmark memories, and the subordinate role of odour orientation. In leader-scouting species, spatial cognition and the ability to transfer information about a distant target dramatically differ among scouts and foragers, suggesting individual cognitive specialization. I suggest that the leader-scouting style of recruitment is closely connected with the ecological niche of a defined group of species, in particular, their searching patterns within the tree crown. There is much work to be done to understand what cognitive mechanisms underpin route planning and communication about locations in ants.

Effect of large visual changes on the navigation of the nocturnal bull ant, Myrmecia midas

Nocturnal insects have remarkable visual capacities in dim light. They can navigate using both the surrounding panorama and celestial cues. Individual foraging ants are efficient navigators, able to accurately reach a variety of goal locations. During navigation, foragers compare the current panoramic view to previously learnt views. In this natural experiment, we observed the effects of large panorama changes, the addition of a fence and the removal of several trees near the nest site, on the navigation of the nocturnal bull ant Myrmecia midas. We examined how the ants' navigational efficiency and behaviour changed in response to changes in ~ 30% of the surrounding skyline, following them over multiple nights. Foragers were displaced locally off-route where we collected initial orientations and homing paths both before and after large panorama changes. We found that immediately after these changes, foragers were unable to initially orient correctly to the nest direction and foragers' return paths were less straight, suggesting increased navigational uncertainty. Continued testing showed rapid recovery in both initial orientation and path straightness.

Opponent processes in visual memories: A model of attraction and repulsion in navigating insects' mushroom bodies

Solitary foraging insects display stunning navigational behaviours in visually complex natural environments. Current literature assumes that these insects are mostly driven by attractive visual memories, which are learnt when the insect's gaze is precisely oriented toward the goal direction, typically along its familiar route or towards its nest. That way, an insect could return home by simply moving in the direction that appears most familiar. Here we show using virtual reconstructions of natural environments that this principle suffers from fundamental drawbacks, notably, a given view of the world does not provide information about whether the agent should turn or not to reach its goal. We propose a simple model where the agent continuously compares its current view with both goal and anti-goal visual memories, which are treated as attractive and repulsive respectively. We show that this strategy effectively results in an opponent process, albeit not at the perceptual level-such as those proposed for colour vision or polarisation detection-but at the level of the environmental space. This opponent process results in a signal that strongly correlates with the angular error of the current body orientation so that a single view of the world now suffices to indicate whether the agent should turn or not. By incorporating this principle into a simple agent navigating in reconstructed natural environments, we show that it overcomes the usual shortcomings and produces a step-increase in navigation effectiveness and robustness. Our findings provide a functional explanation to recent behavioural observations in ants and why and how so-called aversive and appetitive memories must be combined. We propose a likely neural implementation based on insects' mushroom bodies' circuitry that produces behavioural and neural predictions contrasting with previous models.

An insect-inspired model for acquiring views for homing

Wasps and bees perform learning flights when leaving their nest or food locations for the first time during which they acquire visual information that enables them to return successfully. Here we present and test a set of simple control rules underlying the execution of learning flights that closely mimic those performed by ground-nesting wasps. In the simplest model, we assume that the angle between flight direction and the nest direction as seen from the position of the insect is constant and only flips sign when pivoting direction around the nest is changed, resulting in a concatenation of piecewise defined logarithmic spirals. We then added characteristic properties of real learning flights, such as head saccades and the condition that the nest entrance within the visual field is kept nearly constant to describe the development of a learning flight in a head-centered frame of reference, assuming that the retinal position of the nest is known. We finally implemented a closed-loop simulation of learning flights based on a small set of visual control rules. The visual input for this model are rendered views generated from 3D reconstructions of natural wasp nesting sites, and the retinal nest position is controlled by means of simple template-based tracking. We show that naturalistic paths can be generated without knowledge of the absolute distance to the nest or of the flight speed. We demonstrate in addition that nest-tagged views recorded during such simulated learning flights are sufficient for a homing agent to pinpoint the goal, by identifying nest direction when encountering familiar views. We discuss how the information acquired during learning flights close to the nest can be integrated with long-range homing models.

Bumblebee visual allometry results in locally improved resolution and globally improved sensitivity

The quality of visual information that is available to an animal is limited by the size of its eyes. Differences in eye size can be observed even between closely related individuals, yet we understand little about how this affects vision. Insects are good models for exploring the effects of size on visual systems because many insect species exhibit size polymorphism. Previous work has been limited by difficulties in determining the 3D structure of eyes. We have developed a novel method based on x-ray microtomography to measure the 3D structure of insect eyes and to calculate predictions of their visual capabilities. We used our method to investigate visual allometry in the bumblebee Bombus terrestris and found that size affects specific aspects of vision, including binocular overlap, optical sensitivity, and dorsofrontal visual resolution. This reveals that differential scaling between eye areas provides flexibility that improves the visual capabilities of larger bumblebees.

Bees fly through complex environments in search of nectar from flowers. They are aided in this quest by excellent eyesight. Scientists have extensively studied the eyesight of honeybees to learn more about how such tiny eyes work and how they process and learn visual information. Less is known about the honeybee’s larger cousins, the bumblebees, which are also important pollinators. Bumblebees come in different sizes and one question scientists have is how eye size affects vision.

Bigger bumblebees are known to have bigger eyes, and bigger eyes are usually better. But which aspects of vision are improved in larger eyes is not clear. For example, does the size of a bee’s eyes affect how large their field of view is, or how sensitive they are to light? Or does it impact their visual acuity, a measurement of the smallest objects the eye can see? Scaling up an eye would likely improve all these aspects of sight slightly, but changes in a small area of the eye might more drastically improve some parts of vision.

Now, Taylor et al. show that larger bumblebees with bigger eyes have better vision than their smaller counterparts. In the experiments, a technique called microtomography was used to measure the 3D structure of bumblebee eyes. The measurements were then applied to build 3D models of the bumblebee eyes, and computational geometry was used to calculate the sensitivity, acuity, and viewing direction across the entire surface of each model eye. Taylor et al. found that larger bees had improved ability to see small objects in front or slightly above them. They had a bigger area of overlap between the sight in both eyes when they looked forward and up. They were also more sensitive to light across the eye. The experiments show that improvements in eyesight with larger size are very specific and likely help larger bees to adapt to their environment.

Behavioral studies could help scientists better understand how these changes help bigger bees and how the traits evolved. These findings might also help engineers trying to design miniature cameras to help small, flying autonomous vehicles navigate. Bees fly through complex environments and face challenges similar to those small flying vehicles would face. Emulating the design of bee eyes and how they change with size might lead to the development of better cameras for these vehicles.

The role of attractive and repellent scene memories in ant homing (Myrmecia croslandi)

Solitary foraging ants rely on vision when travelling along routes and when pinpointing their nest. We tethered foragers of Myrmecia croslandi on a trackball and recorded their intended movements when the trackball was located on their normal foraging corridor (on-route), above their nest and at a location several meters away where they have never been before (off-route). We find that at on- and off-route locations, most ants walk in the nest or foraging direction and continue to do so for tens of metres in a straight line. In contrast, above the nest, ants walk in random directions and change walking direction frequently. In addition, the walking direction of ants above the nest oscillates at a fine scale, reflecting search movements that are absent from the paths of ants at the other locations. An agent-based simulation shows that the behaviour of ants at all three locations can be explained by the integration of attractive and repellent views directed towards or away from the nest, respectively. Ants are likely to acquire such views via systematic scanning movements during their learning walks. The model predicts that ants placed in a completely unfamiliar environment should behave as if at the nest, which our subsequent experiments confirmed. We conclude first, that the ants’ behaviour at release sites is exclusively driven by what they currently see and not by information on expected outcomes of their behaviour. Second, that navigating ants might continuously integrate attractive and repellent visual memories. We discuss the benefits of such a procedure.

Rotation invariant visual processing for spatial memory in insects

Visual memory is crucial to navigation in many animals, including insects. Here, we focus on the problem of visual homing, that is, using comparison of the view at a current location with a view stored at the home location to control movement towards home by a novel shortcut. Insects show several visual specializations that appear advantageous for this task, including almost panoramic field of view and ultraviolet light sensitivity, which enhances the salience of the skyline. We discuss several proposals for subsequent processing of the image to obtain the required motion information, focusing on how each might deal with the problem of yaw rotation of the current view relative to the home view. Possible solutions include tagging of views with information from the celestial compass system, using multiple views pointing towards home, or rotation invariant encoding of the view. We illustrate briefly how a well-known shape description method from computer vision, Zernike moments, could provide a compact and rotation invariant representation of sky shapes to enhance visual homing. We discuss the biological plausibility of this solution, and also a fourth strategy, based on observed behaviour of insects, that involves transfer of information from visual memory matching to the compass system.

Fractal dimension and the navigational information provided by natural scenes

Recent work on virtual reality navigation in humans has suggested that navigational success is inversely correlated with the fractal dimension (FD) of artificial scenes. Here we investigate the generality of this claim by analysing the relationship between the fractal dimension of natural insect navigation environments and a quantitative measure of the navigational information content of natural scenes. We show that the fractal dimension of natural scenes is in general inversely proportional to the information they provide to navigating agents on heading direction as measured by the rotational image difference function (rotIDF). The rotIDF determines the precision and accuracy with which the orientation of a reference image can be recovered or maintained and the range over which a gradient descent in image differences will find the minimum of the rotIDF, that is the reference orientation. However, scenes with similar fractal dimension can differ significantly in the depth of the rotIDF, because FD does not discriminate between the orientations of edges, while the rotIDF is mainly affected by edge orientation parallel to the axis of rotation. We present a new equation for the rotIDF relating navigational information to quantifiable image properties such as contrast to show (1) that for any given scene the maximum value of the rotIDF (its depth) is proportional to pixel variance and (2) that FD is inversely proportional to pixel variance. This contrast dependence, together with scene differences in orientation statistics, explains why there is no strict relationship between FD and navigational information. Our experimental data and their numerical analysis corroborate these results.

Optimal multiguidance integration in insect navigation

In the last decades, desert ants have become model organisms for the study of insect navigation. In finding their way, they use two major navigational routines: path integration using a celestial compass and landmark guidance based on sets of panoramic views of the terrestrial environment. It has been claimed that this information would enable the insect to acquire and use a centralized cognitive map of its foraging terrain. Here, we present a decentralized architecture, in which the concurrently operating path integration and landmark guidance routines contribute optimally to the directions to be steered, with "optimal" meaning maximizing the certainty (reliability) of the combined information. At any one time during its journey, the animal computes a path integration (global) vector and landmark guidance (local) vector, in which the length of each vector is proportional to the certainty of the individual estimates. Hence, these vectors represent the limited knowledge that the navigator has at any one place about the direction of the goal. The sum of the global and local vectors indicates the navigator's optimal directional estimate. Wherever applied, this decentralized model architecture is sufficient to simulate the results of quite a number of diverse cue-conflict experiments, which have recently been performed in various behavioral contexts by different authors in both desert ants and honeybees. They include even those experiments that have deliberately been designed by former authors to strengthen the evidence for a metric cognitive map in bees.

The problem of home choice in skyline-based homing

Navigation in cluttered environments is an important challenge for animals and robots alike and has been the subject of many studies trying to explain and mimic animal navigational abilities. However, the question of selecting an appropriate home location has, so far, received only little attention. This is surprising, since the choice of a home location might greatly influence an animal’s navigation performance. To address the question of home choice in cluttered environments, a systematic analysis of homing trajectories was performed by computer simulations using a skyline-based local homing method. Our analysis reveals that homing performance strongly depends on the location of the home in the environment. Furthermore, it appears that by assessing homing success in the immediate vicinity of the home, an animal might be able to predict its overall success in returning to it from within a much larger area.

Taking an insect-inspired approach to bird navigation

Navigation is an essential skill for many animals, and understanding how animal use environmental information, particularly visual information, to navigate has a long history in both ethology and psychology. In birds, the dominant approach for investigating navigation at small-scales comes from comparative psychology, which emphasizes the cognitive representations underpinning spatial memory. The majority of this work is based in the laboratory and it is unclear whether this context itself affects the information that birds learn and use when they search for a location. Data from hummingbirds suggests that birds in the wild might use visual information in quite a different manner. To reconcile these differences, here we propose a new approach to avian navigation, inspired by the sensory-driven study of navigation in insects. Using methods devised for studying the navigation of insects, it is possible to quantify the visual information available to navigating birds, and then to determine how this information influences those birds' navigation decisions. Focusing on four areas that we consider characteristic of the insect navigation perspective, we discuss how this approach has shone light on the information insects use to navigate, and assess the prospects of taking a similar approach with birds. Although birds and insects differ in many ways, there is nothing in the insect-inspired approach of the kind we describe that means these methods need be restricted to insects. On the contrary, adopting such an approach could provide a fresh perspective on the well-studied question of how birds navigate through a variety of environments.

The choreography of learning walks in the Australian jack jumper ant Myrmecia croslandi

We provide a detailed analysis of the learning walks performed by Myrmecia croslandi ants at the nest during which they acquire visual information on its location. Most learning walks of 12 individually marked naïve ants took place in the morning with a narrow time window separating the first two learning walks, which most often occurred on the same day. Naïve ants performed between 2 to 7 walks over up to 4 consecutive days before heading out to forage. On subsequent walks naïve ants tend to explore the area around the nest in new compass directions. During learning walks ants move along arcs around the nest while performing oscillating scanning movements. In a regular temporal sequence, the ants’ gaze oscillates between the nest direction and the direction pointing away from the nest. Ants thus experience a sequence of views roughly across the nest and away from the nest from systematically spaced vantage points around the nest. We show further that ants leaving the nest for a foraging trip often walk in an arc around the nest on the opposite side to the intended foraging direction, performing a scanning routine indistinguishable from that of a learning walk. These partial learning walks are triggered by disturbance around the nest and may help returning ants with reorienting when overshooting the nest, which they frequently do. We discuss what is known about learning walks in different ant species and their adaptive significance for acquiring robust navigational memories.

Subtle changes in the landmark panorama disrupt visual navigation in a nocturnal bull ant

The ability of ants to navigate when the visual landmark information is altered has often been tested by creating large and artificial discrepancies in their visual environment. Here, we had an opportunity to slightly modify the natural visual environment around the nest of the nocturnal bull ant Myrmecia pyriformis We achieved this by felling three dead trees, two located along the typical route followed by the foragers of that particular nest and one in a direction perpendicular to their foraging direction. An image difference analysis showed that the change in the overall panorama following the removal of these trees was relatively little. We filmed the behaviour of ants close to the nest and tracked their entire paths, both before and after the trees were removed. We found that immediately after the trees were removed, ants walked slower and were less directed. Their foraging success decreased and they looked around more, including turning back to look towards the nest. We document how their behaviour changed over subsequent nights and discuss how the ants may detect and respond to a modified visual environment in the evening twilight period.This article is part of the themed issue 'Vision in dim light'.

Quantifying navigational information: The catchment volumes of panoramic snapshots in outdoor scenes

Panoramic views of natural environments provide visually navigating animals with two kinds of information: they define locations because image differences increase smoothly with distance from a reference location and they provide compass information, because image differences increase smoothly with rotation away from a reference orientation. The range over which a given reference image can provide navigational guidance (its 'catchment area') has to date been quantified from the perspective of walking animals by determining how image differences develop across the ground plane of natural habitats. However, to understand the information available to flying animals there is a need to characterize the 'catchment volumes' within which panoramic snapshots can provide navigational guidance. We used recently developed camera-based methods for constructing 3D models of natural environments and rendered panoramic views at defined locations within these models with the aim of mapping navigational information in three dimensions. We find that in relatively open woodland habitats, catchment volumes are surprisingly large extending for metres depending on the sensitivity of the viewer to image differences. The size and the shape of catchment volumes depend on the distance of visual features in the environment. Catchment volumes are smaller for reference images close to the ground and become larger for reference images at some distance from the ground and in more open environments. Interestingly, catchment volumes become smaller when only above horizon views are used and also when views include a 1 km distant panorama. We discuss the current limitations of mapping navigational information in natural environments and the relevance of our findings for our understanding of visual navigation in animals and autonomous robots.

Finding Home: Landmark Ambiguity in Human Navigation

Memories of places often include landmark cues, i.e., information provided by the spatial arrangement of distinct objects with respect to the target location. To study how humans combine landmark information for navigation, we conducted two experiments: To this end, participants were either provided with auditory landmarks while walking in a large sports hall or with visual landmarks while walking on a virtual-reality treadmill setup. We found that participants cannot reliably locate their home position due to ambiguities in the spatial arrangement when only one or two uniform landmarks provide cues with respect to the target. With three visual landmarks that look alike, the task is solved without ambiguity, while audio landmarks need to play three unique sounds for a similar performance. This reduction in ambiguity through integration of landmark information from 1, 2, and 3 landmarks is well modeled using a probabilistic approach based on maximum likelihood estimation. Unlike any deterministic model of human navigation (based e.g., on distance or angle information), this probabilistic model predicted both the precision and accuracy of the human homing performance. To further examine how landmark cues are integrated we introduced systematic conflicts in the visual landmark configuration between training of the home position and tests of the homing performance. The participants integrated the spatial information from each landmark near-optimally to reduce spatial variability. When the conflict becomes big, this integration breaks down and precision is sacrificed for accuracy. That is, participants return again closer to the home position, because they start ignoring the deviant third landmark. Relying on two instead of three landmarks, however, goes along with responses that are scattered over a larger area, thus leading to higher variability. To model the breakdown of integration with increasing conflict, the probabilistic model based on a simple Gaussian distribution used for Experiment 1 needed a slide extension in from of a mixture of Gaussians. All parameters for the Mixture Model were fixed based on the homing performance in the baseline condition which contained a single landmark. from the 1-Landmark Condition. This way we found that the Mixture Model could predict the integration performance and its breakdown with no additional free parameters. Overall these data suggest that humans use similar optimal probabilistic strategies in visual and auditory navigation, integrating landmark information to improve homing precision and balance homing precision with homing accuracy.

The sensory arrays of the ant, Temnothorax rugatulus

Individual differences in response thresholds to task-related stimuli may be one mechanism driving task allocation among social insect workers. These differences may arise at various stages in the nervous system. We investigate variability in the peripheral nervous system as a simple mechanism that can introduce inter-individual differences in sensory information. In this study we describe size-dependent variation of the compound eyes and the antennae in the ant Temnothorax rugatulus. Head width in T. rugatulus varies between 0.4 and 0.7 mm (2.6-3.8 mm body length). But despite this limited range of worker sizes we find sensory array variability. We find that the number of ommatidia and of some, but not all, antennal sensilla types vary with head width. The antennal array of T. rugatulus displays the full complement of sensillum types observed in other species of ants, although at much lower quantities than other, larger, studied species. In addition, we describe what we believe to be a new type of sensillum in hymenoptera that occurs on the antennae and on all body segments. T. rugatulus has apposition compound eyes with 45-76 facets per eye, depending on head width, with average lens diameters of 16.5 μm, rhabdom diameters of 5.7 μm and inter-ommatidial angles of 16.8°. The optical system of T. rugatulus ommatidia is severely under focussed, but the absolute sensitivity of the eyes is unusually high. We discuss the functional significance of these findings and the extent to which the variability of sensory arrays may correlate with task allocation.

Navigation performance in virtual environments varies with fractal dimension of landscape

Fractal geometry has been used to describe natural and built environments, but has yet to be studied in navigational research. In order to establish a relationship between the fractal dimension (D) of a natural environment and humans' ability to navigate such spaces, we conducted two experiments using virtual environments that simulate the fractal properties of nature. In Experiment 1, participants completed a goal-driven search task either with or without a map in landscapes that varied in D. In Experiment 2, participants completed a map-reading and location-judgment task in separate sets of fractal landscapes. In both experiments, task performance was highest at the low-to-mid range of D, which was previously reported as most preferred and discriminable in studies of fractal aesthetics and discrimination, respectively, supporting a theory of visual fluency. The applicability of these findings to architecture, urban planning, and the general design of constructed spaces is discussed.

The neurobiological basis of orientation in insects: insights from the silkmoth mating dance

Counterturning is a common movement pattern during orientation behavior in insects. Once male moths sense sex pheromones and then lose the input, they demonstrate zigzag movements, alternating between left and right turns, to increase the probability to contact with the pheromone plume. We summarize the anatomy and function of the neural circuit involved in pheromone orientation in the silkmoth. A neural circuit, the lateral accessory lobe (LAL), serves a role as the circuit module for zigzag movements and controls this operation using a flip-flop neural switch. Circuit design of the LAL is well conserved across species. We hypothesize that this zigzag module is utilized in a wide range of insect behavior. We introduce two examples of the potential use: orientation flight and the waggle dance in bees.

Neural mechanisms of insect navigation

We know more about the ethology of insect navigation than the neural substrates. Few studies have shown direct effects of brain manipulation on navigational behaviour; or measure brain responses that clearly relate to the animal's current location or spatial target, independently of specific sensory cues. This is partly due to the methodological problems of obtaining neural data in a naturally behaving animal. However, substantial indirect evidence, such as comparative anatomy and knowledge of the neural circuits that provide relevant sensory inputs provide converging arguments for the role of some specific brain areas: the mushroom bodies; and the central complex. Finally, modelling can help bridge the gap by relating the computational requirements of a given navigational task to the type of computation offered by different brain areas.

Three spectrally distinct photoreceptors in diurnal and nocturnal Australian ants

Ants are thought to be special among Hymenopterans in having only dichromatic colour vision based on two spectrally distinct photoreceptors. Many ants are highly visual animals, however, and use vision extensively for navigation. We show here that two congeneric day- and night-active Australian ants have three spectrally distinct photoreceptor types, potentially supporting trichromatic colour vision. Electroretinogram recordings show the presence of three spectral sensitivities with peaks (λmax) at 370, 450 and 550 nm in the night-active Myrmecia vindex and peaks at 370, 470 and 510 nm in the day-active Myrmecia croslandi. Intracellular electrophysiology on individual photoreceptors confirmed that the night-active M. vindex has three spectral sensitivities with peaks (λmax) at 370, 430 and 550 nm. A large number of the intracellular recordings in the night-active M. vindex show unusually broad-band spectral sensitivities, suggesting that photoreceptors may be coupled. Spectral measurements at different temporal frequencies revealed that the ultraviolet receptors are comparatively slow. We discuss the adaptive significance and the probability of trichromacy in Myrmecia ants in the context of dim light vision and visual navigation.

Ant Homing Ability Is Not Diminished When Traveling Backwards

Ants are known to be capable of homing to their nest after displacement to a novel location. This is widely assumed to involve some form of retinotopic matching between their current view and previously experienced views. One simple algorithm proposed to explain this behavior is continuous retinotopic alignment, in which the ant constantly adjusts its heading by rotating to minimize the pixel-wise difference of its current view from all views stored while facing the nest. However, ants with large prey items will often drag them home while facing backwards. We tested whether displaced ants (Myrmecia croslandi) dragging prey could still home despite experiencing an inverted view of their surroundings under these conditions. Ants moving backwards with food took similarly direct paths to the nest as ants moving forward without food, demonstrating that continuous retinotopic alignment is not a critical component of homing. It is possible that ants use initial or intermittent retinotopic alignment, coupled with some other direction stabilizing cue that they can utilize when moving backward. However, though most ants dragging prey would occasionally look toward the nest, we observed that their heading direction was not noticeably improved afterwards. We assume ants must use comparison of current and stored images for corrections of their path, but suggest they are either able to chose the appropriate visual memory for comparison using an additional mechanism; or can make such comparisons without retinotopic alignment.

Head roll stabilisation in the nocturnal bull ant Myrmecia pyriformis: implications for visual navigation

Ant foragers are known to memorise visual scenes that allow them to repeatedly travel along idiosyncratic routes and to return to specific places. Guidance is provided by a comparison between visual memories and current views, which critically depends on how well the attitude of the visual system is controlled. Here we show that nocturnal bull ants stabilise their head to varying degrees against locomotion-induced body roll movements, and this ability decreases as light levels fall. There are always un-compensated head roll oscillations that match the frequency of the stride cycle. Head roll stabilisation involves both visual and non-visual cues as ants compensate for body roll in complete darkness and also respond with head roll movements when confronted with visual pattern oscillations. We show that imperfect head roll control degrades navigation-relevant visual information and discuss ways in which navigating ants may deal with this problem.

Early ant trajectories: spatial behaviour before behaviourism

In the beginning of the twentieth century, when Jacques Loeb's and John Watson's mechanistic view of life started to dominate animal physiology and behavioural biology, several scientists with different academic backgrounds got engaged in studying the wayfinding behaviour of ants. Largely unaffected by the scientific spirit of the time, they worked independently of each other in different countries: in Algeria, Tunisia, Spain, Switzerland and the United States of America. In the current literature on spatial cognition these early ant researchers--Victor Cornetz, Felix Santschi, Charles Turner and Rudolf Brun--are barely mentioned. Moreover, it is virtually unknown that the great neuroanatomist Santiago Ramón y Cajal had also worked on spatial orientation in ants. This general neglect is certainly due to the fact that nearly all these ant researchers were scientific loners, who did their idiosyncratic investigations outside the realm of comparative physiology, neurobiology and the behavioural sciences of the time, and published their results in French, German, and Spanish at rather inaccessible places. Even though one might argue that much of their work resulted in mainly anecdotal evidence, the conceptual approaches of these early ant researchers preempt much of the present-day discussions on spatial representation in animals.

Using an Insect Mushroom Body Circuit to Encode Route Memory in Complex Natural Environments

Ants, like many other animals, use visual memory to follow extended routes through complex environments, but it is unknown how their small brains implement this capability. The mushroom body neuropils have been identified as a crucial memory circuit in the insect brain, but their function has mostly been explored for simple olfactory association tasks. We show that a spiking neural model of this circuit originally developed to describe fruitfly (Drosophila melanogaster) olfactory association, can also account for the ability of desert ants (Cataglyphis velox) to rapidly learn visual routes through complex natural environments. We further demonstrate that abstracting the key computational principles of this circuit, which include one-shot learning of sparse codes, enables the theoretical storage capacity of the ant mushroom body to be estimated at hundreds of independent images.

How do field of view and resolution affect the information content of panoramic scenes for visual navigation? A computational investigation

The visual systems of animals have to provide information to guide behaviour and the informational requirements of an animal's behavioural repertoire are often reflected in its sensory system. For insects, this is often evident in the optical array of the compound eye. One behaviour that insects share with many animals is the use of learnt visual information for navigation. As ants are expert visual navigators it may be that their vision is optimised for navigation. Here we take a computational approach in asking how the details of the optical array influence the informational content of scenes used in simple view matching strategies for orientation. We find that robust orientation is best achieved with low-resolution visual information and a large field of view, similar to the optical properties seen for many ant species. A lower resolution allows for a trade-off between specificity and generalisation for stored views. Additionally, our simulations show that orientation performance increases if different portions of the visual field are considered as discrete visual sensors, each giving an independent directional estimate. This suggests that ants might benefit by processing information from their two eyes independently.