Optic Flow Cues Guide Flight in Birds

Landing on a swinging perch: peach-faced lovebirds prefer extremes

Birds frequently must land (safely) on moving branches, and seemingly accomplish this with acrobatic precision. To examine how birds target and land on moving supports, we investigated how lovebirds approach and land on a swinging perch, driven at three sinusoidal frequencies. Flight kinematics were recorded, together with landing forces and pitch torque via a perch-mounted sensor. In support of our hypothesis for stable landings, lovebirds timed half their landings (51.3%) when the perch was approaching either extreme of motion near zero velocity, exhibiting a robust bimodal strategy for landing-phase timing. Horizontal landing forces exceeded vertical forces across all landing conditions, reflecting the shallow flight trajectory (-13.2 deg relative to horizontal) lovebirds adopted to decelerate and land. A uniform body pitch angle (81.9±0.46 deg mean±s.e.m.) characterized landing across all conditions, with lovebirds using the horizontal perch reaction force to assist in braking when landing. Body pitch after landing was not well correlated and was generally opposite to the initial direction and magnitude of landing pitch torque. Flexion of the bird's hindlimb joints at landing reduced landing torque by aligning the bird's center of mass trajectory more closely to the perch. Landing pitch torque and body pitch rotation increased uniformly in response to increased perch swing frequency. In contrast to landing forces, pitch torque varied irregularly across landing conditions. Our results indicate that lovebirds regulate their approach trajectory and velocity to time the phase of landing to a moving perch, providing insight for designing biologically inspired unmanned aerial vehicles capable of landing on moving targets.

A seabird's eye view: visual fields of some seabirds (Laridae and Procellariidae) from tropical latitudes

The visual field of a bird defines the amount of information that can be extracted from the environment around it, using the eyes. Previous visual field research has left large phylogenetic gaps, where tropical bird species have been comparatively understudied. Using the ophthalmoscopic technique, we measured the visual fields of seven tropical seabird species, to understand what are the primary determinants of their visual fields. The visual field topographies of the seven seabird species were relatively similar, despite the two groups of Terns (Laridae) and Shearwaters (Procellariidae) being phylogenetically distant. We propose this similarity is due to their largely similar foraging ecology. These findings support previous research that foraging ecology rather than relatedness is the key determining factor behind a bird's visual field topography. Some bird species were identified to have more limited binocular fields, such as Brown Noddies (Anous stolidus) where binocularity onsets lower down within the visual field, resulting in a larger blind area about the head.

Brightness cues affect gap negotiation behaviours in zebra finches flying between perches

Flying animals have had to evolve robust and effective guidance strategies for dealing with habitat clutter. Birds and insects use optic flow expansion cues to sense and avoid obstacles, but orchid bees have also been shown to use brightness cues during gap negotiation. Such brightness cues might therefore be of general importance in structuring visually guided flight behaviours. To test the hypothesis that brightness cues also affect gap negotiation behaviours in birds, we presented captive zebra finches Taeniopygia guttata with a symmetric or asymmetric background brightness distribution on the other side of a tunnel. The background brightness conditions influenced both the birds' decision to enter the tunnel aperture, and their flight direction upon exit. Zebra finches were more likely to initiate flight through the tunnel if they could see a bright background through it; they were also more likely to fly to the bright side upon exiting. We found no evidence of the centring response that would be expected if optic flow cues were balanced bilaterally during gap negotiation. Instead, the birds entered the tunnel by targeting a clearance of approximately one wing length from its near edge. Brightness cues therefore affect how zebra finches structure their flight when negotiating gaps in enclosed environments.

Hummingbirds use distinct control strategies for forward and hovering flight

The detection of optic flow is important for generating optomotor responses to mediate retinal image stabilization, and it can also be used during ongoing locomotion for centring and velocity control. Previous work in hummingbirds has separately examined the roles of optic flow during hovering and when centring through a narrow passage during forward flight. To develop a hypothesis for the visual control of forward flight velocity, we examined the behaviour of hummingbirds in a flight tunnel where optic flow could be systematically manipulated. In all treatments, the animals exhibited periods of forward flight interspersed with bouts of spontaneous hovering. Hummingbirds flew fastest when they had a reliable signal of optic flow. All optic flow manipulations caused slower flight, suggesting that hummingbirds had an expected optic flow magnitude that was disrupted. In addition, upward and downward optic flow drove optomotor responses for maintaining altitude during forward flight. When hummingbirds made voluntary transitions to hovering, optomotor responses were observed to all directions. Collectively, these results are consistent with hummingbirds controlling flight speed via mechanisms that use an internal forward model to predict expected optic flow whereas flight altitude and hovering position are controlled more directly by sensory feedback from the environment.

Generalizing the optic flow equalization control law to an asymmetrical person-plus-object system

Visually guided action in humans occurs in part through the use of control laws, which are dynamical equations in which optical information modulates an actor's interaction with their environment. For example, humans locomote through the center of a corridor by equalizing the speed of optic flow across their left and right fields of view. This optic flow equalization control law relies on a crucial assumption: that the shape of the body relative to the eyes is laterally symmetrical. Humans engaging in tool use are often producing person-plus-object systems that are not laterally symmetrical, such as when they hold a tool, bag, or briefcase in one hand, or when they drive a vehicle. This experiment tests a new generalized control law for centered steering that accounts for asymmetries produced by external tool use. Participants held an asymmetrical bar and centered themselves within a virtual moving hallway while the speed of the virtual walls were systematically changed. The results demonstrate that humans engaging with an asymmetrical tool can (1) perceive the asymmetry of a person-plus-object system, (2) use that information to modulate the use of optic flow equalization control laws for centered steering, and (3) functionally incorporate the asymmetrical tool into their perception-action system to successfully navigate their environment.

From the eye to the wing: neural circuits for transforming optic flow into motor output in avian flight

Avian flight is guided by optic flow-the movement across the retina of images of surfaces and edges in the environment due to self-motion. In all vertebrates, there is a short pathway for optic flow information to reach pre-motor areas: retinal-recipient regions in the midbrain encode optic flow, which is then sent to the cerebellum. One well-known role for optic flow pathways to the cerebellum is the control of stabilizing eye movements (the optokinetic response). However, the role of this pathway in controlling locomotion is less well understood. Electrophysiological and tract tracing studies are revealing the functional connectivity of a more elaborate circuit through the avian cerebellum, which integrates optic flow with other sensory signals. Here we review the research supporting this framework and identify the cerebellar output centres, the lateral (CbL) and medial (CbM) cerebellar nuclei, as two key nodes with potentially distinct roles in flight control. The CbM receives bilateral optic flow information and projects to sites in the brainstem that suggest a primary role for flight control over time, such as during forward flight. The CbL receives monocular optic flow and other types of visual information. This site provides feedback to sensory areas throughout the brain and has a strong projection the nucleus ruber, which is known to have a dominant role in forelimb muscle control. This arrangement suggests primary roles for the CbL in the control of wing morphing and for rapid maneuvers.

Through Hawks’ Eyes: Synthetically Reconstructing the Visual Field of a Bird in Flight

Birds of prey rely on vision to execute flight manoeuvres that are key to their survival, such as intercepting fast-moving targets or navigating through clutter. A better understanding of the role played by vision during these manoeuvres is not only relevant within the field of animal behaviour, but could also have applications for autonomous drones. In this paper, we present a novel method that uses computer vision tools to analyse the role of active vision in bird flight, and demonstrate its use to answer behavioural questions. Combining motion capture data from Harris’ hawks with a hybrid 3D model of the environment, we render RGB images, semantic maps, depth information and optic flow outputs that characterise the visual experience of the bird in flight. In contrast with previous approaches, our method allows us to consider different camera models and alternative gaze strategies for the purposes of hypothesis testing, allows us to consider visual input over the complete visual field of the bird, and is not limited by the technical specifications and performance of a head-mounted camera light enough to attach to a bird’s head in flight. We present pilot data from three sample flights: a pursuit flight, in which a hawk intercepts a moving target, and two obstacle avoidance flights. With this approach, we provide a reproducible method that facilitates the collection of large volumes of data across many individuals, opening up new avenues for data-driven models of animal behaviour.

Mallard landing behavior on water follows a -constant braking strategy

Many flying animals use optic flow to control their flight. During landing maneuvers, pigeons, hummingbirds, bats, Draco lizards and bees use the -constant braking strategy. This strategy regulates the approach by keeping the ratio of distance to an object and the rate of change of that distance constant. In keeping this ratio, , constant, a variety of deceleration profiles can lead to different collision avoidance behaviors. The landing behaviors listed above all qualify as controlled collisions, where the animal is decelerating into the object. We examined whether the same regulatory strategy is employed by mallards when landing on water. Video of mallard landing behavior was recorded at a local pond and digitized. Kinematic and τ parameters were calculated for each landing (N=177). The Pearson correlation coefficient for τ with respect to time to land was 0.99±0.02, indicating mallards employ a controlled-collision strategy. This result implies regulation by the birds to fix as constant while landing (on average, 0.90±0.13). In comparison with other active flyers, mallards use a higher value of when landing (0.775±0.109, 0.710±0.132 and 0.702±0.052 for pigeons, hummingbirds and bats, respectively). This higher may reflect physical differences in substrate from solid to liquid. The higher compliance of water in comparison to a solid substrate may reduce impact forces that could be injurious on a solid substrate, thereby enabling mallards to approach faster and expend less energy for costly, slow flight.

Motion vision: Fish swimming to see

Self-motion generates optic flow, a visual motion signal used by many organisms for navigation and self-stabilization. A new study quantitatively demonstrates how environmental structure and current behavioral state explain the spatial biases observed in zebrafish optomotor responses.

Opening the black box of bird-window collisions: passive video recordings in a residential backyard

Collisions with windows on buildings are a major source of bird mortality. The current understanding of daytime collisions is limited by a lack of empirical data on how collisions occur in the real world because most data are collected by recording evidence of mortality rather than pre-collision behaviour. Based on published literature suggesting a causal relationship between bird collision risk and the appearance of reflections on glass, the fact that reflections vary in appearance depending on viewing angle, and general principles of object collision kinematics, we hypothesized that the risk and lethality of window collisions may be related to the angle and velocity of birds' flight. We deployed a home security camera system to passively record interactions between common North American bird species and residential windows in a backyard setting over spring, summer and fall seasons over 2 years. We captured 38 events including 29 collisions and nine near-misses in which birds approached the glass but avoided impact. Only two of the collisions resulted in immediate fatality, while 23 birds flew away immediately following impact. Birds approached the glass at variable flight speeds and from a wide range of angles, suggesting that the dynamic appearance of reflections on glass at different times of day may play a causal role in collision risk. Birds that approached the window at higher velocity were more likely to be immediately killed or stunned. Most collisions were not detected by the building occupants and, given that most birds flew away immediately, carcass surveys would only document a small fraction of window collisions. We discuss the implications of characterizing pre-collision behaviour for designing effective collision prevention methods.

Vision-Based Design and Deployment Criteria for Power Line Bird Diverters

The design of bird diverters should be based upon the perception of birds, not the perception of humans, but until now it is human vision that has guided diverter design. Aspects of bird vision pertinent to diverter design are reviewed. These are applied in an example that uses Canada Geese Branta canadensis as a putative worst-case example of a collision-prone species. The proposed design uses an achromatic checkerboard pattern of high contrast whose elements match the low spatial resolution of these birds when they are active under twilight light levels. The detectability of the device will be increased by movement, and this is best achieved with a device that rotates on its own axis driven by the wind. The recommended spacing of diverters along a power line is based upon the maximum width of the bird’s binocular field and the linear distance that it subtends at a distance sufficient to allow a bird to alter its flight path before possible impact. Given the worst-case nature of this example, other bird species should detect and avoid such a device. The basic design can be modified for use with specific target species if sufficient is known about their vision. Field trials of devices based on these design criteria are now required.

Optic flow in the natural habitats of zebrafish supports spatial biases in visual self-motion estimation

Animals benefit from knowing if and how they are moving. Across the animal kingdom, sensory information in the form of optic flow over the visual field is used to estimate self-motion. However, different species exhibit strong spatial biases in how they use optic flow. Here, we show computationally that noisy natural environments favor visual systems that extract spatially biased samples of optic flow when estimating self-motion. The performance associated with these biases, however, depends on interactions between the environment and the animal's brain and behavior. Using the larval zebrafish as a model, we recorded natural optic flow associated with swimming trajectories in the animal's habitat with an omnidirectional camera mounted on a mechanical arm. An analysis of these flow fields suggests that lateral regions of the lower visual field are most informative about swimming speed. This pattern is consistent with the recent findings that zebrafish optomotor responses are preferentially driven by optic flow in the lateral lower visual field, which we extend with behavioral results from a high-resolution spherical arena. Spatial biases in optic-flow sampling are likely pervasive because they are an effective strategy for determining self-motion in noisy natural environments.

Night skies through animals' eyes-Quantifying night-time visual scenes and light pollution as viewed by animals

A large proportion of animal species enjoy the benefits of being active at night, and have evolved the corresponding optical and neural adaptations to cope with the challenges of low light intensities. However, over the past century electric lighting has introduced direct and indirect light pollution into the full range of terrestrial habitats, changing nocturnal animals' visual worlds dramatically. To understand how these changes affect nocturnal behavior, we here propose an animal-centered analysis method based on environmental imaging. This approach incorporates the sensitivity and acuity limits of individual species, arriving at predictions of photon catch relative to noise thresholds, contrast distributions, and the orientation cues nocturnal species can extract from visual scenes. This analysis relies on just a limited number of visual system parameters known for each species. By accounting for light-adaptation in our analysis, we are able to make more realistic predictions of the information animals can extract from nocturnal visual scenes under different levels of light pollution. With this analysis method, we aim to provide context for the interpretation of behavioral findings, and to allow researchers to generate specific hypotheses for the behavior of nocturnal animals in observed light-polluted scenes.

Neuroscience and architecture: Modulating behavior through sensorimotor responses to the built environment

As we move through the world, natural and built environments implicitly guide behavior by appealing to certain sensory and motor dynamics. This process can be motivated by automatic attention to environmental features that resonate with specific sensorimotor responses. This review aims at providing a psychobiological framework describing how environmental features can lead to automated sensorimotor responses through defined neurophysiological mechanisms underlying attention. Through the use of automated processes in subsets of cortical structures, the goal of this framework is to describe on a neuronal level the functional link between the designed environment and sensorimotor responses. By distinguishing between environmental features and sensorimotor responses we elaborate on how automatic behavior employs the environment for sensorimotor adaptation. This is realized through a thalamo-cortical network integrating environmental features with motor aspects of behavior. We highlight the underlying transthalamic transmission from an Enactive and predictive perspective and review recent studies that effectively modulated behavior by systematically manipulating environmental features. We end by suggesting a promising combination of neuroimaging and computational analysis for future studies.

Estimating curvilinear self-motion from optic flow with a biologically inspired neural system

Optic flow provides rich information about world-relative self-motion and is used by many animals to guide movement. For example, self-motion along linear, straight paths without eye movements, generates optic flow that radiates from a singularity that specifies the direction of travel (heading). Many neural models of optic flow processing contain heading detectors that are tuned to the position of the singularity, the design of which is informed by brain area MSTd of primate visual cortex that has been linked to heading perception. Such biologically inspired models could be useful for efficient self-motion estimation in robots, but existing systems are tailored to the limited scenario of linear self-motion and neglect sensitivity to self-motion along more natural curvilinear paths. The observer in this case experiences more complex motion patterns, the appearance of which depends on the radius of the curved path (path curvature) and the direction of gaze. Indeed, MSTd neurons have been shown to exhibit tuning to optic flow patterns other than radial expansion, a property that is rarely captured in neural models. We investigated in a computational model whether a population of MSTd-like sensors tuned to radial, spiral, ground, and other optic flow patterns could support the accurate estimation of parameters describing both linear and curvilinear self-motion. We used deep learning to decode self-motion parameters from the signals produced by the diverse population of MSTd-like units. We demonstrate that this system is capable of accurately estimating curvilinear path curvature, clockwise/counterclockwise sign, and gaze direction relative to the path tangent in both synthetic and naturalistic videos of simulated self-motion. Estimates remained stable over time while rapidly adapting to dynamic changes in the observer's curvilinear self-motion. Our results show that coupled biologically inspired and artificial neural network systems hold promise as a solution for robust vision-based self-motion estimation in robots.

Compensation for wind drift prevails for a shorebird on a long-distance, transoceanic flight

BACKGROUND

Conditions encountered en route can dramatically impact the energy that migratory species spend on movement. Migratory birds often manage energetic costs by adjusting their behavior in relation to wind conditions as they fly. Wind-influenced behaviors can offer insight into the relative importance of risk and resistance during migration, but to date, they have only been studied in a limited subset of avian species and flight types. We add to this understanding by examining in-flight behaviors over a days-long, barrier-crossing flight in a migratory shorebird.

METHODS

Using satellite tracking devices, we followed 25 Hudsonian godwits (Limosa haemastica) from 2019-2021 as they migrated northward across a largely transoceanic landscape extending > 7000 km from Chiloé Island, Chile to the northern coast of the Gulf of Mexico. We identified in-flight behaviors during this crossing by comparing directions of critical movement vectors and used mixed models to test whether the resulting patterns supported three classical predictions about wind and migration.

RESULTS

Contrary to our predictions, compensation did not increase linearly with distance traveled, was not constrained during flight over open ocean, and did not influence where an individual ultimately crossed over the northern coast of the Gulf of Mexico at the end of this flight. Instead, we found a strong preference for full compensation throughout godwit flight paths.

CONCLUSIONS

Our results indicate that compensation is crucial to godwits, emphasizing the role of risk in shaping migratory behavior and raising questions about the consequences of changing wind regimes for other barrier-crossing aerial migrants.

Pretecto- and ponto-cerebellar pathways to the pigeon oculomotor cerebellum follow a zonal organization

Both birds and mammals have relatively large forebrains and cerebella. In mammals, there are extensive sensory-motor projections to the cerebellum through the pontine nuclei originating from several parts of the cerebral cortex. Similar forebrain-to-cerebellum pathways exist in birds, but the organization of this circuitry has not been studied extensively. Birds have two nuclei at the base of the brainstem that are thought to be homologous to the pontine nuclei of mammals, the medial and lateral pontine nuclei (PM, PL). Additionally, birds are unique in that they have a pretectal nucleus called the medial spiriform nucleus (SpM) that, like the pontine nuclei, also receives projections from the forebrain and projects to the oculomotor cerebellum (OCb; folia VI to VIII). The OCb also receives input from the pretectal nucleus lentiformis mesencephali (LM), which analyzes visual optic flow information resulting from self-movement. In this study, we used single or double injections of fluorescent tracers to study the organization of these inputs from PM, PL, SpM and LM to the OCb in pigeons. We found that these inputs follow a zonal organization. The most medial zone in the OCb, zone A1, receives bilateral inputs from the lateral SpM, PL and LM. Zones A2 and C receive a bilateral projection from the medial SpM, and a mostly contralateral projection from PM and LM. We discuss how the pathway to zone A1 processes mainly visuo-motor information to spinal premotor areas, whereas the pathways to zone A2/C processes somato-motor and visuo-motor information and may have a feedback/modulatory role.

An Algorithmic Approach to Natural Behavior

Uncovering the mechanisms and implications of natural behavior is a goal that unites many fields of biology. Yet, the diversity, flexibility, and multi-scale nature of these behaviors often make understanding elusive. Here, we review studies of animal pursuit and evasion - two special classes of behavior where theory-driven experiments and new modeling techniques are beginning to uncover the general control principles underlying natural behavior. A key finding of these studies is that intricate sequences of pursuit and evasion behavior can often be constructed through simple, repeatable rules that link sensory input to motor output: we refer to these rules as behavioral algorithms. Identifying and mathematically characterizing these algorithms has led to important insights, including the discovery of guidance rules that attacking predators use to intercept mobile prey, and coordinated neural and biomechanical mechanisms that animals use to avoid impending collisions. Here, we argue that algorithms provide a good starting point for studies of natural behavior more generally. Rather than beginning at the neural or ecological levels of organization, we advocate starting in the middle, where the algorithms that link sensory input to behavioral output can provide a solid foundation from which to explore both the implementation and the ecological outcomes of behavior. We review insights that have been gained through such an algorithmic approach to pursuit and evasion behaviors. From these, we synthesize theoretical principles and lay out key modeling tools needed to apply an algorithmic approach to the study of other complex natural behaviors.

Flying through gaps: how does a bird deal with the problem and what costs are there?

Animals flying in the wild often show remarkable abilities to negotiate obstacles and narrow openings in complex environments. Impressive as these abilities are, this must result in costs in terms of impaired flight performance. In this study, I used a budgerigar as a model for studying these costs. The bird was filmed in stereo when flying through a wide range of gap widths from well above wingspan down to a mere 1/4 of wingspan. Three-dimensional flight trajectories were acquired and speed, wingbeat frequency and accelerations/decelerations were calculated. The bird used two different wing postures to get through the gaps and could use very small safety margins (down to 6 mm on either side) but preferred to use larger when gap width allowed. When gaps were smaller than wingspan, flight speed was reduced with reducing gap width down to half for the smallest and wingbeat frequency was increased. I conclude that flying through gaps potentially comes with multiple types of cost to a bird of which the main may be: (i) reduced flight speed increases the flight duration and hence the energy consumption to get from point A to B, (ii) the underlying U-shaped speed to power relationship means further cost from reduced flight speed, and associated with it (iii) elevated wingbeat frequency includes a third direct cost.

Look where you go: Characterizing eye movements toward optic flow

When we move through our environment, objects in the visual scene create optic flow patterns on the retina. Even though optic flow is ubiquitous in everyday life, it is not well understood how our eyes naturally respond to it. In small groups of human and non-human primates, optic flow triggers intuitive, uninstructed eye movements to the focus of expansion of the pattern (Knöll, Pillow, & Huk, 2018). Here, we investigate whether such intuitive oculomotor responses to optic flow are generalizable to a larger group of human observers and how eye movements are affected by motion signal strength and task instructions. Observers (N = 43) viewed expanding or contracting optic flow constructed by a cloud of moving dots radiating from or converging toward a focus of expansion that could randomly shift. Results show that 84% of observers tracked the focus of expansion with their eyes without being explicitly instructed to track. Intuitive tracking was tuned to motion signal strength: Saccades landed closer to the focus of expansion, and smooth tracking was more accurate when dot contrast, motion coherence, and translational speed were high. Under explicit tracking instruction, the eyes aligned with the focus of expansion more closely than without instruction. Our results highlight the sensitivity of intuitive eye movements as indicators of visual motion processing in dynamic contexts.

Young frigatebirds learn how to compensate for wind drift

Compensating for wind drift can improve goalward flight efficiency in animal taxa, especially among those that rely on thermal soaring to travel large distances. Little is known, however, about how animals acquire this ability. The great frigatebird (Fregata minor) exemplifies the challenges of wind drift compensation because it lives a highly pelagic lifestyle, travelling very long distances over the open ocean but without the ability to land on water. Using GPS tracks from fledgling frigatebirds, we followed young frigatebirds from the moment of fledging to investigate whether wind drift compensation was learnt and, if so, what sensory inputs underpinned it. We found that the effect of wind drift reduced significantly with both experience and access to visual landmark cues. Further, we found that the effect of experience on wind drift compensation was more pronounced when birds were out of sight of land. Our results suggest that improvement in wind drift compensation is not solely the product of either physical maturation or general improvements in flight control. Instead, we believe it is likely that they reflect how frigatebirds learn to process sensory information so as to reduce wind drift and maintain a constant course during goalward movement.

Sensory systems in birds: What we have learned from studying sensory specialists

"Diversity" is an apt descriptor of the research career of Jack Pettigrew as it ranged from the study of trees, to clinical conditions, to sensory neuroscience. Within sensory neuroscience, he was fascinated by the evolution of sensory systems across species. Here, we review some of his work on avian sensory specialists and research that he inspired in others. We begin with an overview of the importance of the Wulst in stereopsis and the need for further study of the Wulst in relation to binocularity across avian species. Next, we summarize recent anatomical, behavioral, and physiological studies on optic flow specializations in hummingbirds. Beyond vision, we discuss the first evidence of a tactile "fovea" in birds and how this led to detailed studies of tactile specializations in waterfowl and sensorimotor systems in parrots. We then describe preliminary studies by Pettigrew of two endemic Australian species, the plains-wanderer (Pedionomus torquatus) and letter-winged kite (Elanus scriptus), that suggest the evolution of some unique auditory and visual specializations in relation to their unique behavior and ecology. Finally, we conclude by emphasizing the importance of a comparative and integrative approach to understanding avian sensory systems and provide an example of one system that has yet to be properly examined: tactile facial bristles in birds. Through reviewing this research and offering future avenues for discovery, we hope that others also embrace the comparative approach to understanding sensory system evolution in birds and other vertebrates.

Budgerigars adopt robust, but idiosyncratic flight paths

We have investigated the paths taken by Budgerigars while flying in a tunnel. The flight trajectories of nine Budgerigars (Melopsittacus undulatus) were reconstructed in 3D from high speed stereo videography of their flights in an obstacle-free tunnel. Individual birds displayed highly idiosyncratic flight trajectories that were consistent from flight to flight over the course of several months. We then investigated the robustness of each bird’s trajectory by interposing a disk-shaped obstacle in its preferred flight path. We found that each bird continued to fly along its preferred trajectory up to a point very close to the obstacle before veering over the obstacle rapidly, making a minimal deviation to avoid a collision, and subsequently returning to its original path. Thus, Budgerigars show a high propensity to stick to their individual, preferred flight paths even when confronted with a clearly visible obstacle, and do not adopt a substantially different, unobstructed route. The robust preference for idiosyncratic flight paths, and the tendency to pass obstacles by flying above them, provide new insights into the strategies that underpin obstacle avoidance in birds. We believe that this is the first carefully controlled study of the behaviour of birds in response to a newly introduced obstacle in their flight path. The insights from the study could also have implications for conservation efforts to mitigate collisions of birds with man-made obstacles.

Segregating signal from noise through movement in echolocating bats

Segregating signal from noise is one of the most fundamental problems shared by all biological and human-engineered sensory systems. In echolocating bats that search for small objects such as tiny insects in the presence of large obstacles (e.g., vegetation), this task can pose serious challenges as the echoes reflected from the background might be several times louder than the desired signal. Bats’ ability to adjust their sensing, specifically their echolocation signal and sequence design has been deeply studied. In this study, we show that in addition to adjusting their sensing, bats also use movement in order to segregate desired echoes from background noise. Bats responded to an acoustically echoic background by adjusting their angle of attack. Specifically, the bats in our experiment used movement and not adaptation of sensory acquisition in order to overcome a sensory challenge. They approached the target at a smaller angle of attack, which results in weaker echoes from the background as was also confirmed by measuring the echoes of the setup from the bat’s point of view. Our study demonstrates the importance of movement in active sensing.

Optic flow cues help explain altitude control over sea in freely flying gulls

For studies of how birds control their altitude, seabirds are of particular interest because they forage offshore where the visual environment can be simply modelled by a flat world textured by waves then generating only ventral visual cues. This study suggests that optic flow, i.e. the rate at which the sea moves across the eye's retina, can explain gulls' altitude control over seas. In particular, a new flight model that includes both energy and optical invariants helps explain the gulls' trajectories during offshore takeoff and cruising flight. A linear mixed model applied to 352 flights from 16 individual lesser black backed gulls (Larus fuscus) revealed a statistically significant optic flow set-point of ca 25° s^-1. Thereafter, an optic flow-based flight model was applied to 18 offshore takeoff flights from nine individual gulls. By introducing an upper limit in climb rate on the elevation dynamics, coupled with an optic flow set-point, the predicted altitude gives an optimized fit factor value of 63% on average (30-83% in range) with respect to the GPS data. We conclude that the optic flow regulation principle helps gulls to adjust their altitude over sea without having to directly measure their current altitude.

Spatial and Temporal Resolution of the Visual System of the Anna's Hummingbird (Calypte anna) Relative to Other Birds

Hummingbirds are an emerging model for studies of the visual guidance of flight. However, basic properties of their visual systems, such as spatial and temporal visual resolution, have not been characterized. We measured both the spatial and temporal visual resolution of Anna's hummingbirds using behavioral experiments and anatomical estimates. Spatial visual resolution was determined behaviorally using the optocollic reflex and anatomically using peak retinal ganglion cell densities from retinal whole mounts and eye size. Anna's hummingbirds have a spatial visual resolution of 5-6 cycles per degree when measured behaviorally, which matches anatomical estimates (fovea: 6.26 ± 0.12 cycles per degree; area temporalis: 5.59 ± 0.15 cycles per degree; and whole eye average: 4.64 ± 0.08 ). To determine temporal visual resolution, we used an operant conditioning paradigm wherein hummingbirds were trained to use a flickering light to find a food reward. The limits of temporal visual resolution were estimated as 70-80 Hz. To compare Anna's hummingbirds with other bird species, we used a phylogenetically controlled analysis of previously published data on avian visual resolutions and body size. Our measurements for Anna's hummingbird vision fall close to and below predictions based on body size for spatial visual resolution and temporal visual resolution, respectively. These results indicate that the enhanced flight performance and foraging behaviors of hummingbirds do not require enhanced spatial or temporal visual resolution. This finding is important for interpreting flight control studies and contributes to a growing understanding of avian vision.

A Hierarchical View of Gecko Locomotion: Photic Environment, Physiological Optics, and Locomotor Performance

Terrestrial animals move in complex habitats that vary over space and time. The characteristics of these habitats are not only defined by the physical environment, but also by the photic environment, even though the latter has largely been overlooked. For example, numerous studies of have examined the role of habitat structure, such as incline, perch diameter, and compliance, on running performance. However, running performance likely depends heavily on light level. Geckos are an exceptional group for analyzing the role of the photic environment on locomotion as they exhibit several independent shifts to diurnality from a nocturnal ancestor, they are visually-guided predators, and they are extremely diverse. Our initial goal is to discuss the range of photic environments that can be encountered in terrestrial habitats, such as day versus night, canopy cover in a forest, fog, and clouds. We then review the physiological optics of gecko vision with some new information about retina structures, the role of vision in motor-driven behaviors, and what is known about gecko locomotion under different light conditions, before demonstrating the effect of light levels on gecko locomotor performance. Overall, we highlight the importance of integrating sensory and motor information and establish a conceptual framework as guide for future research. Several future directions, such as understanding the role of pupil dynamics, are dependent on an integrative framework. This general framework can be extended to any motor system that relies on sensory information, and can be used to explore the impact of performance features on diversification and evolution.

Gap perception in bumblebees

A number of insects fly over long distances below the natural canopy, where the physical environment is highly cluttered consisting of obstacles of varying shape, size and texture. While navigating within such environments, animals need to perceive and disambiguate environmental features that might obstruct their flight. The most elemental aspect of aerial navigation through such environments is gap identification and 'passability' evaluation. We used bumblebees to seek insights into the mechanisms used for gap identification when confronted with an obstacle in their flight path and behavioral compensations employed to assess gap properties. Initially, bumblebee foragers were trained to fly though an unobstructed flight tunnel that led to a foraging chamber. After the bees were familiar with this situation, we placed a wall containing a gap that unexpectedly obstructed the flight path on a return trip to the hive. The flight trajectories of the bees as they approached the obstacle wall and traversed the gap were analyzed in order to evaluate their behavior as a function of the distance between the gap and a background wall that was placed behind the gap. Bumblebees initially decelerated when confronted with an unexpected obstacle. Deceleration was first noticed when the obstacle subtended around 35 deg on the retina but also depended on the properties of the gap. Subsequently, the bees gradually traded off their longitudinal velocity to lateral velocity and approached the gap with increasing lateral displacement and lateral velocity. Bumblebees shaped their flight trajectory depending on the salience of the gap, indicated in our case by the optic flow contrast between the region within the gap and on the obstacle, which decreased with decreasing distance between the gap and the background wall. As the optic flow contrast decreased, the bees spent an increasing amount of time moving laterally across the obstacles. During these repeated lateral maneuvers, the bees are probably assessing gap geometry and passability.

Echo-acoustic and optic flow interact in bats

Echolocating bats are known to fly and forage in complete darkness using the echoes of their actively emitted calls to navigate and to detect prey. However, under dim light conditions many bats can also rely on vision. Many flying animals have been shown to navigate by optic flow information, and recently, bats were shown to exploit echo-acoustic flow to navigate through dark habitats. Here we show for the bat Phyllostomus discolor that in lighted habitats where self-motion induced optic flow is strong, optic and echo-acoustic flow interact in their efficiency to guide navigation. Echo-acoustic flow showed a surprisingly strong effect compared to optic flow. We thus demonstrate multimodal interaction between two far-ranging spatial senses, vision and echolocation, available in this combination almost exclusively for bats and toothed whales. Our results highlight the importance of merging information from different sensory systems in a sensory-specialist animal to successfully navigate and hunt under difficult conditions.

Echo interval and not echo intensity drives bat flight behavior in structured corridors

To navigate in the natural environment, animals must adapt their locomotion in response to environmental stimuli. The echolocating bat relies on auditory processing of echo returns to represent its surroundings. Recent studies have shown that echo flow patterns influence bat navigation, but the acoustic basis for flight path selection remains unknown. To investigate this problem, we released bats in a flight corridor with walls constructed of adjacent individual wooden poles, which returned cascades of echoes to the flying bat. We manipulated the spacing and echo strength of the poles comprising each corridor side, and predicted that bats would adapt their flight paths to deviate toward the corridor side returning weaker echo cascades. Our results show that the bat's trajectory through the corridor was not affected by the intensity of echo cascades. Instead, bats deviated toward the corridor wall with more sparsely spaced, highly reflective poles, suggesting that pole spacing, rather than echo intensity, influenced bat flight path selection. This result motivated investigation of the neural processing of echo cascades. We measured local evoked auditory responses in the bat inferior colliculus to echo playback recordings from corridor walls constructed of sparsely and densely spaced poles. We predicted that evoked neural responses would be discretely modulated by temporally distinct echoes recorded from the sparsely spaced pole corridor wall, but not by echoes from the more densely spaced corridor wall. The data confirm this prediction and suggest that the bat's temporal resolution of echo cascades may drive its flight behavior in the corridor.

Self-motion processing in visual and entorhinal cortices: inputs, integration, and implications for position coding

The sensory signals generated by self-motion are complex and multimodal, but the ability to integrate these signals into a unified self-motion percept to guide navigation is essential for animal survival. Here, we summarize classic and recent work on self-motion coding in the visual and entorhinal cortices of the rodent brain. We compare motion processing in rodent and primate visual cortices, highlighting the strengths of classic primate work in establishing causal links between neural activity and perception, and discuss the integration of motor and visual signals in rodent visual cortex. We then turn to the medial entorhinal cortex (MEC), where calculations using self-motion to update position estimates are thought to occur. We focus on several key sources of self-motion information to MEC: the medial septum, which provides locomotor speed information; visual cortex, whose input has been increasingly recognized as essential to both position and speed-tuned MEC cells; and the head direction system, which is a major source of directional information for self-motion estimates. These inputs create a large and diverse group of self-motion codes in MEC, and great interest remains in how these self-motion codes might be integrated by MEC grid cells to estimate position. However, which signals are used in these calculations and the mechanisms by which they are integrated remain controversial. We end by proposing future experiments that could further our understanding of the interactions between MEC cells that code for self-motion and position and clarify the relationship between the activity of these cells and spatial perception.

Head-mounted sensors reveal visual attention of free-flying homing pigeons

Gaze behavior offers valuable insights into attention and cognition. However, technological limitations have prevented the examination of animals' gaze behavior in natural, information-rich contexts; for example, during navigation through complex environments. Therefore, we developed a lightweight custom-made logger equipped with an inertial measurement unit (IMU) and GPS to simultaneously track the head movements and flight trajectories of free-flying homing pigeons. Pigeons have a limited range of eye movement, and their eye moves in coordination with their head in a saccadic manner (similar to primate eye saccades). This allows head movement to act as a proxy for visual scanning behavior. Our IMU sensor recorded the 3D movement of the birds' heads in high resolution, allowing us to reliably detect distinct saccade signals. The birds moved their head far more than necessary for maneuvering flight, suggesting that they actively scanned the environment. This movement was predominantly horizontal (yaw) and sideways (roll), allowing them to scan the environment with their lateral visual field. They decreased their head movement when they flew solo over prominent landmarks (major roads and a railway line) and also when they flew in pairs (especially when flying side by side, with the partner maintained in their lateral visual field). Thus, a decrease in head movement indicates a change in birds' focus of attention. We conclude that pigeons use their head gaze in a task-related manner and that tracking flying birds' head movement is a promising method for examining their visual attention during natural tasks.

Comparative analysis of vestibular ecomorphology in birds

The bony labyrinth of vertebrates houses the semicircular canals. These sense rotational accelerations of the head and play an essential role in gaze stabilisation during locomotion. The sizes and shapes of the semicircular canals have hypothesised relationships to agility and locomotory modes in many groups, including birds, and a burgeoning palaeontological literature seeks to make ecological interpretations from the morphology of the labyrinth in extinct species. Rigorous tests of form-function relationships for the vestibular system are required to support these interpretations. We test the hypothesis that the lengths, streamlines and angles between the semicircular canals are related to body size, wing kinematics and flying style in birds. To do this, we applied geometric morphometrics and multivariate phylogenetic comparative methods to a dataset of 64 three-dimensional reconstructions of the endosseous labyrinth obtained using micro-computed tomography scanning of bird crania. A strong relationship between centroid size of the semicircular canals and body size indicates that larger birds have longer semicircular canals compared with their evolutionary relatives. Wing kinematics related to manoeuvrability (and quantified using the brachial index) explain a small additional portion of the variance in labyrinth size. We also find strong evidence for allometric shape change in the semicircular canals of birds, indicating that major aspects of the shape of the avian labyrinth are determined by spatial constraints. The avian braincase accommodates a large brain, a large eye and large semicircular canals compared with other tetrapods. Negative allometry of these structures means that the restriction of space within the braincase is intense in small birds. This may explain our observation that the angles between planes of the semicircular canals of birds deviate more strongly from orthogonality than those of mammals, and especially from agile, gliding and flying mammals. Furthermore, we find little support for relationships between labyrinth shape and flying style or wing kinematics. Overall, our results suggest that the topological problem of fitting long semicircular canals into a spatially constrained braincase is more important in determining the shape of the avian labyrinth than the specifics of locomotory style or agility. Our results tentatively indicate a link between visual acuity and proportional size of the labyrinth among birds. This suggests that the large labyrinths of birds compared with other tetrapods may result from their generally high visual acuities, and not directly from their ability to fly. The endosseous labyrinths of extinct birds and their close dinosaurian relatives may allow broad inferences about flight or vision, but so far provide few specific insights into detailed aspects of locomotion.

Spatial Encoding of Translational Optic Flow in Planar Scenes by Elementary Motion Detector Arrays

Elementary Motion Detectors (EMD) are well-established models of visual motion estimation in insects. The response of EMDs are tuned to specific temporal and spatial frequencies of the input stimuli, which matches the behavioural response of insects to wide-field image rotation, called the optomotor response. However, other behaviours, such as speed and position control, cannot be fully accounted for by EMDs because these behaviours are largely unaffected by image properties and appear to be controlled by the ratio between the flight speed and the distance to an object, defined here as relative nearness. We present a method that resolves this inconsistency by extracting an unambiguous estimate of relative nearness from the output of an EMD array. Our method is suitable for estimation of relative nearness in planar scenes such as when flying above the ground or beside large flat objects. We demonstrate closed loop control of the lateral position and forward velocity of a simulated agent flying in a corridor. This finding may explain how insects can measure relative nearness and control their flight despite the frequency tuning of EMDs. Our method also provides engineers with a relative nearness estimation technique that benefits from the low computational cost of EMDs.

Visual-Cerebellar Pathways and Their Roles in the Control of Avian Flight

In this paper, we review the connections and physiology of visual pathways to the cerebellum in birds and consider their role in flight. We emphasize that there are two visual pathways to the cerebellum. One is to the vestibulocerebellum (folia IXcd and X) that originates from two retinal-recipient nuclei that process optic flow: the nucleus of the basal optic root (nBOR) and the pretectal nucleus lentiformis mesencephali (LM). The second is to the oculomotor cerebellum (folia VI-VIII), which receives optic flow information, mainly from LM, but also local visual motion information from the optic tectum, and other visual information from the ventral lateral geniculate nucleus (Glv). The tectum, LM and Glv are all intimately connected with the pontine nuclei, which also project to the oculomotor cerebellum. We believe this rich integration of visual information in the cerebellum is important for analyzing motion parallax that occurs during flight. Finally, we extend upon a suggestion by Ibbotson (2017) that the hypertrophy that is observed in LM in hummingbirds might be due to an increase in the processing demands associated with the pathway to the oculomotor cerebellum as they fly through a cluttered environment while feeding.

A direct optic flow-based strategy for inverse flight altitude estimation with monocular vision and IMU measurements

With tiny and limited nervous systems, insects demonstrate a remarkable ability to fly through complex environments. Optic flow has been identified to play a crucial role in regulating flight conditions and navigation in flies and bees. In robotics, optic flow has been widely studied thanks to the low computational requirements. However, with only monocular visual information, optic flow is inherently devoid of a scale factor required for estimating the absolute distance. In this paper, we propose a strategy for estimating the flight altitude of a flying robot with a ventral camera by combining the optic flow with measurements from an inertial measurement unit. Instead of using the prevalent feature-based approach for calculation of optic flow, we implement a direct method that evaluates the flow information via image gradients. We show that the direct approach notably simplifies the computation steps compared to the feature-based method. When combined with an extended Kalman filter for fusion of inertial measurement units measurements, the flight altitude can be estimated in real time. We carried out extensive flight tests in different settings. Among 31 hovering and vertical flights near the altitude of 40 cm, we achieved the RMS errors in the altitude estimate of 2.51 cm. Further analysis of factors that affect the quality of the flow and the distance estimate is also provided.

Comparison of Visually Guided Flight in Insects and Birds

Over the last half century, work with flies, bees, and moths have revealed a number of visual guidance strategies for controlling different aspects of flight. Some algorithms, such as the use of pattern velocity in forward flight, are employed by all insects studied so far, and are used to control multiple flight tasks such as regulation of speed, measurement of distance, and positioning through narrow passages. Although much attention has been devoted to long-range navigation and homing in birds, until recently, very little was known about how birds control flight in a moment-to-moment fashion. A bird that flies rapidly through dense foliage to land on a branch—as birds often do—engages in a veritable three-dimensional slalom, in which it has to continually dodge branches and leaves, and find, and possibly even plan a collision-free path to the goal in real time. Each mode of flight from take-off to goal could potentially involve a different visual guidance algorithm. Here, we briefly review strategies for visual guidance of flight in insects, synthesize recent work from short-range visual guidance in birds, and offer a general comparison between the two groups of organisms.

The Orientation of Visual Space from the Perspective of Hummingbirds

Vision is a key component of hummingbird behavior. Hummingbirds hover in front of flowers, guide their bills into them for foraging, and maneuver backwards to undock from them. Capturing insects is also an important foraging strategy for most hummingbirds. However, little is known about the visual sensory specializations hummingbirds use to guide these two foraging strategies. We characterized the hummingbird visual field configuration, degree of eye movement, and orientation of the centers of acute vision. Hummingbirds had a relatively narrow binocular field (~30°) that extended above and behind their heads. Their blind area was also relatively narrow (~23°), which increased their visual coverage (about 98% of their celestial hemisphere). Additionally, eye movement amplitude was relatively low (~9°), so their ability to converge or diverge their eyes was limited. We confirmed that hummingbirds have two centers of acute vision: a fovea centralis, projecting laterally, and an area temporalis, projecting more frontally. This retinal configuration is similar to other predatory species, which may allow hummingbirds to enhance their success at preying on insects. However, there is no evidence that their temporal area could visualize the bill tip or that eye movements could compensate for this constraint. Therefore, guidance of precise bill position during the process of docking occurs via indirect cues or directly with low visual acuity despite having a temporal center of acute vision. The large visual coverage may favor the detection of predators and competitors even while docking into a flower. Overall, hummingbird visual configuration does not seem specialized for flower docking.

Budgerigar flight in a varying environment: flight at distinct speeds?

How do flying birds respond to changing environments? The behaviour of budgerigars, Melopsittacus undulatus, was filmed as they flew through a tapered tunnel. Unlike flying insects-which vary their speed progressively and continuously by holding constant the optic flow induced by the walls-the birds showed a tendency to fly at only two distinct, fixed speeds. They switched between a high speed in the wider section of the tunnel, and a low speed in the narrower section. The transition between the two speeds was abrupt, and anticipatory. The high speed was close to the energy-efficient, outdoor cruising speed for these birds, while the low speed was approximately half this value. This is the first observation of the existence of two distinct, preferred flight speeds in birds. A dual-speed flight strategy may be beneficial for birds that fly in varying environments, with the high speed set at an energy-efficient value for flight through open spaces, and the low speed suited to safe manoeuvring in a cluttered environment. The constancy of flight speed within each regime enables the distances of obstacles and landmarks to be directly calibrated in terms of optic flow, thus facilitating simple and efficient guidance of flight through changing environments.

Pigeons (C. livia) Follow Their Head during Turning Flight: Head Stabilization Underlies the Visual Control of Flight

Similar flight control principles operate across insect and vertebrate fliers. These principles indicate that robust solutions have evolved to meet complex behavioral challenges. Following from studies of visual and cervical feedback control of flight in insects, we investigate the role of head stabilization in providing feedback cues for controlling turning flight in pigeons. Based on previous observations that the eyes of pigeons remain at relatively fixed orientations within the head during flight, we test potential sensory control inputs derived from head and body movements during 90° aerial turns. We observe that periods of angular head stabilization alternate with rapid head repositioning movements (head saccades), and confirm that control of head motion is decoupled from aerodynamic and inertial forces acting on the bird's continuously rotating body during turning flapping flight. Visual cues inferred from head saccades correlate with changes in flight trajectory; whereas the magnitude of neck bending predicts angular changes in body position. The control of head motion to stabilize a pigeon's gaze may therefore facilitate extraction of important motion cues, in addition to offering mechanisms for controlling body and wing movements. Strong similarities between the sensory flight control of birds and insects may also inspire novel designs of robust controllers for human-engineered autonomous aerial vehicles.

What Drives Bird Vision? Bill Control and Predator Detection Overshadow Flight

Although flight is regarded as a key behavior of birds this review argues that the perceptual demands for its control are met within constraints set by the perceptual demands of two other key tasks: the control of bill (or feet) position, and the detection of food items/predators. Control of bill position, or of the feet when used in foraging, and timing of their arrival at a target, are based upon information derived from the optic flow-field in the binocular region that encompasses the bill. Flow-fields use information extracted from close to the bird using vision of relatively low spatial resolution. The detection of food items and predators is based upon information detected at a greater distance and depends upon regions in the retina with relatively high spatial resolution. The tasks of detecting predators and of placing the bill (or feet) accurately, make contradictory demands upon vision and these have resulted in trade-offs in the form of visual fields and in the topography of retinal regions in which spatial resolution is enhanced, indicated by foveas, areas, and high ganglion cell densities. The informational function of binocular vision in birds does not lie in binocularity per se (i.e., two eyes receiving slightly different information simultaneously about the same objects) but in the contralateral projection of the visual field of each eye. This ensures that each eye receives information from a symmetrically expanding optic flow-field centered close to the direction of the bill, and from this the crucial information of direction of travel and time-to-contact can be extracted, almost instantaneously. Interspecific comparisons of visual fields between closely related species have shown that small differences in foraging techniques can give rise to different perceptual challenges and these have resulted in differences in visual fields even within the same genus. This suggests that vision is subject to continuing and relatively rapid natural selection based upon individual differences in the structure of the optical system, retinal topography, and eye position in the skull. From a sensory ecology perspective a bird is best characterized as "a bill guided by an eye" and that control of flight is achieved within constraints on visual capacity dictated primarily by the demands of foraging and bill control.

How bumblebees use lateral and ventral optic flow cues for position control in environments of different proximity

Flying insects frequently navigate through environments of different complexity. In this study, buff-tailed bumblebees (Bombus terrestris L.) were trained to fly along tunnels of different widths, from 60 to 240 cm. In tunnel widths of 60 and 120 cm, bumblebees control their lateral position by balancing the magnitude of translational optic flow experienced in the lateral visual field of each eye. In wider tunnels, bumblebees use translational optic flow cues in the ventral visual field to control their lateral position and to steer along straight tracks. Our results also suggest that bumblebees prefer to fly over surfaces that provide strong ventral optic flow cues, rather than over featureless ones. Together, these strategies allow bumblebees to minimize the risk of collision and to maintain relatively straight flight paths in a broad range of environments.