Through a barn owl's eyes: interactions between scene content and visual attention

How to improve data quality in dog eye tracking

Pupil-corneal reflection (P-CR) eye tracking has gained a prominent role in studying dog visual cognition, despite methodological challenges that often lead to lower-quality data than when recording from humans. In the current study, we investigated if and how the morphology of dogs might interfere with tracking of P-CR systems, and to what extent such interference, possibly in combination with dog-unique eye-movement characteristics, may undermine data quality and affect eye-movement classification when processed through algorithms. For this aim, we have conducted an eye-tracking experiment with dogs and humans, and investigated incidences of tracking interference, compared how they blinked, and examined how differential quality of dog and human data affected the detection and classification of eye-movement events. Our results show that the morphology of dogs' face and eye can interfere with tracking methods of the systems, and dogs blink less often but their blinks are longer. Importantly, the lower quality of dog data lead to larger differences in how two different event detection algorithms classified fixations, indicating that the results of key dependent variables are more susceptible to choice of algorithm in dog than human data. Further, two measures of the Nyström & Holmqvist (Behavior Research Methods, 42(4), 188-204, 2010) algorithm showed that dog fixations are less stable and dog data have more trials with extreme levels of noise. Our findings call for analyses better adjusted to the characteristics of dog eye-tracking data, and our recommendations help future dog eye-tracking studies acquire quality data to enable robust comparisons of visual cognition between dogs and humans.

Behavioral and neuronal study of inhibition of return in barn owls

Inhibition of return (IOR) is the reduction of detection speed and/or detection accuracy of a target in a recently attended location. This phenomenon, which has been discovered and studied thoroughly in humans, is believed to reflect a brain mechanism for controlling the allocation of spatial attention in a manner that enhances efficient search. Findings showing that IOR is robust, apparent at a very early age and seemingly dependent on midbrain activity suggest that IOR is a universal attentional mechanism in vertebrates. However, studies in non-mammalian species are scarce. To explore this hypothesis comparatively, we tested for IOR in barn owls (Tyto alba) using the classical Posner cueing paradigm. Two barn owls were trained to initiate a trial by fixating on the center of a computer screen and then turning their gaze to the location of a target. A short, non-informative cue appeared before the target, either at a location predicting the target (valid) or a location not predicting the target (invalid). In one barn owl, the response times (RT) to the valid targets compared to the invalid targets shifted from facilitation (lower RTs) to inhibition (higher RTs) when increasing the time lag between the cue and the target. The second owl mostly failed to maintain fixation and responded to the cue before the target onset. However, when including in the analysis only the trials in which the owl maintained fixation, an inhibition in the valid trials could be detected. To search for the neural correlates of IOR, we recorded multiunit responses in the optic tectum (OT) of four head-fixed owls passively viewing a cueing paradigm as in the behavioral experiments. At short cue to target lags (<100 ms), neural responses to the target in the receptive field (RF) were usually enhanced if the cue appeared earlier inside the RF (valid) and were suppressed if the cue appeared earlier outside the RF (invalid). This was reversed at longer lags: neural responses were suppressed in the valid conditions and were unaffected in the invalid conditions. The findings support the notion that IOR is a basic mechanism in the evolution of vertebrate behavior and suggest that the effect appears as a result of the interaction between lateral and forward inhibition in the tectal circuitry.

Behavioral Evidence and Neural Correlates of Perceptual Grouping by Motion in the Barn Owl

Perceiving an object as salient from its surround often requires a preceding process of grouping the object and background elements as perceptual wholes. In humans, motion homogeneity provides a strong cue for grouping, yet it is unknown to what extent this occurs in nonprimate species. To explore this question, we studied the effects of visual motion homogeneity in barn owls of both genders, at the behavioral as well as the neural level. Our data show that the coherency of the background motion modulates the perceived saliency of the target object. An object moving in an odd direction relative to other objects attracted more attention when the other objects moved homogeneously compared with when moved in a variety of directions. A possible neural correlate of this effect may arise in the population activity of the intermediate/deep layers of the optic tectum. In these layers, the neural responses to a moving element in the receptive field were suppressed when additional elements moved in the surround. However, when the surrounding elements all moved in one direction (homogeneously moving), they induced less suppression of the response compared with nonhomogeneously moving elements. Moreover, neural responses were more sensitive to the homogeneity of the background motion than to motion-direction contrasts between the receptive field and the surround. The findings suggest similar principles of saliency-by-motion in an avian species as in humans and show a locus in the optic tectum where the underlying neural circuitry may exist.SIGNIFICANCE STATEMENT A critical task of the visual system is to arrange incoming visual information to a meaningful scene of objects and background. In humans, elements that move homogeneously are grouped perceptually to form a categorical whole object. We discovered a similar principle in the barn owl's visual system, whereby the homogeneity of the motion of elements in the scene allows perceptually distinguishing an object from its surround. The novel findings of these visual effects in an avian species, which lacks neocortical structure, suggest that our basic visual perception shares more universal principles across species than presently thought, and shed light on possible brain mechanisms for perceptual grouping.

Selective attention without a neocortex

Selective attention refers to the ability to restrict neural processing and behavioral responses to a relevant subset of available stimuli, while simultaneously excluding other valid stimuli from consideration. In primates and other mammals, descriptions of this ability typically emphasize the neural processing that takes place in the cerebral neocortex. However, non-mammals such as birds, reptiles, amphibians and fish, which completely lack a neocortex, also have the ability to selectively attend. In this article, we survey the behavioral evidence for selective attention in non-mammals, and review the midbrain and forebrain structures that are responsible. The ancestral forms of selective attention are presumably selective orienting behaviors, such as prey-catching and predator avoidance. These behaviors depend critically on a set of subcortical structures, including the optic tectum (OT), thalamus and striatum, that are highly conserved across vertebrate evolution. In contrast, the contributions of different pallial regions in the forebrain to selective attention have been subject to more substantial changes and reorganization. This evolutionary perspective makes plain that selective attention is not a function achieved de novo with the emergence of the neocortex, but instead is implemented by circuits accrued and modified over hundreds of millions of years, beginning well before the forebrain contained a neocortex. Determining how older subcortical circuits interact with the more recently evolved components in the neocortex will likely be crucial for understanding the complex properties of selective attention in primates and other mammals, and for identifying the etiology of attention disorders.

Interactions between top-down and bottom-up attention in barn owls (Tyto alba)

Selective attention, the prioritization of behaviorally relevant stimuli for behavioral control, is commonly divided into two processes: bottom-up, stimulus-driven selection and top-down, task-driven selection. Here, we tested two barn owls in a visual search task that examines attentional capture of the top-down task by bottom-up mechanisms. We trained barn owls to search for a vertical Gabor patch embedded in a circular array of differently oriented Gabor distractors (top-down guided search). To track the point of gaze, a lightweight wireless video camera was mounted on the owl's head. Three experiments were conducted in which the owls were tested in the following conditions: (1) five distractors; (2) nine distractors; (3) five distractors with one distractor surrounded by a red circle; or (4) five distractors with a brief sound at the initiation of the stimulus. Search times and number of head saccades to reach the target were measured and compared between the different conditions. It was found that search time and number of saccades to the target increased when the number of distractors was larger (condition 2) and when an additional irrelevant salient stimulus, auditory or visual, was added to the scene (conditions 3 and 4). These results demonstrate that in barn owls, bottom-up attention interacts with top-down attention to shape behavior in ways similar to human attentional capture. The findings suggest similar attentional principles in taxa that have been evolutionarily separated for 300 million years.

From biokinematics to a robotic active vision system

Barn owls move their heads in very particular motions, compensating for the quasi-immovability of their eyes. These efficient predators often perform peering side-to-side head motions when scanning their surroundings and seeking prey. In this work, we use the head movements of barn owls as a model to bridge between biological active vision and machine vision. The biomotions are measured and used to actuate a specially built robot equipped with a depth camera for scanning. We hypothesize that the biomotions improve scan accuracy of static objects. Our experiments show that barn owl biomotion-based trajectories consistently improve scan accuracy when compared to intuitive scanning motions. This constitutes proof-of-concept evidence that the vision of robotic systems can be enhanced by bio-inspired viewpoint manipulation. Such biomimetic scanning systems can have many applications, e.g. manufacturing inspection or in autonomous robots.

Contrast response functions in the visual wulst of the alert burrowing owl: a single-unit study

The neuronal representation of luminance contrast has not been thoroughly studied in birds. Here we present a detailed quantitative analysis of the contrast response of 120 individual neurons recorded from the visual wulst of awake burrowing owls (Athene cunicularia). Stimuli were sine-wave gratings presented within the cell classical receptive field and optimized in terms of eye preference, direction of drift, and spatiotemporal frequency. As contrast intensity was increased from zero to near 100%, most cells exhibited a monotonic response profile with a compressive, at times saturating, nonlinearity at higher contrasts. However, contrast response functions were found to have a highly variable shape across cells. With the view to capture a systematic trend in the data, we assessed the performance of four plausible models (linear, power, logarithmic, and hyperbolic ratio) using classical goodness-of-fit measures and more rigorous statistical tools for multimodel inferences based on the Akaike information criterion. From this analysis, we conclude that a high degree of model uncertainty is present in our data, meaning that no single descriptor is able on its own to capture the heterogeneous nature of single-unit contrast responses in the wulst. We further show that the generalizability of the hyperbolic ratio model established, for example, in the primary visual cortex of cats and monkeys is not tenable in the owl wulst mainly because most neurons in this area have a much wider dynamic range that starts at low contrast. The challenge for future research will be to understand the functional implications of these findings.

Responses to Pop-Out Stimuli in the Barn Owl's Optic Tectum Can Emerge through Stimulus-Specific Adaptation

Here, we studied neural correlates of orientation-contrast-based saliency in the optic tectum (OT) of barn owls. Neural responses in the intermediate/deep layers of the OT were recorded from lightly anesthetized owls confronted with arrays of bars in which one bar (the target) was orthogonal to the remaining bars (the distractors). Responses to target bars were compared with responses to distractor bars in the receptive field (RF). Initially, no orientation-contrast sensitivity was observed. However, if the position of the target bar in the array was randomly shuffled across trials so that it occasionally appeared in the RF, then such sensitivity emerged. The effect started to become significant after three or four positional changes of the target bar and strengthened with additional trials. Our data further suggest that this effect arises due to specific adaptation to the stimulus in the RF combined with suppression from the surround. By jittering the position of the bar inside the RF across trials, we demonstrate that the adaptation has two components, one position specific and one orientation specific. The findings give rise to the hypothesis that barn owls, by active scanning of the scene, can induce adaptation of the tectal circuitry to the common orientation and thus achieve a "pop-out" of rare orientations. Such a model is consistent with several behavioral observations in owls and may be relevant to other visual features and species.

SIGNIFICANCE STATEMENT

Natural scenes are often characterized by a dominant orientation, such as the scenery of a pine forest or the sand dunes in a windy desert. Therefore, orientation that contrasts the regularity of the scene is perceived salient for many animals as a means to break camouflage. By actively moving the scene between each trial, we show here that neurons in the retinotopic map of the barn owl's optic tectum specifically adapt to the common orientation, giving rise to preferential representation of odd orientations. Based on this, we suggest a new mechanism for orientation-based camouflage breaking that links active scanning of scenes with neural adaptation. This mechanism may be relevant to pop-out in other species and visual features.

When hawks attack: animal-borne video studies of goshawk pursuit and prey-evasion strategies

Video filmed by a camera mounted on the head of a Northern Goshawk (Accipiter gentilis) was used to study how the raptor used visual guidance to pursue prey and land on perches. A combination of novel image analysis methods and numerical simulations of mathematical pursuit models was used to determine the goshawk's pursuit strategy. The goshawk flew to intercept targets by fixing the prey at a constant visual angle, using classical pursuit for stationary prey, lures or perches, and usually using constant absolute target direction (CATD) for moving prey. Visual fixation was better maintained along the horizontal than vertical direction. In some cases, we observed oscillations in the visual fix on the prey, suggesting that the goshawk used finite-feedback steering. Video filmed from the ground gave similar results. In most cases, it showed goshawks intercepting prey using a trajectory consistent with CATD, then turning rapidly to attack by classical pursuit; in a few cases, it showed them using curving non-CATD trajectories. Analysis of the prey's evasive tactics indicated that only sharp sideways turns caused the goshawk to lose visual fixation on the prey, supporting a sensory basis for the surprising frequency and effectiveness of this tactic found by previous studies. The dynamics of the prey's looming image also suggested that the goshawk used a tau-based interception strategy. We interpret these results in the context of a concise review of pursuit-evasion in biology, and conjecture that some prey deimatic 'startle' displays may exploit tau-based interception.

Visual-auditory integration for visual search: a behavioral study in barn owls

Barn owls are nocturnal predators that rely on both vision and hearing for survival. The optic tectum of barn owls, a midbrain structure involved in selective attention, has been used as a model for studying visual-auditory integration at the neuronal level. However, behavioral data on visual-auditory integration in barn owls are lacking. The goal of this study was to examine if the integration of visual and auditory signals contributes to the process of guiding attention toward salient stimuli. We attached miniature wireless video cameras on barn owls' heads (OwlCam) to track their target of gaze. We first provide evidence that the area centralis (a retinal area with a maximal density of photoreceptors) is used as a functional fovea in barn owls. Thus, by mapping the projection of the area centralis on the OwlCam's video frame, it is possible to extract the target of gaze. For the experiment, owls were positioned on a high perch and four food items were scattered in a large arena on the floor. In addition, a hidden loudspeaker was positioned in the arena. The positions of the food items and speaker were changed every session. Video sequences from the OwlCam were saved for offline analysis while the owls spontaneously scanned the room and the food items with abrupt gaze shifts (head saccades). From time to time during the experiment, a brief sound was emitted from the speaker. The fixation points immediately following the sounds were extracted and the distances between the gaze position and the nearest items and loudspeaker were measured. The head saccades were rarely toward the location of the sound source but to salient visual features in the room, such as the door knob or the food items. However, among the food items, the one closest to the loudspeaker had the highest probability of attracting a gaze shift. This result supports the notion that auditory signals are integrated with visual information for the selection of the next visual search target.

Coding space-time stimulus dynamics in auditory brain maps

Sensory maps are often distorted representations of the environment, where ethologically-important ranges are magnified. The implication of a biased representation extends beyond increased acuity for having more neurons dedicated to a certain range. Because neurons are functionally interconnected, non-uniform representations influence the processing of high-order features that rely on comparison across areas of the map. Among these features are time-dependent changes of the auditory scene generated by moving objects. How sensory representation affects high order processing can be approached in the map of auditory space of the owl's midbrain, where locations in the front are over-represented. In this map, neurons are selective not only to location but also to location over time. The tuning to space over time leads to direction selectivity, which is also topographically organized. Across the population, neurons tuned to peripheral space are more selective to sounds moving into the front. The distribution of direction selectivity can be explained by spatial and temporal integration on the non-uniform map of space. Thus, the representation of space can induce biased computation of a second-order stimulus feature. This phenomenon is likely observed in other sensory maps and may be relevant for behavior.

Neuroethology of prey capture in the barn owl (Tyto alba L.)

Barn owls are a model system for studying prey capture. These animals can catch mice by hearing alone, but use vision whenever light conditions allow this. The silent flight, the frontally oriented eyes, and the facial ruffs are specializations that evolved to optimize prey capture. The auditory system is characterized by high absolute sensitivity, a use of interaural time difference for azimuthal sound-localization over almost the total hearing range up to at least 9 kHz, and the use of interaural level difference for elevational sound localization in the upper frequency range. Response latencies towards auditory targets were shortened by covert attention, while overt attention helped to orient towards salient visual objects. However, only 20% of the fixation movements could be explained by the saliency of the fixated objects, suggesting a top-down control of attention. In a visual-search experiment the birds turned earlier and more often towards and spent more time at salient objects. The visual system also exhibits high absolute sensitivity, while the spatial resolution is not particularly high. Last but not least, head movements may be classified as fixations, translations, and rotations combined with translations. These motion primitives may be combined to complex head-movement patterns. With the expected easy availability of genetic techniques for specialists in the near future and the possibility to apply the findings in biomimetic devices prey capture in barn owls will remain an exciting field in the future.

Overt attention toward oriented objects in free-viewing barn owls

Visual saliency based on orientation contrast is a perceptual product attributed to the functional organization of the mammalian brain. We examined this visual phenomenon in barn owls by mounting a wireless video microcamera on the owls' heads and confronting them with visual scenes that contained one differently oriented target among similarly oriented distracters. Without being confined by any particular task, the owls looked significantly longer, more often, and earlier at the target, thus exhibiting visual search strategies so far demonstrated in similar conditions only in primates. Given the considerable differences in phylogeny and the structure of visual pathways between owls and humans, these findings suggest that orientation saliency has computational optimality in a wide variety of ecological contexts, and thus constitutes a universal building block for efficient visual information processing in general.

Hawk eyes II: diurnal raptors differ in head movement strategies when scanning from perches

Background

Relatively little is known about the degree of inter-specific variability in visual scanning strategies in species with laterally placed eyes (e.g., birds). This is relevant because many species detect prey while perching; therefore, head movement behavior may be an indicator of prey detection rate, a central parameter in foraging models. We studied head movement strategies in three diurnal raptors belonging to the Accipitridae and Falconidae families.

Methodology/Principal Findings

We used behavioral recording of individuals under field and captive conditions to calculate the rate of two types of head movements and the interval between consecutive head movements. Cooper's Hawks had the highest rate of regular head movements, which can facilitate tracking prey items in the visually cluttered environment they inhabit (e.g., forested habitats). On the other hand, Red-tailed Hawks showed long intervals between consecutive head movements, which is consistent with prey searching in less visually obstructed environments (e.g., open habitats) and with detecting prey movement from a distance with their central foveae. Finally, American Kestrels have the highest rates of translational head movements (vertical or frontal displacements of the head keeping the bill in the same direction), which have been associated with depth perception through motion parallax. Higher translational head movement rates may be a strategy to compensate for the reduced degree of eye movement of this species.

Conclusions

Cooper's Hawks, Red-tailed Hawks, and American Kestrels use both regular and translational head movements, but to different extents. We conclude that these diurnal raptors have species-specific strategies to gather visual information while perching. These strategies may optimize prey search and detection with different visual systems in habitat types with different degrees of visual obstruction.

Getting real-sensory processing of natural stimuli

Normal sensory experience rarely presents us with isolated bars, gratings, or other stimuli that have shaped our knowledge of sensory representations. Instead, typical input adheres to certain statistical regularities, which make it 'natural' and cannot be adequately modeled by linear superposition of simple stimuli. Natural stimuli necessitate a paradigm shift with a focus on downstream processing. This shift currently follows three main lines: quantification of the information a downstream area can read out (decoding); describing a representation as the optimization of computational principles with respect to natural input (normative approach); understanding the sensory representation as optimal for the systems' tasks and intended actions (behavioral context). The interaction between representational levels, intermediate-level features, and bidirectional coupling through attention are key elements for sensory processing.

Peck tracking: a method for localizing critical features within complex pictures for pigeons

The pigeon is a standard animal in comparative psychology and is frequently used to investigate visuocognitive functions. Nonetheless, the strategies that pigeons use to discriminate complex visual stimuli remain a difficult area of study. In search of a reliable method to identify features that control the discrimination behaviour, pecking location was tracked using touch screen technology in a people-absent/people-present discrimination task. The correct stimuli contained human figures anywhere on the picture, but the birds were not required to peck on that part. However, the stimuli were designed in a way that only the human figures contained distinguishing information. All pigeons focused their pecks on a subarea of the distinctive human figures, namely the heads. Removal of the heads significantly impaired performance, while removal of other distinctive parts did not. Thus, peck tracking reveals the location within a complex visual stimulus that controls discrimination behaviour, and might be a valuable tool to reveal the strategies pigeons apply in visual discrimination tasks.