Encoding of both vertical and horizontal disparity in random-dot stereograms by Wulst neurons of awake barn owls

Evolution of Plumage Patterns in a Pattern Morphospace: A Phylogenetic Analysis of Melanerpine Woodpeckers

AbstractPlumage patterns of melanerpine (Melanerpes-Sphyrapicus) woodpeckers are strikingly diverse. Understanding the evolution and function of this diversity is challenging because of the difficulty of quantifying plumage patterns. We use a three-dimensional space to characterize the evolution of melanerpine achromatic plumage patterns. The axes of the space are three pattern features (spatial frequency, orientation, and contrast) quantified using two-dimensional fast Fourier transformation of museum specimen images. Mapping plumage in pattern space reveals differences in how species and subclades occupy the space. To quantify these differences, we derive two new measures of pattern: pattern diversity (diversity across plumage patches within a species) and pattern uniqueness (divergence of patterns from those of other species). We estimate that the melanerpine ancestor had mottled plumage and find that pattern traits across patches and subclades evolve at different rates. We also find that smaller species are more likely to display horizontal face patterning. We promote pattern spaces as powerful tools for investigating animal pattern evolution.

What's special about horizontal disparity

Horizontal disparity has been recognized as the primary signal driving stereoscopic depth since the invention of the stereoscope in the 1830s. It has a unique status in our understanding of binocular vision. The direction of offset of the eyes gives the disparities of corresponding image point locations across the two retinas a strong horizontal bias. Beyond the retina, other factors give shape to the effective disparity direction used by visual mechanisms. The influence of orientation is examined here. I argue that horizontal disparity is an inflection point along a continuum of effective directions, and its role in stereo vision can be reinterpreted. The pointwise geometric justification for its special status neglects the oriented structural elements of spatial vision, its physiological support is equivocal, and psychophysical support of its special status may partially reflect biased stimulus sampling. The literature shows that horizontal disparity plays no particular role in the processing of one-dimensional stimuli, a reflection of the stereo aperture problem. The resulting depth is non-veridical, even non-transitive. Although one-dimensional components contribute to the stereo depth of visual objects generally, two-dimensional stimuli appear not to inherit the aperture problem. However, a look at the two-dimensional stimuli that predominate in experimental studies shows regularities in orientation that give a new perspective on horizontal disparity.

Sensory systems in birds: What we have learned from studying sensory specialists

"Diversity" is an apt descriptor of the research career of Jack Pettigrew as it ranged from the study of trees, to clinical conditions, to sensory neuroscience. Within sensory neuroscience, he was fascinated by the evolution of sensory systems across species. Here, we review some of his work on avian sensory specialists and research that he inspired in others. We begin with an overview of the importance of the Wulst in stereopsis and the need for further study of the Wulst in relation to binocularity across avian species. Next, we summarize recent anatomical, behavioral, and physiological studies on optic flow specializations in hummingbirds. Beyond vision, we discuss the first evidence of a tactile "fovea" in birds and how this led to detailed studies of tactile specializations in waterfowl and sensorimotor systems in parrots. We then describe preliminary studies by Pettigrew of two endemic Australian species, the plains-wanderer (Pedionomus torquatus) and letter-winged kite (Elanus scriptus), that suggest the evolution of some unique auditory and visual specializations in relation to their unique behavior and ecology. Finally, we conclude by emphasizing the importance of a comparative and integrative approach to understanding avian sensory systems and provide an example of one system that has yet to be properly examined: tactile facial bristles in birds. Through reviewing this research and offering future avenues for discovery, we hope that others also embrace the comparative approach to understanding sensory system evolution in birds and other vertebrates.

Contrast response functions in the visual wulst of the alert burrowing owl: a single-unit study

The neuronal representation of luminance contrast has not been thoroughly studied in birds. Here we present a detailed quantitative analysis of the contrast response of 120 individual neurons recorded from the visual wulst of awake burrowing owls (Athene cunicularia). Stimuli were sine-wave gratings presented within the cell classical receptive field and optimized in terms of eye preference, direction of drift, and spatiotemporal frequency. As contrast intensity was increased from zero to near 100%, most cells exhibited a monotonic response profile with a compressive, at times saturating, nonlinearity at higher contrasts. However, contrast response functions were found to have a highly variable shape across cells. With the view to capture a systematic trend in the data, we assessed the performance of four plausible models (linear, power, logarithmic, and hyperbolic ratio) using classical goodness-of-fit measures and more rigorous statistical tools for multimodel inferences based on the Akaike information criterion. From this analysis, we conclude that a high degree of model uncertainty is present in our data, meaning that no single descriptor is able on its own to capture the heterogeneous nature of single-unit contrast responses in the wulst. We further show that the generalizability of the hyperbolic ratio model established, for example, in the primary visual cortex of cats and monkeys is not tenable in the owl wulst mainly because most neurons in this area have a much wider dynamic range that starts at low contrast. The challenge for future research will be to understand the functional implications of these findings.

A Single Mechanism Can Account for Human Perception of Depth in Mixed Correlation Random Dot Stereograms

In order to extract retinal disparity from a visual scene, the brain must match corresponding points in the left and right retinae. This computationally demanding task is known as the stereo correspondence problem. The initial stage of the solution to the correspondence problem is generally thought to consist of a correlation-based computation. However, recent work by Doi et al suggests that human observers can see depth in a class of stimuli where the mean binocular correlation is 0 (half-matched random dot stereograms). Half-matched random dot stereograms are made up of an equal number of correlated and anticorrelated dots, and the binocular energy model-a well-known model of V1 binocular complex cells-fails to signal disparity here. This has led to the proposition that a second, match-based computation must be extracting disparity in these stimuli. Here we show that a straightforward modification to the binocular energy model-adding a point output nonlinearity-is by itself sufficient to produce cells that are disparity-tuned to half-matched random dot stereograms. We then show that a simple decision model using this single mechanism can reproduce psychometric functions generated by human observers, including reduced performance to large disparities and rapidly updating dot patterns. The model makes predictions about how performance should change with dot size in half-matched stereograms and temporal alternation in correlation, which we test in human observers. We conclude that a single correlation-based computation, based directly on already-known properties of V1 neurons, can account for the literature on mixed correlation random dot stereograms.

Integrating brain, behavior, and phylogeny to understand the evolution of sensory systems in birds

The comparative anatomy of sensory systems has played a major role in developing theories and principles central to evolutionary neuroscience. This includes the central tenet of many comparative studies, the principle of proper mass, which states that the size of a neural structure reflects its processing capacity. The size of structures within the sensory system is not, however, the only salient variable in sensory evolution. Further, the evolution of the brain and behavior are intimately tied to phylogenetic history, requiring studies to integrate neuroanatomy with behavior and phylogeny to gain a more holistic view of brain evolution. Birds have proven to be a useful group for these studies because of widespread interest in their phylogenetic relationships and a wealth of information on the functional organization of most of their sensory pathways. In this review, we examine the principle of proper mass in relation differences in the sensory capabilities among birds. We discuss how neuroanatomy, behavior, and phylogeny can be integrated to understand the evolution of sensory systems in birds providing evidence from visual, auditory, and somatosensory systems. We also consider the concept of a "trade-off," whereby one sensory system (or subpathway within a sensory system), may be expanded in size, at the expense of others, which are reduced in size.

Comparative study of visual pathways in owls (Aves: Strigiformes)

Although they are usually regarded as nocturnal, owls exhibit a wide range of activity patterns, from strictly nocturnal, to crepuscular or cathemeral, to diurnal. Several studies have shown that these differences in the activity pattern are reflected in differences in eye morphology and retinal organization. Despite the evidence that differences in activity pattern among owl species are reflected in the peripheral visual system, there has been no attempt to correlate these differences with changes in the visual regions in the brain. In this study, we compare the relative size of nuclei in the main visual pathways in nine species of owl that exhibit a wide range of activity patterns. We found marked differences in the relative size of all visual structures among the species studied, both in the tectofugal and the thalamofugal pathway, as well in other retinorecipient nuclei, including the nucleus lentiformis mesencephali, the nucleus of the basal optic root and the nucleus geniculatus lateralis, pars ventralis. We show that the barn owl (Tyto alba), a species widely used in the study of the integration of visual and auditory processing, has reduced visual pathways compared to strigid owls. Our results also suggest there could be a trade-off between the relative size of visual pathways and auditory pathways, similar to that reported in mammals. Finally, our results show that although there is no relationship between activity pattern and the relative size of either the tectofugal or the thalamofugal pathway, there is a positive correlation between the relative size of both visual pathways and the relative number of cells in the retinal ganglion layer.

Spatiotemporal frequency tuning dynamics of neurons in the owl visual wulst

The transformation of spatial (SF) and temporal frequency (TF) tuning functions from broad-band/low-pass to narrow band-pass profiles is one of the key emergent properties of neurons in the mammalian primary visual cortex (V1). The mechanisms underlying such transformation are still a matter of ongoing debate. With the aim of providing comparative insights into the issue, we analyzed various aspects of the spatiotemporal tuning dynamics of neurons in the visual wulst of four awake owls. The wulst is the avian telencephalic target of the retinothalamofugal pathway and, in owls, bears striking functional analogy with V1. Most neurons in our sample exhibited fast and large-magnitude adaptation to the visual stimuli with response latencies very similar to those reported for V1. Moreover, latency increased as a function of stimulus SF but not TF, which suggests that parvo- and magno-like geniculate inputs could be converging onto single wulst neurons. No net shifts in preferred SF or TF were observed along the initial second of stimulation, but bandwidth decreased roughly during the first 200 ms after response latency for both stimulus dimensions. For SF, this occurred exclusively as a consequence of low-frequency suppression, whereas suppression was observed both at the low- and high-frequency limbs of TF tuning curves. Overall these results indicate that SF and TF tuning curves in the wulst are shaped by both feedforward and intratelencephalic suppressive mechanisms, similarly to what seems to be the case in the mammalian striate cortex.

Through a barn owl's eyes: interactions between scene content and visual attention

In this study we investigated visual attention properties of freely behaving barn owls, using a miniature wireless camera attached to their heads. The tubular eye structure of barn owls makes them ideal subjects for this research since it limits their eye movements. Video sequences recorded from the owl's point of view capture part of the visual scene as seen by the owl. Automated analysis of video sequences revealed that during an active search task, owls repeatedly and consistently direct their gaze in a way that brings objects of interest to a specific retinal location (retinal fixation area). Using a projective model that captures the geometry between the eye and the camera, we recovered the corresponding location in the recorded images (image fixation area). Recording in various types of environments (aviary, office, outdoors) revealed significant statistical differences of low level image properties at the image fixation area compared to values extracted at random image patches. These differences are in agreement with results obtained in primates in similar studies. To investigate the role of saliency and its contribution to drawing the owl's attention, we used a popular bottom-up computational model. Saliency values at the image fixation area were typically greater than at random patches, yet were only 20% out of the maximal saliency value, suggesting a top-down modulation of gaze control.

Ocular aberrations in barn owl eyes

Optical quality in barn owl eyes is presented in terms of measuring the ocular wavefront aberrations with a standard Tscherning-type wavefront aberrometer under natural viewing conditions. While accommodative state was uncontrolled, all eyes were focused within 0.4D with respect to the plane of the aberrometer. Total RMS wavefront error was between 0.06 and 0.15 microm (mean: 0.10 microm, STD: 0.03 microm, defocus cancelled) for a 6 mm pupil. The results suggest that image quality in barn owl eyes is excellent.

Directional responses of visual wulst neurones to grating and plaid patterns in the awake owl

The avian retinothalamofugal pathway reaches the telencephalon in an area known as visual wulst. A close functional analogy between this area and the early visual cortex of mammals has been established in owls. The goal of the present study was to assess quantitatively the directional selectivity and motion integration capability of visual wulst neurones, aspects that have not been previously investigated. We recorded extracellularly from a total of 101 cells in awake burrowing owls. From this sample, 88% of the units exhibited modulated directional responses to sinusoidal gratings, with a mean direction index of 0.74 +/- 0.03 and tuning bandwidth of 28 +/- 1.16 degrees . A direction index higher than 0.5 was observed in 66% of the cells, thereby qualifying them as direction selective. Motion integration was tested with moving plaids, made by adding two sinusoidal gratings of different orientations. We found that 80% of direction-selective cells responded optimally to the motion direction of the component gratings, whereas none responded to the global motion of plaids, whose direction was intermediate to that of the gratings. The remaining 20% were unclassifiable. The strength of component motion selectivity rapidly increased over a 200 ms period following stimulus onset, maintaining a relatively sustained profile thereafter. Overall, our data suggest that, as in the mammalian primary visual cortex, the visual wulst neurones of owls signal the local orientated features of a moving object. How and where these potentially ambiguous signals are integrated in the owl brain might be important for understanding the mechanisms underlying global motion perception.

The evolution of stereopsis and the Wulst in caprimulgiform birds: a comparative analysis

Owls possess stereopsis (i.e., the ability to perceive depth from retinal disparity cues), but its distribution amongst other birds has remained largely unexplored. Here, we present data on species variation in brain and telencephalon size and features of the Wulst, the neuroanatomical substrate that subserves stereopsis, in a putative sister-group to owls, the order Caprimulgiformes. The caprimulgiforms we examined included nightjars (Caprimulgidae), owlet-nightjars (Aegothelidae), potoos (Nyctibiidae), frogmouths (Podargidae) and the Oilbird (Steatornithidae). The owlet-nightjars and frogmouths shared almost identical relative brain, telencephalic and Wulst volumes as well as overall brain morphology and Wulst morphology with owls. Specifically, the owls, frogmouths and owlet-nightjars possess relatively large brains and telencephalic and Wulst volumes, had a characteristic brain shape and displayed prominent laminae in the Wulst. In contrast, potoos and nightjars both had relatively small brains and telencephala, and Wulst volumes that are typical for similarly sized birds from other orders. The Oilbird had a large brain, telencephalon and Wulst, although these measures were not quite as large as those of the owls. This gradation of owl-like versus nightjar-like brains within caprimulgiforms has significant implications for understanding the evolution of stereopsis and the Wulst both within the order and birds in general.

Evidence for implication of primate area V1 in neural 3-D spatial localization processing

We investigated the neural mechanisms underlying visual localization in 3-D space in area V1 of behaving monkeys. Three different sources of information, retinal disparity, viewing distance and gaze direction, that participate in these neural mechanisms are being reviewed. The way they interact with each other is studied by combining retinal and extraretinal signals. Interactions between retinal disparity and viewing distance have been shown in foveal V1; we have observed a strong modulation of the spontaneous activity and of the visual response of most V1 cells that was highly correlated with the vergence angle. As a consequence of these gain effects, neural horizontal disparity coding is favoured or refined for particular distances of fixation. Changing the gaze direction in the fronto-parallel plane also produces strong gains in the visual response of half of the cells in foveal V1. Cells tested for horizontal disparity and orientation selectivities show gain effects that occur coherently for the same spatial coordinates of the eyes. Shifts in preferred disparity also occurred in several neurons. Cells tested in calcarine V1 at retinal eccentricities larger than 10 degrees , show that horizontal disparity is encoded at least up to 20 degrees around both the horizontal and vertical meridians. At these large retinal eccentricities we found that vertical disparity is also encoded with tuning profiles similar to those of horizontal disparity coding. Combinations of horizontal and vertical disparity signals show that most cells encode both properties. In fact the expression of horizontal disparity coding depends on the vertical disparity signals that produce strong gain effects and frequent changes in peak selectivities. We conclude that the vertical disparity signal and the eye position signal serve to disambiguate the horizontal disparity signal to provide information on 3-D spatial coordinates in terms of distance, gaze direction and retinal eccentricity. We suggest that the relative weight among these different signals is the determining factor involved in the neural processing that gives information on 3-D spatial localization.

Bi-sensory, striped representations: comparative insights from owl and platypus

Bi-sensory striped arrays are described in owl and platypus that share some similarities with the other variant of bi-sensory striped array found in primate and carnivore striate cortex: ocular dominance columns. Like ocular dominance columns, the owl and platypus striped systems each involve two different topographic arrays that are cut into parallel stripes, and interdigitated, so that higher-order neurons can integrate across both arrays. Unlike ocular dominance stripes, which have a separate array for each eye, the striped array in the middle third of the owl tectum has a separate array for each cerebral hemisphere. Binocular neurons send outputs from both hemispheres to the striped array where they are segregated into parallel stripes according to hemisphere of origin. In platypus primary somatosensory cortex (S1), the two arrays of interdigitated stripes are derived from separate sensory systems in the bill, 40,000 electroreceptors and 60,000 mechanoreceptors. The stripes in platypus S1 cortex produce bimodal electrosensory-mechanosensory neurons with specificity for the time-of-arrival difference between the two systems. This "thunder-and-lightning" system would allow the platypus to estimate the distance of the prey using time disparities generated at the bill between the earlier electrical wave and the later mechanical wave caused by the motion of benthic prey. The functional significance of parallel, striped arrays is not clear, even for the highly-studied ocular dominance system, but a general strategy is proposed here that is based on the detection of temporal disparities between the two arrays that can be used to estimate distance.

Binocular vision: an orientation to disparity coding

A new study has shown that neurons in the visual cortex are specialized to encode the larger range of horizontal - relative to vertical - disparities that occurs in central vision. These results challenge the established 'energy' model of disparity processing.

Neurons in parafoveal areas V1 and V2 encode vertical and horizontal disparities

Stereoscopic vision mainly relies on binocular horizontal disparity (HD), and its cortical encoding is well established in the foveal representation of the visual field. The role of vertical disparity (VD) is more controversial. Thus far, in the monkey, very few studies have investigated the HD sensitivity beyond 5 degrees of retinal eccentricity and no evidence of a real encoding of VD exists in the parafoveal representation of areas V1 and V2. Using dynamic random dot stereograms, we have tested both HD and VD selectivities in the parafoveal representation of V1 (calcarine V1) and V2 (eccentricities > 10 degrees ) in a behaving monkey. HD and VD selectivities have been characterized using fitting with Gabor function. A large proportion of the tested cells were both HD and VD selective (47%) and, to a lesser extent, HD selective only (8%) or VD selective only (23%). We found a real encoding of VD, with the same diversity in the tuning profiles as described for HD, that cannot be assimilated to a simple perturbation of the HD matching process. Moreover, the VD encoding had a finer scale than the HD one, which is coherent with the smaller range of naturally occurring VD. For the HD encoding, both the percentage of selective cells and the tuning parameters were close to those reported in foveal V1. These results show that, at parafoveal eccentricities in V1 and V2, disparity detectors are tuned to both horizontal and vertical dimensions of the positional disparity existing between matched features in both retinas.

An unexpected specialization for horizontal disparity in primate primary visual cortex

The horizontal separation of the eyes means that objects nearer or farther than the fixation point project to different locations on the two retinae, differing principally in their horizontal coordinates (horizontal binocular disparity). Disparity-selective neurons have generally been studied with disparities applied in only one direction (often horizontal), which cannot determine whether the encoding is specialized for processing disparities along the horizontal axis. It is therefore unclear if disparity selectivity represents a specialization for naturally occurring disparities. I used random dot stereograms to study disparity-selective neurons from the primary visual cortex (V1) of awake fixating monkeys. Many combinations of vertical and horizontal disparity were used, characterizing the surface of responses as a function of two-dimensional disparity. Here I report that the response surface usually showed elongation along the horizontal disparity axis, despite the isotropic stimulus. Thus these neurons modulated their firing rate over a wider range of horizontal disparity than vertical disparity. This demonstrates that disparity-selective cells are specialized for processing horizontal disparity, and that existing models of disparity selectivity require substantial revision.