Velocity sensitivity and direction selectivity of neurons in areas V1 and V2 of the monkey: influence of eccentricity

Neural encoding of multiple motion speeds in visual cortical area MT

Segmenting objects from each other and their background is critical for vision. The speed at which objects move provides a salient cue for segmentation. However, how the visual system represents and differentiates multiple speeds is largely unknown. Here we investigated the neural encoding of multiple speeds of overlapping stimuli in the primate visual cortex. We first characterized the perceptual capacity of human and monkey subjects to segment spatially overlapping stimuli moving at different speeds. We then determined how neurons in the motion-sensitive, middle-temporal (MT) cortex of macaque monkeys encode multiple speeds. We made a novel finding that the responses of MT neurons to two speeds of overlapping stimuli showed a robust bias toward the faster speed component when both speeds were slow (≤ 20°/s). The faster-speed bias occurred even when a neuron had a slow preferred speed and responded more strongly to the slower component than the faster component when presented alone. The faster-speed bias emerged very early in neuronal response and was robust over time and to manipulations of motion direction and attention. As the stimulus speed increased, the faster-speed bias changed to response averaging. Our finding can be explained by a modified divisive normalization model, in which the weights for the speed components are proportional to the responses of a population of neurons elicited by the individual speeds. Our results suggest that the neuron population, referred to as the weighting pool, includes neurons that have a broad range of speed preferences. As a result, the response weights for the speed components are determined by the stimulus speeds and invariant to the speed preferences of individual neurons. Our findings help to define the neural encoding rule of multiple stimuli and provide new insight into the underlying neural mechanisms. The faster-speed bias would benefit behavioral tasks such as figure-ground segregation if figural objects tend to move faster than the background in the natural environment.

Serial dependence bias can predict the overall estimation error in visual perception

Although visual feature estimations are accurate and precise, overall estimation errors (i.e., the difference between estimates and actual values) tend to show systematic patterns. For example, estimates of orientations are systematically biased away from horizontal and vertical orientations, showing an oblique illusion. Additionally, many recent studies have demonstrated that estimations of current visual features are systematically biased toward previously seen features, showing a serial dependence. However, no study examined whether the overall estimation errors were correlated with the serial dependence bias. To address this question, we enrolled three groups of participants to estimate orientation, motion speed, and point-light-walker direction. The results showed that the serial dependence bias explained over 20% of overall estimation errors in the three tasks, indicating that we could use the serial dependence bias to predict the overall estimation errors. The current study first demonstrated that the serial dependence bias was not independent from the overall estimation errors. This finding could inspire researchers to investigate the neural bases underlying the visual feature estimation and serial dependence.

Neuronal Representations Supporting Three-Dimensional Vision in Nonhuman Primates

The visual system must reconstruct the dynamic, three-dimensional (3D) world from ambiguous two-dimensional (2D) retinal images. In this review, we synthesize current literature on how the visual system of nonhuman primates performs this transformation through multiple channels within the classically defined dorsal (where) and ventral (what) pathways. Each of these channels is specialized for processing different 3D features (e.g., the shape, orientation, or motion of objects, or the larger scene structure). Despite the common goal of 3D reconstruction, neurocomputational differences between the channels impose distinct information-limiting constraints on perception. Convergent evidence further points to the little-studied area V3A as a potential branchpoint from which multiple 3D-fugal processing channels diverge. We speculate that the expansion of V3A in humans may have supported the emergence of advanced 3D spatial reasoning skills. Lastly, we discuss future directions for exploring 3D information transmission across brain areas and experimental approaches that can further advance the understanding of 3D vision.

What and Where: Location-Dependent Feature Sensitivity as a Canonical Organizing Principle of the Visual System

Traditionally, functional representations in early visual areas are conceived as retinotopic maps preserving ego-centric spatial location information while ensuring that other stimulus features are uniformly represented for all locations in space. Recent results challenge this framework of relatively independent encoding of location and features in the early visual system, emphasizing location-dependent feature sensitivities that reflect specialization of cortical circuits for different locations in visual space. Here we review the evidence for such location-specific encoding including: (1) systematic variation of functional properties within conventional retinotopic maps in the cortex; (2) novel periodic retinotopic transforms that dramatically illustrate the tight linkage of feature sensitivity, spatial location, and cortical circuitry; and (3) retinotopic biases in cortical areas, and groups of areas, that have been defined by their functional specializations. We propose that location-dependent feature sensitivity is a fundamental organizing principle of the visual system that achieves efficient representation of positional regularities in visual experience, and reflects the evolutionary selection of sensory and motor circuits to optimally represent behaviorally relevant information. Future studies are necessary to discover mechanisms underlying joint encoding of location and functional information, how this relates to behavior, emerges during development, and varies across species.

Development of Functional Properties in the Early Visual System: New Appreciations of the Roles of Lateral Geniculate Nucleus

In the years following Hubel and Wiesel's first reports on ocular dominance plasticity and amblyopia, much attention has been focused on understanding the role of cortical circuits in developmental and experience-dependent plasticity. Initial studies found few differences between retinal ganglion cells and neurons in the lateral geniculate nucleus and uncovered little evidence for an impact of altered visual experience on the functional properties of lateral geniculate nucleus neurons. In the last two decades, however, studies have revealed that the connectivity between the retina and lateral geniculate nucleus is much richer than was previously appreciated, even revealing visual plasticity - including ocular dominance plasticity - in lateral geniculate nucleus neurons. Here we review the development of the early visual system and the impact of experience with a distinct focus on recent discoveries about lateral geniculate nucleus, its connectivity, and evidence for its plasticity and rigidity during development.

Perspective Cues Make Eye-specific Contributions to 3-D Motion Perception

Robust 3-D visual perception is achieved by integrating stereoscopic and perspective cues. The canonical model describing the integration of these cues assumes that perspective signals sensed by the left and right eyes are indiscriminately pooled into a single representation that contributes to perception. Here, we show that this model fails to account for 3-D motion perception. We measured the sensitivity of male macaque monkeys to 3-D motion signaled by left-eye perspective cues, right-eye perspective cues, stereoscopic cues, and all three cues combined. The monkeys exhibited idiosyncratic differences in their biases and sensitivities for each cue, including left- and right-eye perspective cues, suggesting that the signals undergo at least partially separate neural processing. Importantly, sensitivity to combined cue stimuli was greater than predicted by the canonical model, which previous studies found to account for the perception of 3-D orientation in both humans and monkeys. Instead, 3-D motion sensitivity was best explained by a model in which stereoscopic cues were integrated with left- and right-eye perspective cues whose representations were at least partially independent. These results indicate that the integration of perspective and stereoscopic cues is a shared computational strategy across 3-D processing domains. However, they also reveal a fundamental difference in how left- and right-eye perspective signals are represented for 3-D orientation versus motion perception. This difference results in more effective use of available sensory information in the processing of 3-D motion than orientation and may reflect the temporal urgency of avoiding and intercepting moving objects.

Predictive Visual Motion Extrapolation Emerges Spontaneously and without Supervision at Each Layer of a Hierarchical Neural Network with Spike-Timing-Dependent Plasticity

The fact that the transmission and processing of visual information in the brain takes time presents a problem for the accurate real-time localization of a moving object. One way this problem might be solved is extrapolation: using an object's past trajectory to predict its location in the present moment. Here, we investigate how a simulated in silico layered neural network might implement such extrapolation mechanisms, and how the necessary neural circuits might develop. We allowed an unsupervised hierarchical network of velocity-tuned neurons to learn its connectivity through spike-timing-dependent plasticity (STDP). We show that the temporal contingencies between the different neural populations that are activated by an object as it moves causes the receptive fields of higher-level neurons to shift in the direction opposite to their preferred direction of motion. The result is that neural populations spontaneously start to represent moving objects as being further along their trajectory than where they were physically detected. Because of the inherent delays of neural transmission, this effectively compensates for (part of) those delays by bringing the represented position of a moving object closer to its instantaneous position in the world. Finally, we show that this model accurately predicts the pattern of perceptual mislocalization that arises when human observers are required to localize a moving object relative to a flashed static object (the flash-lag effect; FLE).SIGNIFICANCE STATEMENT Our ability to track and respond to rapidly changing visual stimuli, such as a fast-moving tennis ball, indicates that the brain is capable of extrapolating the trajectory of a moving object to predict its current position, despite the delays that result from neural transmission. Here, we show how the neural circuits underlying this ability can be learned through spike-timing-dependent synaptic plasticity and that these circuits emerge spontaneously and without supervision. This demonstrates how the neural transmission delays can, in part, be compensated to implement the extrapolation mechanisms required to predict where a moving object is at the present moment.

The dual nature of the BOLD signal: Responses in visual area hMT+ reflect both input properties and perceptual decision

Neuroimaging studies have suggested that hMT+ encodes global motion interpretation, but this contradicts the notion that BOLD activity mainly reflects neuronal input. While measuring fMRI responses at 7 Tesla, we used an ambiguous moving stimulus, yielding the perception of two incoherently moving surfaces—component motion—or only one coherently moving surface—pattern motion, to induce perceptual fluctuations and identify perceptual organization size‐matched domains in hMT+. Then, moving gratings, exactly matching either the direction of component or pattern motion percepts of the ambiguous stimulus, were shown to the participants to investigate whether response properties reflect the input or decision. If hMT+ responses reflect the input, component motion domains (selective to incoherent percept) should show grating direction stimulus‐dependent changes, unlike pattern motion domains (selective to the coherent percept). This hypothesis is based on the known direction‐selective nature of inputs in component motion perceptual domains versus non‐selectivity in pattern motion perceptual domains. The response amplitude of pattern motion domains did not change with grating direction (consistently with their non‐selective input), in contrast to what happened for the component motion domains (consistently with their selective input). However, when we analyzed relative ratio measures they mirrored perceptual interpretation. These findings are consistent with the notion that patterns of BOLD responses reflect both sensory input and perceptual read‐out.

Motion-Based Acuity Task: Full Visual Field Measurement of Shape and Motion Perception

Purpose

Damage of retinal representation of the visual field affects its local features and the spared, unaffected parts. Measurements of visual deficiencies in ophthalmological patients are separated for central (shape) or peripheral (motion and space perception) properties, and acuity tasks rely on stationary stimuli. We explored the benefit of measuring shape and motion perception simultaneously using a new motion-based acuity task.

Methods

Eight healthy control subjects, three patients with retinitis pigmentosa (RP; tunnel vision), and 2 patients with Stargardt disease (STGD) juvenile macular degeneration were included. To model the peripheral loss, we narrowed the visual field in controls to 10 degrees. Negative and positive contrast of motion signals were tested in random-dot kinematograms (RDKs), where shapes were separated from the background by the motion of dots based on coherence, direction, or velocity. The task was to distinguish a circle from an ellipse. The difficulty of the task increased as ellipse became more circular until reaching the acuity limit.

Results

High velocity, negative contrast was more difficult for all, and for patients with STGD, it was too difficult to participate. A slower velocity improved acuity for all participants.

Conclusions

Proposed acuity testing not only allows for the full assessment of vision but also advances the capability of standard testing with the potential to detect spare visual functions.

Translational Relevance

The motion-based acuity task might be a practical tool for assessing vision loss and revealing undetected, undamaged, or strengthened properties of the injured visual system by standard testing, as suggested here for two patients with STGD and three patients with RP.

Functional Clusters of Neurons in Layer 6 of Macaque V1

Layer 6 appears to perform a very important role in the function of macaque primary visual cortex, V1, but not enough is understood about the functional characteristics of neurons in the layer 6 population. It is unclear to what extent the population is homogeneous with respect to their visual properties or if one can identify distinct subpopulations. Here we performed a cluster analysis based on measurements of the responses of single neurons in layer 6 of primary visual cortex in male macaque monkeys (Macaca fascicularis) to achromatic grating stimuli that varied in orientation, direction of motion, spatial and temporal frequency, and contrast. The visual stimuli were presented in a stimulus window that was also varied in size. Using the responses to parametric variation in these stimulus variables, we extracted a number of tuning response measures and used them in the cluster analysis. Six main clusters emerged along with some smaller clusters. Additionally, we asked whether parameter distributions from each of the clusters were statistically different. There were clear separations of parameters between some of the clusters, particularly for f1/f0 ratio, direction selectivity, and temporal frequency bandwidth, but other dimensions also showed differences between clusters. Our data suggest that in layer 6 there are multiple parallel circuits that provide information about different aspects of the visual stimulus.SIGNIFICANCE STATEMENT The cortex is multilayered and is involved in many high-level computations. In the current study, we have asked whether there are subpopulations of neurons, clusters, in layer 6 of cortex with different functional tuning properties that provide information about different aspects of the visual image. We identified six major functional clusters within layer 6. These findings show that there is much more complexity to the circuits in cortex than previously demonstrated and open up a new avenue for experimental investigation within layers of other cortical areas and for the elaboration of models of circuit function that incorporate many parallel pathways with different functional roles.

Visual Motion Processing in Macaque V2

In the primate visual system, direction-selective (DS) neurons are critical for visual motion perception. While DS neurons in the dorsal visual pathway have been well characterized, the response properties of DS neurons in other major visual areas are largely unexplored. Recent optical imaging studies in monkey visual cortex area 2 (V2) revealed clusters of DS neurons. This imaging method facilitates targeted recordings from these neurons. Using optical imaging and single-cell recording, we characterized detailed response properties of DS neurons in macaque V2. Compared with DS neurons in the dorsal areas (e.g., middle temporal area [MT]), V2 DS neurons have a smaller receptive field and a stronger antagonistic surround. They do not code speed or plaid motion but are sensitive to motion contrast. Our results suggest that V2 DS neurons play an important role in figure-ground segregation. The clusters of V2 DS neurons are likely specialized functional systems for detecting motion contrast.

Autonomous Development of Active Binocular and Motion Vision Through Active Efficient Coding

We present a model for the autonomous and simultaneous learning of active binocular and motion vision. The model is based on the Active Efficient Coding (AEC) framework, a recent generalization of classic efficient coding theories to active perception. The model learns how to efficiently encode the incoming visual signals generated by an object moving in 3-D through sparse coding. Simultaneously, it learns how to produce eye movements that further improve the efficiency of the sensory coding. This learning is driven by an intrinsic motivation to maximize the system's coding efficiency. We test our approach on the humanoid robot iCub using simulations. The model demonstrates self-calibration of accurate object fixation and tracking of moving objects. Our results show that the model keeps improving until it hits physical constraints such as camera or motor resolution, or limits on its internal coding capacity. Furthermore, we show that the emerging sensory tuning properties are in line with results on disparity, motion, and motion-in-depth tuning in the visual cortex of mammals. The model suggests that vergence and tracking eye movements can be viewed as fundamentally having the same objective of maximizing the coding efficiency of the visual system and that they can be learned and calibrated jointly through AEC.

Characterization of Retinal Functionality at Different Eccentricities in a Diurnal Rodent

Although the properties of the neurons of the visual system that process central and peripheral regions of the visual field have been widely researched in the visual cortex and the LGN, they have scarcely been documented for the retina. The retina is the first step in integrating optical signals, and despite considerable efforts to functionally characterize the different types of retinal ganglion cells (RGCs), a clear account of the particular functionality of cells with central vs. peripheral fields is still wanting. Here, we use electrophysiological recordings, gathered from retinas of the diurnal rodent Octodon degus, to show that RGCs with peripheral receptive fields (RF) are larger, faster, and have shorter transient responses. This translates into higher sensitivity at high temporal frequencies and a full frequency bandwidth when compared to RGCs with more central RF. We also observed that imbalances between ON and OFF cell populations are preserved with eccentricity. Finally, the high diversity of functional types of RGCs highlights the complexity of the computational strategies implemented in the early stages of visual processing, which could inspire the development of bio-inspired artificial systems.

Auditory and Visual Motion Processing and Integration in the Primate Cerebral Cortex

The ability of animals to detect motion is critical for survival, and errors or even delays in motion perception may prove costly. In the natural world, moving objects in the visual field often produce concurrent sounds. Thus, it can highly advantageous to detect motion elicited from sensory signals of either modality, and to integrate them to produce more reliable motion perception. A great deal of progress has been made in understanding how visual motion perception is governed by the activity of single neurons in the primate cerebral cortex, but far less progress has been made in understanding both auditory motion and audiovisual motion integration. Here we, review the key cortical regions for motion processing, focussing on translational motion. We compare the representations of space and motion in the visual and auditory systems, and examine how single neurons in these two sensory systems encode the direction of motion. We also discuss the way in which humans integrate of audio and visual motion cues, and the regions of the cortex that may mediate this process.

Decoupling of Early V5 Motion Processing from Visual Awareness: A Matter of Velocity as Revealed by Transcranial Magnetic Stimulation

Motion information can reach V5/MT through two parallel routes: one conveying information at early latencies through a direct subcortical route and the other reaching V5 later via recurrent projections through V1. Here, we tested the hypothesis that input via the faster direct pathway depends on motion characteristics. To this end, we presented motion stimuli to healthy human observers at different velocities (4.4°/sec vs. 23°/sec) with static stimuli as controls while applying transcranial magnetic stimulation (TMS) pulses over V5 or V1. We probed for TMS interference with objective (two-alternative forced choice [2AFC]) and subjective (awareness) measures of motion processing at six TMS delays from stimulus onset (poststimulus window covered: ∼27–160 msec). Our results for V5–TMS showed earlier interference with objective performance for fast motion (53.3 msec) than slow motion (80 msec) stimuli. Importantly, TMS-induced decreases in objective measures of motion processing did correlate with decreases in subjective measures for slow but not fast motion stimuli. Moreover, V1–TMS induced a temporally unspecific interference with visual processing as it impaired the processing of both motion and static stimuli at the same delays. These results are in accordance with fast moving stimuli reaching V5 through a different route than slow moving stimuli. The differential latencies and coupling to awareness suggest distinct involvement of a direct (i.e., colliculo-extrastriate) connection bypassing V1 depending on stimulus velocity (fast vs. slow). Implication of a direct pathway in the early processing of fast motion may have evolved through its behavioral relevance.

Remediation of perceptual organisation in schizophrenia

Introduction Impaired perceptual organisation in schizophrenia has been repeatedly described in clinical and research literatures. It has also been associated with problems in more complex aspects of visual function, including visuospatial and visual cognitive test performance. Two therapeutic interventions were developed here that target perceptual organisation: (1) Computer-based training, which emphasized stimulus-driven processing (bottom-up approach), and (2) Instrumental Enrichment therapy, which is a therapist-guided interactive learning method (top-down approach). Methods Twenty-eight patients diagnosed with schizophrenia or schizoaffective disorder participated in a 12-week programme. For both forms of interventions, task difficulty increased progressively, based upon successful performance. The third group of patients, which served as controls, received a similar therapeutic intervention that did not include a perceptual organisation component. Before and after intervention, participants received tests of perceptual organisation, as well as a battery of neuropsychological tests. Results Results indicate that both forms of intervention improved perceptual organisation ability relative to the control condition. In addition, the improvement was found for select neuropsychological tests, although the pattern of improvement did not favour capacities more closely associated with visual organisational or visuospatial function. Conclusions Together, results demonstrate the effectiveness of new remediation protocols that target mid-level visual processing, which generalized to select visual cognitive functions.

Binocular summation for reflexive eye movements

Psychophysical studies and our own subjective experience suggest that, in natural viewing conditions (i.e., at medium to high contrasts), monocularly and binocularly viewed scenes appear very similar, with the exception of the improved depth perception provided by stereopsis. This phenomenon is usually described as a lack of binocular summation. We show here that there is an exception to this rule: Ocular following eye movements induced by the sudden motion of a large stimulus, which we recorded from three human subjects, are much larger when both eyes see the moving stimulus, than when only one eye does. We further discovered that this binocular advantage is a function of the interocular correlation between the two monocular images: It is maximal when they are identical, and reduced when the two eyes are presented with different images. This is possible only if the neurons that underlie ocular following are sensitive to binocular disparity.

Does experience provide a permissive or instructive influence on the development of direction selectivity in visual cortex?

In principle, the development of sensory receptive fields in cortex could arise from experience-independent mechanisms that have been acquired through evolution, or through an online analysis of the sensory experience of the individual animal. Here we review recent experiments that suggest that the development of direction selectivity in carnivore visual cortex requires experience, but also suggest that the experience of an individual animal cannot greatly influence the parameters of the direction tuning that emerges, including direction angle preference and speed tuning. The direction angle preference that a neuron will acquire can be predicted from small initial biases that are present in the naïve cortex prior to the onset of visual experience. Further, experience with stimuli that move at slow or fast speeds does not alter the speed tuning properties of direction-selective neurons, suggesting that speed tuning preferences are built in. Finally, unpatterned optogenetic activation of the cortex over a period of a few hours is sufficient to produce the rapid emergence of direction selectivity in the naïve ferret cortex, suggesting that information about the direction angle preference that cells will acquire must already be present in the cortical circuit prior to experience. These results are consistent with the idea that experience has a permissive influence on the development of direction selectivity.

Real-motion signals in human early visual cortex

Eye movements induce visual motion that can complicate the stable perception of the world. The visual system compensates for such self-induced visual motion by integrating visual input with efference copies of eye movement commands. This mechanism is central as it does not only support perceptual stability but also mediates reliable perception of world-centered objective motion. In humans, it remains elusive whether visual motion responses in early retinotopic cortex are driven by objective motion or by retinal motion associated with it. To address this question, we used fMRI to examine functional responses of sixteen visual areas to combinations of planar objective motion and pursuit eye movements. Observers were exposed to objective motion that was faster, matched or slower relative to pursuit, allowing us to compare conditions that differed in objective motion velocity while retinal motion and eye movement signals were matched. Our results show that not only higher level motion regions such as V3A and V6, but also early visual areas signaled the velocity of objective motion, hence the product of integrating retinal with non-retinal signals. These results shed new light on mechanisms that mediate perceptual stability and real-motion perception, and show that extra-retinal signals related to pursuit eye movements influence processing in human early visual cortex.

Attentive Motion Discrimination Recruits an Area in Inferotemporal Cortex

Attentional selection requires the interplay of multiple brain areas. Theoretical accounts of selective attention predict different areas with different functional properties to support endogenous covert attention. To test these predictions, we devised a demanding attention task requiring motion discrimination and spatial selection and performed whole-brain imaging in macaque monkeys. Attention modulated the early visual cortex, motion-selective dorsal stream areas, the lateral intraparietal area, and the frontal eye fields. This pattern of activation supports early selection, feature-based, and biased-competition attention accounts, as well as the frontoparietal theory of attentional control. While high-level motion-selective dorsal stream areas did not exhibit strong attentional modulation, ventral stream areas V4d and the dorsal posterior inferotemporal cortex (PITd) did. The PITd in fact was, consistently across task variations, the most significantly and most strongly attention-modulated area, even though it did not exhibit signs of motion selectivity. Thus the recruitment of the PITd in attention tasks involving different kinds of motion analysis is not predicted by any theoretical account of attention. These functional data, together with known anatomical connections, suggest a general and possibly critical role of the PITd in attentional selection.

SIGNIFICANCE STATEMENT

Attention is the key cognitive function that selects sensory information relevant to the current goals, relegating other information to the shadows of consciousness. To better understand the neural mechanisms of this interplay between sensory processing and internal cognitive state, we must learn more about the brain areas supporting attentional selection. Here, to test theoretical accounts of attentional selection, we used a novel task requiring sustained attention to motion. We found that, surprisingly, among the most strongly attention-modulated areas is one that is neither selective for the sensory feature relevant for current goals nor one hitherto thought to be involved in attentional control. This discovery suggests a need for an extension of current theoretical accounts of the brain circuits for attentional selection.

Separate requirements for detection and perceptual stability of motion in interocular suppression

In interocular masking, a stimulus presented to one eye (the mask) is made stronger in order to suppress from awareness the target stimulus presented to the other eye. We investigated whether matching the features of the target and the mask would lead to more effective suppression (feature-selective suppression), or not (i.e., non-selective suppression). To control the temporal characteristics of the stimuli, we used a dynamic interocular mask to suppress a moving target, and found that neither matching speed nor pattern of motion led to more effective suppression. Instead, a faster target was detected faster, regardless of the mask type or speed, while a relatively slow (about 1°/s) mask was more perceptually stable (i.e., maintained suppression longer) in a non-selective fashion. While the requirement for target detectability, i.e., salience, is well characterized, relatively little attention is given to the factors that make a mask percept more perceptually stable. Based on these results, we argue that there are separate requirements for detection and perceptual stability.

Recurrent Network Dynamics; a Link between Form and Motion

To discriminate visual features such as corners and contours, the brain must be sensitive to spatial correlations between multiple points in an image. Consistent with this, macaque V2 neurons respond selectively to patterns with well-defined multipoint correlations. Here, we show that a standard feedforward model (a cascade of linear–non-linear filters) does not capture this multipoint selectivity. As an alternative, we developed an artificial neural network model with two hierarchical stages of processing and locally recurrent connectivity. This model faithfully reproduced neurons’ selectivity for multipoint correlations. By probing the model, we gained novel insights into early form processing. First, the diverse selectivity for multipoint correlations and complex response dynamics of the hidden units in the model were surprisingly similar to those observed in V1 and V2. This suggests that both transient and sustained response dynamics may be a vital part of form computations. Second, the model self-organized units with speed and direction selectivity that was correlated with selectivity for multipoint correlations. In other words, the model units that detected multipoint spatial correlations also detected space-time correlations. This leads to the novel hypothesis that higher-order spatial correlations could be computed by the rapid, sequential assessment and comparison of multiple low-order correlations within the receptive field. This computation links spatial and temporal processing and leads to the testable prediction that the analysis of complex form and motion are closely intertwined in early visual cortex.

Absolute Depth Sensitivity in Cat Primary Visual Cortex under Natural Viewing Conditions

Mechanisms of 3D perception, investigated in many laboratories, have defined depth either relative to the fixation plane or to other objects in the visual scene. It is obvious that for efficient perception of the 3D world, additional mechanisms of depth constancy could operate in the visual system to provide information about absolute distance. Neurons with properties reflecting some features of depth constancy have been described in the parietal and extrastriate occipital cortical areas. It has also been shown that, for some neurons in the visual area V1, responses to stimuli of constant angular size differ at close and remote distances. The present study was designed to investigate whether, in natural free gaze viewing conditions, neurons tuned to absolute depths can be found in the primary visual cortex (area V1). Single-unit extracellular activity was recorded from the visual cortex of waking cats sitting on a trolley in front of a large screen. The trolley was slowly approaching the visual scene, which consisted of stationary sinusoidal gratings of optimal orientation rear-projected over the whole surface of the screen. Each neuron was tested with two gratings, with spatial frequency of one grating being twice as high as that of the other. Assuming that a cell is tuned to a spatial frequency, its maximum response to the grating with a spatial frequency twice as high should be shifted to a distance half way closer to the screen in order to attain the same size of retinal projection. For hypothetical neurons selective to absolute depth, location of the maximum response should remain at the same distance irrespective of the type of stimulus. It was found that about 20% of neurons in our experimental paradigm demonstrated sensitivity to particular distances independently of the spatial frequencies of the gratings. We interpret these findings as an indication of the use of absolute depth information in the primary visual cortex.

‘Squaring’ is Better at Predicting Plaid Motion than the Vector Average or Intersection of Constraints

How do humans combine the velocity information from two moving gratings (plaids) to detect pattern motion direction? We are still unable to answer this question. The ‘intersection of constraints’ rule (IOC—Adelson and Movshon, 1982 Nature300 523–525), and the ‘vector average’ rule (VA—Wilson et al, 1992 Visual Neuroscience9 79–97) have both been supported by results in the plaid literature, but could these results be predicted by a ‘squaring’ nonlinearity that now forms part of several influential spatiotemporal energy models (Wilson et al 1992, loco cit.; Lu and Sperling, 1995 Vision Research35 2697–2722; Simoncelli and Heeger, 1998 Vision Research38 743–761)? Spatiotemporal energy in these models predicts directions other than those predicted by standard spatiotemporal energy models and may underlie the results that support the combination rules. The two combination rules and predictions from ‘squaring’ were tested under identical conditions. In the first three experiments a plaid was randomly presented in one of 45 different orientations, and observers were asked to remember the direction. The stimulus was then replaced by an oriented line indicating the direction predicted by one of the hypotheses. The observer was unaware which hypothesis had generated the line and was asked to make a same/different judgment. Results showed that the ‘squaring’ hypothesis was better at predicting perceived direction than either the IOC or VA.

Are visual peripheries forever young?

The paper presents a concept of lifelong plasticity of peripheral vision. Central vision processing is accepted as critical and irreplaceable for normal perception in humans. While peripheral processing chiefly carries information about motion stimuli features and redirects foveal attention to new objects, it can also take over functions typical for central vision. Here I review the data showing the plasticity of peripheral vision found in functional, developmental, and comparative studies. Even though it is well established that afferent projections from central and peripheral retinal regions are not established simultaneously during early postnatal life, central vision is commonly used as a general model of development of the visual system. Based on clinical studies and visually deprived animal models, I describe how central and peripheral visual field representations separately rely on early visual experience. Peripheral visual processing (motion) is more affected by binocular visual deprivation than central visual processing (spatial resolution). In addition, our own experimental findings show the possible recruitment of coarse peripheral vision for fine spatial analysis. Accordingly, I hypothesize that the balance between central and peripheral visual processing, established in the course of development, is susceptible to plastic adaptations during the entire life span, with peripheral vision capable of taking over central processing.

Reprogramming of orientation columns in visual cortex: a domino effect

Cortical organization rests upon the fundamental principle that neurons sharing similar properties are co-located. In the visual cortex, neurons are organized into orientation columns. In a column, most neurons respond optimally to the same axis of an oriented edge, that is, the preferred orientation. This orientation selectivity is believed to be absolute in adulthood. However, in a fully mature brain, it has been established that neurons change their selectivity following sensory experience or visual adaptation. Here, we show that after applying an adapter away from the tested cells, neurons whose receptive fields were located remotely from the adapted site also exhibit a novel selectivity in spite of the fact that they were not adapted. These results indicate a robust reconfiguration and remapping of the orientation domains with respect to each other thus removing the possibility of an orientation hole in the new hypercolumn. These data suggest that orientation columns transcend anatomy, and are almost strictly functionally dynamic.

Weak orientation and direction selectivity in lateral geniculate nucleus representing central vision in the gray squirrel Sciurus carolinensis

Classic studies of lateral geniculate nucleus (LGN) and visual cortex (V1) in carnivores and primates have found that a majority of neurons in LGN exhibit a center-surround organization, while V1 neurons exhibit strong orientation selectivity and, in many species, direction selectivity. Recent work in the mouse and the monkey has discovered previously unknown classes of orientation- and direction-selective neurons in LGN. Furthermore, some recent studies in the mouse report that many LGN cells exhibit pronounced orientation biases that are of comparable strength to the subthreshold inputs to V1 neurons. These results raise the possibility that, in rodents, orientation biases of individual LGN cells make a substantial contribution to cortical orientation selectivity. Alternatively, the size and contribution of orientation- or direction-selective channels from LGN to V1 may vary across mammals. To address this question, we examined orientation and direction selectivity in LGN and V1 neurons of a highly visual diurnal rodent: the gray squirrel. In the representation of central vision, only a few LGN neurons exhibited strong orientation or direction selectivity. Across the population, LGN neurons showed weak orientation biases and were much less selective for orientation compared with V1 neurons. Although direction selectivity was weak overall, LGN layers 3abc, which contain neurons that express calbindin, exhibited elevated direction selectivity index values compared with LGN layers 1 and 2. These results suggest that, for central visual fields, the contribution of orientation- and direction-selective channels from the LGN to V1 is small in the squirrel. As in other mammals, this small contribution is elevated in the calbindin-positive layers of the LGN.

A human homologue of monkey F5c

Area F5c is a monkey premotor area housing mirror neurons which responds more strongly to grasping observation when the actor is visible than when only the actor's hand is visible. Here we used this characteristic fMRI signature of F5c in seven imaging experiments – one in macaque monkeys and six in humans – to identify the human homologue of monkey F5c. By presenting the two grasping actions (actor, hand) and varying the low level visual characteristics, we localized a putative human homologue of area F5c (phF5c) in the inferior part of precentral sulcus, bilaterally. In contrast to monkey F5c, phF5c is asymmetric, with a right-sided bias, and is activated more strongly during the observation of the later stages of grasping when the hand is close to the object. The latter characteristic might be related to the emergence, in humans, of the capacity to precisely copy motor acts performed by others, and thus imitation.

•

We use parallel fMRI to identify the human homologue of macaque F5c.

•

In premotor cortex only F5c reacts more to observing grasping with the actor visible.

•

Two bilateral inferior precentral sulcus sites respond similarly for many stimuli.

•

The human homologues of F5c are asymmetric and require fixation near the target.

Motion direction biases and decoding in human visual cortex

Functional magnetic resonance imaging (fMRI) studies have relied on multivariate analysis methods to decode visual motion direction from measurements of cortical activity. Above-chance decoding has been commonly used to infer the motion-selective response properties of the underlying neural populations. Moreover, patterns of reliable response biases across voxels that underlie decoding have been interpreted to reflect maps of functional architecture. Using fMRI, we identified a direction-selective response bias in human visual cortex that: (1) predicted motion-decoding accuracy; (2) depended on the shape of the stimulus aperture rather than the absolute direction of motion, such that response amplitudes gradually decreased with distance from the stimulus aperture edge corresponding to motion origin; and 3) was present in V1, V2, V3, but not evident in MT+, explaining the higher motion-decoding accuracies reported previously in early visual cortex. These results demonstrate that fMRI-based motion decoding has little or no dependence on the underlying functional organization of motion selectivity.

Motion detection based on recurrent network dynamics

The detection of visual motion requires temporal delays to compare current with earlier visual input. Models of motion detection assume that these delays reside in separate classes of slow and fast thalamic cells, or slow and fast synaptic transmission. We used a data-driven modeling approach to generate a model that instead uses recurrent network dynamics with a single, fixed temporal integration window to implement the velocity computation. This model successfully reproduced the temporal response dynamics of a population of motion sensitive neurons in macaque middle temporal area (MT) and its constituent parts matched many of the properties found in the motion processing pathway (e.g., Gabor-like receptive fields (RFs), simple and complex cells, spatially asymmetric excitation and inhibition). Reverse correlation analysis revealed that a simplified network based on first and second order space-time correlations of the recurrent model behaved much like a feedforward motion energy (ME) model. The feedforward model, however, failed to capture the full speed tuning and direction selectivity properties based on higher than second order space-time correlations typically found in MT. These findings support the idea that recurrent network connectivity can create temporal delays to compute velocity. Moreover, the model explains why the motion detection system often behaves like a feedforward ME network, even though the anatomical evidence strongly suggests that this network should be dominated by recurrent feedback.

Representation of central and peripheral vision in the primate cerebral cortex: Insights from studies of the marmoset brain

How the visual field is represented by neurons in the cerebral cortex is one of the most basic questions in visual neuroscience. However, research to date has focused heavily on the small part of the visual field within, and immediately surrounding the fovea. Studies on the cortical representation of the full visual field in the primate brain are still scarce. We have been investigating this issue with electrophysiological and anatomical methods, taking advantage of the small and lissencephalic marmoset brain, which allows easy access to the representation of the full visual field in many cortical areas. This review summarizes our main findings to date, and relates the results to a broader question: is the peripheral visual field processed in a similar manner to the central visual field, but with lower spatial acuity? Given the organization of the visual cortex, the issue can be addressed by asking: (1) Is visual information processed in the same way within a single cortical area? and (2) Are different cortical areas specialized for different parts of the visual field? The electrophysiological data from the primary visual cortex indicate that many aspects of spatiotemporal computation are remarkably similar across the visual field, although subtle variations are detectable. Our anatomical and electrophysiological studies of the extrastriate cortex, on the other hand, suggest that visual processing in the far peripheral visual field is likely to involve a distinct network of specialized cortical areas, located in the depths of the calcarine sulcus and interhemispheric fissure.

Feature integration and object representations along the dorsal stream visual hierarchy

The visual system is split into two processing streams: a ventral stream that receives color and form information and a dorsal stream that receives motion information. Each stream processes that information hierarchically, with each stage building upon the previous. In the ventral stream this leads to the formation of object representations that ultimately allow for object recognition regardless of changes in the surrounding environment. In the dorsal stream, this hierarchical processing has classically been thought to lead to the computation of complex motion in three dimensions. However, there is evidence to suggest that there is integration of both dorsal and ventral stream information into motion computation processes, giving rise to intermediate object representations, which facilitate object selection and decision making mechanisms in the dorsal stream. First we review the hierarchical processing of motion along the dorsal stream and the building up of object representations along the ventral stream. Then we discuss recent work on the integration of ventral and dorsal stream features that lead to intermediate object representations in the dorsal stream. Finally we propose a framework describing how and at what stage different features are integrated into dorsal visual stream object representations. Determining the integration of features along the dorsal stream is necessary to understand not only how the dorsal stream builds up an object representation but also which computations are performed on object representations instead of local features.

Uniformity and diversity of response properties of neurons in the primary visual cortex: selectivity for orientation, direction of motion, and stimulus size from center to far periphery

Although the primary visual cortex (V1) is one of the most extensively studied areas of the primate brain, very little is known about how the far periphery of visual space is represented in this area. We characterized the physiological response properties of V1 neurons in anaesthetized marmoset monkeys, using high-contrast drifting gratings. Comparisons were made between cells with receptive fields located in three regions of V1, defined by eccentricity: central (3-5°), near peripheral (5-15°), and far peripheral (>50°). We found that orientation selectivity of individual cells was similar from the center to the far periphery. Nonetheless, the proportion of orientation-selective neurons was higher in central visual field representation than in the peripheral representations. In addition, there were similar proportions of cells representing all orientations, with the exception of the representation of the far periphery, where we detected a bias favoring near-horizontal orientations. The proportions of direction-selective cells were similar throughout V1. When the center/surround organization of the receptive fields was tested with gratings with varying diameters, we found that the population of neurons that was suppressed by large gratings was smaller in the far periphery, although the strength of suppression in these cells tended to be stronger. In addition, the ratio between the diameters of the excitatory centers and suppressive surrounds was similar across the entire visual field. These results suggest that, superimposed on the broad uniformity of V1, there are subtle physiological differences, which indicate that spatial information is processed differently in the central versus far peripheral visual fields.

Neuronal correlates of tactile speed in primary somatosensory cortex

Moving stimuli activate all of the mechanoreceptive afferents involved in discriminative touch, but their signals covary with several parameters, including texture. Despite this, the brain extracts precise information about tactile speed, and humans can scale the tangential speed of moving surfaces as long as they have some surface texture. Speed estimates, however, vary with texture: lower estimates for rougher surfaces (increased spatial period, SP). We hypothesized that the discharge of cortical neurons playing a role in scaling tactile speed should covary with speed and SP in the same manner. Single-cell recordings (n = 119) were made in the hand region of primary somatosensory cortex (S1) of awake monkeys while raised-dot surfaces (longitudinal SPs, 2-8 mm; periodic or nonperiodic) were displaced under their fingertips at speeds of 40-105 mm/s. Speed sensitivity was widely distributed (area 3b, 13/25; area 1, 32/51; area 2, 31/43) and almost invariably combined with texture sensitivity (82% of cells). A subset of cells (27/64 fully tested speed-sensitive cells) showed a graded increase in discharge with increasing speed for testing with both sets of surfaces (periodic, nonperiodic), consistent with a role in tactile speed scaling. These cells were almost entirely confined to caudal S1 (areas 1 and 2). None of the speed-sensitive cells, however, showed a pattern of decreased discharge with increased SP, as found for subjective speed estimates in humans. Thus further processing of tactile motion signals, presumably in higher-order areas, is required to explain human tactile speed scaling.

A motion direction preference map in monkey V4

In the primate visual system, area V4 is located in the ventral pathway and is traditionally thought to be involved in processing color and form information. However, little is known about its functional role in processing motion information. Using intrinsic signal optical imaging over large fields of view in V1, V2, and V4, we mapped the direction of motion responses in anesthetized macaques. We found that V4 contains direction-preferring domains that are preferentially activated by stimuli moving in one direction. These direction-preferring domains normally occupy several restricted regions of V4 and tend to overlap with orientation- and color-preferring domains. Single-cell recordings targeting these direction-preferring domains also showed a clustering, as well as a columnar organization of V4 direction-selective neurons. These data suggest that, in contrast to the classical view, motion information is also processed in ventral pathway regions such as area V4.

Distinct functional organizations for processing different motion signals in V1, V2, and V4 of macaque

Motion perception is qualitatively invariant across different objects and forms, namely, the same motion information can be conveyed by many different physical carriers, and it requires the processing of motion signals consisting of direction, speed, and axis or trajectory of motion defined by a moving object. Compared with the representation of orientation, the cortical processing of these different motion signals within the early ventral visual pathway of the primate remains poorly understood. Using drifting full-field noise stimuli and intrinsic optical imaging, along with cytochrome-oxidase staining, we found that the orientation domains in macaque V1, V2, and V4 that processed orientation signals also served to process motion signals associated with the axis and speed of motion. In contrast, direction domains within the thick stripes of V2 demonstrated preferences that were independent of motion speed. The population responses encoding the orientation and motion axis could be precisely reproduced by a spatiotemporal energy model. Thus, our observation of orientation domains with dual functions in V1, V2, and V4 directly support the notion that the linear representation of the temporal series of retinotopic activations may serve as another motion processing strategy in primate ventral visual pathway, contributing directly to fine form and motion analysis. Our findings further reveal that different types of motion information are differentially processed in parallel and segregated compartments within primate early visual cortices, before these motion features are fully combined in high-tier visual areas.

Effects of retinal eccentricity and acuity on global-motion processing

The present study assessed direction discrimination with moving random-dot cinematograms at retinal eccentricities of 0, 8, 22, and 40 deg. In addition, Landolt-C acuity was assessed at these eccentricities to determine whether changes in motion discrimination performance covaried with acuity in the retinal periphery. The results of the experiment indicated that discrimination thresholds increased with retinal eccentricity and directional variance (noise), independent of acuity. Psychophysical modeling indicated that the results for eccentricity and noise could be explained by an increase in channel bandwidth and an increase in internal multiplicative noise.

Toward a unified theory of visual area V4

Visual area V4 is a midtier cortical area in the ventral visual pathway. It is crucial for visual object recognition and has been a focus of many studies on visual attention. However, there is no unifying view of V4's role in visual processing. Neither is there an understanding of how its role in feature processing interfaces with its role in visual attention. This review captures our current knowledge of V4, largely derived from electrophysiological and imaging studies in the macaque monkey. Based on recent discovery of functionally specific domains in V4, we propose that the unifying function of V4 circuitry is to enable selective extraction of specific functional domain-based networks, whether it be by bottom-up specification of object features or by top-down attentionally driven selection.

Direction-specific fMRI adaptation reveals the visual cortical network underlying the "Rotating Snakes" illusion

The "Rotating Snakes" figure elicits a clear sense of anomalous motion in stationary repetitive patterns. We used an event-related fMRI adaptation paradigm to investigate cortical mechanisms underlying the illusory motion. Following an adapting stimulus (S1) and a blank period, a probe stimulus (S2) that elicited illusory motion either in the same or in the opposite direction was presented. Attention was controlled by a fixation task, and control experiments precluded explanations in terms of artefacts of local adaptation, afterimages, or involuntary eye movements. Recorded BOLD responses were smaller for S2 in the same direction than S2 in the opposite direction in V1-V4, V3A, and MT+, indicating direction-selective adaptation. Adaptation in MT+ was correlated with adaptation in V1 but not in V4. With possible downstream inheritance of adaptation, it is most likely that adaptation predominantly occurred in V1. The results extend our previous findings of activation in MT+ (I. Kuriki, H. Ashida, I. Murakami, and A. Kitaoka, 2008), revealing the activity of the cortical network for motion processing from V1 towards MT+. This provides evidence for the role of front-end motion detectors, which has been assumed in proposed models of the illusion.

Multifocal attention filters targets from distracters within and beyond primate MT neurons' receptive field boundaries

Visual attention has been classically described as a spotlight that enhances the processing of a behaviorally relevant object. However, in many situations, humans and animals must simultaneously attend to several relevant objects separated by distracters. To account for this ability, various models of attention have been proposed including splitting of the attentional spotlight into multiple foci, zooming of the spotlight over a region of space, and switching of the spotlight among objects. We investigated this controversial issue by recording neuronal activity in visual area MT of two macaques while they attended to two translating objects that circumvented a third distracter object located inside the neurons' receptive field. We found that when the attended objects passed through or nearby the receptive field, neuronal responses to the distracter were either decreased or remained unaltered. These results demonstrate that attention can split into multiple spotlights corresponding to relevant objects while filtering out interspersed distracters.

Representation of perceptually invisible image motion in extrastriate visual area MT of macaque monkeys

Why does the world appear stable despite the visual motion induced by eye movements during fixation? We find that the answer must reside in how visual motion signals are interpreted by perception, because MT neurons in monkeys respond to the image motion caused by eye drifts in the presence of a stationary stimulus. Several features suggest a visual origin for the responses of MT neurons during fixation: spike-triggered averaging yields a peak image velocity in the preferred direction that precedes spikes by ∼60 ms; image velocity during fixation and firing rate show similar peaks in power at 4-5 Hz; and average MT firing during a period of fixation is related monotonically to the image speed along the preferred axis of the neurons 60 ms earlier. The percept caused by the responses of MT neurons during fixation depends on the distribution of activity across the population of neurons of different preferred speeds. For imposed stimulus motion, the population response peaks for neurons that prefer the actual target speed. For small image motions caused by eye drifts during fixation, the population response is large, but is noisy and does not show a clear peak. This representation of image motion in MT would be ignored if perception interprets the population response in the context of a prior of zero speed. Then, we would see a stable scene despite MT responses caused by eye drifts during fixation.

Phase sensitivities, excitatory summation fields, and silent suppressive receptive fields of single neurons in the parastriate cortex of the cat

We have recorded single-neuron activity from cytoarchitectonic area 18 of anesthetized (0.4–0.7% isoflurane in 65% N2O-35% O2 gaseous mixture) domestic cats. Neurons were identified as simple or complex on the basis of the ratios between the phase-variant (F1) component and the mean firing rate (F0) of spike responses to optimized (orientation, direction, spatial and temporal frequencies, size) high-contrast, luminance-modulated, sine-wave drifting gratings (simple: F1/F0 spike-response ratios > 1; complex: F1/F0 spike-response ratios < 1). The predominance (∼80%) of simple cells among the neurons recorded from the principal thalamorecipient layers supports the idea that most simple cells in area 18 might constitute a putative early stage in the visual information processing. Apart from the “spike-generating” regions (the classical receptive fields, CRFs), the receptive fields of three-quarters of area 18 neurons contain silent, extraclassical suppressive regions (ECRFs). The spatial extent of summation areas of excitatory responses was negatively correlated with the strength of the ECRF-induced suppression of spike responses. Lowering the stimulus contrast resulted in an expansion of the summation areas of excitatory responses accompanied by a reduction in the strength of the ECRF-induced suppression. The spatial and temporal frequency and orientation tunings of the ECRFs were much broader than those of the CRFs. Hence, the ECRFs of area 18 neurons appear to be largely “inherited” from their dorsal thalamic inputs. In most area 18 cells, costimulation of CRFs and ECRFs resulted in significant increases in F1/F0 spike-response ratios, and thus there was a contextually modulated functional continuum between the simple and complex cells.

Reconstructing visual experiences from brain activity evoked by natural movies

Quantitative modeling of human brain activity can provide crucial insights about cortical representations [1, 2] and can form the basis for brain decoding devices [3-5]. Recent functional magnetic resonance imaging (fMRI) studies have modeled brain activity elicited by static visual patterns and have reconstructed these patterns from brain activity [6-8]. However, blood oxygen level-dependent (BOLD) signals measured via fMRI are very slow [9], so it has been difficult to model brain activity elicited by dynamic stimuli such as natural movies. Here we present a new motion-energy [10, 11] encoding model that largely overcomes this limitation. The model describes fast visual information and slow hemodynamics by separate components. We recorded BOLD signals in occipitotemporal visual cortex of human subjects who watched natural movies and fit the model separately to individual voxels. Visualization of the fit models reveals how early visual areas represent the information in movies. To demonstrate the power of our approach, we also constructed a Bayesian decoder [8] by combining estimated encoding models with a sampled natural movie prior. The decoder provides remarkable reconstructions of the viewed movies. These results demonstrate that dynamic brain activity measured under naturalistic conditions can be decoded using current fMRI technology.

Psychophysical evidence for contraction of the range of spatial integration as a mechanism for filtering out spatial noise in a random dot motion display

Human judgment is frequently impaired by distracters extending across our field of view. How we extract relevant information from a spatially restricted region in a complex scene in spite of this impairment is an important issue in vision. Recently, it has been shown that this impairment can be reduced by increasing the number of surrounding distracters without changing the density, thus increasing the total area covered by the distracters. Little, however, is known regarding the underlying mechanism(s). Here, we tested the hypothesis that visual impairment by distracters is due to integration of irrelevant information across space, and that further addition of distracters produces contraction of the spatial integration field. Human subjects were instructed to judge the direction of motion within a center disk and to ignore motion noise in the surrounding annulus in a random dot kinematogram. We observed a non-monotonic effect of the size of the annulus, in which the subjects' discrimination thresholds at first increased, and then decreased as the size of the annulus became larger. We further investigated how weak coherent motion in the surrounding annulus interferes with the subjects' performance. Importantly, we found that the amount of interference decreases with the addition of surrounding motion noise, consistent with the hypothesis that the addition of distracters produces contraction of the range of spatial integration. Our results suggest that integration within a visual receptive field causes impairment by distracters across our visual field, and that contraction of the range of integration can counteract this impairment.

Contributions of indirect pathways to visual response properties in macaque middle temporal area MT

The primate visual cortex exhibits a remarkable degree of interconnectivity. Each visual area receives an average of 10 to 15 inputs, many of them from cortical areas with overlapping, but not identical, functional properties. In this study, we assessed the functional significance of this anatomical parallelism to the middle temporal area (MT) of the macaque visual cortex. MT receives major feedforward inputs from areas V1, V2, and V3, but little is known about the properties of each of these pathways. We previously demonstrated that reversible inactivation of V2 and V3 causes a disproportionate degradation of tuning for binocular disparity of MT neurons, relative to direction tuning (Ponce et al., 2008). Here we show that MT neurons continued to encode speed and size information during V2/3 inactivation; however, many became significantly less responsive to fast speeds and others showed a modest decrease in surround suppression. These changes resemble previously reported effects of reducing stimulus contrast (Pack et al., 2005; Krekelberg et al., 2006), but we show here that they differ in their temporal dynamics. We find no evidence that the indirect pathways selectively target different functional regions within MT. Overall, our findings suggest that the indirect pathways to MT primarily convey modality-specific information on binocular disparity, but that they also contribute to the processing of stimuli moving at fast speeds.

A motion direction map in macaque V2

In mammals, the perception of motion starts with direction-selective neurons in the visual cortex. Despite numerous studies in monkey primary and second visual cortex (V1 and V2), there has been no evidence of direction maps in these areas. In the present study, we used optical imaging methods to study the organization of motion response in macaque V1 and V2. In contrast to the findings in other mammals (e.g., cats and ferrets), we found no direction maps in macaque V1. Robust direction maps, however, were found in V2 thick/pale stripes and avoided thin stripes. In many cases direction maps were located within thick stripes and exhibited pinwheel or linear organizations. The presence of motion maps in V2 points to a newfound prominence of V2 in motion processing, for contributing to motion perception in the dorsal pathway and/or for motion cue-dependent form perception in the ventral pathway.

The neural mechanism for Latent (fusion maldevelopment) nystagmus

Latent nystagmus (LN) is the by-product of fusion maldevelopment in infancy. Because fusion maldevelopment--in the form of strabismus and amblyopia--is common, LN is a prevalent form of pathologic nystagmus encountered in clinical practice. It originates as an afferent visual pathway disorder. To unravel the mechanism for LN, we studied patients and nonhuman primates with maldeveloped fusion. These experiments have revealed that loss of binocular connections within striate cortex (area V1) in the first months of life is the necessary and sufficient cause of LN. The severity of LN increases systematically with longer durations of binocular decorrelation and greater losses of V1 connections. Decorrelation durations that exceed the equivalent of 2-3 months in human development result in an LN prevalence of 100%. No manipulation of brain stem motor pathways is required. The binocular maldevelopment originating in area V1 is passed on to downstream extrastriate regions of cerebral cortex that drive conjugate gaze, notably MSTd. Conjugate gaze is stable when MSTd neurons of the right and left cerebral hemispheres have balanced binocular activity. Fusion maldevelopment in infancy causes unbalanced monocular activity. If input from one eye dominates and the other is suppressed, MSTd in one hemisphere becomes more active. Acting through downstream projections to the ipsilateral nucleus of the optic tract, the eyes are driven conjugately to that side. The unbalanced MSTd drive is evident as the nasalward gaze-holding bias of LN when viewing with either eye.