Directional anisotropy of motion responses in retinotopic cortex

Radial bias alters high-level motion perception

The visual system involves various orientation and visual field anisotropies, one of which is a preference for radial orientations and motion directions. By radial, we mean those directions coursing symmetrically outward from the fovea into the periphery. This bias stems from anatomical and physiological substrates in the early visual system. We recently reported that this low-level visual anisotropy can alter perceived object orientation. Here, we report that radial bias can also alter another higher-level system, the perceived direction of apparent motion. We presented a bistable apparent motion quartet in the center of the screen while participants fixated on various locations around the quartet. Participants (N = 22) were strongly biased to see the motion direction that was radial with respect to their fixation, controlling for any biases with center fixation. This was observed using a vertical-horizontal quartet as well as an oblique quartet (45° rotated quartet). The latter allowed us to rule out the contribution of the hemisphere effect where motion across the midline is perceived less often. These results extend our earlier findings on perceived object orientation, showing that low-level structural aspects of the visual system alter yet another higher-level visual process, that of apparent motion perception.

Position representations of moving objects align with real-time position in the early visual response

When interacting with the dynamic world, the brain receives outdated sensory information, due to the time required for neural transmission and processing. In motion perception, the brain may overcome these fundamental delays through predictively encoding the position of moving objects using information from their past trajectories. In the present study, we evaluated this proposition using multivariate analysis of high temporal resolution electroencephalographic data. We tracked neural position representations of moving objects at different stages of visual processing, relative to the real-time position of the object. During early stimulus-evoked activity, position representations of moving objects were activated substantially earlier than the equivalent activity evoked by unpredictable flashes, aligning the earliest representations of moving stimuli with their real-time positions. These findings indicate that the predictability of straight trajectories enables full compensation for the neural delays accumulated early in stimulus processing, but that delays still accumulate across later stages of cortical processing.

Radial Bias Alters Perceived Object Orientation

Orientation sensitivity is a fundamental property of the visual system, but not all orientations are created equal. For instance, radially oriented stimuli, aligned with a line intersecting the center of gaze, produce greater activity throughout the visual cortex and are associated with greater perceptual sensitivity compared with other orientations. Here, we discuss a robust visual illusion that is likely related to this preference. Using a continuous response measure, participants (N = 36 adults) indicated the gap position in a peripheral Landolt C placed in one of eight orientations and eight locations along four meridians (vertical, horizontal, 45°, 135°). The error distributions revealed that the perceived gap was attracted toward the radial axis. For instance, the gap in a regular C would often be wrongly perceived as tilted 45° corresponding to the oblique meridian where it was placed. These findings demonstrate an unsuspected early-vision influence on the perceived orientation of an object.

Topographic signatures of global object perception in human visual cortex

Our visual system readily groups dynamic fragmented input into global objects. How the brain represents global object perception remains however unclear. To address this question, we recorded brain responses using functional magnetic resonance imaging whilst observers viewed a dynamic bistable stimulus that could either be perceived globally (i.e., as a grouped and coherently moving shape) or locally (i.e., as ungrouped and incoherently moving elements). We further estimated population receptive fields and used these to back-project the brain activity measured during stimulus perception into visual space via a searchlight procedure. Global perception resulted in universal suppression of responses in lower visual cortex accompanied by wide-spread enhancement in higher object-sensitive cortex. However, follow-up experiments indicated that higher object-sensitive cortex is suppressed if global perception lacks shape grouping, and that grouping-related suppression can be diffusely confined to stimulated sites and accompanied by background enhancement once stimulus size is reduced. These results speak to a non-generic involvement of higher object-sensitive cortex in perceptual grouping and point to an enhancement-suppression mechanism mediating the perception of figure and ground.

•

Lower visual cortex activity to grouped vs ungrouped dynamic stimuli is suppressed.

•

When grouping a shape, activity in higher object-sensitive cortex is enhanced.

•

Without shape grouping, activity in higher object-sensitive cortex is suppressed.

•

Grouping-related suppression can be diffusely confined to stimulated cortical sites.

Changes in fMRI BOLD dynamics reflect anticipation to moving objects

The human brain is thought to respond differently to novel versus predictable neural input. In human visual cortex, neural response amplitude to visual input might be determined by the degree of predictability. We investigated how fMRI BOLD responses in human early visual cortex reflect the anticipation of a single moving bar's trajectory. We found that BOLD signals decreased linearly from onset to offset of the stimulus trajectory. Moreover, decreased amplitudes of BOLD responses coincided with an increased initial dip as the stimulus moved along its trajectory. Importantly, motion anticipation effects were absent, when motion coherence was disrupted by means of stimulus contrast reversals. These results show that human early visual cortex anticipates the trajectory of a coherently moving object at the initial stages of visual motion processing. The results can be explained by suppression of predictable input, plausibly underlying the formation of stable visual percepts.

Visual motion transforms visual space representations similarly throughout the human visual hierarchy

Several studies demonstrate that visual stimulus motion affects neural receptive fields and fMRI response amplitudes. Here we unite results of these two approaches and extend them by examining the effects of visual motion on neural position preferences throughout the hierarchy of human visual field maps. We measured population receptive field (pRF) properties using high-field fMRI (7T), characterizing position preferences simultaneously over large regions of the visual cortex. We measured pRFs properties using sine wave gratings in stationary apertures, moving at various speeds in either the direction of pRF measurement or the orthogonal direction. We find direction- and speed-dependent changes in pRF preferred position and size in all visual field maps examined, including V1, V3A, and the MT+ map TO1. These effects on pRF properties increase up the hierarchy of visual field maps. However, both within and between visual field maps the extent of pRF changes was approximately proportional to pRF size. This suggests that visual motion transforms the representation of visual space similarly throughout the visual hierarchy. Visual motion can also produce an illusory displacement of perceived stimulus position. We demonstrate perceptual displacements using the same stimulus configuration. In contrast to effects on pRF properties, perceptual displacements show only weak effects of motion speed, with far larger speed-independent effects. We describe a model where low-level mechanisms could underlie the observed effects on neural position preferences. We conclude that visual motion induces similar transformations of visuo-spatial representations throughout the visual hierarchy, which may arise through low-level mechanisms.

Predictions to motion stimuli in human early visual cortex: Effects of motion displacement on motion predictability

Recently, several studies showed that fMRI BOLD responses to moving random dot stimuli are enhanced at the location of dot appearance, i.e., the motion trailing edge. Possibly, BOLD activity in human visual cortex reflects predictability of visual motion input. In the current study, we investigate to what extent fMRI BOLD responses reflect estimated predictions to visual motion. We varied motion displacement parameters (duration and velocity), while measuring BOLD amplitudes as a function of distance from the trailing edge. We have found that for all stimulus configurations, BOLD signals decrease with increasing distance from the trailing edge. This finding indicates that neural activity directly reflects the predictability of moving dots, rather than their appearance within classical receptive fields. However, different motion displacement parameters exerted only marginal effects on predictability, suggesting that early visual cortex does not literally predict motion trajectories. Rather, the results reveal a heuristic mechanism of motion suppression from trailing to leading edge, plausibly mediated through short-range horizontal connections. Simple heuristic suppression allows the visual system to recognize novel input among many motion signals, while being most energy efficient.

Preference for concentric orientations in the mouse superior colliculus

The superior colliculus is a layered structure important for body- and gaze-orienting responses. Its superficial layer is, next to the lateral geniculate nucleus, the second major target of retinal ganglion axons and is retinotopically organized. Here we show that in the mouse there is also a precise organization of orientation preference. In columns perpendicular to the tectal surface, neurons respond to the same visual location and prefer gratings of the same orientation. Calcium imaging and extracellular recording revealed that the preferred grating varies with retinotopic location, and is oriented parallel to the concentric circle around the centre of vision through the receptive field. This implies that not all orientations are equally represented across the visual field. This makes the superior colliculus different from visual cortex and unsuitable for translation-invariant object recognition and suggests that visual stimuli might have different behavioural consequences depending on their retinotopic location.

The mammalian superior colliculus (SC) processes visual stimuli but little is known about the spatial organization of the response preferences for specific visual features. Here the authors show that the mouse SC contains a map for orientation preference such that preferred grating orientation is aligned to concentric circles around the centre of the visual field.

Motion direction biases and decoding in human visual cortex

Functional magnetic resonance imaging (fMRI) studies have relied on multivariate analysis methods to decode visual motion direction from measurements of cortical activity. Above-chance decoding has been commonly used to infer the motion-selective response properties of the underlying neural populations. Moreover, patterns of reliable response biases across voxels that underlie decoding have been interpreted to reflect maps of functional architecture. Using fMRI, we identified a direction-selective response bias in human visual cortex that: (1) predicted motion-decoding accuracy; (2) depended on the shape of the stimulus aperture rather than the absolute direction of motion, such that response amplitudes gradually decreased with distance from the stimulus aperture edge corresponding to motion origin; and 3) was present in V1, V2, V3, but not evident in MT+, explaining the higher motion-decoding accuracies reported previously in early visual cortex. These results demonstrate that fMRI-based motion decoding has little or no dependence on the underlying functional organization of motion selectivity.

Human cortical and behavioral sensitivity to patterns of complex motion at eccentricity

Complex patterns of image motion (contracting, expanding, rotating, and spiraling fields) are important in the coordination of visually guided behaviors. Whereas specialized detectors in monkey visual cortex show selectivity for particular patterns of complex motion, their representation in human visual cortex remains unclear. In the present study, functional magnetic resonance imaging (fMRI) was used to investigate the sensitivity of functionally defined regions of human visual cortex to parametrically modulated complex motion trajectories, coupled with complementary psychophysical testing. A unique stimulus design made it possible to disambiguate the neural responses and psychophysical sensitivity to complex motions per se from the distribution of local motions relative to the fovea, which are known to enhance cortical activity when presented radial to fixation. This involved presenting several small, separate motion fields in the periphery in a manner that distinguished them from global optic flow patterns. The patterns were morphed through complex motion space in a systematic time-locked fashion when presented in the scanner. Anisotropies were observed in the fMRI signal, marked by an enhanced response to expanding vs. contracting fields, even in early visual cortex. Anisotropies in the psychophysical sensitivity measures followed a similar pattern that was correlated with activity in areas hV4, V5/MT, and MST. This represents the first systematic examination of complex motion perception at both a behavioral and neural level in human observers. The characteristic processing anisotropy revealed in both data sets can inform models of complex motion processing, particularly with respect to computations performed in early visual cortex.

Linking brain imaging signals to visual perception

The rapid advances in brain imaging technology over the past 20 years are affording new insights into cortical processing hierarchies in the human brain. These new data provide a complementary front in seeking to understand the links between perceptual and physiological states. Here we review some of the challenges associated with incorporating brain imaging data into such "linking hypotheses," highlighting some of the considerations needed in brain imaging data acquisition and analysis. We discuss work that has sought to link human brain imaging signals to existing electrophysiological data and opened up new opportunities in studying the neural basis of complex perceptual judgments. We consider a range of approaches when using human functional magnetic resonance imaging to identify brain circuits whose activity changes in a similar manner to perceptual judgments and illustrate these approaches by discussing work that has studied the neural basis of 3D perception and perceptual learning. Finally, we describe approaches that have sought to understand the information content of brain imaging data using machine learning and work that has integrated multimodal data to overcome the limitations associated with individual brain imaging approaches. Together these approaches provide an important route in seeking to understand the links between physiological and psychological states.

Patterns of resting state connectivity in human primary visual cortical areas: a 7T fMRI study

The nature and origin of fMRI resting state fluctuations and connectivity are still not fully known. More detailed knowledge on the relationship between resting state patterns and brain function may help to elucidate this matter. We therefore performed an in depth study of how resting state fluctuations map to the well known architecture of the visual system. We investigated resting state connectivity at both a fine and large scale within and across visual areas V1, V2 and V3 in ten human subjects using a 7Tesla scanner. We found evidence for several coexisting and overlapping connectivity structures at different spatial scales. At the fine-scale level we found enhanced connectivity between the same topographic locations in the fieldmaps of V1, V2 and V3, enhanced connectivity to the contralateral functional homologue, and to a lesser extent enhanced connectivity between iso-eccentric locations within the same visual area. However, by far the largest proportion of the resting state fluctuations occurred within large-scale bilateral networks. These large-scale networks mapped to some extent onto the architecture of the visual system and could thereby obscure fine-scale connectivity. In fact, most of the fine-scale connectivity only became apparent after the large-scale network fluctuations were filtered from the timeseries. We conclude that fMRI resting state fluctuations in the visual cortex may in fact be a composite signal of different overlapping sources. Isolating the different sources could enhance correlations between BOLD and electrophysiological correlates of resting state activity.

Integration of motion responses underlying directional motion anisotropy in human early visual cortical areas

Recent imaging studies have reported directional motion biases in human visual cortex when perceiving moving random dot patterns. It has been hypothesized that these biases occur as a result of the integration of motion detector activation along the path of motion in visual cortex. In this study we investigate the nature of such motion integration with functional MRI (fMRI) using different motion stimuli. Three types of moving random dot stimuli were presented, showing either coherent motion, motion with spatial decorrelations or motion with temporal decorrelations. The results from the coherent motion stimulus reproduced the centripetal and centrifugal directional motion biases in V1, V2 and V3 as previously reported. The temporally decorrelated motion stimulus resulted in both centripetal and centrifugal biases similar to coherent motion. In contrast, the spatially decorrelated motion stimulus resulted in small directional motion biases that were only present in parts of visual cortex coding for higher eccentricities of the visual field. In combination with previous results, these findings indicate that biased motion responses in early visual cortical areas most likely depend on the spatial integration of a simultaneously activated motion detector chain.

Illusory movement of stationary stimuli in the visual periphery: evidence for a strong centrifugal prior in motion processing

Visual input is remarkably diverse. Certain sensory inputs are more probable than others, mirroring statistical regularities of the visual environment. The visual system exploits many of these regularities, resulting, on average, in better inferences about visual stimuli. However, by incorporating prior knowledge into perceptual decisions, visual processing can also result in perceptions that do not match sensory inputs. Such perceptual biases can often reveal unique insights into underlying mechanisms and computations. For example, a prior assumption that objects move slowly can explain a wide range of motion phenomena. The prior on slow speed is usually rationalized by its match with visual input, which typically includes stationary or slow moving objects. However, this only holds for foveal and parafoveal stimulation. The visual periphery tends to be exposed to faster motions, which are biased toward centrifugal directions. Thus, if prior assumptions derive from experience, peripheral motion processing should be biased toward centrifugal speeds. Here, in experiments with human participants, we support this hypothesis and report a novel visual illusion where stationary objects in the visual periphery are perceived as moving centrifugally, while objects moving as fast as 7°/s toward fovea are perceived as stationary. These behavioral results were quantitatively explained by a Bayesian observer that has a strong centrifugal prior. This prior is consistent with both the prevalence of centrifugal motions in the visual periphery and a centrifugal bias of direction tuning in cortical area MT, supporting the notion that visual processing mirrors its input statistics.

Direction anisotropy of human motion perception depends on stimulus speed

A number of previous studies have extensively investigated directional anisotropy in motion perception. However, consensus has not been reached regarding the nature of motion directional anisotropies in human vision. In this study, we investigated the directional anisotropy of human motion perception by moving random-dot stimuli in the peripheral upper visual field. Our findings show that the degree of directional anisotropy depends on the stimulus speed. Furthermore, the high and low speed conditions have preferred directions that are opposite. This may reflect differences in the directional information among temporal frequencies in natural scenes. These differences are thought to have crucial roles in the detection of motion direction.

Orientation anisotropies in human visual cortex

Representing the orientation of features in the visual image is a fundamental operation of the early cortical visual system. The nature of such representations can be informed by considering anisotropic distributions of response across the range of orientations. Here we used functional MRI to study modulations in the cortical activity elicited by observation of a sinusoidal grating that varied in orientation. We report a significant anisotropy in the measured blood-oxygen level-dependent activity within visual areas V1, V2, V3, and V3A/B in which horizontal orientations evoked a reduced response. These visual areas and hV4 showed a further anisotropy in which increased responses were observed for orientations that were radial to the point of fixation. We speculate that the anisotropies in cortical activity may be related to anisotropies in the prevalence and behavioral relevance of orientations in typical natural environments.

Radial biases in the processing of motion and motion-defined contours by human visual cortex

Luminance gratings reportedly produce a stronger functional magnetic resonance imaging (fMRI) blood oxygen level-dependent (BOLD) signal in those parts of the retinotopic cortical maps where they are oriented radially to the point of fixation. We sought to extend this finding by examining anisotropies in the response of cortical areas V1-V3 to motion-defined contour stimuli. fMRI at 3 Tesla was used to measure the BOLD signal in the visual cortex of six human subjects. Stimuli were composed of strips of spatial white noise texture presented in an annular window. The texture in alternate strips moved in opposite directions (left-right or up-down). The strips themselves were static and tilted 45 degrees left or right from vertical. Comparison with maps of the visual field obtained from phase-encoded retinotopic analysis revealed systematic patterns of radial bias. For motion, a stronger response to horizontal was evident within V1 and along the borders between V2 and V3. For orientation, the response to leftward tilted contours was greater in left dorsal and right ventral V1-V3. Radial bias for the orientation of motion-defined contours analogous to that reported previously for luminance gratings could reflect cue-invariant processing or the operation of distinct mechanisms subject to similar anisotropies in orientation tuning. Radial bias for motion might be related to the phenomenon of "motion streaks," whereby temporal integration by the visual system introduces oriented blur along the axis of motion. We speculate that the observed forms of radial bias reflect a common underlying anisotropy in the representation of spatiotemporal image structure across the visual field.