Functional MRI studies of human visual motion perception: texture, luminance, attention and after-effects

Development of static and dynamic perception for luminance- and texture-defined information from school-ages to adulthood

Few studies have assessed the visual development of static and dynamic information processing at different levels of processing during typical development from the school-age years to adulthood. The implication of non-visual factors on visual development, such as cognitive (e.g., IQ) and attentional abilities, has yet to be systematically assessed with regard to spanning such a large age range. To address these voids, 203 typically-developing participants (aged 6 to 31 years) identified the orientation or direction of a static or moving grating defined by either luminance- or texture-contrast. An adaptive staircase procedure was used to measure contrast sensitivity in all four conditions. Cognitive (Wechsler IQ) and attentional ability (CPT-3) were also measured for all participants. Different developmental rates of contrast sensitivity were found between static and dynamic conditions when defined by more complex, texture-defined information, with the difference in sensitivity starting after the age of 9.71 years. However, static and dynamic profiles for luminance-defined information developed similarly with age. In addition, IQ did not correlate with nor predict the sensitivity across any condition. These results suggest age significantly explains the variance in the developmental profiles of contrast sensitivity above and beyond non-visual factors such as IQ and the CPT-3 attentional scores. Moreover, the neural pathways processing static and dynamic visual information continue to develop through late childhood and adolescence for the processing of texture-defined information only.

Resting-state fMRI functional connectivity of the left temporal parietal junction is associated with visual temporal order threshold

The study aimed to determine the relationship between the millisecond timing, measured by visual temporal order threshold (TOT), i.e. a minimum gap between two successive stimuli necessary to judge a before-after relation, and resting-state fMRI functional connectivity (rsFC). We assume that the TOT reflects a relatively stable feature of local internal state networks and is associated with rsFC of the temporal parietal junction (TPJ). Sixty five healthy young adults underwent the visual TOT, fluid intelligence (G_f) and an eyes-open resting-state fMRI examination. After controlling for the influence of gender, the higher the TOT, the stronger was the left TPJ’s rsFC with the left postcentral and the right precentral gyri, bilateral putamen and the right supplementary motor area. When the effects of G_f and TOT × G_f interaction were additionally controlled, the TOT—left TPJ’s rsFC relationship survived for almost all above regions with the exception of the left and right putamen. This is the first study demonstrating that visual TOT is associated with rsFC between the areas involved both in sub-second timing and motor control. Current outcomes indicate that the local neural networks are prepared to process brief, rapidly presented, consecutive events, even in the absence of such stimulation.

Neural correlates associated with impaired global motion perception in cerebral visual impairment (CVI)

•

Cerebral visual impairment (CVI) is associated with impaired global motion processing.

•

Mean motion coherence thresholds was higher in individuals with CVI.

•

fMRI responses in area hMT+ showed an aberrant response profile in CVI.

•

White matter tract reconstruction revealed cortico-cortical dysmyelination in CVI.

Cerebral visual impairment (CVI) is associated with a wide range of visual perceptual deficits including global motion processing. However, the underlying neurophysiological basis for these impairments remain poorly understood. We investigated global motion processing abilities in individuals with CVI compared to neurotypical controls using a combined behavioral and multi-modal neuroimaging approach. We found that CVI participants had a significantly higher mean motion coherence threshold (determined using a random dot kinematogram pattern simulating optic flow motion) compared to controls. Using functional magnetic resonance imaging (fMRI), we investigated activation response profiles in functionally defined early (i.e. primary visual cortex; area V1) and higher order (i.e. middle temporal cortex; area hMT+) stages of motion processing. In area V1, responses to increasing motion coherence were similar in both groups. However, in the CVI group, activation in area hMT+ was significantly reduced compared to controls, and consistent with a surround facilitation (rather than suppression) response profile. White matter tract reconstruction obtained from high angular resolution diffusion imaging (HARDI) revealed evidence of increased mean, axial, and radial diffusivities within cortico-cortical (i.e. V1-hMT+), but not thalamo-hMT+ connections. Overall, our results suggest that global motion processing deficits in CVI may be associated with impaired signal integration and segregation mechanisms, as well as white matter integrity at the level of area hMT+.

Does visuospatial motion perception correlate with coexisting movement disorders in Parkinson's disease?

Postural instability and balance impairment are common in Parkinson's disease (PD). Multiple factors, such as increased tone, bradykinesia, freezing of gait, posture, axial stiffness, and involuntary appendicular movements, can affect balance. The recent studies found that PD patients have abnormal perception of self-motion in vestibular domain. We asked whether measures of balance function, such as perception of one's motion, correlate with specific movement disorders seen in PD. Moving retinal image or self-motion in space triggers the perception of self-motion. We measured one's linear motion (heading) perception when subjects were moved en bloc using a moving platform (vestibular heading). Similar motion perception was generated in the visual domain (visual heading) by having the subjects view a 3D optical flow with immersive virtual reality goggles. During both tasks, the subjects reported the motion direction in the two-alternative-forced-choice paradigm. The accuracy of perceived motion direction was calculated from the responses fitted to the psychometric function curves to estimate how accurately and precisely the subjects can perceive rightward versus leftward motion (i.e., threshold and slope). Response accuracies and psychometric parameters were correlated with the disease duration, disease severity (total Unified Parkinson's Disease Rating Scale-III, UPDRS-III), and tremor, rigidity, axial, gait/posture components of UPRDS-III. We also correlated heading perception with the number of falls and subjective assessment of balance confidence using the Activities-Specific Balance Component (ABC) Scale. Accuracy, threshold, and sensitivity of vestibular heading perception significantly correlated with the disease duration and severity, particularly the tremor. Correlations were stronger for leftward heading perception in the vestibular domain. The visual heading perception was correlated with ABC Scale, especially with its items concerning optic-flow processing. There was asymmetry in leftward versus rightward vestibular heading perception. The level of asymmetry correlated with the axial component of UPDRS-III. Differences in the clinical parameters that correlate with visual versus vestibular heading perception suggest that two heading perception processes have different mechanistic underpinnings. The correlation of discordance between vestibular and visual heading perception with disease severity and duration suggests that visual function can be utilized for balance rehab in PD patients.

Enhancing visual motion discrimination by desynchronizing bifocal oscillatory activity

Visual motion discrimination involves reciprocal interactions in the alpha band between the primary visual cortex (V1) and mediotemporal areas (V5/MT). We investigated whether modulating alpha phase synchronization using individualized multisite transcranial alternating current stimulation (tACS) over V5 and V1 regions would improve motion discrimination. We tested 3 groups of healthy subjects with the following conditions: (1) individualized In-Phase V1_alpha-V5_alpha tACS (0° lag), (2) individualized Anti-Phase V1_alpha-V5_alpha tACS (180° lag) and (3) sham tACS. Motion discrimination and EEG activity were recorded before, during and after tACS. Performance significantly improved in the Anti-Phase group compared to the In-Phase group 10 and 30 min after stimulation. This result was explained by decreases in bottom-up alpha-V1 gamma-V5 phase-amplitude coupling. One possible explanation of these results is that Anti-Phase V1_alpha-V5_alpha tACS might impose an optimal phase lag between stimulation sites due to the inherent speed of wave propagation, hereby supporting optimized neuronal communication.

Motion perception and its disorders

As we live in a dynamic world, motion is a fundamental aspect of our visual experience. The advent of computerized stimuli has allowed controlled study of a wide array of motion phenomena, including global integration and segmentation, speed and direction discrimination, motion aftereffects, the optic flow that accompanies self-motion, perception of object form derived from motion cues, and point-light biological motion. Animal studies first revealed the existence of a motion-selective region, the middle temporal (MT) area, also known as V5, located in the lateral occipitotemporal cortex, followed by areas such as V5A (also known as MST, the middle superior temporal area), V6/V6A, the ventral intraparietal area, and others. In humans there are rare cases of bilateral lesions of the V5/V5A complex causing cerebral akinetopsia, a severe impairment of motion perception. Unilateral V5/V5A lesions are more common but cause milder asymptomatic deficits, often limited to the contralateral hemifield, while parietal lesions can impair perception of point-light biological motion or high-level motion tasks that are attentionally demanding. Impairments of motion perception have also been described in optic neuropathy, particularly glaucoma, as well as Alzheimer's disease, Parkinson's disease with dementia, and dementia with Lewy body disease. Prematurity with or without periventricular leukomalacia and developmental syndromes such as Williams' syndrome, autism, and dyslexia have also been associated with impaired motion perception, suggesting a developmental vulnerability of the dorsal pathway.

Neural Selectivity for Visual Motion in Macaque Area V3A

The processing of visual motion is conducted by dedicated pathways in the primate brain. These pathways originate with populations of direction-selective neurons in the primary visual cortex, which projects to dorsal structures like the middle temporal (MT) and medial superior temporal (MST) areas. Anatomical and imaging studies have suggested that area V3A might also be specialized for motion processing, but there have been very few studies of single-neuron direction selectivity in this area. We have therefore performed electrophysiological recordings from V3A neurons in two macaque monkeys (one male and one female) and measured responses to a large battery of motion stimuli that includes translation motion, as well as more complex optic flow patterns. For comparison, we simultaneously recorded the responses of MT neurons to the same stimuli. Surprisingly, we find that overall levels of direction selectivity are similar in V3A and MT and moreover that the population of V3A neurons exhibits somewhat greater selectivity for optic flow patterns. These results suggest that V3A should be considered as part of the motion processing machinery of the visual cortex, in both human and non-human primates.

Rotating One's Head Modulates the Perceived Velocity of Motion Aftereffect

As a prominent illusion, the motion aftereffect (MAE) has traditionally been considered a visual phenomenon. Recent neuroimaging work has revealed increased activities in MT+ and decreased activities in vestibular regions during the MAE, supporting the notion of visual-vestibular interaction on the MAE. Since the head had to remain stationary in fMRI experiments, vestibular self-motion signals were absent in those studies. Accordingly, more direct evidence is still lacking in terms of whether and how vestibular signals modulate the MAE. By developing a virtual reality approach, the present study for the first time demonstrates that horizontal head rotation affects the perceived velocity of the MAE. We found that the MAE was predominantly perceived as moving faster when its direction was opposite to the direction of head rotation than when its direction was the same as head rotation. The magnitude of this effect was positively correlated with the velocity of head rotation. Similar result patterns were not observed for the real motion stimuli. Our findings support a 'cross-modal bias' hypothesis that after living in a multisensory environment long-term the brain develops a strong association between signals from the visual and vestibular pathways. Consequently, weak biasing visual signals in the associated direction can spontaneously emerge with the input of vestibular signals in the multisensory brain areas, substantially modulating the illusory visual motion represented in those areas as well. The hypothesis can also be used to explain other multisensory integration phenomena.

Searching for illusory motion

In a series of four experiments, standard visual search was used to explore whether the onset of illusory motion pre-attentively guides vision in the same way that the onset of real-motion is known to do. Participants searched for target stimuli based on Akiyoshi Kitaoka's classic illusions, configured so that they either did or did not give the subjective impression of illusory motion. Distractor items always contained the same elements as target items, but did not convey a sense of illusory motion. When target items contained illusory motion, they popped-out, with flat search slopes that were independent of set size. Search for control items without illusory motion - but with identical structural differences to distractors - was slow and serial in nature (> 200 ms/item). Using a nulling task, we estimated the speed of illusory rotation in our displays to be approximately 2 °/s. Direct comparison of illusory and real-motion targets moving with matched velocity showed that illusory motion targets were detected more quickly. Blurred target items that conveyed a weak subjective impression of illusory motion gave rise to serial but faster (< 100 ms/item) search than control items. Our behavioral findings of parallel detection across the visual field, together with previous imaging and neurophysiological studies, suggests that relatively early cortical areas play a causal role in the perception of illusory motion. Furthermore, we hope to re-emphasize the way in which visual search can be used as a flexible, objective measure of illusion strength.

Functional correlate and delineated connectivity pattern of human motion aftereffect responses substantiate a subjacent visual-vestibular interaction

The visual motion aftereffect (MAE) is the most prominent aftereffect in the visual system. Regarding its function, psychophysical studies suggest its function to be a form of sensory error correction, possibly also triggered by incongruent visual-vestibular stimulation. Several observational imaging experiments have deducted an essential role for region MT+ in the perception of a visual MAE but not provided conclusive evidence. Potential confounders with the MAE such as ocular motor performance, attention, and vection sensations have also never been controlled for. Aim of this neuroimaging study was to delineate the neural correlates of MAE and its subjacent functional connectivity pattern. A rotational MAE (n = 22) was induced using differing visual stimuli whilst modulating ocular motor parameters in a 3T scanner. Data was analyzed with SPM12. Eye movements as a response to the same stimuli were studied by means of high-resolution videooculography. Analysis for all stimuli gave bilateral activations along the dorsal visual stream with an emphasis on area MT. The onset of a visual MAE revealed an additional response in the right medial superior temporal area (MST) and a concurrent deactivation of vestibular hub region OP2. There was no correlation for the BOLD effects during the MAE with either ocular motor or attention parameters. The functional correlate of a visual MAE in humans may be represented in the interaction between region MT and area MST. This MAE representation is independent of a potential afternystagmus, attention and the presence of egomotion sensations. Connectivity analyses showed that in the event of conflicting visual-vestibular motion information (here MAE) area MST and area OP2 may act as the relevant mediating network hubs.

Cortical BOLD responses to moderate- and high-speed motion in the human visual cortex

We investigated the BOLD response of visual cortical and sub-cortical regions to fast drifting motion presented over wide fields, including the far periphery. Stimuli were sinusoidal gratings of 50% contrast moving at moderate and very high speeds (38 and 570 °/s), projected to a large field of view (~60°). Both stimuli generated strong and balanced responses in the lateral geniculate nucleus and the superior colliculus. In visual cortical areas, responses were evaluated at three different eccentricities: central 0-15°; peripheral 20-30°; and extreme peripheral 30-60°. "Ventral stream" areas (V2, V3, V4) preferred moderate-speeds in the central visual field, while motion area MT+ responded equally well to both speeds at all eccentricities. In all other areas and eccentricities BOLD responses were significant and equally strong for both types of moving stimuli. Support vector machine showed that the direction of the fast-speed motion could be successfully decoded from the BOLD response in all visual areas, suggesting that responses are mediated by motion mechanisms rather than being an unspecific preference for fast rate of flicker. The results show that the visual cortex responds to very fast motion, at speeds generated when we move our eyes rapidly, or when moving objects pass by closely.

Phase-Dependent Interactions in Visual Cortex to Combinations of First- and Second-Order Stimuli

A fundamental task of the visual system is to extract figure-ground boundaries between objects, which are often defined, not only by differences in luminance, but also by "second-order" contrast or texture differences. Responses of cortical neurons to both first- and second-order patterns have been studied extensively, but only for responses to either type of stimulus in isolation. Here, we examined responses of visual cortex neurons to the spatial relationship between superimposed periodic luminance modulation (LM) and contrast modulation (CM) stimuli, the contrasts of which were adjusted to give equated responses when presented alone. Extracellular single-unit recordings were made in area 18 of the cat, the neurons of which show responses to CM and LM stimuli very similar to those in primate area V2 (Li et al., 2014). Most neurons showed a significant dependence on the relative phase of the combined LM and CM patterns, with a clear overall optimal response when they were approximately phase aligned. The degree of this phase preference, and the contributions of suppressive and/or facilitatory interactions, varied considerably from one neuron to another. Such phase-dependent and phase-invariant responses were evident in both simple- and complex-type cells. These results place important constraints on any future model of the underlying neural circuitry for second-order responses. The diversity in the degree of phase dependence between LM and CM stimuli that we observed could help to disambiguate different kinds of boundaries in natural scenes.

SIGNIFICANCE STATEMENT

Many visual cortex neurons exhibit orientation-selective responses to boundaries defined by differences either in luminance or in texture contrast. Previous studies have examined responses to either type of boundary in isolation, but here we measured systematically responses of cortical neurons to the spatial relationship between superimposed periodic luminance-modulated (LM) and contrast-modulated (CM) stimuli with contrasts adjusted to give equated responses. We demonstrate that neuronal responses to these compound stimuli are highly dependent on the relative phase between the LM and CM components. Diversity in the degree of such phase dependence could help to disambiguate different kinds of boundaries in natural scenes, for example, those arising from surface reflectance changes or from illumination gradients such as shading or shadows.

Differential processing of the direction and focus of expansion of optic flow stimuli in areas MST and V3A of the human visual cortex

Human neuropsychological and neuroimaging studies have raised the possibility that different attributes of optic flow stimuli, namely radial direction and the position of the focus of expansion (FOE), are processed within separate cortical areas. In the human brain, visual areas V5/MT+ and V3A have been proposed as integral to the analysis of these different attributes of optic flow stimuli. To establish direct causal relationships between neural activity in human (h)V5/MT+ and V3A and the perception of radial motion direction and FOE position, we used transcranial magnetic stimulation (TMS) to disrupt cortical activity in these areas while participants performed behavioral tasks dependent on these different aspects of optic flow stimuli. The cortical regions of interest were identified in seven human participants using standard functional MRI retinotopic mapping techniques and functional localizers. TMS to area V3A was found to disrupt FOE positional judgments but not radial direction discrimination, whereas the application of TMS to an anterior subdivision of hV5/MT+, MST/TO-2 produced the reverse effects, disrupting radial direction discrimination but eliciting no effect on the FOE positional judgment task. This double dissociation demonstrates that FOE position and radial direction of optic flow stimuli are signaled independently by neural activity in areas hV5/MT+ and V3A.NEW & NOTEWORTHY Optic flow constitutes a biologically relevant visual cue as we move through any environment. With the use of neuroimaging and brain-stimulation techniques, this study demonstrates that separate human brain areas are involved in the analysis of the direction of radial motion and the focus of expansion in optic flow. This dissociation reveals the existence of separate processing pathways for the analysis of different attributes of optic flow that are important for the guidance of self-locomotion and object avoidance.

Breaking cover: neural responses to slow and fast camouflage-breaking motion

Primates need to detect and recognize camouflaged animals in natural environments. Camouflage-breaking movements are often the only visual cue available to accomplish this. Specifically, sudden movements are often detected before full recognition of the camouflaged animal is made, suggesting that initial processing of motion precedes the recognition of motion-defined contours or shapes. What are the neuronal mechanisms underlying this initial processing of camouflaged motion in the primate visual brain? We investigated this question using intrinsic-signal optical imaging of macaque V1, V2 and V4, along with computer simulations of the neural population responses. We found that camouflaged motion at low speed was processed as a direction signal by both direction- and orientation-selective neurons, whereas at high-speed camouflaged motion was encoded as a motion-streak signal primarily by orientation-selective neurons. No population responses were found to be invariant to the camouflage contours. These results suggest that the initial processing of camouflaged motion at low and high speeds is encoded as direction and motion-streak signals in primate early visual cortices. These processes are consistent with a spatio-temporal filter mechanism that provides for fast processing of motion signals, prior to full recognition of camouflage-breaking animals.

The neural representation of objects formed through the spatiotemporal integration of visual transients

Oftentimes, objects are only partially and transiently visible as parts of them become occluded during observer or object motion. The visual system can integrate such object fragments across space and time into perceptual wholes or spatiotemporal objects. This integrative and dynamic process may involve both ventral and dorsal visual processing pathways, along which shape and spatial representations are thought to arise. We measured fMRI BOLD response to spatiotemporal objects and used multi-voxel pattern analysis (MVPA) to decode shape information across 20 topographic regions of visual cortex. Object identity could be decoded throughout visual cortex, including intermediate (V3A, V3B, hV4, LO1-2,) and dorsal (TO1-2, and IPS0-1) visual areas. Shape-specific information, therefore, may not be limited to early and ventral visual areas, particularly when it is dynamic and must be integrated. Contrary to the classic view that the representation of objects is the purview of the ventral stream, intermediate and dorsal areas may play a distinct and critical role in the construction of object representations across space and time.

Concept Representation Reflects Multimodal Abstraction: A Framework for Embodied Semantics

Recent research indicates that sensory and motor cortical areas play a significant role in the neural representation of concepts. However, little is known about the overall architecture of this representational system, including the role played by higher level areas that integrate different types of sensory and motor information. The present study addressed this issue by investigating the simultaneous contributions of multiple sensory-motor modalities to semantic word processing. With a multivariate fMRI design, we examined activation associated with 5 sensory-motor attributes--color, shape, visual motion, sound, and manipulation--for 900 words. Regions responsive to each attribute were identified using independent ratings of the attributes' relevance to the meaning of each word. The results indicate that these aspects of conceptual knowledge are encoded in multimodal and higher level unimodal areas involved in processing the corresponding types of information during perception and action, in agreement with embodied theories of semantics. They also reveal a hierarchical system of abstracted sensory-motor representations incorporating a major division between object interaction and object perception processes.

Orientation-cue invariant population responses to contrast-modulated and phase-reversed contour stimuli in macaque V1 and V2

Visual scenes can be readily decomposed into a variety of oriented components, the processing of which is vital for object segregation and recognition. In primate V1 and V2, most neurons have small spatio-temporal receptive fields responding selectively to oriented luminance contours (first order), while only a subgroup of neurons signal non-luminance defined contours (second order). So how is the orientation of second-order contours represented at the population level in macaque V1 and V2? Here we compared the population responses in macaque V1 and V2 to two types of second-order contour stimuli generated either by modulation of contrast or phase reversal with those to first-order contour stimuli. Using intrinsic signal optical imaging, we found that the orientation of second-order contour stimuli was represented invariantly in the orientation columns of both macaque V1 and V2. A physiologically constrained spatio-temporal energy model of V1 and V2 neuronal populations could reproduce all the recorded population responses. These findings suggest that, at the population level, the primate early visual system processes the orientation of second-order contours initially through a linear spatio-temporal filter mechanism. Our results of population responses to different second-order contour stimuli support the idea that the orientation maps in primate V1 and V2 can be described as a spatial-temporal energy map.

Functional correlates of optic flow motion processing in Parkinson's disease

The visual input created by the relative motion between an individual and the environment, also called optic flow, influences the sense of self-motion, postural orientation, veering of gait, and visuospatial cognition. An optic flow network comprising visual motion areas V6, V3A, and MT+, as well as visuo-vestibular areas including posterior insula vestibular cortex (PIVC) and cingulate sulcus visual area (CSv), has been described as uniquely selective for parsing egomotion depth cues in humans. Individuals with Parkinson’s disease (PD) have known behavioral deficits in optic flow perception and visuospatial cognition compared to age- and education-matched control adults (MC). The present study used functional magnetic resonance imaging (fMRI) to investigate neural correlates related to impaired optic flow perception in PD. We conducted fMRI on 40 non-demented participants (23 PD and 17 MC) during passive viewing of simulated optic flow motion and random motion. We hypothesized that compared to the MC group, PD participants would show abnormal neural activity in regions comprising this optic flow network. MC participants showed robust activation across all regions in the optic flow network, consistent with studies in young adults, suggesting intact optic flow perception at the neural level in healthy aging. PD participants showed diminished activity compared to MC particularly within visual motion area MT+ and the visuo-vestibular region CSv. Further, activation in visuo-vestibular region CSv was associated with disease severity. These findings suggest that behavioral reports of impaired optic flow perception and visuospatial performance may be a result of impaired neural processing within visual motion and visuo-vestibular regions in PD.

Unidirectional visual motion adaptation induces reciprocal inhibition of human early visual cortex excitability

OBJECTIVES

Behavioural observations provided by the waterfall illusion suggest that motion perception is mediated by a comparison of responsiveness of directional selective neurones. These are proposed to be optimally tuned for motion detection in different directions. Critically however, despite the behavioural observations, direct evidence of this relationship at a cortical level in humans is lacking. By utilising the state dependant properties of transcranial magnetic stimulation (TMS), one can probe the excitability of specific neuronal populations using the perceptual phenomenon of phosphenes.

METHOD

We exposed subjects to unidirectional visual motion adaptation and subsequently simultaneously measured early visual cortex (V1) excitability whilst viewing motion in the adapted and non-adapted direction.

RESULT

Following adaptation, the probability of perceiving a phosphene whilst viewing motion in the adapted direction was diminished reflecting a reduction in V1 excitability. Conversely, V1 excitability was enhanced whilst viewing motion in the opposite direction to that used for adaptation.

CONCLUSION

Our results provide support that in humans a process of reciprocal inhibition between oppositely tuned directionally selective neurones in V1 facilitates motion perception.

SIGNIFICANCE

This paradigm affords a unique opportunity to investigate changes in cortical excitability following peripheral vestibular disorders.

Binocular summation of second-order global motion signals in human vision

Although many studies have examined the principles governing first-order global motion perception, the mechanisms that mediate second-order global motion perception remain unresolved. This study investigated the existence, nature and extent of the binocular advantage for encoding second-order (contrast-defined) global motion. Motion coherence thresholds (79.4% correct) were assessed for determining the direction of radial, rotational and translational second-order motion trajectories as a function of local element modulation depth (contrast) under monocular and binocular viewing conditions. We found a binocular advantage for second-order global motion processing for all motion types. This advantage was mainly one of enhanced modulation sensitivity, rather than of motion-integration. However, compared to findings for first-order motion where the binocular advantage was in the region of a factor of around 1.7 (Hess et al., 2007), the binocular advantage for second-order global motion was marginal, being in the region of around 1.2. This weak enhancement in sensitivity with binocular viewing is considerably less than would be predicted by conventional models of either probability summation or neural summation.

Neural correlates of visual motion prediction

Predicting the trajectories of moving objects in our surroundings is important for many life scenarios, such as driving, walking, reaching, hunting and combat. We determined human subjects’ performance and task-related brain activity in a motion trajectory prediction task. The task required spatial and motion working memory as well as the ability to extrapolate motion information in time to predict future object locations. We showed that the neural circuits associated with motion prediction included frontal, parietal and insular cortex, as well as the thalamus and the visual cortex. Interestingly, deactivation of many of these regions seemed to be more closely related to task performance. The differential activity during motion prediction vs. direct observation was also correlated with task performance. The neural networks involved in our visual motion prediction task are significantly different from those that underlie visual motion memory and imagery. Our results set the stage for the examination of the effects of deficiencies in these networks, such as those caused by aging and mental disorders, on visual motion prediction and its consequences on mobility related daily activities.

Direction-selective patterns of activity in human visual cortex suggest common neural substrates for different types of motion

A sense of motion can be elicited by the movement of both luminance- and texture-defined patterns, what is commonly referred to as first- and second-order, respectively. Although there are differences in the perception of these two classes of motion stimuli, including differences in temporal and spatial sensitivity, it is debated whether common or separate direction-selective mechanisms are responsible for processing these two types of motion. Here, we measured direction-selective responses to luminance- and texture-defined motion in the human visual cortex by using functional MRI (fMRI) in conjunction with multivariate pattern analysis (MVPA). We found evidence of direction selectivity for both types of motion in all early visual areas (V1, V2, V3, V3A, V4, and MT+), implying that none of these early visual areas is specialized for processing a specific type of motion. More importantly, linear classifiers trained with cortical activity patterns to one type of motion (e.g., first-order motion) could reliably classify the direction of motion defined by the other type (e.g., second-order motion). Our results suggest that the direction-selective mechanisms that respond to these two types of motion share similar spatial distributions in the early visual cortex, consistent with the possibility that common mechanisms are responsible for processing both types of motion.

Neuropsychological evidence for three distinct motion mechanisms

We describe psychophysical performance of two stroke patients with lesions in distinct cortical regions in the left hemisphere. Both patients were selectively impaired on direction discrimination in several local and global second-order but not first-order motion tasks. However, only patient FD was impaired on a specific bi-stable motion task where the direction of motion is biased by object similarity. We suggest that this bi-stable motion task may be mediated by a high-level attention or position based mechanism indicating a separate neurological substrate for a high-level attention or position-based mechanism. Therefore, these results provide evidence for the existence of at least three motion mechanisms in the human visual system: a low-level first- and second-order motion mechanism and a high-level attention or position-based mechanism.

Spatially localized motion aftereffect disappears faster from awareness when selectively attended to according to its direction

In searching for the target-afterimage patch among spatially separate alternatives of color-afterimages the target fades from awareness before its competitors (Bachmann, T., & Murd, C. (2010). Covert spatial attention in search for the location of a color-afterimage patch speeds up its decay from awareness: Introducing a method useful for the study of neural correlates of visual awareness. Vision Research 50, 1048-1053). In an analogous study presented here we show that a similar effect is obtained when a target spatial location specified according to the direction of motion aftereffect within it is searched by covert top-down attention. The adverse effect of selective attention on the duration of awareness of sensory qualiae known earlier to be present for color and periodic spatial contrast is extended also to sensory channels carrying motion information.

Attention regulates the plasticity of multisensory timing

Evidence suggests than human time perception is likely to reflect an ensemble of recent temporal experience. For example, prolonged exposure to consistent temporal patterns can adaptively realign the perception of event order, both within and between sensory modalities (e.g. Fujisaki et al., 2004 Nat. Neurosci., 7, 773-778). In addition, the observation that 'a watched pot never boils' serves to illustrate the fact that dynamic shifts in our attentional state can also produce marked distortions in our temporal estimates. In the current study we provide evidence for a hitherto unknown link between adaptation, temporal perception and our attentional state. We show that our ability to use recent sensory history as a perceptual baseline for ongoing temporal judgments is subject to striking top-down modulation via shifts in the observer's selective attention. Specifically, attending to the temporal structure of asynchronous auditory and visual adapting stimuli generates a substantial increase in the temporal recalibration induced by these stimuli. We propose a conceptual framework accounting for our findings whereby attention modulates the perceived salience of temporal patterns. This heightened salience allows the formation of audiovisual perceptual 'objects', defined solely by their temporal structure. Repeated exposure to these objects induces high-level pattern adaptation effects, akin to those found in visual and auditory domains (e.g. Leopold & Bondar (2005) Fitting the Mind to the World: Adaptation and Aftereffects in High-Level Vision. Oxford University Press, Oxford, 189-211; Schweinberger et al. (2008) Curr. Biol., 18, 684-688).

Voxel-based morphometry depicts central compensation after vestibular neuritis

OBJECTIVE

Patients who have had vestibular neuritis (VN) show a remarkable clinical improvement especially in gait and posture >6 months after disease onset.

METHODS

Voxel-based morphometry was used to detect the VN-induced changes in gray and white matter by means of structural magnetic resonance imaging. Twenty-two patients were compared an average 2.5 years after onset of VN to a healthy sex-and age-matched control group.

RESULTS

Our analysis revealed that all patients had signal intensity increases for gray matter in the medial vestibular nuclei and the right gracile nucleus and for white matter in the area of the pontine commissural vestibular fibers. A relative atrophy was observed in the left posterior hippocampus and the right superior temporal gyrus. Patients with a residual canal paresis also showed an increase of gray matter in middle temporal (MT)/V5 bilaterally.

INTERPRETATION

These findings indicate that the processes of central compensation after VN seem to occur in 3 different sensory systems. First of all, the vestibular system itself showed a white matter increase in the commissural fibers as a direct consequence of an increased internuclei vestibular crosstalk of the medial vestibular nuclei. Second, to regain postural stability, there was a shift to the somatosensory system due to an elevated processing of proprioceptive information in the right gracile nucleus. Third, there was a bilateral increase in the area of MT/V5 in VN patients with a residual peripheral vestibular hypofunction. This seems to be the result of an increased importance of visual motion processing.

Spatial summation of first-order and second-order motion in human vision

This study assessed spatial summation of first-order (luminance-defined) and second-order (contrast-defined) motion. Thresholds were measured for identifying the drift direction of 1c/deg., luminance-modulated and contrast-modulated dynamic noise drifting at temporal frequencies of 0.5, 2 and 8Hz. Image size varied from 0.125 degrees to 16 degrees . The effects of increasing image size on thresholds for luminance-modulated noise were also compared to those for luminance-defined gratings. In all cases, performance improved as image size increased. The rate at which performance improved with increasing image size was similar for all stimuli employed although the slopes corresponding to the initial improvement were steeper for first-order compared to second-order motion. The image sizes at which performance for first-order motion asymptote were larger than for second-order motion. In addition, findings showed that the minimum image size required to support reliable identification of the direction of moving stimuli is greater for second-order than first-order motion. Thus, although first-order and second-order motion processing have a number of properties in common, the visual system's sensitivity to each type of motion as a function of image size is quite different.

The visual perception of motion by observers with autism spectrum disorders: a review and synthesis

Traditionally, psychological research on autism spectrum disorder (ASD) has focused on social and cognitive abilities. Vision provides an important input channel to both of these processes, and, increasingly, researchers are investigating whether observers with ASD differ from typical observers in their visual percepts. Recently, significant controversies have arisen over whether observers with ASD differ from typical observers in their visual analyses of movement. Initial studies suggested that observers with ASD experience significant deficits in their visual sensitivity to coherent motion in random dot displays but not to point-light displays of human motion. More recent evidence suggests exactly the opposite: that observers with ASD do not differ from typical observers in their visual sensitivity to coherent motion in random dot displays, but do differ from typical observers in their visual sensitivity to human motion. This review examines these apparently conflicting results, notes gaps in previous findings, suggests a potentially unifying hypothesis, and identifies areas ripe for future research.

The contribution of human cortical area V3A to the perception of chromatic motion: a transcranial magnetic stimulation study

Area V3A was identified in five human subjects on both a functional and retinotopic basis using functional magnetic resonance imaging techniques. V3A, along with other visual areas responsive to motion, was then targeted for disruption by repetitive transcranial magnetic stimulation (rTMS) whilst the participants performed a delayed speed matching task. The stimuli used for this task included chromatic, isoluminant motion stimuli that activated either the L-M or S-(L+M) cone-opponent mechanisms, in addition to moving stimuli that contained only luminance contrast (L+M). The speed matching task was performed for chromatic and luminance stimuli that moved at slow (2 degrees/s) or faster (8 degrees/s) speeds. The application of rTMS to area V3A produced a perceived slowing of all chromatic and luminance stimuli at both slow and fast speeds. Similar deficits were found when rTMS was applied to V5/MT+. No deficits in performance were found when areas V3B and V3d were targeted by rTMS. These results provide evidence of a causal link between neural activity in human area V3A and the perception of chromatic isoluminant motion. They establish area V3A, alongside V5/MT+, as a key area in a cortical network that underpins the analysis of not only luminance but also chromatically-defined motion.

The role of the parietal lobe in visual extinction studied with transcranial magnetic stimulation

Interhemispheric competition between homologous areas in the human brain is believed to be involved in a wide variety of human behaviors from motor activity to visual perception and particularly attention. For example, patients with lesions in the posterior parietal cortex are unable to selectively track objects in the contralesional side of visual space when targets are simultaneously present in the ipsilesional visual field, a form of visual extinction. Visual extinction may arise due to an imbalance in the normal interhemispheric competition. To directly assess the issue of reciprocal inhibition, we used fMRI to localize those brain regions active during attention-based visual tracking and then applied low-frequency repetitive transcranial magnetic stimulation over identified areas in the left and right intraparietal sulcus to asses the behavioral effects on visual tracking. We induced a severe impairment in visual tracking that was selective for conditions of simultaneous tracking in both visual fields. Our data show that the parietal lobe is essential for visual tracking and that the two hemispheres compete for attentional resources during tracking. Our results provide a neuronal basis for visual extinction in patients with parietal lobe damage.

Spatio-temporal tuning of coherent motion evoked responses in 4-6 month old infants and adults

Motion cues provide a rich source of information about translations of the observer through the environment as well as the movements of objects and surfaces. While the direction of motion can be extracted locally these local measurements are, in general, insufficient for determining object and surface motions. To study the development of local and global motion processing mechanisms, we recorded Visual Evoked Potentials (VEPs) in response to dynamic random dot displays that alternated between coherent rotational motion and random motion at 0.8 Hz. We compared the spatio-temporal tuning of the evoked response in 4-6 months old infants to that of adults by recording over a range of dot displacements and temporal update rates. Responses recorded at the frequency of the coherent motion modulation were tuned for displacement at the occipital midline in both adults in infants. Responses at lateral electrodes were tuned for speed in adults, but not in infants. Infant responses were maximal at a larger range of spatial displacement than that of adults. In contrast, responses recorded at the dot-update rate showed a more similar parametric displacement tuning and scalp topography in infants and adults. Taken together, our results suggest that while local motion processing is relatively mature at 4-6 months, global integration mechanisms exhibit significant immaturities at this age.

Low- and high-level motion perception deficits in anisometropic and strabismic amblyopia: evidence from fMRI

Maximum motion displacement (Dmax) is the largest dot displacement in a random-dot kinematogram (RDK) at which direction of motion can be correctly discriminated [Braddick, O. (1974). A short-range process in apparent motion. Vision Research, 14, 519-527]. For first-order RDKs, Dmax gets larger as dot size increases and/or dot density decreases. It has been suggested that this increase in Dmax reflects greater involvement of high-level feature-matching motion mechanisms and less dependence on low-level motion detectors [Sato, T. (1998). Dmax: Relations to low- and high-level motion processes. In T. Watanabe (Ed.), High-level motion processing, computational, neurobiological, and psychophysical perspectives (pp. 115-151). Boston: MIT Press]. Recent psychophysical findings [Ho, C. S., & Giaschi, D. E. (2006). Deficient maximum motion displacement in amblyopia. Vision Research, 46, 4595-4603; Ho, C. S., & Giaschi, D. E. (2007). Stereopsis-dependent deficits in maximum motion displacement. Vision Research, 47, 2778-2785] suggest that this "switch" from low-level to high-level motion processing is also observed in children with anisometropic and strabismic amblyopia as RDK dot size is increased and/or dot density is decreased. However, both high- and low-level Dmax were reduced relative to controls. In this study, we used functional MRI to determine the motion-sensitive areas that may account for the reduced Dmax in amblyopia In the control group, low-level RDKs elicited stronger responses in low-level (posterior occipital) areas and high-level RDKs elicited a greater response in high-level (extra-striate occipital-parietal) areas when activation for high-level RDKs was compared to that for low-level RDKs. Participants with anisometropic amblyopia showed the same pattern of cortical activation although extent of activation differences was less than in controls. For those with strabismic amblyopia, there was almost no difference in the cortical activity for low-level and high-level RDKs, and activation was reduced relative to the other groups. Differences in the extent of cortical activation may be related to amblyogenic subtype.

Source estimates for MEG/EEG visual evoked responses constrained by multiple, retinotopically-mapped stimulus locations

Studying the human visual system with high temporal resolution is a significant challenge due to the limitations of the available, noninvasive measurement tools. MEG and EEG provide the millisecond temporal resolution necessary for answering questions about intracortical communication involved in visual processing, but source estimation is ill-posed and unreliable when multiple; simultaneously active areas are located close together. To address this problem, we have developed a retinotopy-constrained source estimation method to calculate the time courses of activation in multiple visual areas. Source estimation was disambiguated by: (1) fixing MEG/EEG generator locations and orientations based on fMRI retinotopy and surface tessellations constructed from high-resolution MRI images; and (2) solving for many visual field locations simultaneously in MEG/EEG responses, assuming source current amplitudes to be constant or varying smoothly across the visual field. Because of these constraints on the solutions, estimated source waveforms become less sensitive to sensor noise or random errors in the specification of the retinotopic dipole models. We demonstrate the feasibility of this method and discuss future applications such as studying the timing of attentional modulation in individual visual areas.

Illusory position shift induced by cyclopean motion

The position of a visual pattern moving within a static aperture appears to be displaced in the direction of motion. This illusory position shift can be induced by luminance-defined as well as contrast-defined motion. The present study used a random-dot binocular correlogram in which a moving square-wave grating was solely defined by binocular correlations. This cyclopean motion was found to induce illusory position shift. Consistent with previous reports on position shift induced by second-order motion, the illusion was smaller than that found in the case of the first-order motion. This pattern of results unequivocally demonstrates the existence of a binocular mechanism mediating this illusion.

Maximal motion aftereffects in spite of diverted awareness

This study attempts to isolate the underlying processing resources of visual attention from the 'cognitive supervision'-working memory, decision processes, but especially awareness-that typically accompanies their allocation. To decouple them, we used the motion aftereffect (MAE) as a passive assay of resource allocation. In our main condition, observers were presented with an adapting field, but did not attend to it. Instead their effort was directed to an engrossing auditory two-back memory task. Consequently, observers had no consistent awareness of the adaptor, nor were able to make accurate judgements about its luminance, but nonetheless had MAE's no smaller than those induced when the adaptor was 'fully attended'. Similarly to when object- or feature-based attention spreads unwittingly, attention was allocated automatically to the adaptor, without requiring nor engaging executive control or awareness.

The motion aftereffect reloaded

The motion aftereffect is a robust illusion of visual motion resulting from exposure to a moving pattern. There is a widely accepted explanation of it in terms of changes in the response of cortical direction-selective neurons. Research has distinguished several variants of the effect. Converging recent evidence from different experimental techniques (psychophysics, single-unit recording, brain imaging, transcranial magnetic stimulation, visual evoked potentials and magnetoencephalography) reveals that adaptation is not confined to one or even two cortical areas, but occurs at multiple levels of processing involved in visual motion analysis. A tentative motion-processing framework is described, based on motion aftereffect research. Recent ideas on the function of adaptation see it as a form of gain control that maximises the efficiency of information transmission at multiple levels of the visual pathway.

Induced deficits in speed perception by transcranial magnetic stimulation of human cortical areas V5/MT+ and V3A

In this report, we evaluate the role of visual areas responsive to motion in the human brain in the perception of stimulus speed. We first identified and localized V1, V3A, and V5/MT+ in individual participants on the basis of blood oxygenation level-dependent responses obtained in retinotopic mapping experiments and responses to moving gratings. Repetitive transcranial magnetic stimulation (rTMS) was then used to disrupt the normal functioning of the previously localized visual areas in each participant. During the rTMS application, participants were required to perform delayed discrimination of the speed of drifting or spatial frequency of static gratings. The application of rTMS to areas V5/MT and V3A induced a subjective slowing of visual stimuli and (often) caused increases in speed discrimination thresholds. Deficits in spatial frequency discrimination were not observed for applications of rTMS to V3A or V5/MT+. The induced deficits in speed perception were also specific to the cortical site of TMS delivery. The application of TMS to regions of the cortex adjacent to V5/MT and V3A, as well as to area V1, produced no deficits in speed perception. These results suggest that, in addition to area V5/MT+, V3A plays an important role in a cortical network that underpins the perception of stimulus speed in the human brain.

Contrast detection in infants with fragile X syndrome

Studies have reported that a selective deficit in visual motion processing is present in certain developmental disorders, including Williams syndrome and autism. More recent evidence suggests a visual motion impairment is also present in adults with fragile X syndrome (FXS), the most common form of inherited mental retardation. The goal of the current study was to examine low-level cortical visual processing in infants diagnosed with FXS in order to explore the developmental origin of this putative deficit. We measured contrast detection of first-order (luminance-defined) and second-order (contrast-defined) gratings at two levels of temporal frequency, 0 Hz (static) and 4 Hz (moving). Results indicate that infants with FXS display significantly higher detection thresholds only for the second-order, moving stimuli compared to mental age-matched typically developing controls.

Development of cortical responses to optic flow

Humans discriminate approaching objects from receding ones shortly after birth, and optic flow associated with self-motion may activate distinctive brain networks, including the human MT+ complex. We sought evidence for evoked brain activity that distinguished radial motion from other optic flow patterns, such as translation or rotation by recording steady-state visual evoked potentials (ssVEPs), in both adults and 4–6 month-old infants to direction-reversing optic flow patterns. In adults, radial flow evoked distinctive brain responses in both the time and frequency domains. Differences between expansion/contraction and both translation and rotation were especially strong in lateral channels (PO7 and PO8), and there was an asymmetry between responses to expansion and contraction. In contrast, infants' evoked response waveforms to all flow types were equivalent, and showed no evidence of the expansion/contraction asymmetry. Infants' responses were largest and most reliable for the translation patterns in which all dots moved in the same direction. This pattern of response is consistent with an account in which motion processing systems detecting locally uniform motion develop earlier than do systems specializing in complex, globally non-uniform patterns of motion, and with evidence suggesting that motion processing undergoes prolonged postnatal development.