The combination of motion signals over time

Investigating the Interaction Between Form and Motion Processing: A Review of Basic Research and Clinical Evidence

A widely held view of the visual system supported the perspective that the primate brain is organized in two main specialized streams, called the ventral and dorsal streams. The ventral stream is known to be involved in object recognition (e.g., form and orientation). In contrast, the dorsal stream is thought to be more involved in spatial recognition (e.g., the spatial relationship between objects and motion direction). Recent evidence suggests that these two streams are not segregated but interact with each other. A class of visual stimuli known as Glass patterns has been developed to shed light on this process. Glass patterns are visual stimuli made of pairs of dots, called dipoles, that give the percept of a specific form or apparent motion, depending on the spatial and temporal arrangement of the dipoles. In this review, we show an update of the neurophysiological, brain imaging, psychophysical, clinical, and brain stimulation studies which have assessed form and motion integration mechanisms, and the level at which this occurs in the human and non-human primate brain. We also discuss several studies based on non-invasive brain stimulation techniques that used different types of visual stimuli to assess the cortico-cortical interactions in the visual cortex for the processing of form and motion information. Additionally, we discuss the timing of specific visual processing in the ventral and dorsal streams. Finally, we report some parallels between healthy participants and neurologically impaired patients in the conscious processing of form and motion.

Temporal modulation improves dynamic peripheral acuity

Macular degeneration and related visual disorders greatly limit foveal function, resulting in reliance on the peripheral retina for tasks requiring fine spatial vision. Here we investigate stimulus manipulations intended to maximize peripheral acuity for dynamic targets. Acuity was measured using a single interval orientation discrimination task at 10° eccentricity. Two types of image motion were investigated along with two different forms of temporal manipulation. Smooth object motion was generated by translating targets along an isoeccentric path at a constant speed (0-20°/s). Ocular motion was simulated by jittering target location using previously recorded fixational eye movement data, amplified by a variable gain factor (0-8). In one stimulus manipulation, the sequence was temporally subsampled by displaying the target on an evenly spaced subset of video frames. In the other, the contrast polarity of the stimulus was reversed at a variable rate. We found that threshold under object motion was improved at all speeds by reversing contrast polarity, while temporal subsampling improved resolution at high speeds but impaired performance at low speeds. With simulated ocular motion, thresholds were consistently improved by contrast polarity reversal, but impaired by temporal subsampling. We find that contrast polarity reversal and temporal subsampling produce differential effects on peripheral acuity. Applying contrast polarity reversal may offer a relatively simple image manipulation that could enhance visual performance in individuals with central vision loss.

Apparent Motion Perception in the Praying Mantis: Psychophysics and Modelling

Simple Summary

Computer monitors, smart phone screens, and other forms of digital displays present a series of still images (frames) in which objects are displaced in small steps, tricking us into perceiving smooth motion. This illusion is referred to as “apparent motion”. For motion to be perceived, the magnitude of each displacement step must be smaller than a certain limit, referred to as Dmax. Previous studies have investigated the relationship between this limit and object size in humans and found that the maximum displacement is larger for larger objects than for smaller ones. In this work, we investigated the same relationship in the praying mantis Sphodromantis lineola by presenting them with moving random chequerboard patterns on a computer monitor. Even though motion perception in humans and insects are believed to be explained equally well by the same underlying model, we found that Dmax scales differently with object size in mantids. These results suggest that there may be qualitative differences in how mantids perceive apparent motion compared to humans.

Abstract

Apparent motion is the perception of motion created by rapidly presenting still frames in which objects are displaced in space. Observers can reliably discriminate the direction of apparent motion when inter-frame object displacement is below a certain limit, Dmax. Earlier studies of motion perception in humans found that Dmax is lower-bounded at around 15 arcmin, and thereafter scales with the size of the spatial elements in the images. Here, we run corresponding experiments in the praying mantis Sphodromantis lineola to investigate how Dmax scales with the element size. We use random moving chequerboard patterns of varying element and displacement step sizes to elicit the optomotor response, a postural stabilization mechanism that causes mantids to lean in the direction of large-field motion. Subsequently, we calculate Dmax as the displacement step size corresponding to a 50% probability of detecting an optomotor response in the same direction as the stimulus. Our main findings are that the mantis Dmax scales roughly as a square-root of element size and that, in contrast to humans, it is not lower-bounded. We present two models to explain these observations: a simple high-level model based on motion energy in the Fourier domain and a more-detailed one based on the Reichardt Detector. The models present complementary intuitive and physiologically-realistic accounts of how Dmax scales with the element size in insects. We conclude that insect motion perception is limited by only a single stage of spatial filtering, reflecting the optics of the compound eye. In contrast, human motion perception reflects a second stage of spatial filtering, at coarser scales than imposed by human optics, likely corresponding to the magnocellular pathway. After this spatial filtering, mantis and human motion perception and Dmax are qualitatively very similar.

Directional Bias for Vertical Integration of Motion Trajectories

Abstract. Here we report a new ambiguous continuous motion display, in which two objects appear at the diagonally opposite corners of an imaginary square, move along the diagonal axis toward each other, and after meeting in the center, shift their trajectories to the other two diagonal corners. This display can be seen as two objects’ colliding and bouncing off each other, with two competing interpretations of trajectory configuration requiring either vertical or horizontal integration of trajectory segments. Despite the fact that both percepts are equally plausible, the current study revealed a perceptual preference toward a vertical integration interpretation. We compared this bias with the similar vertical bias in a bistable apparent motion quartet, which suggests that the directional anisotropy found here is quite a new, and distinct phenomenon in both its perceptual characteristics and underlying mechanism.

The development of perceptual averaging: learning what to do, not just how to do it

The mature visual system condenses complex scenes into simple summary statistics (e.g., average size, location, orientation, etc.). However, children, often perform poorly on perceptual averaging tasks. Children's difficulties are typically thought to represent the suboptimal implementation of an adult-like strategy. This paper examines another possibility: that children actually make decisions in a qualitatively different way to adults (optimal implementation of a non-ideal strategy). Ninety children (6-7, 8-9, 10-11 years) and 30 adults were asked to locate the middle of randomly generated dot-clouds. Nine plausible decision strategies were formulated, and each was fitted to observers' trial-by-trial response data (Reverse Correlation). When the number of visual elements was low (N < 6), children used a qualitatively different decision strategy from adults: appearing to "join up the dots" and locate the gravitational center of the enclosing shape. Given denser displays, both children and adults used an ideal strategy of arithmetically averaging individual points. Accounting for this difference in decision strategy explained 29% of children's lower precision. These findings suggest that children are not simply suboptimal at performing adult-like computations, but may at times use sensible, but qualitatively different strategies to make perceptual judgments. Learning which strategy is best in which circumstance might be an important driving factor of perceptual development.

Spatial proximity modulates the strength of motion opponent suppression elicited by locally paired dot displays

Locally paired dot stimuli that contain opposing motion signals at roughly the same spatial locations (counter-phase stimuli) have been reported to produce percepts devoid of global motion. Counter-phase stimuli are also thought to elicit a reduced neural response at motion processing brain area MT/V5, an effect known as motion opponency. The current study examines the effect of vertical counter-phase background motion on behavioral discrimination of horizontal target motion. We found that counter-phase backgrounds generally produced lower behavioral thresholds than locally unbalanced backgrounds, an effect consistent with the idea that counter-phase motion elicits opponency. However, this effect was apparent only if the paired dots were close enough in proximity that they crossed one another during their movement. Furthermore, we found that counter-phase stimuli containing within-pair dot crossing elicits similar behavioral thresholds to non-motion flicker stimuli. These results provide insight into the requirements for activating opponency in the brain and suggest that the brain processes counter-phase and flicker stimuli similarly due to opponency.

Low-Level Motion Characteristics Do Not Account for Perceptions of Stream-Bounce Stimuli

The stream-bounce effect refers to a bistable motion stimulus that is interpreted as two targets either “streaming” past or “bouncing” off one another, and the manipulations that bias responses. Directional bias, according to Bertenthal et al., is an account of the effect proposing that low-level motion integration promotes streaming, and its disruption leads to bouncing, and it is sometimes cited either directly in a bottom-up fashion or indirectly under top-down control despite Sekuler and Sekuler finding evidence inconsistent with it. We tested two key aspects of the hypothesis: (a) comparable changes in speed should produce comparable disruptions and lead to similar effects; and (b) speed changes alone should disrupt integration without the need for additional more complex changes of motion. We found that target motion influences stream-bounce perception, but not as directional bias predicts. Our results support Sekuler and Sekuler and argue against the low-level motion signals driving perceptual outcomes in stream-bounce displays (directly or indirectly) and point to higher level inferential processes involving perceptual history and expectation. Directional bias as a mechanism should be abandoned and either another specific bottom-up process must be proposed and tested or consideration should be given to top-down factors alone driving the effect.

The effects of aging on the perception of depth from motion parallax

Successful navigation in the world requires effective visuospatial processing. Unfortunately, older adults have many visuospatial deficits, which can have severe real-world consequences. Although some of these age effects are well documented, some others, such as the perception of depth from motion parallax, are poorly understood. Depth perception from motion parallax requires intact retinal image motion and pursuit eye movement processing. Decades of research have shown that both motion processing and pursuit eye movements are affected by age; it follows that older adults may also be less sensitive to depth from motion parallax. The goals of the present study were to characterize motion parallax depth thresholds in older adults, and to explain older adults' sensitivity to depth from motion parallax in terms of motion and pursuit deficits. Younger and older adults' motion thresholds and pursuit accuracy were measured. Observers' depth thresholds across several different stimulus conditions were measured, as well. Older adults had higher motion thresholds and less accurate pursuit than younger adults. They were also less sensitive to depth from motion parallax at slow and moderate pursuit speeds. Although older adults had higher motion thresholds than younger adults, they used the available motion signals optimally, and age differences in motion processing could not account for the older adults' increased depth thresholds. Rather, these age effects can be explained by changes in older adults' pursuit signals.

Information extraction during simultaneous motion processing

When confronted with multiple moving objects the visual system can process them in two stages: an initial stage in which a limited number of signals are processed in parallel (i.e. simultaneously) followed by a sequential stage. We previously demonstrated that during the simultaneous stage, observers could discriminate between presentations containing up to 5 vs. 6 spatially localized motion signals (Edwards & Rideaux, 2013). Here we investigate what information is actually extracted during the simultaneous stage and whether the simultaneous limit varies with the detail of information extracted. This was achieved by measuring the ability of observers to extract varied information from low detail, i.e. the number of signals presented, to high detail, i.e. the actual directions present and the direction of a specific element, during the simultaneous stage. The results indicate that the resolution of simultaneous processing varies as a function of the information which is extracted, i.e. as the information extraction becomes more detailed, from the number of moving elements to the direction of a specific element, the capacity to process multiple signals is reduced. Thus, when assigning a capacity to simultaneous motion processing, this must be qualified by designating the degree of information extraction.

Why do adults with dyslexia have poor global motion sensitivity?

Two experiments aimed to determine why adults with dyslexia have higher global motion thresholds than typically reading controls. In Experiment 1, the dot density and number of animation frames presented in the dot stimulus were manipulated because of findings that use of a high dot density can normalize coherence thresholds in individuals with dyslexia. Dot densities were 14.15 and 3.54 dots/deg². These were presented for five (84 ms) or eight (134 ms) frames. The dyslexia group had higher coherence thresholds in all conditions than controls. However, in the high dot density, long duration condition, both reader groups had the lowest thresholds indicating normal temporal recruitment. These results indicated that the dyslexia group could sample the additional signals dots over space and then integrate these with the same efficiency as controls. In Experiment 2, we determined whether briefly presenting a fully coherent prime moving in either the same or opposite direction of motion to a partially coherent test stimulus would systematically increase and decrease global motion thresholds in the reader groups. When the direction of motion in the prime and test was the same, global motion thresholds increased for both reader groups. The increase in coherence thresholds was significantly greater for the dyslexia group. When the motion of the prime and test were presented in opposite directions, coherence thresholds were reduced in both groups. No group threshold differences were found. We concluded that the global motion processing deficit found in adults with dyslexia can be explained by undersampling of the target motion signals. This might occur because of difficulties directing attention to the relevant motion signals in the random dot pattern, and not a specific difficulty integrating global motion signals. These effects are most likely to occur in the group with dyslexia when more complex computational processes are required to process global motion.

Integration of motion responses underlying directional motion anisotropy in human early visual cortical areas

Recent imaging studies have reported directional motion biases in human visual cortex when perceiving moving random dot patterns. It has been hypothesized that these biases occur as a result of the integration of motion detector activation along the path of motion in visual cortex. In this study we investigate the nature of such motion integration with functional MRI (fMRI) using different motion stimuli. Three types of moving random dot stimuli were presented, showing either coherent motion, motion with spatial decorrelations or motion with temporal decorrelations. The results from the coherent motion stimulus reproduced the centripetal and centrifugal directional motion biases in V1, V2 and V3 as previously reported. The temporally decorrelated motion stimulus resulted in both centripetal and centrifugal biases similar to coherent motion. In contrast, the spatially decorrelated motion stimulus resulted in small directional motion biases that were only present in parts of visual cortex coding for higher eccentricities of the visual field. In combination with previous results, these findings indicate that biased motion responses in early visual cortical areas most likely depend on the spatial integration of a simultaneously activated motion detector chain.

Keep your eyes on development: the behavioral and neurophysiological development of visual mechanisms underlying form processing

Visual form perception is essential for correct interpretation of, and interaction with, our environment. Form perception depends on visual acuity and processing of specific form characteristics, such as luminance contrast, spatial frequency, color, orientation, depth, and even motion information. As other cognitive processes, form perception matures with age. This paper aims at providing a concise overview of our current understanding of the typical development, from birth to adulthood, of form-characteristic processing, as measured both behaviorally and neurophysiologically. Two main conclusions can be drawn. First, the current literature conveys that for most reviewed characteristics a developmental pattern is apparent. These trajectories are discussed in relation to the organization of the visual system. The second conclusion is that significant gaps in the literature exist for several age-ranges. To complete our understanding of the typical and, by consequence, atypical development of visual mechanisms underlying form processing, future research should uncover these missing segments.

The effect of spatial orientation on detecting motion trajectories in noise

A series of experiments investigated the extent to which the spatial orientation of a signal line affects discrimination of its trajectory from the random trajectories of background noise lines. The orientation of the signal line was either parallel (iso-) or orthogonal (ortho-) to its motion direction and it was identical in all respects to the noise (orientation, length and speed) except for its motion direction, rendering the signal line indistinguishable from the noise on a frame-to-frame basis. We found that discrimination of ortho-trajectories was generally better than iso-trajectories. Discrimination of ortho-trajectories was largely immune to the effects of spatial jitter in the trajectory, and to variations in step size and line-length. Discrimination of iso-trajectories was reliable provided that step-size was not too short and did not exceed line length, and that the trajectory was straight. The new result that trajectory discrimination in moving line elements is modulated by line orientation suggests that ortho- and iso-trajectory discrimination rely upon two distinct mechanisms: iso-motion discrimination involves a 'motion-streak' process that combines motion information with information about orientation parallel to the motion trajectory, while ortho-motion discrimination involves extended trajectory facilitation in a network of receptive fields with orthogonal orientation tuning.

Vision in developmental disorders: is there a dorsal stream deficit?

The main aim of this review is to evaluate the proposal that several developmental disorders affecting vision share an impairment of the dorsal visual stream. First, the current definitions and common measurement approaches used to assess differences in both local and global functioning within the visual system are considered. Next, studies assessing local and global processing in the dorsal and ventral visual pathways are reviewed for five developmental conditions for which early to mid level visual abilities have been assessed: developmental dyslexia, autism spectrum disorders, developmental dyspraxia, Williams syndrome and Fragile X syndrome. The reviewed evidence is broadly consistent with the idea that the dorsal visual stream is affected in developmental disorders. However, the potential for a unique profile of visual abilities that distinguish some of the conditions is posited, given that for some of these disorders ventral stream deficits have also been found. We conclude with ideas regarding future directions for the study of visual perception in children with developmental disorders using psychophysical measures.

Averaging facial expression over time

The visual system groups similar features, objects, and motion (e.g., Gestalt grouping). Recent work suggests that the computation underlying perceptual grouping may be one of summary statistical representation. Summary representation occurs for low-level features, such as size, motion, and position, and even for high level stimuli, including faces; for example, observers accurately perceive the average expression in a group of faces (J. Haberman & D. Whitney, 2007, 2009). The purpose of the present experiments was to characterize the time-course of this facial integration mechanism. In a series of three experiments, we measured observers' abilities to recognize the average expression of a temporal sequence of distinct faces. Faces were presented in sets of 4, 12, or 20, at temporal frequencies ranging from 1.6 to 21.3 Hz. The results revealed that observers perceived the average expression in a temporal sequence of different faces as precisely as they perceived a single face presented repeatedly. The facial averaging was independent of temporal frequency or set size, but depended on the total duration of exposed faces, with a time constant of approximately 800 ms. These experiments provide evidence that the visual system is sensitive to the ensemble characteristics of complex objects presented over time.

Low- and high-level first-order random-dot kinematograms: evidence from fMRI

Maximum motion displacement (Dmax) represents the largest dot displacement in a random-dot kinematogram (RDK) at which direction of motion can be discriminated. Direction discrimination thresholds for maximum motion displacement (Dmax) are not fixed but are stimulus dependent. For first-order RDKs, Dmax is larger as dot size increases and/or dot density decreases. Dmax may be limited by the receptive field size of low-level motion detectors when the dots comprising the RDK are small and densely spaced. With RDKs of increased dot size/decreased dot density, however, Dmax exceeds the spatial limits of these detectors and is likely determined by high-level feature-matching mechanisms. Using functional MRI, we obtained greater activation in posterior occipital areas for low-level RDKs and greater activation in extra-striate occipital and parietal areas for high-level RDKs. This is the first reported neuroimaging evidence supporting proposed low-level and high-level models of motion processing for first-order random-dot stimuli.

Eye movement and visual motion perception in schizophrenia II: Global coherent motion as a function of target velocity and stimulus density

Coherent global motion is a compelling illusion of visual motion that is seen as the result of spatially and successively presented stimuli that are, in fact, stationary. In the present study the threshold perception of global coherent motion was measured using random-dot kinematograms in a group of normal observers and a group with mixed symptoms in schizophrenia who also participated in a companion study on smooth pursuit eye movement (Slaghuis et al. in Exp Brain Res, 2007). The velocity of coherent motion target stimuli was produced by varying the spatial step-size (Deltas) between dots to create three target velocities (6.0, 12.0 and 24.0 deg/s) which were measured at three target stimulus densities (100, 200, and 400 dots/deg(2)). A staircase procedure was used to determine the threshold for the number of target dots that was needed to move in the same direction to detect the direction of motion and which were plotted amongst a field of randomly moving visual noise dots. The findings demonstrate that in comparison with normal observers, the threshold for the perception of coherent motion in the group with schizophrenia was significantly higher at the lowest target velocity of 6.0 deg/s but not at target velocities of 12.0 and 24.0 deg/s. Stimulus density was found to have a significant effect on the perception of coherent motion, but it had no differential effect on performance in the groups. An examination of relationships between coherent motion and smooth pursuit eye movement in the companion study (Slaghuis et al. in Exp Brain Res, 2007) revealed significant, negative, correlations between coherent motion and apparent motion smooth pursuit eye velocity at target velocities of 6.0, 12.0 and 24.0 deg/s in the group with schizophrenia, but no such relationship was found in normal observers. It was concluded that the significant reduction in sensitivity for the perception of coherent motion at the lowest target velocity of 6.0 deg/s in the group with schizophrenia is consistent with an impairment in the detection of visual motion at a local level and in parallel for all parts of the image at striate and extrastiate levels of visual processing.

Motion streaks improve motion detection

A number of studies were conducted to determine whether motion-streaks assist motion extraction, and whether a purely motion-based model could account for any observed facilitation. A 3-frame global-motion stimulus was used. Signal dots were manipulated in order to control the strength of the motion-streak. In the long-streak condition, the same dots carried the global-motion signal over successive motion frames, while in the short-streak condition, different dots carried the signal over successive frames. Noise dots always moved in different directions over successive frames. While lower thresholds in the long-streak condition could be explain by motion-streak facilitation, it could also be explained in terms of interactions purely within the motion system. Specifically, by excitatory feed-forward connections between neighbouring local-motion units tuned to the same or similar directions of motion. In order to test these two models, speed and contrast were varied. If lower thresholds are due to motion streaks (form input to motion) then maximum facilitation should occur at high speeds (no streak at low speeds) and high contrast (due to reduced streak magnitude and the low contrast sensitivity of the form cells that extract the motion-streak). Lower thresholds were obtained for the long-streak condition but only at high speeds and this facilitation was lost, or at least greatly reduced, at low (5%) contrast. These results support the notion that detection thresholds were facilitated by a motion-streak system.

Deficient maximum motion displacement in amblyopia

Direction discrimination thresholds for maximum motion displacement (Dmax) are not fixed, but are stimulus dependent. Dmax increases with reduced dot probability or increased dot size. We previously reported abnormal Dmax in the fellow eyes of amblyopic children for dense patterns of small dots. To determine how deficits of Dmax in amblyopic eyes compare to those in fellow eyes, thresholds were obtained in both eyes of 9 children with unilateral amblyopia and 9 control children. The expected increase in Dmax was observed for reduced dot probability and increased dot size conditions relative to baseline in both control and amblyopic groups. Both eyes of the amblyopic group demonstrated significant deficits. Our findings implicate abnormal binocular motion processing, which may involve both low-level and high-level motion mechanisms, in the neural deficit underlying amblyopia.

The psychophysical law of speed estimation in Michotte’s causal events

Observers saw an event in which a computer-animated square moved up to and made contact with another, which after a short delay moved off, its motion appearing to be caused by launch by the first square. Observers chose whether the second (launched) square was faster in this causal event than when presented following a long delay (non-causal event). The speed of the second object in causal events was overestimated for a wide range of speeds of the first object (launcher), but accurately assessed in non-causal events. Experiments 2 and 3 showed that overestimation occurred also in other causal displays in which the trajectories were overlapping, successive, spatially separated or inverted but did not occurred with consecutive speeds that did not produce causal percepts. We also found that if the first object in a causal event was faster, then Weber's law holds and overestimation of the launched object speed was proportional to the speed of the launcher. In contrast, if the second object was faster, overestimation was constant, i.e. independent of the launcher. We propose that the particular speed integration of causal display results in overestimation and that the way overestimation depends on V1 phenomenally affects the attribution of the source of V2 motion: either in V1 (in launching) or in V2 (in triggering).

Deficits of motion integration and segregation in patients with unilateral extrastriate lesions

Functional neuroimaging in human subjects and single cell recordings in monkeys show that several extra-striate visual areas are activated by visual motion. However, the extent to which different types of motion are processed in different regions remains unclear, although neuropsychological studies of patients with circumscribed lesions hint at regional specialization. We, therefore, studied four patients with unilateral damage to different regions of extrastriate visual cortex on a series of visual discrimination tasks that required them, to a different extent, to integrate local motion signals in order to correctly perceive the direction of global motion. Performance was assessed psychophysically and compared with that of control subjects and with the patients' performance with stimuli presented in the visual field ipsilateral to the lesion. The results indicate considerable regional specialization in extra-striate regions for different aspects of motion processing, namely the largest displacement from frame to frame (D-max) that can sustain perception of coherent motion; perception of relative speed; the amount of coherent motion needed to sustain a percept of global motion in a particular direction; the detection of discontinuities within a moving display; the extraction of form from motion. It was also clear that a defect in local motion, i.e. D-max, can be overcome by integrating local motion signals over a longer period of time. Although no patient suffered from only one defect, the overall pattern of results strongly supports the notion of regional specialization for different aspects of motion processing.

The integration of auditory and visual motion signals at threshold

To interpret our environment, we integrate information from all our senses. For moving objects, auditory and visual motion signals are correlated and provide information about the speed and the direction of the moving object. We investigated at what level the auditory and the visual modalities interact and whether the human brain integrates only motion signals that are ecologically valid. We found that the sensitivity for identifying motion was improved when motion signals were provided in both modalities. This improvement in sensitivity can be explained by probability summation. That is, auditory and visual stimuli are combined at a decision level, after the stimuli have been processed independently in the auditory and the visual pathways. Furthermore, this integration is direction blind and is not restricted to ecologically valid motion signals.

Can spatial and temporal motion integration compensate for deficits in local motion mechanisms?

We studied the motion perception of a patient, AMG, who had a lesion in the left occipital lobe centered on visual areas V3 and V3A, with involvement of underlying white matter. As shown by a variety of psychophysical tests involving her perception of motion, the patient was impaired at motion discriminations that involved the detection of small displacements of random-dot displays, including local speed discrimination. However, she was unimpaired on tests that required spatial and temporal integration of moving displays, such as motion coherence. The results indicate that she had a specific impairment of the computation of local but not global motion and that she could not integrate motion information across different spatial scales. Such a specific impairment has not been reported before.

Do 'clumsy' children have visual deficits

Visual processing by 10-year-old children diagnosed on the basis of standardised tests as having developmental 'clumsiness' syndrome, and by a control group of children without motor difficulties, was tested using three different psychophysical tasks. The tasks comprised a measure of global motion processing using a dynamic random dot kinematogram, a measure of static global pattern processing where the position of the target was randomised, and a measure of static global pattern processing in which the target position was fixed. The most striking finding was that the group of clumsy children, who were diagnosed solely on the basis of their motor difficulties, were significantly less sensitive than the control group on all three tasks of visual sensitivity. Clumsy children may have impaired visual sensitivity in both the dorsal and ventral streams in addition to their obvious problems with motor control. These results support the existence of generalised visual anomalies associated with impairments of cerebellar function.

Integration of speed signals in the direction of motion

Speed discrimination tasks were used to examine the spatial and temporal characteristics of the integration mechanism involved when signals are extended in the direction of motion. We varied the aspect ratio of a signal patch whose speed differed from the background, while holding the area of the signal patch constant, so that the signal patch could be either extended in the direction of motion or extended orthogonal to the direction of motion. Speed discrimination thresholds decreased dramatically as the signal patch was extended in the direction of motion. The spatial and temporal integration regions were larger than would be expected if the integration mechanism were a low-level motion detector. The mechanism was tuned for direction of motion. The data are discussed with reference to two alternative integration mechanisms: a low-level detector that is elongated in the direction of motion and a higher level integration mechanism characterized by cooperative or facilitatory interactions between low-level detectors tuned to the same direction of motion. Our data are consistent with a second-level, direction-specific process that integrates the responses of low-level motion detectors.

Independent detectors for expansion and rotation, and for orthogonal components of deformation

It is well known that optic flow--the smooth transformation of the retinal image experienced by a moving observer--contains valuable information about the three-dimensional layout of the environment. From psychophysical and neurophysiological experiments, specialised mechanisms responsive to components of optic flow (sometimes called complex motion) such as expansion and rotation have been inferred. However, it remains unclear (a) whether the visual system has mechanisms for processing the component of deformation and (b) whether there are multiple mechanisms that function independently from each other. Here, we investigate these issues using random-dot patterns and a forced-choice subthreshold summation technique. In experiment 1, we manipulated the size of a test region that was permitted to contain signal and found substantial spatial summation for signal components of translation, expansion, rotation, and deformation embedded in noise. In experiment 2, little or no summation was found for the superposition of orthogonal pairs of complex motion patterns (eg expansion and rotation), consistent with probability summation between pairs of independent detectors. Our results suggest that optic-flow components are detected by mechanisms that are specialised for particular patterns of complex motion.

Spatio-temporal tuning of motion coherence detection at different luminance levels

We studied effects of dark adaptation on spatial and temporal tuning for motion coherence detection. We compared tuning for step size and delay for moving random pixel arrays (RPAs) at two adaptation levels, one light adapted (50 cd/m(2)) and the other relatively dark adapted (0.05 cd/m(2)). To study coherence detection rather than contrast detection, RPAs were scaled for equal contrast detection at each luminance level, and a signal-to-noise ratio paradigm was used in which the RPA is always at a fixed, supra-threshold contrast level. The noise consists of a spatio-temporally incoherent RPA added to the moving RPA on a pixel-by-pixel basis. Spatial and temporal limits for coherence detection were measured using a single step pattern lifetime stimulus, in which patterns on alternate frames make a coherent step and are being refreshed. Therefore, the stimulus contains coherent motion at a single combination of step size and delay only. The main effect of dark adaptation is a large shift in step size, slightly less than the adjustment of spatial scale required for maintaining equal contrast sensitivity. A similar change of preferred step size occurs also for scaled stimuli at a light-adapted level, indicating that the spatial effect is not directly linked to dark adaptation, but more generally related to changes in the available low-level spatial information. Dark-adaptation shifts temporal tuning by about a factor of 2. Long delays are more effective at low luminance levels, whereas short delays no longer support motion coherence detection. Luminance-invariant velocity tuning curves, as reported previously [Lankheet, M.J.M., van Doorn, A.J., Bouman, M.A., & van de Grind, W.A. (2000) Motion coherence detection as a function of luminance in human central vision. Vision Research, 40, 3599-3611], result from recruitment of different sets of motion detectors, and an adjustment of their temporal properties.

Time course of amodal completion revealed by a shape discrimination task

We measured the extent of amodal completion as a function of stimulus duration over the range of 15-210 msec, for both moving and stationary stimuli. Completion was assessed using a performance-based measure; a shape discrimination task that is easy if the stimulus is amodally completed and difficult if it is not. Specifically, participants judged whether an upright rectangle was longer horizontally or vertically, when the rectangle was unoccluded, occluded at its corners by four negative-contrast squares, or occluded at its corners by four zero-contrast squares. In the zero-contrast condition, amodal completion did not occur because there were no occlusion cues; in the unoccluded condition, the entire figure was present. Thus, comparing performance in the negative-contrast condition to these two extremes provided a quantitative measure of amodal completion. This measure revealed a rapid but measurable time course for amodal completion. Moving and stationary stimuli took the same amount of time to be completed (approximately 75 msec), but moving stimuli had slightly stronger completion at long durations.

Cross-modal integration of auditory and visual motion signals

Real-world moving objects are usually defined by correlated information in multiple sensory modalities such as vision and hearing. The aim of our study was to assess whether simultaneous auditory supra-threshold motion introduces a bias or affects the sensitivity in a visual motion detection task. We demonstrate a bias in the perceived direction of visual motion that is consistent with the direction of the auditory motion (audio-visual motion capture). This bias effect is robust and occurs even if the auditory and visual motion signals come from different locations or move at different speeds. We also show that visual motion detection thresholds are higher for consistent auditory motion than for inconsistent motion, provided the stimuli move at the same speed and are co-localised.

Direction-specific changes of sensitivity after brief apparent motion stimuli

Direction-specific losses in sensitivity were found for a test grating which was superimposed on a stationary contrast pedestal and which moved either in the same or opposite direction as a prior biasing stimulus. Three types of biasing stimuli were employed: a grating swept through 270 degrees in 45 degrees steps, a single 90 degrees step of a grating, and a single 90 degrees step of a grating which contained a blank IFI and whose perceived direction was reversed. For the biasing sweep and the single 90 degrees step, the response of directionally selective mechanisms (directional motion energy) is greatest for the direction which corresponds to the actual physical displacement of the stimulus. For the biasing step with an IFI, the response is maximum for the opposite direction. For all three types of biasing stimuli, directional sensitivity for a test stimulus was reduced most when it moved in the biasing direction, i.e. the direction which produced the strongest signal in directionally selective mechanisms. Unlike the effects of the same types of biasing stimuli on the perceived direction of a suprathreshold 180 degrees step of a grating [Pinkus, A., & Pantle, A. (1997). Probing motion signals with a priming paradigm. Vision Research, 37, 541-52; Pantle, A., Gallogly, D.P., & Piehler, O.C. (2000). Direction biasing by brief apparent motion stimuli. Vision Research, 40, 1979-91], all the direction-specific losses of sensitivity can be explained by changes in the response characteristics of directionally selective mechanisms.

Motion capture depends on signal strength

When flickering dots are superimposed onto a drifting grating, the dots appear to move coherently with the grating. In this study we examine: (i) how the perceived direction of a compound stimulus composed of superimposed grating and dots, moving in opposite directions with equal speeds, is influenced by the relative strength of the motion signals; (ii) how the perceived speed of a compound stimulus composed of superimposed grating and dots, moving in the same direction but at different speeds, is influenced by the relative strength of the motion signals; and (iii) whether this stimulus is discriminable from its metameric speed match. Dot signal strength was manipulated by using different proportions of signal dots in noise and different dot lifetimes. Both the perceived direction and speed of these compound stimuli depended upon the relative motion-signal strengths of the grating and the dots. Those compound stimuli that appeared coherent were not discriminable from the speed-matched metameric compound stimuli. When the signals were completely integrated into a coherent compound stimulus, the local motion signals were no longer perceptually available, though both contributed to the global percept. These data strongly support a weighted-combination model where the relative weights depend on signal strength, instead of a winner-takes-all model.

Are dyslexics' visual deficits limited to measures of dorsal stream function?

We tested the hypothesis that the differences in performance between developmental dyslexics and controls on visual tasks are specific for the detection of dynamic stimuli. We found that dyslexics were less sensitive than controls to coherent motion in dynamic random dot displays. However, their sensitivity to control measures of static visual form coherence was not significantly different from that of controls. This dissociation of dyslexics' performance on measures that are suggested to tap the sensitivity of different extrastriate visual areas provides evidence for an impairment specific to the detection of dynamic properties of global stimuli, perhaps resulting from selective deficits in dorsal stream functions.

Temporal facilitation for moving stimuli is independent of changes in direction

A flash that is presented aligned with a moving stimulus appears to lag behind the position of the moving stimulus. This flash-lag phenomenon reflects a processing advantage for moving stimuli (Metzger, W. (1932) Psychologische Forschung 16, 176-200; MacKay, D. M. (1958) Nature 181, 507-508; Nijhawan, R. (1994) Nature 370, 256-257; Purushothaman, G., Patel, S.S., Bedell, H.E., & Ogmen, H. (1998) Nature 396, 424; Whitney, D. & Murakami, I. (1998) Nature Neuroscience 1, 656-657). The present study measures the sensitivity of the illusion to unpredictable changes in the direction of motion. A moving stimulus translated upwards and then made a 90 degrees turn leftward or rightward. The flash-lag illusion was measured and it was found that, although the change in direction was unpredictable, the flash was still perceived to lag behind the moving stimulus at all points along the trajectory, a finding that is at odds with the extrapolation hypothesis (Nijhawan, R. (1994) Nature 370, 256-257). The results suggest that there is a shorter latency of the neural response to motion even during unpredictable changes in direction. The latency facilitation therefore appears to be omnidirectional rather than specific to a predictable path of motion (Grzywacz, N. M. & Amthor, F. R. (1993) Journal of Neurophysiology 69, 2188-2199).

Direction biasing by brief apparent motion stimuli

The perceived direction of a motion step (probe stimulus) can be influenced by an earlier motion step or a brief motion sweep containing a series of steps (biasing stimulus). Depending upon experimental conditions, the biasing of the direction of the probe step (a phase shift of 180 degrees +/-Phi) by a biasing stimulus which precedes it by approximately 250 ms can either increase (positive filter biasing) or decrease (negative filter biasing) the tendency to see the probe move in the biasing direction as computed with a motion filter with a biphasic temporal impulse response. In a series of experiments it was found that biasing motions traversing 90 degrees of phase angle in fewer than six steps in less than 100 ms produced positive filter biasing. Also, biasing of the probe direction could be dissociated from the consciously reported direction of the biasing stimulus, and it did not occur when the probe preceded rather than followed the biasing stimulus. A biasing sweep containing more than six steps traversing 90 degrees or a sweep traversing 270 degrees produced negative filter biasing. Perceptual fusion of the steps of the sweep was not a necessary condition for obtaining negative filter biasing. In general, the negative filter biasing effects were found to be the most pervasive for the conditions investigated, and they are suggestive of a direction-specific, adaptation-like (gain-control) process in first-order motion filters. The exception to the negative biasing rule was found only with biasing stimuli which were short in duration or distance spanned.

Stimulus configuration determines the detectability of motion signals in noise

We measured the detectability of moving signal dots in dynamic noise to determine whether local motion signals are preferentially combined along an axis parallel to the direction of motion. Observers were asked to detect a signal composed of three dots moving in a linear trajectory among dynamic noise dots. The signal dots were collinear and equally spaced in a configuration that was either parallel to or perpendicular to their trajectory. The probability of detecting the signal was measured as a function of noise density, over a range of signal dot spacings from 0.5 degrees to 5.0 degrees. At any given noise density, the signal in the parallel configuration was more detectable than that in the perpendicular configuration. Our four observers could tolerate 1.5-2.5 times more noise in the parallel configuration. This improvement is not due merely to temporal summation between consecutive dots in the parallel trajectory. Temporal summation functions measured on our observers indicate that the benefit from spatial coincidence of the dots lasts for no more than 50 ms, whereas the increased detectability of the parallel configuration is observed up to the largest temporal separations tested (210 ms). These results demonstrate that dots arranged parallel to the signal trajectory are more easily detected than those arranged perpendicularly. Moreover, this enhancement points to the existence of visual mechanisms that preferentially organize motion information parallel to the direction of motion.

Illusory spatial offset of a flash relative to a moving stimulus is caused by differential latencies for moving and flashed stimuli

A flash that is presented adjacent to a continuously moving bar is perceived to lag behind the bar. One explanation for this phenomenon is that there is a difference in the persistence of the flash and the bar. Another explanation is that the visual system compensates for the neural delays of processing visual motion information, such as the moving bar, by spatially extrapolating the bar's perceived location forward in space along its expected trajectory. Two experiments demonstrate that neither of these models is tenable. The first experiment masked the flash one video frame after its presentation. The flash was still perceived to lag behind the bar, suggesting that a difference in the persistence of the flash and bar, does not cause the apparent offset. The second experiment employed unpredictable changes in the velocity of the bar including an abrupt reversal, disappearance, acceleration, and deceleration. If the extrapolation model held, the bar would continue to be extrapolated in accordance with its initial velocity until the moment of an abrupt velocity change. The results were inconsistent with this prediction, suggesting that there is little or no spatial compensation for the neural delays of processing moving objects. The results support a new model of temporal facilitation for moving objects whereby the apparent flash lag is due to a latency advantage for moving over flashed stimuli.

Motion integration and postdiction in visual awareness

In the flash-lag illusion, a flash and a moving object in the same location appear to be offset. A series of psychophysical experiments yields data inconsistent with two previously proposed explanations: motion extrapolation (a predictive model) and latency difference (an online model). We propose an alternative in which visual awareness is neither predictive nor online but is postdictive, so that the percept attributed to the time of the flash is a function of events that happen in the approximately 80 milliseconds after the flash. The results here show how interpolation of the past is the only framework of the three models that provides a unified explanation for the flash-lag phenomenon.

Collisions between moving visual targets: what controls alternative ways of seeing an ambiguous display?

When identical visual targets move directly toward and then past one another, they appear either to stream past one another or to bounce off each other. Bertenthal et al (1993 Perception 22 193-207) accounted for the relative strengths of these two percepts by invoking a directional bias, arising from cooperative interactions within a network of motion detectors. We tested this explanation by devising conditions that would enhance or diminish the strength of such a directional bias. In separate experiments we varied (i) the presence or absence of temporal transients (pausing, disappearance, occlusion); (ii) the distances travelled by the targets; and (iii) their acceleration or deceleration before and after collision. The tendency to see the objects stream past one another was not related to the strength of an hypothesized directional bias, suggesting that the perception of this ambiguous motion display was not mediated by directional recruitment. Instead, the results suggest that perceived direction reflects the operation of neural constraints that mirror the constraints operating upon moving objects in the three-dimensional natural world.

Parallel search for conjunctions with stimuli in apparent motion

A series of experiments was conducted to determine whether apparent motion tends to follow the similarity rule (i.e. is attribute-specific) and to investigate the underlying mechanism. Stimulus duration thresholds were measured during a two-alternative forced-choice task in which observers detected either the location or the motion direction of target groups defined by the conjunction of size and orientation. Target element positions were randomly chosen within a nominally defined rectangular subregion of the display (target region). The target region was presented either statically (followed by a 250 ms duration mask) or dynamically, displaced by a small distance (18 min of arc) from frame to frame. In the motion display, the position of both target and background elements was changed randomly from frame to frame within the respective areas to abolish spatial correspondence over time. Stimulus duration thresholds were lower in the motion than in the static task, indicating that target detection in the dynamic condition does not rely on the explicit identification of target elements in each static frame. Increasing the distractor-to-target ratio was found to reduce detectability in the static, but not in the motion task. This indicates that the perceptual segregation of the target is effortless and parallel with motion but not with static displays. The pattern of results holds regardless of the task or search paradigm employed. The detectability in the motion condition can be improved by increasing the number of frames and/or by reducing the width of the target area. Furthermore, parallel search in the dynamic condition can be conducted with both short-range and long-range motion stimuli. Finally, apparent motion of conjunctions is insufficient on its own to support location decision and is disrupted by random visual noise. Overall, these findings show that (i) the mechanism underlying apparent motion is attribute-specific; (ii) the motion system mediates temporal integration of feature conjunctions before they are identified by the static system; and (iii) target detectability in these stimuli relies upon a nonattentive, cooperative, directionally selective motion mechanism that responds to high-level attributes (conjunction of size and orientation).

Stereoscopic depth cues can segment motion information

Can the motion system selectively process elements at a particular depth? We attempted to answer this question using global coherence tasks in which signal and noise elements could be given different disparities. In experiment 1 we found that, if all the signal elements had a disparity different from that of the noise elements, performance was far better than when they had the same disparity (at least for stereo-normal observers). In a second experiment we found that adding additional noise elements to the motion task had no effect if they had a different disparity (however, they had a marked effect for stereo-blind observers). We conclude that stereo disparity can be used as a segmentation cue by the motion system.

Infants' sensitivity to statistical distributions of motion direction and speed

Adults combine different local motions to form a global percept of motion. This study explores the origins of this process by testing how perturbations of local motion influence infants' sensitivity to global motion. Infants at 6-, 12-, and 18-weeks of age viewed random dots moving with a gaussian distribution of dot directions defined by a mean of 0 degree (rightward) or 180 degrees (leftward) and a standard deviation (SD) of 0, 34, or 68 degrees. A well-practiced observer used infants' optokinetic responses to judge the direction of stimulus motion. Infants were studied both cross-sectionally and longitudinally. Direction discrimination was relatively high at all ages when the SD was 0 degree. When the SD was 34 or 68 degrees, performance declined with age. Adult performance was nearly perfect at these SDs. A similar developmental pattern was found with distributions of dot speed. The decline in infant performance is consistent with the development of both neural tuning and receptive field size. The subsequent improvement by adulthood suggests the development of additional processes such as long-range interactions.

The role of terminators and occlusion cues in motion integration and segmentation: a neural network model

The perceptual interaction of terminators and occlusion cues with the functional processes of motion integration and segmentation is examined using a computational model. Integration is necessary to overcome noise and the inherent ambiguity in locally measured motion direction (the aperture problem). Segmentation is required to detect the presence of motion discontinuities and to prevent spurious integration of motion signals between objects with different trajectories. Terminators are used for motion disambiguation, while occlusion cues are used to suppress motion noise at points where objects intersect. The model illustrates how competitive and cooperative interactions among cells carrying out these functions can account for a number of perceptual effects, including the chopsticks illusion and the occluded diamond illusion. Possible links to the neurophysiology of the middle temporal visual area (MT) are suggested.

Temporal recruitment along the trajectory of moving objects and the perception of position

The trajectory of a moving object provides information about its velocity, direction and position. This information can be used to enhance the visual system's ability to detect changes in these parameters. We show that the visibility of the trajectory of a moving object influences the perception of its position. This form of temporal recruitment builds up on a long timescale of approximately 500 ms. Temporary occlusion of the trajectory during this time period reduces recruitment, but does not abolish it. Moreover, we found no spatial restrictions on recruitment on the scale of 10 degrees of arc. When the position of objects on trajectories with different degrees of visibility are compared, this recruitment effect causes spatial offsets. This leads to a visual illusion in which the position of moving objects is misperceived.

Attentional modulation in perception of visual motion events

Identical visual targets moving across each other with equal and constant speed can be perceived either to bounce off or to stream through each other. This bistable motion perception has been studied mostly in the context of motion integration. Since the perception of most ambiguous motion is affected by attention, there is the possibility of attentional modulation occurring in this case as well. We investigated whether distraction of attention from the moving targets would alter the relative frequency of each percept. During the observation of the streaming/bouncing motion event in the peripheral visual field, visual attention was disrupted by an abrupt presentation of a visual distractor at various timings and locations (experiment 1; exogenous distraction of attention) or by the demand of an additional discrimination task (experiments 2 and 3; endogenous distraction of attention). Both types of distractions of attention increased the frequency of the bouncing percept and decreased that of the streaming percept. These results suggest that attention may facilitate the perception of object motion as continuing in the same direction as in the past.

Colour and polarity contributions to global motion perception

The influence of the image segmentation cues based on colour and polarity on a motion coherence task were examined. In line with previous reports, when the signal and noise were given unique identities thresholds were much lower than when they were the same, suggesting a strong influence of segmentation. In another paradigm extra noise elements that differed in colour or polarity interfered despite this perceptual segmentation. We suggest that the results when signal and noise have unique identities are attributable to the subjects' ability to attend to a particular location(s) in space. When this strategy was eliminated by presenting the stimuli in the near-periphery or very briefly the effect of the colour or polarity information disappears.

Spatio-temporal contrast sensitivity, coherent motion, and visible persistence in developmental dyslexia

Three experiments measured spatio-temporal contrast sensitivity, coherent motion, and visible persistence in a single group of children with developmental dyslexia and a matched control group. The findings were consistent with a transient channel disorder in the dyslexic group which showed a reduction in contrast sensitivity at low spatial frequencies, a significant reduction in sensitivity for coherent motion, and a significantly longer duration of visible persistence. The results were also examined by classifying the dyslexic group into dyseidetic, dysphonetic, and mixed (dysphoneidetic) subgroups. There were no differences between the control and dyseidetic groups in contrast sensitivity, in coherent motion and in visible persistence. In comparison to the control group, the mixed (dysphoneidetic) dyslexic subgroup was found to have a significant reduction in contrast sensitivity at low spatial frequencies, a significant reduction in sensitivity for coherent motion, and a significantly longer duration of visible persistence. In comparison to the control group, the dysphonetic group only showed a reduction in contrast sensitivity at low spatial frequencies. Comparisons between the dyseidetic, dysphonetic and mixed dyslexic subgroups showed that there were no substantive differences in contrast sensitivity, coherent motion, and visible persistence. The results support the proposal and findings by Borsting et al. (Borsting E, Ridder WH, Dudeck K, Kelley C, Matsui L, Motoyama J. Vis Res 1996;36:1047-1053) that a transient channel disorder may only be present in a dysphoneidetic dyslexic subgroup. Psychometric assessment revealed that all the children with dyslexia appear to have a concurrent disorder in phonological coding, temporal order processing, and short-term memory.

Local motion detectors cannot account for the detectability of an extended trajectory in noise

Previous work has shown that a single dot moving in a consistent direction is easily detected among noise dots in Brownian motion (Watamaniuk et al., Vis Res 1995;35:65-77). In this study we calculated the predictions of a commonly-used psychophysical motion model for a motion trajectory in noise. This model assumes local motion energy detectors optimally tuned to the signal, followed by a decision stage that implements the maximum rule. We first show that local motion detectors do indeed explain the detectability of brief trajectories (100 ms) that fall within a single unit, but that they severely underestimate the detectability of extended trajectories that span multiple units. For instance, a 200 ms trajectory is approximately three times more detectable than two isolated 100 ms trajectories presented together within an equivalent temporal interval. This result suggests a nonlinear interaction among local motion units. This interaction is not restricted to linear trajectories because circular trajectories with curvatures larger than 1 degree are almost as detectable as linear trajectories. Our data are consistent with a flexible network that feeds forward excitation among units tuned to similar directions of motion.