Speed change detection in foveal and peripheral vision

Characterizing Spatiotemporal Population Receptive Fields in Human Visual Cortex with fMRI

The use of fMRI and computational modeling has advanced understanding of spatial characteristics of population receptive fields (pRFs) in human visual cortex. However, we know relatively little about the spatiotemporal characteristics of pRFs because neurons' temporal properties are one to two orders of magnitude faster than fMRI BOLD responses. Here, we developed an image-computable framework to estimate spatiotemporal pRFs from fMRI data. First, we developed a simulation software that predicts fMRI responses to a time-varying visual input given a spatiotemporal pRF model and solves the model parameters. The simulator revealed that ground-truth spatiotemporal parameters can be accurately recovered at the millisecond resolution from synthesized fMRI responses. Then, using fMRI and a novel stimulus paradigm, we mapped spatiotemporal pRFs in individual voxels across human visual cortex in 10 participants (both females and males). We find that a compressive spatiotemporal (CST) pRF model better explains fMRI responses than a conventional spatial pRF model across visual areas spanning the dorsal, lateral, and ventral streams. Further, we find three organizational principles of spatiotemporal pRFs: (1) from early to later areas within a visual stream, spatial and temporal windows of pRFs progressively increase in size and show greater compressive nonlinearities, (2) later visual areas show diverging spatial and temporal windows across streams, and (3) within early visual areas (V1-V3), both spatial and temporal windows systematically increase with eccentricity. Together, this computational framework and empirical results open exciting new possibilities for modeling and measuring fine-grained spatiotemporal dynamics of neural responses using fMRI.

Duration perception in peripheral vision: Underestimation increases with greater stimuli eccentricity

Duration perception plays a fundamental role in our daily visual activities; however, it can be easily distorted, even in the retinal location. While this topic has been extensively investigated in central vision, similar exploration in peripheral vision is still at an early stage. To investigate the influence of eccentricity, a commonly used indicator for quantifying retinal location, on duration perception in peripheral vision, we conducted two psychophysical experiments. In Experiment 1, we observed that the retinal location influenced the Point of Subjective Equality (PSE) but not the Weber Fraction (WF) of stimuli appearing at eccentricities ranging from 30° to 70°. Except at 30°, the PSEs were significantly longer than 416.7 ms (25 frames), which was the duration of standard stimuli. This suggested that participants underestimated duration, and this underestimation increased with greater distance from the central fixation point on the retina. To eliminate the potential interference of the central task used in Experiment 1, we conducted a supplementary experiment (Experiment 2) that demonstrated that this central task did not change the underestimation (PSE) but did influence the sensitivity (WF) at an eccentricity of 50°. In summary, our findings revealed a compressive effect of eccentricity on duration perception in peripheral vision: as stimuli appeared more peripheral on the retina, there was an increasing underestimation of subjective duration. Reasons and survival advantages of this underestimation are discussed. Findings provide new insight on duration perception in peripheral vision, highlighting an expanding compressive underestimation effect with greater eccentricity.

Are predictive saccades linked to the processing of peripheral information?

High-level athletes can predict the actions of an opposing player. Interestingly, such predictions are also reflected by the athlete's gaze behavior. In cricket, for example, players first pursue the ball with their eyes before they very often initiate two predictive saccades: one to the predicted ball-bounce point and a second to the predicted ball-bat-contact point. That means, they move their eyes ahead of the ball and "wait" for the ball at the new fixation location, potentially using their peripheral vision to update information about the ball's trajectory. In this study, we investigated whether predictive saccades are linked to the processing of information in peripheral vision and if predictive saccades are superior to continuously following the ball with foveal vision using smooth-pursuit eye-movements (SPEMs). In the first two experiments, we evoked the typical eye-movements observed in cricket and showed that the information gathered during SPEMs is sufficient to predict when the moving object will hit the target location and that (additional) peripheral monitoring of the object does not help to improve performance. In a third experiment, we show that it could actually be beneficial to use SPEMs rather than predictive saccades to improve performance. Thus, predictive saccades ahead of a target are unlikely to be performed to enhance the peripheral monitoring of target.

Dynamic divisive normalization circuits explain and predict change detection in monkey area MT

Sudden changes in visual scenes often indicate important events for behavior. For their quick and reliable detection, the brain must be capable to process these changes as independently as possible from its current activation state. In motion-selective area MT, neurons respond to instantaneous speed changes with pronounced transients, often far exceeding the expected response as derived from their speed tuning profile. We here show that this complex, non-linear behavior emerges from the combined temporal dynamics of excitation and divisive inhibition, and provide a comprehensive mathematical analysis. A central prediction derived from this investigation is that attention increases the steepness of the transient response irrespective of the activation state prior to a stimulus change, and irrespective of the sign of the change (i.e. irrespective of whether the stimulus is accelerating or decelerating). Extracellular recordings of attention-dependent representation of both speed increments and decrements confirmed this prediction and suggest that improved change detection derives from basic computations in a canonical cortical circuitry.

Perception of the Harvester Operator’s Working Environment in Windthrow Stands

The aim of the study was to determine the mental workload of a harvester operator when working in late thinning and in windthrown stands of the same type and age, using eye movement patterns as an indicator. Eyeball movement variability was analysed using the eye tracking method. The mean duration of eyesight fixations in windthrown stands was shorter than in the control undamaged stands by about 20% (444 ms and 534 ms, respectively). The mean time of eyesight movements (saccades) in the windthrown stands was shorter than in the control undamaged stands by approx. 15%. The largest differences between the duration of saccades in the windthrown and control stands were observed between the cutting of trees and cutting logs off their root plates: the saccades were longer by about 20% when working in the control stands (49 ms) as compared to the windthrown stands (43 ms). Large differences in the duration of saccades between the windthrown area (42 ms) and the control area (47 ms) were also found when travelling between successive operation sites. In both types of stands, the shortest saccades were observed during processing: 39 ms. Summary durations of saccades observed during the processing of successive trees occurred in sequences showing repeated periods of variable eyeball activity, where longer saccades were followed by shorter ones. Documented more variability of eyesight activities of the harvester operator performing the operations of processing and moving is new standard of eye balls activities for the more taxing work conditions presented by windthrown stands.

Enhanced bodily states of fear facilitates bias perception of fearful faces

We investigated whether enhanced interoceptive bodily states of fear would facilitate recognition of the fearful faces. Participants performed an emotional judgment task after a bodily imagery task inside a functional magnetic resonance imaging scanner. In the bodily imagery task, participants were instructed to imagine feeling the bodily sensations of two specific somatotopic patterns: a fear-associated bodily sensation (FBS) or a disgust-associated bodily sensation (DBS). They were shown faces expressing various levels of fearfulness and disgust and instructed to classify the facial expression as fear or disgust. We found a stronger bias favoring the “fearful face” under the congruent FBS condition than under the incongruent DBS condition. The brain response to fearful versus intermediate faces increased in the fronto-insular-temporal network under the FBS condition, but not the DBS condition. The fearful face elicited activity in the anterior cingulate cortex and extrastriate body area under the FBS condition relative to the DBS condition. Furthermore, functional connectivity between the anterior cingulate cortex/extrastriate body area and the fronto-insular-temporal network was modulated according to the specific bodily sensation. Our findings suggest that somatotopic patterns of bodily sensation provide informative access to the collective visceral state in the fear processing via the fronto-insular-temporal network.

Event-Based Eccentric Motion Detection Exploiting Time Difference Encoding

Attentional selectivity tends to follow events considered as interesting stimuli. Indeed, the motion of visual stimuli present in the environment attract our attention and allow us to react and interact with our surroundings. Extracting relevant motion information from the environment presents a challenge with regards to the high information content of the visual input. In this work we propose a novel integration between an eccentric down-sampling of the visual field, taking inspiration from the varying size of receptive fields (RFs) in the mammalian retina, and the Spiking Elementary Motion Detector (sEMD) model. We characterize the system functionality with simulated data and real world data collected with bio-inspired event driven cameras, successfully implementing motion detection along the four cardinal directions and diagonally.

Detecting motion changes with peripheral vision: On the superiority of fixating over smooth-pursuit tracking

Detecting motion changes is a fundamental prerequisite for solving tasks in sports and in everyday life. It is known that peripheral vision is used to detect these changes and that saccades impair detection performance. However, comparatively little is known about the role of smooth-pursuit eye-movements (SPEMs) during these tasks. Therefore, we compared peripheral motion-change detection during SPEM and fixation at eccentricities up to 18°, simulating the perceptual demands of real-life situations. Based on expert gaze behavior in sports, we predicted that motion detection should be better during fixation than SPEM. In a series of three experiments, we consistently found that detection rates and response times were impaired during SPEM compared to fixation, particularly at 18° eccentricity. With an invisible pursuit object and targets moving ahead rather than behind the pursued object, performance differences in response times declined, whereas differences in detection rates interestingly remained unmoved. We argue that retinal image motion and attentional demands are reasons for SPEM impairments.

Advantage of detecting visual events in the right hemifield is affected by reading skill

Visual perception is often not homogenous across the visual field and can vary depending on situational demands. The reasons behind this inhomogeneity are not clear. Here we show that directing attention that is consistent with a western reading habit from left to right, results in a ~32% higher sensitivity to detect transient visual events in the right hemifield. This right visual field advantage was largely reduced in individuals with reading difficulties from developmental dyslexia. Similarly, visual detection became more symmetric in skilled readers, when attention was guided opposite to the reading pattern. Taken together, these findings highlight a higher sensitivity in the right visual field for detecting the onset of sudden visual events that is well accounted for by left hemisphere dominated reading habit.

Dynamics of contrast adaptation in central and peripheral vision

Adaptation aftereffects are generally stronger for peripheral than for foveal viewing. We examined whether there are also differences in the dynamics of visual adaptation in central and peripheral vision. We tracked the time course of contrast adaptation to binocularly presented Gabor patterns in both the central visual field (within 5°) and in the periphery (beyond 10° eccentricity) using a yes/no detection task to monitor contrast thresholds. Consistent with previous studies, sensitivity losses were stronger in the periphery than in the center when adapting to equivalent high contrast (90% contrast) patterns. The time course of the threshold changes was fitted with separate exponential functions to estimate the time constants during the adapt and post-adapt phases. When adapting to equivalent high contrast, adaptation effects built up and decayed more slowly in the periphery compared with central adaptation. Surprisingly, the aftereffect in the periphery did not decay completely to the baseline within the monitored post-adapt period (400 s), and instead asymptoted to a higher level than for central adaptation. Even when contrast was reduced to one-third (30% contrast) of the central contrast, peripheral adaptation remained stronger and decayed more slowly. This slower dynamic was also confirmed at suprathreshold test contrasts by tracking tilt-aftereffects with a 2AFC orientation discrimination task. Our results indicate that the dynamics of contrast adaptation differ between central and peripheral vision, with the periphery adapting not only more strongly but also more slowly, and provide another example of potential qualitative processing differences between central and peripheral vision.

Attentional modulation of speed-change perception in the perifoveal and near-peripheral visual field

The ability to perceive changes in motion, such as rapid changes of speed, has important ecological significance. We show that exogenous and endogenous attention have different effects on speed-change perception and operate differently in different regions of the visual field. Using a spatial-cueing paradigm, with either exogenous or endogenous cues followed by drifting Gabor patches of changing speed that appear at the cued or uncued location, we measured participants’ thresholds for localizing both acceleration and deceleration of the Gabor patches in different regions (5° and 10°) of the visual field. The results revealed a larger exogenous cueing effect, indexed by a lower threshold for the cued relative to the uncued conditions, at 5° for perceiving acceleration and at 10° for perceiving deceleration. Endogenous attention, in contrast, improved performance equally at both eccentricities. We conclude that exogenous and endogenous spatial orienting constitute two independent attentional systems, with distinct modulation patterns on speed change perception in the visual field. While exogenous attentional modulation is eccentricity-dependent, endogenous attention acts homogeneously in perifoveal and near-peripheral regions of the visual field.

Influence of social presence on eye movements in visual search tasks

This study employed an eye-tracking technique to investigate the influence of social presence on eye movements in visual search tasks. A total of 20 male subjects performed visual search tasks in a 2 (target presence: present vs. absent) × 2 (task complexity: complex vs. simple) × 2 (social presence: alone vs. a human audience) within-subject experiment. Results indicated that the presence of an audience could evoke a social facilitation effect on response time in visual search tasks. Compared with working alone, the participants made fewer and shorter fixations, larger saccades and shorter scan path in simple search tasks and more and longer fixations, smaller saccades and longer scan path in complex search tasks when working with an audience. The saccade velocity and pupil diameter in the audience-present condition were larger than those in the working-alone condition. No significant change in target fixation number was observed between two social presence conditions. Practitioner Summary: This study employed an eye-tracking technique to examine the influence of social presence on eye movements in visual search tasks. Results clarified the variation mechanism and characteristics of oculomotor scanning induced by social presence in visual search.

Categories and Constraints in Causal Perception

When object A moves adjacent to a stationary object, B, and in that instant A stops moving and B starts moving, people irresistibly see this as an event in which A causes B to move. Real-world causal collisions are subject to Newtonian constraints on the relative speed of B following the collision, but here we show that perceptual constraints on the relative speed of B (which align imprecisely with Newtonian principles) define two categories of causal events in perception. Using performance-based tasks, we show that triggering events, in which B moves noticeably faster than A, are treated as being categorically different from launching events, in which B does not move noticeably faster than A, and that these categories are unique to causal events (Experiments 1 and 2). Furthermore, we show that 7- to 9-month-old infants are sensitive to this distinction, which suggests that this boundary may be an early-developing component of causal perception (Experiment 3).

Peripheral resolution and contrast sensitivity: Effects of stimulus drift

Optimal temporal modulation of the stimulus can improve foveal contrast sensitivity. This study evaluates the characteristics of the peripheral spatiotemporal contrast sensitivity function in normal-sighted subjects. The purpose is to identify a temporal modulation that can potentially improve the remaining peripheral visual function in subjects with central visual field loss. High contrast resolution cut-off for grating stimuli with four temporal frequencies (0, 5, 10 and 15Hz drift) was first evaluated in the 10° nasal visual field. Resolution contrast sensitivity for all temporal frequencies was then measured at four spatial frequencies between 0.5 cycles per degree (cpd) and the measured stationary cut-off. All measurements were performed with eccentric optical correction. Similar to foveal vision, peripheral contrast sensitivity is highest for a combination of low spatial frequency and 5-10Hz drift. At higher spatial frequencies, there was a decrease in contrast sensitivity with 15Hz drift. Despite this decrease, the resolution cut-off did not vary largely between the different temporal frequencies tested. Additional measurements of contrast sensitivity at 0.5 cpd and resolution cut-off for stationary (0Hz) and 7.5Hz stimuli performed at 10, 15, 20 and 25° in the nasal visual field also showed the same characteristics across eccentricities.

Effects of Motion in the Far Peripheral Visual Field on Cognitive Test Performance and Cognitive Load

Cognitive load theory posits that limited attention is in actuality a limitation in working memory resources. The load theory of selective attention and cognitive control sees the interplay between attention and awareness as separate modifying functions that act on working memory. Reconciling the theoretical differences in these two theories has important implications for learning. Thirty-nine adult participants performed a cognitively demanding test, with and without movement in the far peripheral field. Although the results for movement effects on cognitive load in this experiment were not statistically significant, men spent less time on the cognitive test in the peripheral movement condition than in the conditions without peripheral movement. No such difference was found for women. The implications of these results and recommendations for future research that extends the present study are presented.

Robust Underestimation of Speed During Driving: A Field Study

Traffic reports consistently identify speeding as a substantial source of accidents. Adequate driving speeds require reliable speed estimation; however, there is still a lack of understanding how speed perception is biased during driving. Therefore, we ran three experiments measuring speed estimation under controlled driving and lighting conditions. In the first experiment, participants had to produce target speeds as drivers or had to judge driven speed as passengers. Measurements were performed at daylight and at night. In the second experiment, participants were required to produce target speeds at dusk, under rapidly changing lighting conditions. In the third experiment, we let two cars approach and pass each other. Drivers were instructed to produce target speeds as well as to judge the speed of the oncoming vehicle. Here measurements were performed at daylight and at night, with full or dipped headlights. We found that passengers underestimated driven speed by about 20% and drivers went over the instructed speed by roughly the same amount. Interestingly, the underestimation of speed extended to oncoming cars. All of these effects were independent of lighting conditions. The consistent underestimation of speed could lead to potentially fatal situations where drivers go faster than intended and judge oncoming traffic to approach slower than it actually is.

Transient activity in monkey area MT represents speed changes and is correlated with human behavioral performance

Neurons in the middle temporal area (MT) respond to motion onsets and speed changes with a transient-sustained firing pattern. The latency of the transient response has recently been shown to correlate with reaction time in a speed change detection task, but it is not known how the sign, the amplitude, and the latency of this response depend on the sign and the magnitude of a speed change, and whether these transients can be decoded to explain speed change detection behavior. To investigate this issue, we measured the neuronal representation of a wide range of positive and negative speed changes in area MT of fixating macaques and obtained three major findings. First, speed change transients not only reflect a neuron's absolute speed tuning but are shaped by an additional gain that scales the tuned response according to the magnitude of a relative speed change. Second, by means of a threshold model positive and negative population transients of a moderate number of MT neurons explain detection of both positive and negative speed changes, respectively, at a level comparable to human detection rates under identical visual stimulation. Third, like reaction times in a psychophysical model of velocity detection, speed change response latencies follow a power-law function of the absolute difference of a speed change. Both this neuronal representation and its close correlation with behavioral measures of speed change detection suggest that neuronal transients in area MT facilitate the detection of rapid changes in visual input.

Representation of central and peripheral vision in the primate cerebral cortex: Insights from studies of the marmoset brain

How the visual field is represented by neurons in the cerebral cortex is one of the most basic questions in visual neuroscience. However, research to date has focused heavily on the small part of the visual field within, and immediately surrounding the fovea. Studies on the cortical representation of the full visual field in the primate brain are still scarce. We have been investigating this issue with electrophysiological and anatomical methods, taking advantage of the small and lissencephalic marmoset brain, which allows easy access to the representation of the full visual field in many cortical areas. This review summarizes our main findings to date, and relates the results to a broader question: is the peripheral visual field processed in a similar manner to the central visual field, but with lower spatial acuity? Given the organization of the visual cortex, the issue can be addressed by asking: (1) Is visual information processed in the same way within a single cortical area? and (2) Are different cortical areas specialized for different parts of the visual field? The electrophysiological data from the primary visual cortex indicate that many aspects of spatiotemporal computation are remarkably similar across the visual field, although subtle variations are detectable. Our anatomical and electrophysiological studies of the extrastriate cortex, on the other hand, suggest that visual processing in the far peripheral visual field is likely to involve a distinct network of specialized cortical areas, located in the depths of the calcarine sulcus and interhemispheric fissure.

Implied dynamics biases the visual perception of velocity

We expand the anecdotic report by Johansson that back-and-forth linear harmonic motions appear uniform. Six experiments explore the role of shape and spatial orientation of the trajectory of a point-light target in the perceptual judgment of uniform motion. In Experiment 1, the target oscillated back-and-forth along a circular arc around an invisible pivot. The imaginary segment from the pivot to the midpoint of the trajectory could be oriented vertically downward (consistent with an upright pendulum), horizontally leftward, or vertically upward (upside-down). In Experiments 2 to 5, the target moved uni-directionally. The effect of suppressing the alternation of movement directions was tested with curvilinear (Experiment 2 and 3) or rectilinear (Experiment 4 and 5) paths. Experiment 6 replicated the upright condition of Experiment 1, but participants were asked to hold the gaze on a fixation point. When some features of the trajectory evoked the motion of either a simple pendulum or a mass-spring system, observers identified as uniform the kinematic profiles close to harmonic motion. The bias towards harmonic motion was most consistent in the upright orientation of Experiment 1 and 6. The bias disappeared when the stimuli were incompatible with both pendulum and mass-spring models (Experiments 3 to 5). The results are compatible with the hypothesis that the perception of dynamic stimuli is biased by the laws of motion obeyed by natural events, so that only natural motions appear uniform.

Monkey area MT latencies to speed changes depend on attention and correlate with behavioral reaction times

Selective visual attention is known to be associated with characteristic modulations of neuronal activity in early visual cortex, but there is only rare evidence showing that these neuronal modulations are directly related to attention-dependent behavioral improvements. Here, we describe a strong, transient increase in the response of neurons in the mediotemporal (MT) area to behaviorally relevant speed changes that is not only modulated by attention but also highly correlated with the animal's performance. In trials with fast reaction time (RT), this transient component occurs with short latency, whereas latency increases monotonically with slower RT. Importantly, RTs are related not to the firing rate modulation during sustained attentive tracking of the target prior to the speed change but to the variability of the neuronal response. Our findings suggest a direct link between attention-dependent response modulations in early visual cortex and improved behavioral performance.