The role of location probability in the programming of saccades: implications for "center-of-gravity" tendencies

The functional role of spatial anisotropies in ensemble perception

BACKGROUND

The human brain can rapidly represent sets of similar stimuli by their ensemble summary statistics, like the average orientation or size. Classic models assume that ensemble statistics are computed by integrating all elements with equal weight. Challenging this view, here, we show that ensemble statistics are estimated by combining parafoveal and foveal statistics in proportion to their reliability. In a series of experiments, observers reproduced the average orientation of an ensemble of stimuli under varying levels of visual uncertainty.

RESULTS

Ensemble statistics were affected by multiple spatial biases, in particular, a strong and persistent bias towards the center of the visual field. This bias, evident in the majority of subjects and in all experiments, scaled with uncertainty: the higher the uncertainty in the ensemble statistics, the larger the bias towards the element shown at the fovea.

CONCLUSION

Our findings indicate that ensemble perception cannot be explained by simple uniform pooling. The visual system weights information anisotropically from both the parafovea and the fovea, taking the intrinsic spatial anisotropies of vision into account to compensate for visual uncertainty.

Single-Trial Dynamics of Competing Reach Plans in the Human Motor Periphery

Contemporary motor control theories propose competition between multiple motor plans before the winning command is executed. While most competitions are completed before movement onset, movements are often initiated before the competition has been resolved. An example of this is saccadic averaging, wherein the eyes land at an intermediate location between two visual targets. Behavioral and neurophysiological signatures of competing motor commands have also been reported for reaching movements, but debate remains about whether such signatures attest to an unresolved competition, arise from averaging across many trials, or reflect a strategy to optimize behavior given task constraints. Here, we recorded EMG activity from an upper limb muscle (m. pectoralis) while 12 (8 female) participants performed an immediate response reach task, freely choosing between one of two identical and suddenly presented visual targets. On each trial, muscle recruitment showed two distinct phases of directionally tuned activity. In the first wave, time-locked ∼100 ms of target presentation, muscle activity was clearly influenced by the nonchosen target, reflecting a competition between reach commands that was biased in favor of the ultimately chosen target. This resulted in an initial movement intermediate between the two targets. In contrast, the second wave, time-locked to voluntary reach onset, was not biased toward the nonchosen target, showing that the competition between targets was resolved. Instead, this wave of activity compensated for the averaging induced by the first wave. Thus, single-trial analysis reveals an evolution in how the nonchosen target differentially influences the first and second wave of muscle activity.SIGNIFICANCE STATEMENT Contemporary theories of motor control suggest that multiple motor plans compete for selection before the winning command is executed. Evidence for this is found in intermediate reach movements toward two potential target locations, but recent findings have challenged this notion by arguing that intermediate reaching movements reflect an optimal response strategy. By examining upper limb muscle recruitment during a free-choice reach task, we show early recruitment of a suboptimal averaged motor command to the two targets that subsequently transitions to a single motor command that compensates for the initially averaged motor command. Recording limb muscle activity permits single-trial resolution of the dynamic influence of the nonchosen target through time.

Dynamics of attentional and oculomotor orienting in visual foraging tasks

A vast amount of research has been carried out to understand how humans visually search for targets in their environment. However, this research has typically involved search for one unique target among several distractors. Although this line of research has yielded important insights into the basic characteristics of how humans explore their visual environment, this may not be a very realistic model for everyday visual orientation. Recently, researchers have used multi-target displays to assess orienting in the visual field. Eye movements in such tasks are, however, less well understood. Here, we investigated oculomotor dynamics during four visual foraging tasks differing in target crypticity (feature-based foraging vs. conjunction-based foraging) and the effector type being used for target selection (mouse foraging vs. gaze foraging). Our results show that both target crypticity and effector type affect foraging strategies. These changes are reflected in oculomotor dynamics, feature foraging being associated with focal exploration (long fixations and short-amplitude saccades), and conjunction foraging with ambient exploration (short fixations and high-amplitude saccades). These results provide important new information for existing accounts of visual attention and oculomotor control and emphasise the usefulness of foraging tasks for a better understanding of how humans orient in the visual environment.

Foveal processing of emotion-informative facial features

Certain facial features provide useful information for recognition of facial expressions. In two experiments, we investigated whether foveating informative features of briefly presented expressions improves recognition accuracy and whether these features are targeted reflexively when not foveated. Angry, fearful, surprised, and sad or disgusted expressions were presented briefly at locations which would ensure foveation of specific features. Foveating the mouth of fearful, surprised and disgusted expressions improved emotion recognition compared to foveating an eye or cheek or the central brow. Foveating the brow led to equivocal results in anger recognition across the two experiments, which might be due to the different combination of emotions used. There was no consistent evidence suggesting that reflexive first saccades targeted emotion-relevant features; instead, they targeted the closest feature to initial fixation. In a third experiment, angry, fearful, surprised and disgusted expressions were presented for 5 seconds. Duration of task-related fixations in the eyes, brow, nose and mouth regions was modulated by the presented expression. Moreover, longer fixation at the mouth positively correlated with anger and disgust accuracy both when these expressions were freely viewed (Experiment 2b) and when briefly presented at the mouth (Experiment 2a). Finally, an overall preference to fixate the mouth across all expressions correlated positively with anger and disgust accuracy. These findings suggest that foveal processing of informative features is functional/contributory to emotion recognition, but they are not automatically sought out when not foveated, and that facial emotion recognition performance is related to idiosyncratic gaze behaviour.

A nearby distractor does not influence hand movements

When interacting with the environment, our manual actions are often preceded by an eye movement. This suggests that the processes underlying target selection in hand and eye movements may be coupled. It is known that when a distractor is presented close to a target, the endpoint of an eye movement will be biased towards the distractor. The size of this so-called global effect decreases when more viewing time is available. Here we investigate whether a similar effect is also present in hand movements. If the processes underlying target selection for hand and eye movements are indeed coupled, a similar bias should be present in hand movements as well. To test this, we adopted a classic global effect paradigm but applied it to goal-directed hand movements. We show that the endpoints of hand movements are unbiased for all but one participant, irrespective of the viewing time. These results suggest that the processes underlying target selection for hand movements operate independently from those for eye movements.

Gravitational effects of scene information in object localization

We effortlessly interact with objects in our environment, but how do we know where something is? An object's apparent position does not simply correspond to its retinotopic location but is influenced by its surrounding context. In the natural environment, this context is highly complex, and little is known about how visual information in a scene influences the apparent location of the objects within it. We measured the influence of local image statistics (luminance, edges, object boundaries, and saliency) on the reported location of a brief target superimposed on images of natural scenes. For each image statistic, we calculated the difference between the image value at the physical center of the target and the value at its reported center, using observers' cursor responses, and averaged the resulting values across all trials. To isolate image-specific effects, difference scores were compared to a randomly-permuted null distribution that accounted for any response biases. The observed difference scores indicated that responses were significantly biased toward darker regions, luminance edges, object boundaries, and areas of high saliency, with relatively low shared variance among these measures. In addition, we show that the same image statistics were associated with observers' saccade errors, despite large differences in response time, and that some effects persisted when high-level scene processing was disrupted by 180° rotations and color negatives of the originals. Together, these results provide evidence for landmark effects within natural images, in which feature location reports are pulled toward low- and high-level informative content in the scene.

Visual attention and eye movement control during oculomotor competition

Saccadic eye movements are typically preceded by selective shifts of visual attention. Recent evidence, however, suggests that oculomotor selection can occur in the absence of attentional selection when saccades erroneously land in between nearby competing objects (saccade averaging). This study combined a saccade task with a visual discrimination task to investigate saccade target selection during episodes of competition between a saccade target and a nearby distractor. We manipulated the spatial predictability of target and distractor locations and asked participants to execute saccades upon variably delayed go-signals. This allowed us to systematically investigate the capacity to exert top-down eye movement control (as reflected in saccade endpoints) based on the spatiotemporal dynamics of visual attention during movement preparation (measured as visual sensitivity). Our data demonstrate that the predictability of target and distractor locations, despite not affecting the deployment of visual attention prior to movement preparation, largely improved the accuracy of short-latency saccades. Under spatial uncertainty, a short go-signal delay likewise enhanced saccade accuracy substantially, which was associated with a more selective deployment of attentional resources to the saccade target. Moreover, we observed a systematic relationship between the deployment of visual attention and saccade accuracy, with visual discrimination performance being significantly enhanced at the saccade target relative to the distractor only before the execution of saccades accurately landing at the saccade target. Our results provide novel insights linking top-down eye movement control to the operation of selective visual attention during movement preparation.

Inhibition of saccade initiation improves saccade accuracy: The role of local and remote visual distractors in the control of saccadic eye movements

When a distractor appears close to the target location, saccades are less accurate. However, the presence of a further distractor, remote from those stimuli, increases the saccade response latency and improves accuracy. Explanations for this are either that the second, remote distractor impacts directly on target selection processes or that the remote distractor merely impairs the ability to initiate a saccade and changes the time at which unaffected target selection processes are accessed. In order to tease these two explanations apart, here we examine the relationship between latency and accuracy of saccades to a target and close distractor pair while a remote distractor appears at variable distance. Accuracy improvements are found to follow a similar pattern, regardless of the presence of the remote distractor, which suggests that the effect of the remote distractor is not the result of a direct impact on the target selection process. Our findings support the proposal that a remote distractor impairs the ability to initiate a saccade, meaning the competition between target and close distractor is accessed at a later time, thus resulting in more accurate saccades.

Saccade dynamics during an online updating task change with healthy aging

Goal-directed movements rely on the integration of both visual and motor information, especially during the online control of movement, to fluidly and flexibly control coordinated action. Eye-hand coordination typically plays an important role in goal-directed movements. As people age, various aspects of motor control and visual performance decline (Haegerstrom-Portnoy, Schneck, & Brabyn, 1999; Seidler et al., 2010), including an increase in saccade latencies (Munoz, Broughton, Goldring, & Armstrong, 1998). However, there is limited insight into how age-related changes in saccadic performance impact eye-hand coordination during online control. We investigated this question through the use of a target perturbation paradigm. Older and younger participants completed a perturbation task where target perturbations could occur either early (0 ms) or later (200 ms) after reach onset. We analyzed reach correction latencies and the frequency of the reach correction, coupled with analyses of saccades across all stages of movement. Older participants had slower correction latencies and initiated corrections less frequently compared to younger participants, with this trend being exacerbated in the later (200 ms) target perturbation condition. Older participants also produced slower saccade latencies toward both the initial target and the perturbed target. For trials in which a correction occurred to a late perturbation, touch responses were more accurate when there was more time between the saccade landing and the touch. Altogether, our results suggest that these age-related effects may be due to the delayed acquisition of visual and oculomotor information used to inform the reaching movement, stemming from the increase in saccade latencies before and after target perturbation.

Visual information is required to reduce the global effect

When a distractor appears in close proximity to a saccade target, the saccadic end point is biased towards the distractor. This so-called global effect reduces with the latency of the saccade if the saccade is visually guided. We recently reported that the global effect does not reduce with the latency of a double-step memory-guided saccade. The aim of this study was to investigate why the global effect in memory-guided saccades does not show the typically observed reduction with saccadic latency. One possibility is that reduction of the global effect requires continuous access to visual information about target and distractor locations, which is lacking in the case of a memory-guided saccade. Alternatively, participants may be inclined to routinely preprogram a memory-guided saccade at the moment the visual information disappears, with the result that a memory-guided saccade is typically programmed on the basis of an earlier representation than necessary. To distinguish between these alternatives, two potential targets were presented, and participants were asked to make a saccade to one of them after a delay. In one condition, the target identity was precued, allowing preprogramming of the saccade, while in another condition, it was revealed by a retro cue after the delay. The global effect remained present in both conditions. Increasing visual exposure of target and distractor led to a reduction of the global effect, irrespective of whether participants could preprogram a saccade or not. The results suggest that continuous access to visual information is required in order to eliminate the global effect.

The effect of the Müller-Lyer configuration on saccadic eye movements is not fully due to illusory perception

Previous research has shown that both perception and oculomotor control are affected by visual illusions. While these findings appear to suggest a common code of visual processing for perception and oculomotor control, there remains the possibility that the perceptual and the oculomotor effects emerge through partially different processes. In three experiments, we replicated the previous finding that perception and saccades were both biased by the typical Müller-Lyer configurations. However, using a non-Müller-Lyer setup in which the perceptual illusion effect was much restrained, we did not observe a comparable reduction in the saccadic effect. Instead, the saccadic effect by Müller-Lyer configuration could be partially due to the center-of-gravity (CoG) effect (i.e., the tendency for saccades to land at the center of gravity of the stimuli). These results indicate that the influence of the Müller-Lyer configuration on saccadic eye movements is a mixed effect of perceptual representation and CoG, rather than exclusively due to the illusory perception. We further found that the saccadic and perceptual effects were not correlated at the trial-by-trial level, which suggest that there could be largely independent sources of noise for perception and saccadic control.NEW & NOTEWORTHY The Müller-Lyer illusion affects both perception and oculomotor control, but it is unknown whether these effects arise from the same or different underlying mechanisms. We developed a modified version of the Müller-Lyer configuration, which largely reduced the perceptual illusion effect compared with the typical configuration but reduced the saccadic effect to a much less extent. Such difference indicates that influence of the Müller-Lyer configuration on saccadic eye movements is not fully mediated by illusory perception.

The spatial and temporal properties of attentional selectivity for saccades and reaches

The preparation and execution of saccades and goal-directed movements elicits an accompanying shift in attention at the locus of the impending movement. However, some key aspects of the spatiotemporal profile of this attentional shift between eye and hand movements are not resolved. While there is evidence that attention is improved at the target location when making a reach, it is not clear how attention shifts over space and time around the movement target as a saccade and a reach are made to that target. Determining this spread of attention is an important aspect in understanding how attentional resources are used in relation to movement planning and guidance in real world tasks. We compared performance on a perceptual discrimination paradigm during a saccade-alone task, reach-alone task, and a saccade-plus-reach task to map the temporal profile of the premotor attentional shift at the goal of the movement and at three surrounding locations. We measured performance relative to a valid baseline level to determine whether motor planning induces additional attentional facilitation compared to mere covert attention. Sensitivity increased relative to movement onset at the target and at the surrounding locations, for both the saccade-alone and saccade-plus-reach conditions. The results suggest that the temporal profile of the attentional shift is similar for the two tasks involving saccades (saccade-alone and saccade-plus-reach tasks), but is very different when the influence of the saccade is removed. In this case, performance in the saccade-plus-reach task reflects the lower sensitivity observed when a reach-alone task is being conducted. In addition, the spatial profile of this spread of attention is not symmetrical around the target. This suggests that when a saccade and reach are being planned together, the saccade drives the attentional shift, and the reach-alone carries little attentional weight.

Gain control of saccadic eye movements is probabilistic

Saccades are rapid eye movements that orient the visual axis toward objects of interest to allow their processing by the central, high-acuity retina. Our ability to collect visual information efficiently relies on saccadic accuracy, which is limited by a combination of uncertainty in the location of the target and motor noise. It has been observed that saccades have a systematic tendency to fall short of their intended targets, and it has been suggested that this bias originates from a cost function that overly penalizes hypermetric errors. Here, we tested this hypothesis by systematically manipulating the positional uncertainty of saccadic targets. We found that increasing uncertainty produced not only a larger spread of the saccadic endpoints but also more hypometric errors and a systematic bias toward the average of target locations in a given block, revealing that prior knowledge was integrated into saccadic planning. Moreover, by examining how variability and bias covaried across conditions, we estimated the asymmetry of the cost function and found that it was related to individual differences in the additional time needed to program secondary saccades for correcting hypermetric errors, relative to hypometric ones. Taken together, these findings reveal that the saccadic system uses a probabilistic-Bayesian control strategy to compensate for uncertainty in a statistically principled way and to minimize the expected cost of saccadic errors.

Increased preparation time reduces, but does not abolish, action history bias of saccadic eye movements

The characteristics of movements are strongly history-dependent. Marinovic et al. (Marinovic W, Poh E, de Rugy A, Carroll TJ. eLife 6: e26713, 2017) showed that past experience influences the execution of limb movements through a combination of temporally stable processes that are strictly use dependent and dynamically evolving and context-dependent processes that reflect prediction of future actions. Here we tested the basis of history-dependent biases for multiple spatiotemporal features of saccadic eye movements under two preparation time conditions (long and short). Twenty people performed saccades to visual targets. To prompt context-specific expectations of most likely target locations, 1 of 12 potential target locations was specified on ~85% of the trials and each remaining target was presented on ~1% trials. In long preparation trials participants were shown the location of the next target 1 s before its presentation onset, whereas in short preparation trials each target was first specified as the cue to move. Saccade reaction times and direction were biased by recent saccade history but according to distinct spatial tuning profiles. Biases were purely expectation related for saccadic reaction times, which increased linearly as the distance from the repeated target location increased when preparation time was short but were similar to all targets when preparation time was long. By contrast, the directions of saccades were biased toward the repeated target in both preparation time conditions, although to a lesser extent when the target location was precued (long preparation). The results suggest that saccade history affects saccade dynamics via both use- and expectation-dependent mechanisms and that movement history has dissociable effects on reaction time and saccadic direction. NEW & NOTEWORTHY The characteristics of our movements are influenced not only by concurrent sensory inputs but also by how we have moved in the past. For limb movements, history effects involve both use-dependent processes due strictly to movement repetition and processes that reflect prediction of future actions. Here we show that saccade history also affects saccade dynamics via use- and expectation-dependent mechanisms but that movement history has dissociable effects on saccade reaction time and direction.

The role of implicit perceptual-motor costs in the integration of information across graph and text

Strategies used to gather visual information are typically viewed as depending solely on the value of information gained from each action. A different approach may be required when actions entail cognitive effort or deliberate control. Integration of information across a graph and text is a resource-intensive task in which decisions to switch between graph and text may take into account the resources required to plan or execute the switches. Participants viewed a graph and text depicting attributes of two fictitious products and were asked to select the preferred product. Graph and text were presented: (1) simultaneously, side by side; (2) sequentially, where the appearance of graph or text was triggered by a button press, or (3) sequentially, where the appearance of graph or text was triggered by a saccade, thus requiring cognitive effort, memory, or controlled processing to access regions out of immediate view. Switches between graph and text were rare during initial readings, consistent with prior observations of perceptual "switch costs." Switches became more frequent during re-inspections (80% of time). Switches were twice as frequent in the simultaneous condition than in either sequential condition (button press or saccade-contingent), showing the importance of perceptual availability. These results show that strategies used to gather information while reading a graph and text are not based solely on information value, but also on implicit costs of switching, such as effort level, working memory load, or demand on controlled processing. Taking implicit costs into account is important for a complete understanding of strategies used to gather visual information.

Target-distractor competition cannot be resolved across a saccade

When a distractor is presented in close spatial proximity to a target, a saccade tends to land in between the two objects rather than on the target. This robust phenomenon (also referred to as the global effect) is thought to reflect unresolved competition between target and distractor. It is unclear whether this landing bias persists across saccades since a saccade displaces the retinotopic representations of target and distractor. In the present study participants made successive saccades towards two saccadic targets which were presented simultaneously with an irrelevant distractor in close proximity to the second saccade target. The second saccade was either visually-guided or memory-guided. For the memory-guided trials, the second saccade showed a landing bias towards the location of the distractor, despite the disappearance of the distractor after the first saccade. In contrast, for the visually-guided trials, the bias was corrected and the landing bias was eliminated, even for saccades with the shortest intersaccadic intervals. This suggests that the biased saccade plan was remapped across the first saccade. Therefore, we conclude that the target-distractor competition was not resolved across a saccade, but can be resolved based on visual information that is available after a saccade.

Higher order, multifeatural object encoding by the oculomotor system

Previous behavioral and physiological research has demonstrated that as the behavioral relevance of potential saccade goals increases, they elicit more competition during target selection processing as evidenced by increased saccade curvature and neural activity. However, these effects have only been demonstrated for lower order feature singletons, and it remains unclear whether more complicated featural differences between higher order objects also elicit vector modulation. Therefore, we measured human saccades curvature elicited by distractors bilaterally flanking a target during a visual search saccade task and systematically varied subsets of features shared between the two distractors and the target, referred to as objective similarity (OS). Our results demonstrate that saccades deviated away from the distractor highest in OS to the target and that there was a linear relationship between the magnitude of saccade deviation and the number of feature differences between the most similar distractor and the target. Furthermore, an analysis of curvature over the time course of the saccade demonstrated that curvature only occurred in the first 20-30 ms of the movement. Given the multifeatural complexity of the novel stimuli, these results suggest that saccadic target selection processing involves dynamically reweighting vector representations for movement planning to several possible targets based on their behavioral relevance. NEW & NOTEWORTHY We demonstrate that small featural differences between unfamiliar, higher order object representations modulate vector weights during saccadic target selection processing. Such effects have previously only been demonstrated for familiar, simple feature singletons (e.g., color) in which features characterize entire objects. The complexity and novelty of our stimuli suggest that the oculomotor system dynamically receives visual/cognitive information processed in the higher order representational networks of the cortical visual processing hierarchy and integrates this information for saccadic movement planning.

Visual attention is not deployed at the endpoint of averaging saccades

The premotor theory of attention postulates that spatial attention arises from the activation of saccade areas and that the deployment of attention is the consequence of motor programming. Yet attentional and oculomotor processes have been shown to be dissociable at the neuronal level in covert attention tasks. To investigate a potential dissociation at the behavioral level, we instructed human participants to move their eyes (saccade) towards 1 of 2 nearby, competing saccade targets. The spatial distribution of visual attention was determined using oriented visual stimuli presented either at the target locations, between them, or at several other equidistant locations. Results demonstrate that accurate saccades towards one of the targets were associated with presaccadic enhancement of visual sensitivity at the respective saccade endpoint compared to the nonsaccaded target location. In contrast, averaging saccades, landing between the 2 targets, were not associated with attentional facilitation at the saccade endpoint. Rather, attention before averaging saccades was equally deployed at the 2 target locations. Taken together, our results reveal that visual attention is not obligatorily coupled to the endpoint of a subsequent saccade. Rather, our results suggest that the oculomotor program depends on the state of attentional selection before saccade onset and that saccade averaging arises from unresolved attentional selection.

The premotor theory of attention postulates that spatial visual attention is a consequence of the brain activity that controls eye movement. Indeed, attention and eye movement share overlapping brain networks, and attention is deployed at the target of an eye movement (saccade) even before the eyes start to move. But is attention always deployed at the endpoint of saccades? Here, we measured visual attention before accurate saccades and before saccades that landed in between 2 targets (averaging saccades). While accurate saccades were associated with a selective enhancement of visual sensitivity at their endpoint, no such enhancement was found at the endpoint of averaging saccades. Rather, visual sensitivity was evenly distributed across the 2 saccade targets, suggesting that saccade averaging arises from unresolved attentional selection. Overall, our results reveal that attention is not always coupled to the endpoint of saccades, arguing against a simplistic view of the premotor theory of attention at the behavioral level. Instead, we propose that saccadic responses depend on the state of attentional selection at saccade onset.

The profile of attention differs between locations orthogonal to and in line with reach direction

People make movements in a variety of directions when interacting with the world around them. It has been well documented that attention shifts to the goal of an upcoming movement, whether the movement is a saccade or a reach. However, recent evidence suggests that the direction of a movement may influence the spatial spread of attention (Stewart & Ma-Wyatt, 2015, Journal of Vision, 15(5), 10). We investigated whether the spatiotemporal profile of attention differs depending on where that location is situated relative to the direction of movement, and if this pattern is consistent across different movement effectors. We compared attentional facilitation at locations in line with or orthogonal to the movement, for reach-only, reach-plus-saccade, and saccade-only conditions. Results show that the spatiotemporal profile of attention differs across different movement combinations, and is also different at target locations orthogonal to and in line with the movement direction. Specifically, when a reach alone was made, there was a general decrease in attention at all locations during the movement and a general increase in attention at all locations with a saccade only. However, the concurrent reach and saccade condition showed a premovement attentional facilitation at locations orthogonal to movement direction, but not those in line with the movement direction. These results suggest attentional guidance may be more important at differing time points, depending on the type of movement.

Changes to online control and eye-hand coordination with healthy ageing

Goal directed movements are typically accompanied by a saccade to the target location. Online control plays an important part in correction of a reach, especially if the target or goal of the reach moves during the reach. While there are notable changes to visual processing and motor control with healthy ageing, there is limited evidence about how eye-hand coordination during online updating changes with healthy ageing. We sought to quantify differences between older and younger people for eye-hand coordination during online updating. Participants completed a double step reaching task implemented under time pressure. The target perturbation could occur 200, 400 and 600 ms into a reach. We measured eye position and hand position throughout the trials to investigate changes to saccade latency, movement latency, movement time, reach characteristics and eye-hand latency and accuracy. Both groups were able to update their reach in response to a target perturbation that occurred at 200 or 400 ms into the reach. All participants demonstrated incomplete online updating for the 600 ms perturbation time. Saccade latencies, measured from the first target presentation, were generally longer for older participants. Older participants had significantly increased movement times but there was no significant difference between groups for touch accuracy. We speculate that the longer movement times enable the use of new visual information about the target location for online updating towards the end of the movement. Interestingly, older participants also produced a greater proportion of secondary saccades within the target perturbation condition and had generally shorter eye-hand latencies. This is perhaps a compensatory mechanism as there was no significant group effect on final saccade accuracy. Overall, the pattern of results suggests that online control of movements may be qualitatively different in older participants.

The fate of nonselected activity in saccadic decisions: distinct goal-related and history-related modulation

The global effect (GE) traditionally refers to the tendency of effectors (e.g., hand, eyes) to first land in between two nearby stimuli, forming a unimodal distribution. By measuring a shift of this distribution, recent studies used the GE to assess the presence of decision-related inputs on the motor map for eye movements. However, this method cannot distinguish whether one stimulus is inhibited or the other is facilitated and could not detect situations where both stimuli are inhibited or facilitated. Here, we detect deviations in the bimodal distribution of landing positions for remote stimuli and find that this bimodal GE reveals the presence, location, and polarity (facilitation or inhibition) of history-related and goal-related modulation of the nonselected activity (e.g., the distractor activity in correct trials, and the target activity in error trials). We tested, for different interstimulus distances, the effect of the rarity of double-stimulus trials and the difference between performing a discrimination task compared with free choice. Our work shows that the effect of rarity is symmetric and decreases with interstimulus distances, while the effect of goal-directed discrimination is asymmetric - occurring only when the distractor is selected for the saccade - and maintained across interstimulus distances. These results suggest that the former effect changes the response property of the motor map, while the latter specifically facilitates the target location. NEW & NOTEWORTHY Deviations in landing positions for saccades to targets and distractors reveal the presence, location and polarity of history-related or goal-related signals. Goal-directed discrimination appears to facilitate the target location, rather than inhibiting the distractor location, Rare occurrence of a choice appears to indiscriminately increase the neural response for both locations.

Action history influences subsequent movement via two distinct processes

The characteristics of goal-directed actions tend to resemble those of previously executed actions, but it is unclear whether such effects depend strictly on action history, or also reflect context-dependent processes related to predictive motor planning. Here we manipulated the time available to initiate movements after a target was specified, and studied the effects of predictable movement sequences, to systematically dissociate effects of the most recently executed movement from the movement required next. We found that directional biases due to recent movement history strongly depend upon movement preparation time, suggesting an important contribution from predictive planning. However predictive biases co-exist with an independent source of bias that depends only on recent movement history. The results indicate that past experience influences movement execution through a combination of temporally-stable processes that are strictly use-dependent, and dynamically-evolving and context-dependent processes that reflect prediction of future actions.

Individual differences in responsivity to social rewards: Insights from two eye-tracking tasks

Humans generally prefer social over nonsocial stimuli from an early age. Reduced preference for social rewards has been observed in individuals with autism spectrum conditions (ASC). This preference has typically been noted in separate tasks that measure orienting toward and engaging with social stimuli. In this experiment, we used two eye-tracking tasks to index both of these aspects of social preference in in 77 typical adults. We used two measures, global effect and preferential looking time. The global effect task measures saccadic deviation toward a social stimulus (related to ‘orienting’), while the preferential looking task records gaze duration bias toward social stimuli (relating to ‘engaging’). Social rewards were found to elicit greater saccadic deviation and greater gaze duration bias, suggesting that they have both greater salience and higher value compared to nonsocial rewards. Trait empathy was positively correlated with the measure of relative value of social rewards, but not with their salience. This study thus elucidates the relationship of empathy with social reward processing.

Identification of opposites and intermediates by eye and by hand

In this eye-tracking and drawing study, we investigate the perceptual grounding of different types of spatial dimensions such as dense-sparse and top-bottom, focusing both on the participants' experiences of the opposite regions, e.g., O1: dense; O2: sparse, and the region that is experienced as intermediate, e.g., INT: neither dense nor sparse. Six spatial dimensions expected to have three different perceptual structures in terms of the point and range nature of O1, INT and O2 were analysed. Presented with images, the participants were instructed to identify each region (O1, INT, O2), first by looking at the region, and then circumscribing it using the computer mouse. We measured the eye movements, identification times and various characteristics of the drawings such as the relative size of the three regions, overlaps and gaps. Three main results emerged. Firstly, generally speaking, intermediate regions were not different from the poles on any of the indicators: overall identification times, number of fixations, and locations. Some differences emerged with regard to the duration of fixations for point INTs and the number of fixations for range INTs between two range poles (O1, O2). Secondly, the analyses of the fixation locations showed that the poles support the identification of the intermediate region as much as the intermediate region supports the identification of the poles. Finally, the relative size of the three areas selected in the drawing task were consistent with the classification of the regions as points or ranges. The analyses of the gaps and the overlaps between the three areas showed that the intermediate is neither O1 nor O2, but an entity in its own right.

Accuracy of eye position for saccades and smooth pursuit

In this study, we address the question of whether a target is foveated during smooth pursuit. Specifically, we examine whether smooth pursuit eye movements land near the center-of-mass of the target, as is the case for saccades. To that end, we instructed eight untrained, healthy participants to follow moving targets, presented monocularly in a scanning laser ophthalmoscope. Stimuli moved either in a modified step-ramp (smooth pursuit), or made a single step (saccade), stepping 6° from the center. Targets were ring-shaped and either 0.6° or 1.7° in diameter. In an additional set of experiments, two participants collected more extensive data on smooth pursuit and saccades for a larger range of target sizes (0.6°, 1.7°, or 4.3°). During pursuit, eyes were rarely placed at target center, even when participants' fixational stability was taken into account. Furthermore, there was a clear tendency for distance from target center to increase with target size. This outcome was in contrast to saccades, where there was no effect of target size across participants. The difference in foveal placement between the two types of eye movements is consistent with their different purposes: closer inspection of the target for saccades versus maintenance of the target in the visual field for smooth pursuit.

Automatic and intentional influences on saccade landing

Saccadic eye movements enable us to rapidly direct our high-resolution fovea onto relevant parts of the visual world. However, while we can intentionally select a location as a saccade target, the wider visual scene also influences our executed movements. In the presence of multiple objects, eye movements may be "captured" to the location of a distractor object, or be biased toward the intermediate position between objects (the "global effect"). Here we examined how the relative strengths of the global effect and visual object capture changed with saccade latency, the separation between visual items and stimulus contrast. Importantly, while many previous studies have omitted giving observers explicit instructions, we instructed participants to either saccade to a specified target object or to the midpoint between two stimuli. This allowed us to examine how their explicit movement goal influenced the likelihood that their saccades terminated at either the target, distractor, or intermediate locations. Using a probabilistic mixture model, we found evidence that both visual object capture and the global effect co-occurred at short latencies and declined as latency increased. As object separation increased, capture came to dominate the landing positions of fast saccades, with reduced global effect. Using the mixture model fits, we dissociated the proportion of unavoidably captured saccades to each location from those intentionally directed to the task goal. From this we could extract the time course of competition between automatic capture and intentional targeting. We show that task instructions substantially altered the distribution of saccade landing points, even at the shortest latencies.NEW & NOTEWORTHY When making an eye movement to a target location, the presence of a nearby distractor can cause the saccade to unintentionally terminate at the distractor itself or the average position in between stimuli. With probabilistic mixture models, we quantified how both unavoidable capture and goal-directed targeting were influenced by changing the task and the target-distractor separation. Using this novel technique, we could extract the time course over which automatic and intentional processes compete for control of saccades.

Motor planning flexibly optimizes performance under uncertainty about task goals

In an environment full of potential goals, how does the brain determine which movement to execute? Existing theories posit that the motor system prepares for all potential goals by generating several motor plans in parallel. One major line of evidence for such theories is that presenting two competing goals often results in a movement intermediate between them. These intermediate movements are thought to reflect an unintentional averaging of the competing plans. However, normative theories suggest instead that intermediate movements might actually be deliberate, generated because they improve task performance over a random guessing strategy. To test this hypothesis, we vary the benefit of making an intermediate movement by changing movement speed. We find that participants generate intermediate movements only at (slower) speeds where they measurably improve performance. Our findings support the normative view that the motor system selects only a single, flexible motor plan, optimized for uncertain goals.

The effect of object-centered instructions in Cartesian and polar coordinates on saccade vector

Express saccades (ES) are the most reflexive saccadic eye movements, with very short reaction times of 70-110 ms. It is likely that ES have the shortest saccade reaction times (SRTs) possible given the known physiological and anatomical delays present in sensory and motor systems. Nevertheless, it has been demonstrated that a vector displacement of ES to spatially extended stimuli can be influenced by spatial cognition. Edelman, Kristjansson, and Nakayama (2007) found that when two horizontally separated visual stimuli appear at a random location, the spatial vector, but not the reaction time, of human ES is strongly influenced by an instruction to make a saccade to one side (either left or right) of a visual stimulus array. Presently, we attempt to extend these findings of cognitive effects on saccades in three ways: (a) determining whether ES could be affected by other types of spatial instructions: vertical, polar amplitude, and polar direction; (b) determining whether these spatial effects increased with practice; and (c) determining how these effects depended on SRTs. The results demonstrate that both types of Cartesian as well as polar amplitude instructions strongly affect ES vector, but only modestly affect SRTs. Polar direction instructions had sizable effects only on nonreflexive saccades where the visual stimuli could be viewed for several hundred milliseconds prior to saccade execution. Short- (trial order within a block) and long-term (experience across several sessions) practice had little effect, though the effect of instruction increased with SRT. Such findings suggest a generalized, innate ability of cognition to affect the most reflexive saccadic eye movements.

Robust sampling of decision information during perceptual choice

Humans move their eyes to gather information about the visual world. However, saccadic sampling has largely been explored in paradigms that involve searching for a lone target in a cluttered array or natural scene. Here, we investigated the policy that humans use to overtly sample information in a perceptual decision task that required information from across multiple spatial locations to be combined. Participants viewed a spatial array of numbers and judged whether the average was greater or smaller than a reference value. Participants preferentially sampled items that were less diagnostic of the correct answer ("inlying" elements; that is, elements closer to the reference value). This preference to sample inlying items was linked to decisions, enhancing the tendency to give more weight to inlying elements in the final choice ("robust averaging"). These findings contrast with a large body of evidence indicating that gaze is directed preferentially to deviant information during natural scene viewing and visual search, and suggest that humans may sample information "robustly" with their eyes during perceptual decision-making.

Looking for symmetry: fixational eye movements are biased by image mirror symmetry

Humans are highly sensitive to symmetry. During scene exploration, the area of the retina with dense light receptor coverage acquires most information from relevant locations determined by gaze fixation. We characterized patterns of fixational eye movements made by observers staring at synthetic scenes either freely (i.e., free exploration) or during a symmetry orientation discrimination task (i.e., active exploration). Stimuli could be mirror-symmetric or not. Both free and active exploration generated more saccades parallel to the axis of symmetry than along other orientations. Most saccades were small (<2°), leaving the fovea within a 4° radius of fixation. Analysis of saccade dynamics showed that the observed parallel orientation selectivity emerged within 500 ms of stimulus onset and persisted throughout the trials under both viewing conditions. Symmetry strongly distorted existing anisotropies in gaze direction in a seemingly automatic process. We argue that this bias serves a functional role in which adjusted scene sampling enhances and maintains sustained sensitivity to local spatial correlations arising from symmetry.

Revisiting the global effect and inhibition of return

Saccades toward previously cued locations have longer latencies than saccades toward other locations, a phenomenon known as inhibition of return (IOR). Watanabe (Exp Brain Res 138:330–342. doi:10.1007/s002210100709, 2001) combined IOR with the global effect (where saccade landing points fall in between neighboring objects) to investigate whether IOR can also have a spatial component. When one of two neighboring targets was cued, there was a clear bias away from the cued location. In a condition where both targets were cued, it appeared that the global effect magnitude was similar to the condition without any cues. However, as the latencies in the double cue condition were shorter compared to the no cue condition, it is still an open question whether these results are representative for IOR. Considering the double cue condition can provide valuable insight into the interaction of the mechanisms underlying the two phenomena, here, we revisit this condition in an adapted paradigm. Our paradigm does result in longer latencies for the cued locations, and we find that the magnitude of the global effect is reduced significantly. Unexpectedly, this holds even when only including saccades with the same latencies for both conditions. Thus, the increased latencies associated with IOR cannot directly explain the reduction in global effect. The global effect reduction can likely best be seen as either a result of short-term depression of exogenous visual signals or a result of IOR established at the center of gravity of cues.

Oculomotor interference of bimodal distractors

•

Bimodal distractors evoked more oculomotor competition than unimodal distractors.

•

The direction of interference was dependent on the spatial layout of the scene.

•

Close distractors cause deviation towards, remote distractors cause deviation away.

•

Saccade averaging and trajectory deviation were similarly affected by distractors.

•

Interfering effects were most pronounced in the spatial domain.

When executing an eye movement to a target location, the presence of an irrelevant distracting stimulus can influence the saccade metrics and latency. The present study investigated the influence of distractors of different sensory modalities (i.e. auditory, visual and audiovisual) which were presented at various distances (i.e. close or remote) from a visual target. The interfering effects of a bimodal distractor were more pronounced in the spatial domain than in the temporal domain. The results indicate that the direction of interference depended on the spatial layout of the visual scene. The close bimodal distractor caused the saccade endpoint and saccade trajectory to deviate towards the distractor whereas the remote bimodal distractor caused a deviation away from the distractor. Furthermore, saccade averaging and trajectory deviation evoked by a bimodal distractor was larger compared to the effects evoked by a unimodal distractor. This indicates that a bimodal distractor evoked stronger spatial oculomotor competition compared to a unimodal distractor and that the direction of the interference depended on the distance between the target and the distractor. Together, these findings suggest that the oculomotor vector to irrelevant bimodal input is enhanced and that the interference by multisensory input is stronger compared to unisensory input.

Eye Movements Reveal the Spatiotemporal Dynamics of Visual Search

Given that attention precedes an eye movement to a target it becomes possible to use fixation sequences to probe the spatiotemporal dynamics of search Applying this method to a realistic search task, we found eye movements directed to the geometric centers of progressively smaller groups of objects rather than accurate fixations to individual objects in a display Such a binary search strategy is consistent with zoom-lens models positing an initially broad distribution of search, followed by a narrowing of this search region until only the target is selected We also interpret this oculomotor averaging behavior as evidence for an initially parallel search analysis that becomes increasingly serial as the search process converges on the target

Can we resist another person's gaze?

Adaptive adjustments of strategies are needed to optimize behavior in a dynamic and uncertain world. A key function in implementing flexible behavior and exerting self-control is represented by the ability to stop the execution of an action when it is no longer appropriate for the environmental requests. Importantly, stimuli in our environment are not equally relevant and some are more valuable than others. One example is the gaze of other people, which is known to convey important social information about their direction of attention and their emotional and mental states. Indeed, gaze direction has a significant impact on the execution of voluntary saccades of an observer since it is capable of inducing in the observer an automatic gaze-following behavior: a phenomenon named social or joint attention. Nevertheless, people can exert volitional inhibitory control on saccadic eye movements during their planning. Little is known about the interaction between gaze direction signals and volitional inhibition of saccades. To fill this gap, we administered a countermanding task to 15 healthy participants in which they were asked to observe the eye region of a face with the eyes shut appearing at central fixation. In one condition, participants were required to suppress a saccade, that was previously instructed by a gaze shift toward one of two peripheral targets, when the eyes were suddenly shut down (social condition, SC). In a second condition, participants were asked to inhibit a saccade, that was previously instructed by a change in color of one of the two same targets, when a change of color of a central picture occurred (non-social condition, N-SC). We found that inhibitory control was more impaired in the SC, suggesting that actions initiated and stopped by social cues conveyed by the eyes are more difficult to withhold. This is probably due to the social value intrinsically linked to these cues and the many uses we make of them.

Optimal and human eye movements to clustered low value cues to increase decision rewards during search

Rewards have important influences on the motor planning of primates and the firing of neurons coding visual information and action. When eye movements to a target are differentially rewarded across locations, primates execute saccades towards the possible target location with the highest expected value, a product of sensory evidence and potentially earned reward (saccade to maximum expected value model, sMEV). Yet, in the natural world eye movements are not directly rewarded. Their role is to gather information to support subsequent rewarded search decisions and actions. Less is known about the effects of decision rewards on saccades. We show that when varying the decision rewards across cued locations following visual search, humans can plan their eye movements to increase decision rewards. Critically, we report a scenario for which five of seven tested humans do not preferentially deploy saccades to the possible target location with the highest reward, a strategy which is optimal when rewarding eye movements. Instead, these humans make saccades towards lower value but clustered locations when this strategy optimizes decision rewards consistent with the preferences of an ideal Bayesian reward searcher that takes into account the visibility of the target across eccentricities. The ideal reward searcher can be approximated with a sMEV model with pooling of rewards from spatially clustered locations. We also find observers with systematic departures from the optimal strategy and inter-observer variability of eye movement plans. These deviations often reflect multiplicity of fixation strategies that lead to near optimal decision rewards but, for some observers, it relates to suboptimal choices in eye movement planning.

Reward modulates oculomotor competition between differently valued stimuli

The present work explored the effects of reward in the well-known global effect paradigm in which two objects appear simultaneously in close spatial proximity. The experiment consisted of three phases (i) a pre-training phase that served as a baseline, (ii) a reward-training phase to associate differently colored stimuli with high, low and no reward value, and (iii) a post-training phase in which rewards were no longer delivered, to examine whether objects previously associated with higher reward value attracted the eyes more strongly than those associated with low or no reward value. Unlike previous reward studies, the differently valued objects directly competed with each other on the same trial. The results showed that initially eye movements were not biased towards any particular stimulus, while in the reward-training phase, eye movements started to land progressively closer towards stimuli that were associated with a high reward value. Even though rewards were no longer delivered, this bias remained robustly present in the post-training phase. A time course analysis showed that the effect of reward was present for the fastest saccades (around 170 ms) and increased with increasing latency. Although strategic effects for slower saccades cannot be ruled out, we suggest that fast oculomotor responses became habituated and were no longer under strategic attentional control. Together the results imply that reward affects oculomotor competition in favor of stimuli previously associated high reward, when multiple reward associated objects compete for selection.

Cost-sensitive Bayesian control policy in human active sensing

An important but poorly understood aspect of sensory processing is the role of active sensing, the use of self-motion such as eye or head movements to focus sensing resources on the most rewarding or informative aspects of the sensory environment. Here, we present behavioral data from a visual search experiment, as well as a Bayesian model of within-trial dynamics of sensory processing and eye movements. Within this Bayes-optimal inference and control framework, which we call C-DAC (Context-Dependent Active Controller), various types of behavioral costs, such as temporal delay, response error, and sensor repositioning cost, are explicitly minimized. This contrasts with previously proposed algorithms that optimize abstract statistical objectives such as anticipated information gain (Infomax) (Butko and Movellan, 2010) and expected posterior maximum (greedy MAP) (Najemnik and Geisler, 2005). We find that C-DAC captures human visual search dynamics better than previous models, in particular a certain form of "confirmation bias" apparent in the way human subjects utilize prior knowledge about the spatial distribution of the search target to improve search speed and accuracy. We also examine several computationally efficient approximations to C-DAC that may present biologically more plausible accounts of the neural computations underlying active sensing, as well as practical tools for solving active sensing problems in engineering applications. To summarize, this paper makes the following key contributions: human visual search behavioral data, a context-sensitive Bayesian active sensing model, a comparative study between different models of human active sensing, and a family of efficient approximations to the optimal model.

An inverse Yarbus process: predicting observers' task from eye movement patterns

In this paper we develop a probabilistic method to infer the visual-task of a viewer given measured eye movement trajectories. This method is based on the theory of hidden Markov models (HMM) that employs a first order Markov process to predict the coordinates of fixations given the task. The prediction confidence level of each task-dependent model is used in a Bayesian inference formulation, whereby the task with the maximum a posteriori (MAP) probability is selected. We applied this technique to a challenging dataset consisting of eye movement trajectories obtained from subjects viewing monochrome images of real scenes tasked with answering questions regarding the scenes. The results show that the HMM approach, combined with a clustering technique, can be a reliable way to infer visual-task from eye movements data.

On the reduced influence of contour on saccade metrics and its competition with stimulus size

It is well known that the metrical properties of saccadic eye movements are strongly influenced by the extraction of low-level visual features (e.g., luminance). Higher-level visual features (e.g., contour) also play a role, but their relative contribution and time course remain undetermined. Here, we investigated this issue, by testing the influence of contour on saccade metrics. We used a saccade-targeting task in which a peripheral target was, on some trials, simultaneously displayed with a less eccentric distractor. This paradigm is known to yield a global effect, that is a deviation of the eyes towards an intermediate location between the stimuli. The novelty was to test whether this effect would vary with the alignment of the distractor's elementary features. Distractors were of high vs. low luminance, and composed of 16 pixels that were either aligned or misaligned by 0.23° or 0.43°. Our prediction, under the hypothesis that contour intervenes, was that aligned distractors, which formed a definite contour, would deviate the eyes more strongly than misaligned distractors. On the contrary, we found that distractors of high luminance produced greater eye deviations when they were misaligned, and hence more largely spread, than when they were aligned. Furthermore, low-luminance distractors deviated the eyes to the same extent irrespective of their alignment, though showing a reversed, contour-like, effect of alignment for early-triggered saccades. We proposed that contour has only limited influence on saccade metrics, when other, lower-level and more salient visual features, such as the extent of the stimulus pattern, are available.

Monetary reward speeds up voluntary saccades

Past studies have shown that reward contingency is critical for sensorimotor learning, and reward expectation speeds up saccades in animals. Whether monetary reward speeds up saccades in human remains unknown. Here we addressed this issue by employing a conditional saccade task, in which human subjects performed a series of non-reflexive, visually-guided horizontal saccades. The subjects were (or were not) financially compensated for making a saccade in response to a centrally-displayed visual congruent (or incongruent) stimulus. Reward modulation of saccadic velocities was quantified independently of the amplitude-velocity coupling. We found that reward expectation significantly sped up voluntary saccades up to 30°/s, and the reward modulation was consistent across tests. These findings suggest that monetary reward speeds up saccades in human in a fashion analogous to how juice reward sped up saccades in monkeys. We further noticed that the idiosyncratic nasal-temporal velocity asymmetry was highly consistent regardless of test order, and its magnitude was not correlated with the magnitude of reward modulation. This suggests that reward modulation and the intrinsic velocity asymmetry may be governed by separate mechanisms that regulate saccade generation.

Spatial ranking strategy and enhanced peripheral vision discrimination optimize performance and efficiency of visual sequential search

Visual sequential search might use a peripheral spatial ranking of the scene to put the next target of the sequence in the correct order. This strategy, indeed, might enhance the discriminative capacity of the human peripheral vision and spare neural resources associated with foveation. However, it is not known how exactly the peripheral vision sustains sequential search and whether the sparing of neural resources has a cost in terms of performance. To elucidate these issues, we compared strategy and performance during an alpha-numeric sequential task where peripheral vision was modulated in three different conditions: normal, blurred, or obscured. If spatial ranking is applied to increase the peripheral discrimination, its use as a strategy in visual sequencing should differ according to the degree of discriminative information that can be obtained from the periphery. Moreover, if this strategy spares neural resources without impairing the performance, its use should be associated with better performance. We found that spatial ranking was applied when peripheral vision was fully available, reducing the number and time of explorative fixations. When the periphery was obscured, explorative fixations were numerous and sparse; when the periphery was blurred, explorative fixations were longer and often located close to the items. Performance was significantly improved by this strategy. Our results demonstrated that spatial ranking is an efficient strategy adopted by the brain in visual sequencing to highlight peripheral detection and discrimination; it reduces the neural cost by avoiding unnecessary foveations, and promotes sequential search by facilitating the onset of a new saccade.

Centre-of-Gravity Fixations in Visual Search: When Looking at Nothing Helps to Find Something

In visual search, some fixations are made between stimuli on empty regions, commonly referred to as "centre-of-gravity" fixations (henceforth: COG fixations). Previous studies have shown that observers with task expertise show more COG fixations than novices. This led to the view that COG fixations reflect simultaneous encoding of multiple stimuli, allowing more efficient processing of task-related items. The present study tested whether COG fixations also aid performance in visual search tasks with unfamiliar and abstract stimuli. Moreover, to provide evidence for the multiple-item processing view, we analysed the effects of COG fixations on the number and dwell times of stimulus fixations. The results showed that (1) search efficiency increased with increasing COG fixations even in search for unfamiliar stimuli and in the absence of special higher-order skills, (2) COG fixations reliably reduced the number of stimulus fixations and their dwell times, indicating processing of multiple distractors, and (3) the proportion of COG fixations was dynamically adapted to potential information gain of COG locations. A second experiment showed that COG fixations are diminished when stimulus positions unpredictably vary across trials. Together, the results support the multiple-item processing view, which has important implications for current theories of visual search.

Effects of multiple stimuli on ocular orientation by cats

We investigated the characteristics of saccades made by cats in response to single and double stimuli. Stimuli were either visual, auditory, or bimodal. We initially trained cats to look toward the location of briefly presented single visual or single auditory targets that were extinguished before the initiation of eye movements. Following training, we monitored eye movements during and after the presentation of double targets, either two visual, two auditory, or bimodal, that were at disparate spatial locations. Cats made saccadic eye movements to positions that ranged between the location of the two targets. If the eye position at the start of a saccade was near the mid point of the targets, cats were less likely to initiate a saccade, and saccadic latencies were longer, compared to when starting eye position was at a distance from this location. These behavioral results are consistent with the hypothesis that the neural representations of briefly presented targets are combined and treated as a unitary, low resolution stimulus from which an orienting motor program is derived. The similarity of responses to double visual, double auditory, and bimodal stimuli suggests that a common sensorimotor mechanism applies within and between these sensory modalities.

The visual system prioritizes locations near corners of surfaces (not just locations near a corner)

When a new visual object appears, attention is directed toward it. However, some locations along the outline of the new object may receive more resources, perhaps as a consequence of their relative importance in describing its shape. Evidence suggests that corners receive enhanced processing, relative to the straight edges of an outline (corner enhancement effect). Using a technique similar to that in an original study in which observers had to respond to a probe presented near a contour (Cole et al. in Journal of Experimental Psychology: Human Perception and Performance 27:1356-1368, 2001), we confirmed this effect. When figure-ground relations were manipulated using shaded surfaces (Exps. 1 and 2) and stereograms (Exps. 3 and 4), two novel aspects of the phenomenon emerged: We found no difference between corners perceived as being convex or concave, and we found that the enhancement was stronger when the probe was perceived as being a feature of the surface that the corner belonged to. Therefore, the enhancement is not based on spatial aspects of the regions in the image, but critically depends on figure-ground stratification, supporting the link between the prioritization of corners and the representation of surface layout.

How global is the global effect? The spatial characteristics of saccade averaging

When a target and a distractor are presented in close proximity, an eye movement will generally land in between these two elements. This is known as the 'global effect' and has been claimed to be a reflection of the averaged saccade programs towards both locations. The aim of the present study was to systematically investigate whether there is only a limited area in the saccade map in which saccade averaging occurs. To this end, we examined various distances between target and distractor in two experiments and investigated whether the majority of eye movements landed in between the target and the distractor. Results indicated that the endpoint distribution was unimodal for distances up to 35° (in polar coordinates), with saccades generally landing in between the target and the distractor. When the distance was higher than 45°, the saccade endpoint distribution was predominantly bimodal, with saccades landing either on the target or on the distractor. The decrease in saccade averaging was linear until almost no averaging saccades were observed for the longest distances. As saccades landing in between target and distractor reflect a weak, or absent, top-down signal, the present study indicated that top-down information is unable to strongly influence the oculomotor system when target and distractor are presented in close proximity. In this situation, the resulting eye movement is determined by the weighted average of saccade vectors present in a restricted region in the motor map.