Parallel programming of saccades in the macaque frontal eye field: are sequential motor plans coactivated?

Inferential eye movement control while following dynamic gaze

Attending to other people's gaze is evolutionary important to make inferences about intentions and actions. Gaze influences covert attention and triggers eye movements. However, we know little about how the brain controls the fine-grain dynamics of eye movements during gaze following. Observers followed people's gaze shifts in videos during search and we related the observer eye movement dynamics to the time course of gazer head movements extracted by a deep neural network. We show that the observers' brains use information in the visual periphery to execute predictive saccades that anticipate the information in the gazer's head direction by 190-350ms. The brain simultaneously monitors moment-to-moment changes in the gazer's head velocity to dynamically alter eye movements and re-fixate the gazer (reverse saccades) when the head accelerates before the initiation of the first forward gaze-following saccade. Using saccade-contingent manipulations of the videos, we experimentally show that the reverse saccades are planned concurrently with the first forward gaze-following saccade and have a functional role in reducing subsequent errors fixating on the gaze goal. Together, our findings characterize the inferential and functional nature of social attention's fine-grain eye movement dynamics.

Contextual saccade adaptation induced by sequential saccades

Saccade adaptation is the gradual adjustment of saccade end point to maintain spatial accuracy. Contextual adaptation refers to a situation in which the adaptation-related change in saccade end point is contingent on the behavioral context in which the saccade is made. For example, in some situations, the same saccade to the same retinotopic location can be simultaneously adapted in opposite directions depending on the context in which it is made. Saccade adaptation has traditionally been studied in isolated movements, but in everyday life, saccades are often planned and executed in sequences. The oculomotor system may therefore have adaptive mechanisms specific to sequential saccades. Here, in five experiments, we investigated contextual saccade adaptation in sequences of saccades. In the first experiment, we demonstrate that saccades to a given retinotopic location can be simultaneously adapted in opposite directions depending on whether they occur in isolation or in a sequence. In the other experiments, we measured the extent to which properties of the previous and following saccades in a sequence can induce contextual saccade adaptation. Overall, we find that the existence, direction, and amplitude of previous and subsequent saccades, as well as the order of the current saccade within a movement sequence, can all induce contextual adaptation. These novel findings demonstrate the surprising flexibility of the system in maintaining end point accuracy, and support the idea that saccades made in a movement sequence are planned concurrently rather than independently.NEW & NOTEWORTHY This study reveals a new type of contextual saccade adaptation: sequential saccades are able to induce contextual saccade adaptation when direction, amplitude, or the existence of preceding and following saccades are used as contexts. These novel findings are also consistent with the idea that saccades made in a sequence are planned concurrently rather than independently.

Neural mechanisms underlying the temporal control of sequential saccade planning in the frontal eye field

Sequences of saccadic eye movements are instrumental in navigating our visual environment. While neural activity has been shown to ramp up to a threshold before single saccades, the neural underpinnings of multiple saccades is unknown. To understand the neural control of saccade sequences, we recorded from the frontal eye field (FEF) of macaque monkeys while they performed a sequential saccade task. We show that the concurrent planning of two saccade plans brings forth processing bottlenecks, specifically by decreasing the growth rate and increasing the threshold of saccade-related ramping activity. The rate disruption affected both saccade plans, and a computational model, wherein activity related to the two saccade plans mutually and asymmetrically inhibited each other, predicted the behavioral and neural results observed experimentally. Borrowing from models in psychology, our results demonstrate a capacity-sharing mechanism of processing bottlenecks, wherein multiple saccade plans in a sequence compete for the processing capacity by the perturbation of the saccade-related ramping activity. Finally, we show that, in contrast to movement-related neurons, visual activity in FEF neurons is not affected by the presence of multiple saccade targets, indicating that, for perceptually simple tasks, inhibition within movement-related neurons mainly instantiates capacity sharing. Taken together, we show how psychology-inspired models of capacity sharing can be mapped onto neural responses to understand the control of rapid saccade sequences.

Dynamic encoding of saccade sequences in primate frontal eye field

The frontal eye field (FEF) is a key part of the oculomotor system, with dominant responses to the direction of single saccades. However, whether and how FEF contributes to sequential saccades remain largely unknown. By training rhesus monkeys to perform saccade sequences, we found sequence-related activities in FEF neurons, whose selectivity to saccade direction undergoes dynamic changes during sequential vs. single saccades. These sequence-related activities are context-dependent, exhibiting different firing activities during memory- vs. visually guided sequences. When the monkey was performing the sequential saccade task, the thresholds of microstimulation to evoke saccades in FEF were increased and the percentage of the successfully induced saccades was significantly reduced compared with the fixation condition. Pharmacological inactivation of FEF impaired the monkey's performance of previously learned sequential saccades, with different effects on the same actions depending on its position within the sequence. These results reveal the context-dependent, sequence-specific dynamic encoding of saccades in FEF, and underscore the crucial role of FEF in the planning and execution of sequential saccades. KEY POINTS: FEF neurons respond differently during sequential vs. single saccades Sequence-related FEF activity is context-dependent The microstimulation threshold in FEF was increased during the sequential task but the evoked saccade did not alter the sequence structure FEF inactivation severely impaired the performance of sequential saccades.

Neural correlates of goal-directed and non-goal-directed movements

What are the cortical neural correlates that distinguish goal-directed and non-goal-directed movements? We investigated this question in the monkey frontal eye field (FEF), which is implicated in voluntary control of saccades. Here, we compared FEF activity associated with goal-directed (G) saccades and non-goal-directed (nG) saccades made by the monkey. Although the FEF neurons discharged before these nG saccades, there were three major differences in the neural activity: First, the variability in spike rate across trials decreased only for G saccades. Second, the local field potential beta-band power decreased during G saccades but did not change during nG saccades. Third, the time from saccade direction selection to the saccade onset was significantly longer for G saccades compared with nG saccades. Overall, our results reveal unexpected differences in neural signatures for G versus nG saccades in a brain area that has been implicated selectively in voluntary control. Taken together, these data add critical constraints to the way we think about saccade generation in the brain.

Competitive state of movements during planning predicts sequence performance

Humans can learn and produce skilled movement sequences from memory, yet the nature of sequence planning is not well understood. Previous computational and neurophysiological work suggests that movements in a sequence are planned as parallel graded activations and selected for output through competition. However, the relevance of this planning pattern to sequence production fluency and accuracy, as opposed to the temporal structure of sequences, is unclear. To resolve this question, we assessed the relative availability of constituent movements behaviorally during the preparation of motor sequences from memory. In three separate multisession experiments, healthy participants were trained to retrieve and produce four-element finger press sequences with particular timing according to an abstract sequence cue. We evaluated reaction time (RT) and error rate as markers of movement availability to constituent movement probes. Our results demonstrate that longer preparation time produces more pronounced differences in availability between adjacent sequence elements, whereas no effect was found for sequence speed or temporal grouping. Further, participants with larger position-dependent differences in movement availability tended to initiate correct sequences faster and with a higher temporal accuracy. Our results suggest that competitive preactivation is established gradually during sequence planning and predicts sequence skill, rather than the temporal structure of the motor sequence.NEW & NOTEWORTHY Sequence planning is an integral part of motor sequence control. Here, we demonstrate that the competitive state of sequential movements during sequence planning can be read out behaviorally through movement probes. We show that position-dependent differences in movement availability during planning reflect sequence preparedness and skill but not the timing of the planned sequence. Behavioral access to the preparatory state of movements may serve as a marker of sequence planning capacity.