Neurons in the supplementary eye field of rhesus monkeys code visual targets and saccadic eye movements in an oculocentric coordinate system

Visual Attention in the Prefrontal Cortex

Voluntary attention selects behaviorally relevant signals for further processing while filtering out distracter signals. Neural correlates of voluntary visual attention have been reported across multiple areas of the primate visual processing streams, with the earliest and strongest effects isolated in the prefrontal cortex. In this article, I review evidence supporting the hypothesis that signals guiding the allocation of voluntary attention emerge in areas of the prefrontal cortex and reach upstream areas to modulate the processing of incoming visual information according to its behavioral relevance. Areas located anterior and dorsal to the arcuate sulcus and the frontal eye fields produce signals that guide the allocation of spatial attention. Areas located anterior and ventral to the arcuate sulcus produce signals for feature-based attention. Prefrontal microcircuits are particularly suited to supporting voluntary attention because of their ability to generate attentional template signals and implement signal gating and their extensive connectivity with the rest of the brain. Expected final online publication date for the Annual Review of Vision Science, Volume 8 is September 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

A Predictive Processing Model of Perception and Action for Self-Other Distinction

During interaction with others, we perceive and produce social actions in close temporal distance or even simultaneously. It has been argued that the motor system is involved in perception and action, playing a fundamental role in the handling of actions produced by oneself and by others. But how does it distinguish in this processing between self and other, thus contributing to self-other distinction? In this paper we propose a hierarchical model of sensorimotor coordination based on principles of perception-action coupling and predictive processing in which self-other distinction arises during action and perception. For this we draw on mechanisms assumed for the integration of cues for a sense of agency, i.e., the sense that an action is self-generated. We report results from simulations of different scenarios, showing that the model is not only able to minimize free energy during perception and action, but also showing that the model can correctly attribute sense of agency to own actions.

Neuronal Correlates of Serial Decision-Making in the Supplementary Eye Field

Human behavior is influenced by serial decision-making: past decisions affect choices that set the context for selecting future options. A primate brain region that may be involved in linking decisions across time is the supplementary eye field (SEF), which, in addition to its well known visual responses and saccade-related activity, also signals the rules that govern flexible decisions and the outcomes of those decisions. Our hypotheses were that SEF neurons encode events during serial decision-making and link the sequential decisions with sustained activity. We recorded from neurons in the SEF of two rhesus monkeys (Macaca mulatta, one male, one female) that performed a serial decision-making task. The monkeys used saccades to select a rule that had to be applied later in the same trial to discriminate between visual stimuli. We found, first, that SEF neurons encoded the spatial parameters of saccades during rule selection but not during visual discrimination, suggesting a malleability to their movement-related tuning. Second, SEF activity linked the sequential decisions of rule selection and visual discrimination, but not continuously. Instead, rule-encoding activity appeared in a "just-in-time" manner before the visual discrimination. Third, SEF neurons encoded trial outcomes both prospectively, before decisions within a trial, and retrospectively, across multiple trials. The results thus identify neuronal correlates of rule selection and application in the SEF, including transient signals that link these sequential decisions. Its activity patterns suggest that the SEF participates in serial decision-making in a contextually dependent manner as part of a broader network.SIGNIFICANCE STATEMENT Much research has gone into studying the neurobiological basis of single, isolated decisions. An important next step is to understand how the brain links multiple decisions to generate a coherent stream of thought and behavior. We studied neural activity related to serial decision-making in an area of frontal cortex known as the supplementary eye field (SEF). Neural recordings were conducted in monkeys that performed a serial decision-making task in which they selected and applied rules. We found that SEF neurons convey signals for serial decision-making, including transient encoding of one decision at the time it is needed for the next one and longer-term representations of trial outcomes, suggesting that the region plays a role in continuity of cognition and behavior.

Sustained Activity Encoding Working Memories: Not Fully Distributed

Working memory (WM) is the ability to remember and manipulate information for short time intervals. Recent studies have proposed that sustained firing encoding the contents of WM is ubiquitous across cortical neurons. We review here the collective evidence supporting this claim. A variety of studies report that neurons in prefrontal, parietal, and inferotemporal association cortices show robust sustained activity encoding the location and features of memoranda during WM tasks. However, reports of WM-related sustained activity in early sensory areas are rare, and typically lack stimulus specificity. We propose that robust sustained activity that can support WM coding arises as a property of association cortices downstream from the early stages of sensory processing.

Modeling eye-head gaze shifts in multiple contexts without motor planning

During gaze shifts, the eyes and head collaborate to rapidly capture a target (saccade) and fixate it. Accordingly, models of gaze shift control should embed both saccadic and fixation modes and a mechanism for switching between them. We demonstrate a model in which the eye and head platforms are driven by a shared gaze error signal. To limit the number of free parameters, we implement a model reduction approach in which steady-state cerebellar effects at each of their projection sites are lumped with the parameter of that site. The model topology is consistent with anatomy and neurophysiology, and can replicate eye-head responses observed in multiple experimental contexts: 1) observed gaze characteristics across species and subjects can emerge from this structure with minor parametric changes; 2) gaze can move to a goal while in the fixation mode; 3) ocular compensation for head perturbations during saccades could rely on vestibular-only cells in the vestibular nuclei with postulated projections to burst neurons; 4) two nonlinearities suffice, i.e., the experimentally-determined mapping of tectoreticular cells onto brain stem targets and the increased recruitment of the head for larger target eccentricities; 5) the effects of initial conditions on eye/head trajectories are due to neural circuit dynamics, not planning; and 6) "compensatory" ocular slow phases exist even after semicircular canal plugging, because of interconnections linking eye-head circuits. Our model structure also simulates classical vestibulo-ocular reflex and pursuit nystagmus, and provides novel neural circuit and behavioral predictions, notably that both eye-head coordination and segmental limb coordination are possible without trajectory planning.

Visual-Motor Transformations Within Frontal Eye Fields During Head-Unrestrained Gaze Shifts in the Monkey

A fundamental question in sensorimotor control concerns the transformation of spatial signals from the retina into eye and head motor commands required for accurate gaze shifts. Here, we investigated these transformations by identifying the spatial codes embedded in visually evoked and movement-related responses in the frontal eye fields (FEFs) during head-unrestrained gaze shifts. Monkeys made delayed gaze shifts to the remembered location of briefly presented visual stimuli, with delay serving to dissociate visual and movement responses. A statistical analysis of nonparametric model fits to response field data from 57 neurons (38 with visual and 49 with movement activities) eliminated most effector-specific, head-fixed, and space-fixed models, but confirmed the dominance of eye-centered codes observed in head-restrained studies. More importantly, the visual response encoded target location, whereas the movement response mainly encoded the final position of the imminent gaze shift (including gaze errors). This spatiotemporal distinction between target and gaze coding was present not only at the population level, but even at the single-cell level. We propose that an imperfect visual–motor transformation occurs during the brief memory interval between perception and action, and further transformations from the FEF's eye-centered gaze motor code to effector-specific codes in motor frames occur downstream in the subcortical areas.

Contrasting the roles of the supplementary and frontal eye fields in ocular decision making

Single-unit recording in monkeys and functional imaging of the human frontal lobe indicate that the supplementary eye field (SEF) and the frontal eye field (FEF) are involved in ocular decision making. To test whether these structures have distinct roles in decision making, single-neuron activity was recorded from each structure while monkeys executed an ocular go/nogo task. The task rule is to pursue a moving target if it intersects a visible square or "go zone." We found that most SEF neurons showed differential go/nogo activity during the delay period, before the target intersected the go zone (delay period), whereas most FEF neurons did so after target intersection, during the period in which the movement was executed (movement period). Choice probability (CP) for SEF neurons was high in the delay period but decreased in the movement period, whereas for FEF neurons it was low in the delay period and increased in the movement period. Directional selectivity of SEF neurons was low throughout the trial, whereas that of FEF neurons was highest in the delay period, decreasing later in the trial. Increasing task difficulty led to later discrimination between go and nogo in both structures and lower CP in the SEF, but it did not affect CP in the FEF. The results suggest that the SEF interprets the task rule early but is less involved in executing the motor decision than is the FEF and that these two areas collaborate dynamically to execute ocular decisions.

Evidence for a retinal velocity memory underlying the direction of anticipatory smooth pursuit eye movements

To compute spatially correct smooth pursuit eye movements, the brain uses both retinal motion and extraretinal signals about the eyes and head in space (Blohm and Lefèvre 2010). However, when smooth eye movements rely solely on memorized target velocity, such as during anticipatory pursuit, it is unknown if this velocity memory also accounts for extraretinal information, such as head roll and ocular torsion. To answer this question, we used a novel behavioral updating paradigm in which participants pursued a repetitive, spatially constant fixation-gap-ramp stimulus in series of five trials. During the first four trials, participants' heads were rolled toward one shoulder, inducing ocular counterroll (OCR). With each repetition, participants increased their anticipatory pursuit gain, indicating a robust encoding of velocity memory. On the fifth trial, they rolled their heads to the opposite shoulder before pursuit, also inducing changes in ocular torsion. Consequently, for spatially accurate anticipatory pursuit, the velocity memory had to be updated across changes in head roll and ocular torsion. We tested how the velocity memory accounted for head roll and OCR by observing the effects of changes to these signals on anticipatory trajectories of the memory decoding (fifth) trials. We found that anticipatory pursuit was updated for changes in head roll; however, we observed no evidence of compensation for OCR, representing the absence of ocular torsion signals within the velocity memory. This indicated that the directional component of the memory must be coded retinally and updated to account for changes in head roll, but not OCR.

Frames of reference for eye-head gaze shifts evoked during frontal eye field stimulation

The frontal eye field (FEF), in the prefrontal cortex, participates in the transformation of visual signals into saccade motor commands and in eye-head gaze control. The FEF is thought to show eye-fixed visual codes in head-restrained monkeys, but it is not known how it transforms these inputs into spatial codes for head-unrestrained gaze commands. Here, we tested if the FEF influences desired gaze commands within a simple eye-fixed frame, like the superior colliculus (SC), or in more complex egocentric frames like the supplementary eye fields (SEFs). We electrically stimulated 95 FEF sites in two head-unrestrained monkeys to evoke 3D eye-head gaze shifts and then mathematically rotated these trajectories into various reference frames. In theory, each stimulation site should specify a specific spatial goal when the evoked gaze shifts are plotted in the appropriate frame. We found that these motor output frames varied site by site, mainly within the eye-to-head frame continuum. Thus, consistent with the intermediate placement of the FEF within the high-level circuits for gaze control, its stimulation-evoked output showed an intermediate trend between the multiple reference frame codes observed in SEF-evoked gaze shifts and the simpler eye-fixed reference frame observed in SC-evoked movements. These results suggest that, although the SC, FEF and SEF carry eye-fixed information at the level of their unit response fields, this information is transformed differently in their output projections to the eye and head controllers.

Neuronal correlates of metacognition in primate frontal cortex

Humans are metacognitive: they monitor and control their cognition. Our hypothesis was that neuronal correlates of metacognition reside in the same brain areas responsible for cognition, including frontal cortex. Recent work demonstrated that nonhuman primates are capable of metacognition, so we recorded from single neurons in the frontal eye field, dorsolateral prefrontal cortex, and supplementary eye field of monkeys (Macaca mulatta) that performed a metacognitive visual-oculomotor task. The animals made a decision and reported it with a saccade, but received no immediate reward or feedback. Instead, they had to monitor their decision and bet whether it was correct. Activity was correlated with decisions and bets in all three brain areas, but putative metacognitive activity that linked decisions to appropriate bets occurred exclusively in the SEF. Our results offer a survey of neuronal correlates of metacognition and implicate the SEF in linking cognitive functions over short periods of time.

Contribution of the frontal eye field to gaze shifts in the head-unrestrained rhesus monkey: neuronal activity

The frontal eye field (FEF) has a strong influence on saccadic eye movements with the head restrained. With the head unrestrained, eye saccades combine with head movements to produce large gaze shifts, and microstimulation of the FEF evokes both eye and head movements. To test whether the dorsomedial FEF provides commands for the entire gaze shift or its separate eye and head components, we recorded extracellular single-unit activity in monkeys trained to make large head-unrestrained gaze shifts. We recorded 80 units active during gaze shifts, and closely examined 26 of these that discharged a burst of action potentials that preceded horizontal gaze movements. These units were movement or visuomovement related and most exhibited open movement fields with respect to amplitude. To reveal the relations of burst parameters to gaze, eye, and/or head movement metrics, we used behavioral dissociations of gaze, eye, and head movements and linear regression analyses. The burst number of spikes (NOS) was strongly correlated with movement amplitude and burst temporal parameters were strongly correlated with movement temporal metrics for eight gaze-related burst neurons and five saccade-related burst neurons. For the remaining 13 neurons, the NOS was strongly correlated with the head movement amplitude, but burst temporal parameters were most strongly correlated with eye movement temporal metrics (head-eye-related burst neurons, HEBNs). These results suggest that FEF units do not encode a command for the unified gaze shift only; instead, different units may carry signals related to the overall gaze shift or its eye and/or head components. Moreover, the HEBNs exhibit bursts whose magnitude and timing may encode a head displacement signal and a signal that influences the timing of the eye saccade, thereby serving as a mechanism for coordinating the eye and head movements of a gaze shift.

Recruitment of a contralateral head turning synergy by stimulation of monkey supplementary eye fields

The supplementary eye fields (SEF) are thought to enable higher-level aspects of oculomotor control. The goal of the present experiment was to learn more about the SEF's role in orienting, specifically by examining neck muscle recruitment evoked by stimulation of the SEF. Neck muscle activity was recorded from multiple muscles in two monkeys during SEF stimulation (100 μA, 150–300 ms, 300 Hz, with the head restrained or unrestrained) delivered 200 ms into a gap period, before a visually guided saccade initiated from a central position (doing so avoids confounds between initial position and prestimulation neck muscle activity). SEF stimulation occasionally evoked overt gaze shifts and/or head movements but almost always evoked a response that invariably consisted of a contralateral head turning synergy by increasing activity on contralateral turning muscles and decreasing activity on ipsilateral turning muscles (when background activity was present). Neck muscle responses began well in advance of evoked gaze shifts (∼30 ms after stimulation onset, leading gaze shifts by ∼40–70 ms on average), started earlier and attained a larger magnitude when accompanied by progressively larger gaze shifts, and persisted on trials without overt gaze shifts. The patterns of evoked neck muscle responses resembled those evoked by frontal eye field (FEF) stimulation, except that response latencies from the SEF were ∼10 ms longer. This basic description of the cephalomotor command evoked by SEF stimulation suggests that this structure, while further removed from the motor periphery than the FEF, accesses premotor orienting circuits in the brain stem and spinal cord in a similar manner.

Vestibular-related frontal cortical areas and their roles in smooth-pursuit eye movements: representation of neck velocity, neck-vestibular interactions, and memory-based smooth-pursuit

Smooth-pursuit eye movements are voluntary responses to small slow-moving objects in the fronto-parallel plane. They evolved in primates, who possess high-acuity foveae, to ensure clear vision about the moving target. The primate frontal cortex contains two smooth-pursuit related areas; the caudal part of the frontal eye fields (FEF) and the supplementary eye fields (SEF). Both areas receive vestibular inputs. We review functional differences between the two areas in smooth-pursuit. Most FEF pursuit neurons signal pursuit parameters such as eye velocity and gaze-velocity, and are involved in canceling the vestibulo-ocular reflex by linear addition of vestibular and smooth-pursuit responses. In contrast, gaze-velocity signals are rarely represented in the SEF. Most FEF pursuit neurons receive neck velocity inputs, while discharge modulation during pursuit and trunk-on-head rotation adds linearly. Linear addition also occurs between neck velocity responses and vestibular responses during head-on-trunk rotation in a task-dependent manner. During cross-axis pursuit-vestibular interactions, vestibular signals effectively initiate predictive pursuit eye movements. Most FEF pursuit neurons discharge during the interaction training after the onset of pursuit eye velocity, making their involvement unlikely in the initial stages of generating predictive pursuit. Comparison of representative signals in the two areas and the results of chemical inactivation during a memory-based smooth-pursuit task indicate they have different roles; the SEF plans smooth-pursuit including working memory of motion-direction, whereas the caudal FEF generates motor commands for pursuit eye movements. Patients with idiopathic Parkinson's disease were asked to perform this task, since impaired smooth-pursuit and visual working memory deficit during cognitive tasks have been reported in most patients. Preliminary results suggested specific roles of the basal ganglia in memory-based smooth-pursuit.

Bayesian nonparametric analysis of neuronal intensity rates

We propose a flexible hierarchical Bayesian nonparametric modeling approach to compare the spiking patterns of neurons recorded under multiple experimental conditions. In particular, we showcase the application of our statistical methodology using neurons recorded from the supplementary eye field region of the brains of two macaque monkeys trained to make delayed eye movements to three different types of targets. The proposed Bayesian methodology can be used to perform either a global analysis, allowing for the construction of posterior comparative intervals over the entire experimental time window, or a pointwise analysis for comparing the spiking patterns locally, in a predetermined portion of the experimental time window. By developing our nonparametric Bayesian model we are able to analyze neuronal data from three or more conditions while avoiding the computational expenses typically associated with more traditional analysis of physiological data.

Supplementary eye field activity reflects a decision rule governing smooth pursuit but not the decision

Animals depend on learned rules to guide their actions. Prefrontal (PFC) and premotor (PMC) cortex of primates have been reported to display rule-related neural activity, but it is unclear how signals encoded here are utilized to enforce the decision to act. The supplementary eye field (SEF) is a candidate for enforcing rule-guided ocular decisions because the activity of neurons here is correlated with the rule in an ocular decision-making task and because this area is anatomically more proximal to movement structures than PFC and PMC and receives inputs from them. However, in the previous work, the rule encoding and ocular outcome were confounded, leaving open the question of whether SEF activity is related to the rule or the behavior. In the present study, we attempted to discriminate between these alternatives by increasing task difficulty and forcing errors, thereby putting the stimulus and the behavior at odds. Single SEF neurons were recorded while monkeys performed the task in which the rule is to pursue a moving target if it intersects a visible square and maintain fixation if it does not. A delay period was imposed to monitor neural activity while the target approached the square. Two complementary populations of go and nogo neurons were found. When task difficulty was increased, the monkeys made more errors, and the neurons took longer to encode the rule. However, in error trials, most neurons continued to reflect the rule rather the monkey's ocular decision in both the delay period and after square intersection (movement period). This was the case for both directionally tuned and nondirectional SEF neurons. The results suggest that SEF neurons encode the ocular decision rule but that the decision itself likely occurs in a different structure that sums rule information from the SEF with information from other areas.

Influence of saccade efference copy on the spatiotemporal properties of remapping: a neural network study

Remapping of gaze-centered target-position signals across saccades has been observed in the superior colliculus and several cortical areas. It is generally assumed that this remapping is driven by saccade-related signals. What is not known is how the different potential forms of this signal (i.e., visual, visuomotor, or motor) might influence this remapping. We trained a three-layer recurrent neural network to update target position (represented as a "hill" of activity in a gaze-centered topographic map) across saccades, using discrete time steps and backpropagation-through-time algorithm. Updating was driven by an efference copy of one of three saccade-related signals: a transient visual response to the saccade-target in two-dimensional (2-D) topographic coordinates (Vtop), a temporally extended motor burst in 2-D topographic coordinates (Mtop), or a 3-D eye velocity signal in brain stem coordinates (EV). The Vtop model produced presaccadic remapping in the output layer, with a "jumping hill" of activity and intrasaccadic suppression. The Mtop model also produced presaccadic remapping with a dispersed moving hill of activity that closely reproduced the quantitative results of Sommer and Wurtz. The EV model produced a coherent moving hill of activity but failed to produce presaccadic remapping. When eye velocity and a topographic (Vtop or Mtop) updater signal were used together, the remapping relied primarily on the topographic signal. An analysis of the hidden layer activity revealed that the transient remapping was highly dispersed across hidden-layer units in both Vtop and Mtop models but tightly clustered in the EV model. These results show that the nature of the updater signal influences both the mechanism and final dynamics of remapping. Taken together with the currently known physiology, our simulations suggest that different brain areas might rely on different signals and mechanisms for updating that should be further distinguishable through currently available single- and multiunit recording paradigms.

Decoding the cortical transformations for visually guided reaching in 3D space

To explore the possible cortical mechanisms underlying the 3-dimensional (3D) visuomotor transformation for reaching, we trained a 4-layer feed-forward artificial neural network to compute a reach vector (output) from the visual positions of both the hand and target viewed from different eye and head orientations (inputs). The emergent properties of the intermediate layers reflected several known neurophysiological findings, for example, gain field-like modulations and position-dependent shifting of receptive fields (RFs). We performed a reference frame analysis for each individual network unit, simulating standard electrophysiological experiments, that is, RF mapping (unit input), motor field mapping, and microstimulation effects (unit outputs). At the level of individual units (in both intermediate layers), the 3 different electrophysiological approaches identified different reference frames, demonstrating that these techniques reveal different neuronal properties and suggesting that a comparison across these techniques is required to understand the neural code of physiological networks. This analysis showed fixed input-output relationships within each layer and, more importantly, within each unit. These local reference frame transformation modules provide the basic elements for the global transformation; their parallel contributions are combined in a gain field-like fashion at the population level to implement both the linear and nonlinear elements of the 3D visuomotor transformation.

Neuronal bases of directional expectation and anticipatory pursuit

Expectation of upcoming events is an essential cognitive function on which anticipatory actions are based. The neuronal basis of this prospective representation is poorly understood. We trained rhesus monkeys in a smooth-pursuit task in which the direction of upcoming target motion was indicated using a color cue. Under these conditions, directional expectation frequently evoked anticipatory smooth movements. We found that the activity of a population of neurons in the supplementary eye fields encoded the expected future direction of the target. Neuronal activity increased after presentation of the cue, indicating future target motion in the preferred direction. Neuronal activity either remained unaltered or was reduced if the antipreferred direction was cued. In addition, approximately 30% of these neurons were more active during trials with anticipatory pursuit in the preferred direction than during trials when monkeys did not anticipate target motion onset. This subset of recorded neurons encoded the direction of the subsequent anticipatory pursuit. We hypothesize that the neural representation of directional expectation could be conceptualized as a competitive interaction between pools of neurons representing likely future events, with the winner of this competition determining the direction of the subsequent anticipatory movement. Similar mechanisms could drive prediction before movement initiation in other motor domains.

Comparison of Saccade-Associated Neuronal Activity in the Primate Central Mesencephalic and Paramedian Pontine Reticular Formations

The oculomotor system must convert signals representing the target of an intended eye movement into appropriate input to drive the individual extraocular muscles. Neural models propose that this transformation may involve either a decomposition of the intended eye displacement signal into horizontal and vertical components or an implicit process whereby component signals do not predominate until the level of the motor neurons. Thus decomposition models predict that premotor neurons should primarily encode component signals while implicit models predict encoding of off-cardinal optimal directions by premotor neurons. The central mesencephalic reticular formation (cMRF) and paramedian pontine reticular formation (PPRF) are two brain stem regions that likely participate in the development of motor activity since both structures are anatomically connected to nuclei that encode movement goal (superior colliculus) and generate horizontal eye movements (abducens nucleus). We compared cMRF and PPRF neurons and found they had similar relationships to saccade dynamics, latencies, and movement fields. Typically, the direction preference of these premotor neurons was horizontal, suggesting they were related to saccade components. To confirm this supposition, we studied the neurons during a series of oblique saccades that caused “component stretching” and thus allowed the vectorial (overall) saccade velocity to be dissociated from horizontal component velocity. The majority of cMRF and PPRF neurons encoded component velocity across all saccades, supporting decomposition models that suggest horizontal and vertical signals are generated before the level of the motoneurons. However, we also found novel vectorial eye velocity encoding neurons that may have important implications for saccade control.

Saccade-related remapping of target representations between topographic maps: a neural network study

The goal of this study was to explore how a neural network could solve the updating task associated with the double-saccade paradigm, where two targets are flashed in succession and the subject must make saccades to the remembered locations of both targets. Because of the eye rotation of the saccade to the first target, the remembered retinal position of the second target must be updated if an accurate saccade to that target is to be made. We trained a three-layer, feed-forward neural network to solve this updating task using back-propagation. The network's inputs were the initial retinal position of the second target represented by a hill of activation in a 2D topographic array of units, as well as the initial eye orientation and the motor error of the saccade to the first target, each represented as 3D vectors in brainstem coordinates. The output of the network was the updated retinal position of the second target, also represented in a 2D topographic array of units. The network was trained to perform this updating using the full 3D geometry of eye rotations, and was able to produce the updated second-target position to within a 1 degrees RMS accuracy for a set of test points that included saccades of up to 70 degrees . Emergent properties in the network's hidden layer included sigmoidal receptive fields whose orientations formed distinct clusters, and predictive remapping similar to that seen in brain areas associated with saccade generation. Networks with the larger numbers of hidden-layer units developed two distinct types of units with different transformation properties: units that preferentially performed the linear remapping of vector subtraction, and units that performed the nonlinear elements of remapping that arise from initial eye orientation.

Frames of reference for gaze saccades evoked during stimulation of lateral intraparietal cortex

Previous studies suggest that stimulation of lateral intraparietal cortex (LIP) evokes saccadic eye movements toward eye- or head-fixed goals, whereas most single-unit studies suggest that LIP uses an eye-fixed frame with eye-position modulations. The goal of our study was to determine the reference frame for gaze shifts evoked during LIP stimulation in head-unrestrained monkeys. Two macaques (M1 and M2) were implanted with recording chambers over the right intraparietal sulcus and with search coils for recording three-dimensional eye and head movements. The LIP region was microstimulated using pulse trains of 300 Hz, 100-150 microA, and 200 ms. Eighty-five putative LIP sites in M1 and 194 putative sites in M2 were used in our quantitative analysis throughout this study. Average amplitude of the stimulation-evoked gaze shifts was 8.67 degrees for M1 and 7.97 degrees for M2 with very small head movements. When these gaze-shift trajectories were rotated into three coordinate frames (eye, head, and body), gaze endpoint distribution for all sites was most convergent to a common point when plotted in eye coordinates. Across all sites, the eye-centered model provided a significantly better fit compared with the head, body, or fixed-vector models (where the latter model signifies no modulation of the gaze trajectory as a function of initial gaze position). Moreover, the probability of evoking a gaze shift from any one particular position was modulated by the current gaze direction (independent of saccade direction). These results provide causal evidence that the motor commands from LIP encode gaze command in eye-fixed coordinates but are also subtly modulated by initial gaze position.

Impact of Experience on the Representation of Object-Centered Space in the Macaque Supplementary Eye Field

Many neurons in the macaque supplementary eye field (SEF) exhibit object-centered spatial selectivity, firing at different rates when the monkey plans a saccade to the left or right end of a horizontal bar. Is this property natural to the SEF or is it a product of specialized training in the laboratory? To answer this question, we monitored the activity of single SEF neurons in two monkeys before and after training to select eye-movement targets by an object-centered rule. During stage 1, the monkeys performed a color delayed-match-to-sample (DMS) task in which a red or green central cue dictated an eye movement to the matching end of a horizontal bar. Many neurons at this stage exhibited object-centered spatial selectivity. During stage 2, the monkeys performed a color-conditional object-centered task in which a green or red central cue instructed an eye movement to the left or right end of a gray bar. More neurons exhibited object-centered spatial selectivity during this stage than during stage 1. During stage 3, the monkeys again performed the color DMS task. The fraction of neurons exhibiting object-centered spatial selectivity remained at a level comparable to that observed during stage 2 and above that observed during stage 1. Thus object-centered spatial selectivity was present before training on an object-centered rule, was enhanced as a product of object-centered training, and outlasted active use of an object-centered rule. We conclude that neural representations of object-centered space, naturally present in the primate brain, can be sharpened by training.

Combination of neuronal signals representing object-centered location and saccade direction in macaque supplementary eye field

Neurons in the macaque supplementary eye field (SEF) fire at different rates in conjunction with planning saccades in different directions. They also exhibit object-centered spatial selectivity, firing at different rates when the target of the saccade is at the left or right end of a horizontal bar. To compare the rate of incidence of the two kinds of signal, and to determine how they combine, we recorded from SEF neurons while monkeys performed a task in which the target (a dot or the left or right end of a horizontal bar) could appear in any visual field quadrant. During the period when the target was visible on the screen and the monkey was preparing to make a saccade, many neurons exhibited selectivity for saccade direction, firing at a rate determined by the direction of the impending saccade irrespective of whether the target was a dot or the end of a bar. On bar trials, many of the same neurons exhibited object-centered selectivity, firing more strongly when the target was at the preferred end of the bar regardless of saccade direction. The rate of incidence of object-centered selectivity (33%) was lower overall than that of saccade-direction selectivity (56%). Signals related to saccade direction and the object-centered location of the target tended to combine additively. The results suggest that the SEF is at a transitional stage between representing the object-centered command and specifying the parameters of the saccade.

Contribution of the Frontal Eye Field to Gaze Shifts in the Head-Unrestrained Monkey: Effects of Microstimulation

The role of the primate frontal eye field (FEF) has been inferred primarily from experiments investigating saccadic eye movements with the head restrained. Three recent reports investigating head-unrestrained gaze shifts disagree on whether head movements are evoked with FEF stimulation and thus whether the FEF participates in gaze movement commands. We therefore examined the eye, head, and overall gaze movement evoked by low-intensity microstimulation of the low-threshold region of the FEF in two head-unrestrained monkeys. Microstimulation applied at 200 or 350 Hz for 200 ms evoked large gaze shifts with substantial head movement components from most sites in the dorsomedial FEF, but evoked small, predominantly eye-only gaze shifts from ventrolateral sites. The size and direction of gaze and eye movements were strongly affected by the eye position before stimulation. Head movements exhibited little position dependency, but at some sites and initial eye positions, head-only movements were evoked. Stimulus-evoked gaze shifts and their eye and head components resembled those elicited naturally by visual targets. With stimulus train durations >200 ms, the evoked gaze shifts were more likely to be accomplished with a substantial head movement, which often continued for the entire stimulus duration. The amplitude, duration and peak velocity of the evoked head movement were more strongly correlated with stimulus duration than were those of the gaze or eye movements. We conclude that the dorsomedial FEF generates a gaze command signal that can produce eye, head, or combined eye–head movement depending on the initial orbital position of the eye.

Functional organization within a neural network trained to update target representations across 3-D saccades

The goal of this study was to understand how neural networks solve the 3-D aspects of updating in the double-saccade task, where subjects make sequential saccades to the remembered locations of two targets. We trained a 3-layer, feed-forward neural network, using back-propagation, to calculate the 3-D motor error the second saccade. Network inputs were a 2-D topographic map of the direction of the second target in retinal coordinates, and 3-D vector representations of initial eye orientation and motor error of the first saccade in head-fixed coordinates. The network learned to account for all 3-D aspects of updating. Hidden-layer units (HLUs) showed retinal-coordinate visual receptive fields that were remapped across the first saccade. Two classes of HLUs emerged from the training, one class primarily implementing the linear aspects of updating using vector subtraction, the second class implementing the eye-orientation-dependent, non-linear aspects of updating. These mechanisms interacted at the unit level through gain-field-like input summations, and through the parallel "tweaking" of optimally-tuned HLU contributions to the output that shifted the overall population output vector to the correct second-saccade motor error. These observations may provide clues for the biological implementation of updating.

Microstimulation of frontal cortex can reorder a remembered spatial sequence

Complex goal-directed behaviors extend over time and thus depend on the ability to serially order memories and assemble compound, temporally coordinated movements. Theories of sequential processing range from simple associative chaining to hierarchical models in which order is encoded explicitly and separately from sequence components. To examine how short-term memory and planning for sequences might be coded, we used microstimulation to perturb neural activity in the supplementary eye field (SEF) while animals held a sequence of two cued locations in memory over a short delay. We found that stimulation affected the order in which animals saccaded to the locations, but not the memory for which locations were cued. These results imply that memory for sequential order can be dissociated from that of its components. Furthermore, stimulation of the SEF appeared to bias sequence endpoints to converge toward a location in contralateral space, suggesting that this area encodes sequences in terms of their endpoints rather than their individual components.

The "other" transformation required for visual-auditory integration: representational format

Multisensory integration of spatial signals requires not only that stimulus locations be encoded in the same spatial reference frame, but also that stimulus locations be encoded in the same representational format. Previous studies have addressed the issue of spatial reference frame, but representational format, particularly for sound location, has been relatively overlooked. We discuss here our recent findings that sound location in the primate inferior colliculus is encoded using a "rate" code, a format that differs from the place code used for representing visual stimulus locations. Possible mechanisms for transforming signals from rate-to-place or place-to-rate coding formats are considered.

Cortico-cortical networks and cortico-subcortical loops for the higher control of eye movements

There are multiple distinct regions, or eye fields, in the cerebral cortex that contribute directly to the initiation and control of voluntary eye movements. We concentrate on six of these: the frontal eye field, parietal eye field, supplementary eye field, middle superior temporal area, prefrontal eye field, and area 7 m (precuneus in humans). In each of these regions: (1) there is neural activity closely related to eye movements; (2) electrical microstimulation produces or modifies eye movements; (3) surgical lesions or chemical inactivation impairs eye movements; (4) there are direct neural projections to major structures in the brainstem oculomotor system; and (5) increased activity is observed during eye movement tasks in functional magnetic resonance imaging or positron emission tomography experiments in humans. Each of these eye fields is reciprocally connected with the other eye fields, and each receives visual information directly from visual association cortex. Each eye field has distinct subregions that are concerned with either saccadic or pursuit eye movements. The saccadic subregions are preferentially interconnected with other saccade subregions and the pursuit subregions are preferentially interconnected with other pursuit subregions. Current evidence strongly supports the proposal that there are parallel cortico-cortical networks that control purposeful saccadic and pursuit eye movements, and that the activity in those networks is modulated by feedback information, via the thalamus, from the superior colliculus, basal ganglia, and cerebellum.

Present concepts of oculomotor organization

This chapter gives an introduction to the oculomotor system, thus providing a framework for the subsequent chapters. This chapter describes the characteristics, and outlines the structures involved, of the five basic types of eye movements, for gaze holding ("neural integrator") and eye movements in three dimensions (Listing's law, pulleys).

Frames of Reference for Saccadic Command Tested By Saccade Collision in the Supplementary Eye Field

In what frame of reference does the supplementary eye field (SEF) encode saccadic eye movements? In this study, the "saccade collision" test was used to determine whether a saccade electrically evoked in the monkey's SEF is programmed to reach an oculocentric goal or a nonoculocentric (e.g., head or body-centered) goal. If the eyes start moving just before or when an oculocentric goal is imposed by electrical stimulation, the trajectory of the saccade to that goal should compensate for the ongoing movement. Conversely, if the goal imposed by electrical stimulation is nonoculocentric, the trajectory of the evoked saccade should not be altered. In head-fixed experiments, we mapped the trajectories of evoked saccades while the monkey fixated at each of 25 positions 10 degrees apart in a 40 x 40 degrees grid. For each studied SEF site, we calculated convergences indices and found that "convergent" and "nonconvergent" sites were separately clustered: nonconvergent rostral to convergent. Then, the "saccade collision" test was systematically applied. We found compensation at sites where saccades were of the nonconvergent type and practically no compensation at sites where saccades were of the convergent type. The results indicate that the SEF can encode saccade goals in at least two frames of reference and suggest a rostrocaudal segregation in the representation of these two modes.

The primate working memory networks

Working memory has long been associated with the prefrontal cortex, since damage to this brain area can critically impair the ability to maintain and update mnemonic information. Anatomical and physiological evidence suggests, however, that the prefrontal cortex is part of a broader network of interconnected brain areas involved in working memory. These include the parietal and temporal association areas of the cerebral cortex, cingulate and limbic areas, and subcortical structures such as the mediodorsal thalamus and the basal ganglia. Neurophysiological studies in primates confirm the involvement of areas beyond the frontal lobe and illustrate that working memory involves parallel, distributed neuronal networks. In this article, we review the current understanding of the anatomical organization of networks mediating working memory and the neural correlates of memory manifested in each of their nodes. The neural mechanisms of memory maintenance and the integrative role of the prefrontal cortex are also discussed.

A neural circuit basis for spatial working memory

The maintenance of a mental image in memory over a time scale of seconds is mediated by the persistent discharges of neurons in a distributed brain network. The representation of the spatial location of a remembered visual stimulus has been studied most extensively and provides the best-understood model of how mnemonic information is encoded in the brain. Neural correlates of spatial working memory are manifested in multiple brain areas, including the prefrontal and parietal association cortices. Spatial working memory ability is severely compromised in schizophrenia, a condition that has been linked to prefrontal cortical malfunction. Recent computational modeling work, in interplay with physiological studies of behaving monkeys, has begun to identify microcircuit properties and neural dynamics that are sufficient to generate memory-related persistent activity in a recurrent network of excitatory and inhibitory neurons during spatial working memory. This review summarizes recent results and discusses issues of current debate. It is argued that understanding collective neural dynamics in a recurrent microcircuit provides a key step in bridging the gap between network memory function and its underlying cellular mechanisms. Progress in this direction will shed fundamental insights into the neural basis of spatial working memory impairment associated with mental disorders.

Frames of reference for eye-head gaze commands in primate supplementary eye fields

The supplementary eye field (SEF) is a region within medial frontal cortex that integrates complex visuospatial information and controls eye-head gaze shifts. Here, we test if the SEF encodes desired gaze directions in a simple retinal (eye-centered) frame, such as the superior colliculus, or in some other, more complex frame. We electrically stimulated 55 SEF sites in two head-unrestrained monkeys to evoke 3D eye-head gaze shifts and then mathematically rotated these trajectories into various reference frames. Each stimulation site specified a specific spatial goal when plotted in its intrinsic frame. These intrinsic frames varied site by site, in a continuum from eye-, to head-, to space/body-centered coding schemes. This variety of coding schemes provides the SEF with a unique potential for implementing arbitrary reference frame transformations.

Distributed population mechanism for the 3-D oculomotor reference frame transformation

Human saccades require a nonlinear, eye orientation-dependent reference frame transformation to transform visual codes to the motor commands for eye muscles. Primate neurophysiology suggests that this transformation is performed between the superior colliculus and brain stem burst neurons, but provides little clues as to how this is done. To understand how the brain might accomplish this, we trained a 3-layer neural net to generate accurate commands for kinematically correct 3-D saccades. The inputs to the network were a 2-D, eye-centered, topographic map of Gaussian visual receptive fields and an efference copy of eye position in 6-dimensional, push-pull "neural integrator" coordinates. The output was an eye orientation displacement command in similar coordinates appropriate to drive brain stem burst neurons. The network learned to generate accurate, kinematically correct saccades, including the eye orientation-dependent tilts in saccade motor error commands required to match saccade trajectories to their visual input. Our analysis showed that the hidden units developed complex, eye-centered visual receptive fields, widely distributed fixed-vector motor commands, and "gain field"-like eye position sensitivities. The latter evoked subtle adjustments in the relative motor contributions of each hidden unit, thereby rotating the population motor vector into the correct correspondence with the visual target input for each eye orientation: a distributed population mechanism for the visuomotor reference frame transformation. These findings were robust; there was little variation across networks with between 9 and 49 hidden units. Because essentially the same observations have been reported in the visuomotor transformations of the real oculomotor system, as well as other visuomotor systems (although interpreted elsewhere in terms of other models) we suggest that the mechanism for visuomotor reference frame transformations identified here is the same solution used in the real brain.

Comparison of Memory- and Visually Guided Saccades Using Event-Related fMRI

Previous functional imaging studies have shown an increased hemodynamic signal in several cortical areas when subjects perform memory-guided saccades than that when they perform visually guided saccades using blocked trial designs. It is unknown, however, whether this difference results from sensory processes associated with stimulus presentation, from processes occurring during the delay period before saccade generation, or from an increased motor signal for memory-guided saccades. We conducted fMRI using an event-related paradigm that separated stimulus-related, delay-related, and saccade-related activity. Subjects initially fixated a central cross, whose color indicated whether the trial was a memory- or a visually guided trial. A peripheral stimulus was then flashed at one of 4 possible locations. On memory-guided trials, subjects had to remember this location for the subsequent saccade, whereas the stimulus was a distractor on visually guided trials. Fixation cross disappearance after a delay period was the signal either to generate a memory-guided saccade or to look at a visual stimulus that was flashed on visually guided trials. We found slightly greater stimulus-related activation for visually guided trials in 3 right prefrontal regions and right rostral intraparietal sulcus (IPS). Memory-guided trials evoked greater delay-related activity in right posterior inferior frontal gyrus, right medial frontal eye field, bilateral supplementary eye field, right rostral IPS, and right ventral IPS but not in middle frontal gyrus. Right precentral gyrus and right rostral IPS exhibited greater saccade-related activation on memory-guided trials. We conclude that activation differences revealed by previous blocked experiments have different sources in different areas and that cortical saccade regions exhibit delay-related activation differences.

Contribution of head movement to gaze command coding in monkey frontal cortex and superior colliculus

Most of what we know about the neural control of gaze comes from experiments in head-fixed animals, but several "head-free" studies have suggested that fixing the head dramatically alters the apparent gaze command. We directly investigated this issue by quantitatively comparing head-fixed and head-free gaze trajectories evoked by electrically stimulating 52 sites in the superior colliculus (SC) of two monkeys and 23 sites in the supplementary eye fields (SEF) of two other monkeys. We found that head movements made a significant contribution to gaze shifts evoked from both neural structures. In the majority of the stimulated sites, average gaze amplitude was significantly larger and individual gaze trajectories were significantly less convergent in space with the head free to move. Our results are consistent with the hypothesis that head-fixed stimulation only reveals the oculomotor component of the gaze shift, not the true, planned goal of the movement. One implication of this finding is that when comparing stimulation data against popular gaze control models, freeing the head shifts the apparent coding of gaze away from a "spatial code" toward a simpler visual model in the SC and toward an eye-centered or fixed-vector model representation in the SEF.

Primate antisaccade. II. Supplementary eye field neuronal activity predicts correct performance

Neuronal activities were recorded in the supplementary eye field (SEF) of 3 macaque monkeys trained to perform antisaccades pseudorandomly interleaved with prosaccades, as instructed by the shape of a central fixation point. The prosaccade goal was indicated by a peripheral stimulus flashed anywhere on the screen, whereas the antisaccade goal was an unmarked site diametrically opposite the flashed stimulus. The visual cue was given immediately after the instruction cue disappeared in the immediate-saccade task, or during the instruction period in the delayed-saccade task. The instruction cue offset was the saccade gosignal. Here we focus on 92 task-related neurons: visual, eye-movement, and instruction/fixation neurons. We found that 73% of SEF eye-movement-related neurons fired significantly more before anti-saccades than prosaccades. This finding was analyzed at 3 levels: population, single neuron, and individual trial. On individual antisaccade trials, 40 ms before saccade, the firing rate of eye-movement-related neurons was highly predictive of successful performance. A similar analysis of visual responses (40 ms astride the peak) gave less-coherent results. Fixation neurons, activated during the initial instruction period (i.e., after the instruction cue but before the stimulus) always fired more on antisaccade than on prosaccade trials. This trend, however, was statistically significant for only half of these neurons. We conclude that the SEF is critically involved in the production of antisaccades.

Contrasting neuronal activity in the supplementary and frontal eye fields during temporal organization of multiple saccades

The organization of a series of actions into an appropriate temporal order is of particular importance in the voluntary control of motor behavior. Previous reports have emphasized the importance of medial motor areas for the temporal organization of movements. The aim of this study was to compare the neuronal activity in the supplementary and frontal eye fields (SEF and FEF) during sequential performance of multiple saccades to clarify the role of the two cortical oculomotor areas in the temporal organization of saccades based on memorized information. We analyzed neuronal activity while monkeys performed three saccades to peripheral targets in orders that were instructed and memorized. We found that activity that reflected saccade sequence or the numerical position of a saccade within a sequence (rank) was more prevalent in the SEF, whereas activity reflecting saccade direction was more dominant in the FEF. Furthermore, a sizeable number of SEF neurons exhibited an increase in activity when the animals were required to discard a current sequence and compose a novel sequence. We propose that the SEF is primarily involved in the process of planning, decoding, and updating saccade sequences, whereas the FEF plays a major role in determining the direction of forthcoming saccades.

Electrical stimulation of the supplementary eye fields in the head-free macaque evokes kinematically normal gaze shifts

The supplementary eye fields (SEFs), located on the dorsomedial surface of the frontal cortex, are involved in high-level aspects of saccade generation. Some reports suggest that the same area could also be involved in the generation of motor commands for the head. If so, it is important to establish whether this structure encodes eye and head commands separately or gaze commands that give rise to coordinated eye-head movements. Here we systematically stimulated (50 microA, 300 Hz, 200 ms) the SEF of two head-free (head unrestrained) macaques while recording three-dimensional eye and head rotations. A total of 55 sites were found to consistently elicit saccade-like gaze movements, always in the contralateral direction with variable vertical components, and ranging in average amplitude from 5 to 60 degrees. These movements were always a combination of eye-in-head saccades and head-in-space movements. We then performed a comparison between these movements and natural gaze shifts. The kinematics of the elicited movements (i.e., their temporal structure, their velocity-amplitude relationships, and the relative contributions of the eye and the head as a function of movement amplitude) were indistinguishable from those of natural gaze shifts. Additionally, they obeyed the same three-dimensional constraints as natural gaze shifts (i.e., eye-in-head movements obeyed Listing's law, whereas head- and eye-in-space movements obeyed Donders' law). In summary, gaze movements evoked by stimulating the SEF were indistinguishable from natural coordinated eye-head gaze shifts. Based on this we conclude that the SEF explicitly encodes gaze and that the kinematics aspects of eye-head coordination are implicitly specified by mechanisms downstream from the SEF.

Differential cortical activation during voluntary and reflexive saccades in man

A saccade involves both a step in eye position and an obligatory shift in spatial attention. The traditional division of saccades into two types, the "reflexive" saccade made in response to an exogenous stimulus change in the visual periphery and the "voluntary" saccade based on an endogenous judgement to move gaze, is supported by lines of evidence which include the longer onset latency of the latter and the differential effects of lesions in humans and primates on each. It has been supposed that differences between the two types of saccade derive from differences in how the spatial attention shifts involved in each are processed. However, while functional imaging studies have affirmed the close link between saccades and attentional shifts by showing they activate overlapping cortical networks, attempts to contrast exogenous with endogenous ("covert") attentional shifts directly have not revealed separate patterns of cortical activation. We took the "overt" approach, contrasting whole reflexive and voluntary saccades using event-related fMRI. This demonstrated that, relative to reflexive saccades, voluntary saccades produced greater activation within the frontal eye fields and the saccade-related area of the intraparietal sulci. The reverse contrast showed reflexive saccades to be associated with relative activation of the angular gyrus of the inferior parietal lobule, strongest in the right hemisphere. The frequent involvement of the right inferior parietal lobule in lesions causing hemispatial neglect has long implicated this parietal region in an important, though as yet uncertain, role in the awareness and exploration of space. This is the first study to demonstrate preferential activation of an area in its posterior part, the right angular gyrus, during production of exogenously triggered rather than endogenously generated saccades, a finding which we propose is consistent with an important role for the angular gyrus in exogenous saccadic orienting.

Monitoring and control of action by the frontal lobes

Success requires deciding among alternatives, controlling the initiation of movements, and judging the consequences of actions. When alternatives are difficult to distinguish, habitual responses must be overcome, or consequences are uncertain, deliberation is necessary and a supervisory system exerts control over the processes that produce sensory-guided movements. We have investigated these processes by recording neural activity in the frontal lobe of macaque monkeys performing a countermanding task. Distinct neurons in the frontal eye field respond to visual stimuli or control the production of the movements. In the supplementary eye field and anterior cingulate cortex, neurons appear not to control directly movement initiation but instead signal the production of errors, the anticipation and delivery of reinforcement, and the presence of processing conflict. These signals form the core of current models of supervisory control of sensorimotor processes.

Distribution of eye- and arm-movement-related neuronal activity in the SEF and in the SMA and Pre-SMA of monkeys

We analyzed neuronal activity in the supplementary eye field (SEF), supplementary motor area (SMA), and presupplementary motor area (pre-SMA) during the performance of three motor tasks: capturing a visual target with a saccade, reaching one arm to a target while gazing at a visual fixation point, or capturing a target with a saccade and arm-reach together. Our data demonstrated that each area was involved in controlling the arm and eye movements in a different manner. Saccade-related neurons were found mainly in the SEF. In contrast, arm-movement-related neurons were found primarily in the SMA and pre-SMA. In addition, we found that the activity of both arm-movement- and saccade-related neurons differed depending on the presence or absence of an accompanying saccade or arm movement. Such context dependency was found in all three areas. We also discovered that activity preceding eye or arm movement alone, and eye and arm movement combined, appeared more often in the pre-SMA and SEF, suggesting their involvement in effector-independent aspects of motor behavior. Subsequent analysis revealed that the laterality of arm representation differed in the three areas: it was predominantly contralateral in the SMA but largely bilateral in the pre-SMA and SEF.

Neurons with object-centered spatial selectivity in macaque SEF: do they represent locations or rules?

In macaque monkeys performing a task that requires eye movements to the leftmost or rightmost of two dots in a horizontal array, some neurons in the supplementary eye field (SEF) fire differentially according to which side of the array is the target regardless of the array's location on the screen. We refer to these neurons as exhibiting selectivity for object-centered location. This form of selectivity might arise from involvement of the neurons in either of two processes: representing the locations of targets or representing the rules by which targets are selected. To distinguish between these possibilities, we monitored neuronal activity in the SEF of two monkeys performing a task that required the selection of targets by either an object-centered spatial rule or a color rule. On each trial, a sample array consisting of two side-by-side dots appeared; then a cue flashed on one dot; then the display vanished and a delay ensued. Next a target array consisting of two side-by-side dots appeared at an unpredictable location and another delay ensued; finally the monkey had to make an eye movement to one of the target dots. On some trials, the monkey had to select the dot on the same side as the cue (right or left). On other trials, he had to select the target of the same color as the cue (red or green). Neuronal activity robustly encoded the object-centered locations first of the cue and then of the target regardless of the whether the monkey was following a rule based on object-centered location or color. Neuronal activity was at most weakly affected by the type of rule the monkey was following (object-centered-location or color) or by the color of the cue and target (red or green). On trials involving a color rule, neuronal activity was moderately enhanced when the cue and target appeared on opposite sides of their respective arrays. We conclude that the general function of SEF neurons selective for object-centered location is to represent where the cue and target are in their respective arrays rather than to represent the rule for target selection.

The superior colliculus encodes gaze commands in retinal coordinates

The superior colliculus (SC) has a topographic map of visual space, but the spatial nature of its output command for orienting gaze shifts remains unclear. Here we show that the SC codes neither desired gaze displacement nor gaze direction in space (as debated previously), but rather, desired gaze direction in retinal coordinates. Electrical micro-stimulation of the SC in two head-free (non-immobilized) monkeys evoked natural-looking, eye-head gaze shifts, with anterior sites producing small, fixed-vector movements and posterior sites producing larger, strongly converging movements. However, when correctly calculated in retinal coordinates, all of these trajectories became 'fixed-vector.' Moreover, our data show that this eye-centered SC command is then further transformed, as a function of eye and head position, by downstream mechanisms into the head- and body-centered commands for coordinated eye-head gaze shifts.

The planning of refixation saccades in reading

The planning of the refixation saccade, i.e. the second saccade on 9- and 11-letter-strings, was assessed in two reading experiments that examined the influence of a length change at different times during the first fixation on a letter string. The results showed that the saccadic system was able to modify the first motor program if the new length information was available 150-190 ms before the execution of the refixation saccade. Moreover, the amplitude of the refixation saccade was found to be planned as a constant movement relative to the length of the item, regardless of the position of the initial fixation on the item. Finally, the refixation saccade seems to be preprogrammed before the primary saccade, depending on the length integrated at that time. Overall, these results suggest that the refixation saccade is programmed on the basis of the intrinsic properties of the item, such as its length.

Supplementary eye field: representation of saccades and relationship between neural response fields and elicited eye movements

The functional organization of the low-threshold supplementary eye field (SEF) was studied by analyzing presaccadic activity, electrically elicited saccades, and the relationship between them. Response-field optimal vectors, defined as the visual field coordinates or saccadic eye-movement dimensions evoking the highest neural discharge, were quantitatively estimated for 160 SEF neurons by systematically varying peripheral target location relative to a central fixation point and then fitting the responses to Gaussian functions. Saccades were electrically elicited at 109 SEF sites by microstimulation (70 ms, 10-100 microA) during central fixation. The distribution of response fields and elicited saccades indicated a complete representation of all contralateral saccades in SEF. Elicited saccade polar directions ranged between 97 and 262 degrees (data from left hemispheres were transformed to a right-hemisphere convention), and amplitudes ranged between 1.8 and 26.9 degrees. Response-field optimal vectors (right hemisphere transformed) were nearly all contralateral as well; the directions of 115/119 visual response fields and 80/84 movement response fields ranged between 90 and 279 degrees, and response-field eccentricities ranged between 5 and 50 degrees. Response-field directions for the visual and movement activity of visuomovement neurons were strongly correlated (r = 0.95). When neural activity and elicited saccades obtained at exactly the same sites were compared, response fields were highly predictive of elicited saccade dimensions. Response-field direction was highly correlated with the direction of saccades elicited at the recording site (r = 0.92, n = 77). Similarly, response-field eccentricity predicted the size of subsequent electrically elicited saccades (r = 0.49, n = 60). However, elicited saccades were generally smaller than response-field eccentricities and consistently more horizontal when response fields were nearly vertical. The polar direction of response fields and elicited saccades remained constant perpendicular to the cortical surface, indicating a columnar organization of saccade direction. Saccade direction progressively shifted across SEF; however, these orderly shifts were more indicative of a hypercolumnar organization rather than a single global topography. No systematic organization for saccade amplitude was evident. We conclude that saccades are represented in SEF by congruent visual receptive fields, presaccadic movement fields, and efferent mappings. Thus SEF specifies saccade vectors as bursts of activity by local groups of neurons with appropriate projections to downstream oculomotor structures. In this respect, SEF is organized like the superior colliculus and the frontal eye field even though SEF lacks an overall global saccade topography. We contend that all specialized oculomotor functions of SEF must operate within the context of this fundamental organization.

Neuronal activity in macaque supplementary eye field during planning of saccades in response to pattern and spatial cues

The aim of this study was to determine whether neuronal activity in the macaque supplementary eye field (SEF) is influenced by the rule used for saccadic target selection. Two monkeys were trained to perform a variant of the memory-guided saccade task in which any of four visible dots (rightward, upward, leftward, and downward) could be the target. On each trial, the cue identifying the target was either a spot flashed in superimposition on the target (spatial condition) or a foveally presented digitized image associated with the target (pattern condition). Trials conforming to the two conditions were interleaved randomly. On recording from 439 SEF neurons, we found that two aspects of neuronal activity were influenced by the nature of the cue. 1) Activity reflecting the direction of the impending response developed more rapidly following spatial than following pattern cues. 2) Activity throughout the delay period tended to be higher following pattern than following spatial cues. We consider these findings in relation to the possible involvement of the SEF in processes underlying attention, arousal, response-selection, and motor preparation.

Eye fields in the frontal lobes of primates

Two eye fields have been identified in the frontal lobes of primates: one is situated dorsomedially within the frontal cortex and will be referred to as the eye field within the dorsomedial frontal cortex (DMFC); the other resides dorsolaterally within the frontal cortex and is commonly referred to as the frontal eye field (FEF). This review documents the similarities and differences between these eye fields. Although the DMFC and FEF are both active during the execution of saccadic and smooth pursuit eye movements, the FEF is more dedicated to these functions. Lesions of DMFC minimally affect the production of most types of saccadic eye movements and have no effect on the execution of smooth pursuit eye movements. In contrast, lesions of the FEF produce deficits in generating saccades to briefly presented targets, in the production of saccades to two or more sequentially presented targets, in the selection of simultaneously presented targets, and in the execution of smooth pursuit eye movements. For the most part, these deficits are prevalent in both monkeys and humans. Single-unit recording experiments have shown that the DMFC contains neurons that mediate both limb and eye movements, whereas the FEF seems to be involved in the execution of eye movements only. Imaging experiments conducted on humans have corroborated these findings. A feature that distinguishes the DMFC from the FEF is that the DMFC contains a somatotopic map with eyes represented rostrally and hindlimbs represented caudally; the FEF has no such topography. Furthermore, experiments have revealed that the DMFC tends to contain a craniotopic (i.e., head-centered) code for the execution of saccadic eye movements, whereas the FEF contains a retinotopic (i.e., eye-centered) code for the elicitation of saccades. Imaging and unit recording data suggest that the DMFC is more involved in the learning of new tasks than is the FEF. Also with continued training on behavioural tasks the responsivity of the DMFC tends to drop. Accordingly, the DMFC is more involved in learning operations whereas the FEF is more specialized for the execution of saccadic and smooth pursuit eye movements.

Macaque supplementary eye field neurons encode object-centered locations relative to both continuous and discontinuous objects

Many neurons in the supplementary eye field (SEF) of the macaque monkey fire at different rates before eye movements to the right or the left end of a horizontal bar regardless of the bar's location in the visual field. We refer to such neurons as carrying object-centered directional signals. The aim of the present study was to throw light on the nature of object-centered direction selectivity by determining whether it depends on the reference image's physical continuity. To address this issue, we recorded from 143 neurons in two monkeys. All of these neurons were located in a region coincident with the SEF as mapped out in previous electrical stimulation studies and many exhibited task-related activity in a standard saccade task. In each neuron, we compared neuronal activity across trials in which the monkey made eye movements to the right or left end of a reference image. On interleaved trials, the reference image might be either a horizontal bar or a pair of discrete dots in a horizontal array. The dominant effect revealed by this experiment was that neurons selectively active before eye movements to the right (or left) end of a bar were also selectively active before eye movements to the right (or left) dot in a horizontal array. An additional minor effect, present in around a quarter of the sample, took the form of a difference in firing rate between bar and dot trials, with the greater level of activity most commonly associated with dot trials. These phenomena could not be accounted for by minor intertrial differences in the physical directions of eye movements. In summary, SEF neurons carry object-centered signals and carry these signals regardless of whether the reference image is physically continuous or disjunct.