Eye-head coordination during large gaze shifts

Large eye-head gaze shifts measured with a wearable eye tracker and an industrial camera

We built a novel setup to record large gaze shifts (up to 140[Formula: see text]). The setup consists of a wearable eye tracker and a high-speed camera with fiducial marker technology to track the head. We tested our setup by replicating findings from the classic eye-head gaze shift literature. We conclude that our new inexpensive setup is good enough to investigate the dynamics of large eye-head gaze shifts. This novel setup could be used for future research on large eye-head gaze shifts, but also for research on gaze during e.g., human interaction. We further discuss reference frames and terminology in head-free eye tracking. Despite a transition from head-fixed eye tracking to head-free gaze tracking, researchers still use head-fixed eye movement terminology when discussing world-fixed gaze phenomena. We propose to use more specific terminology for world-fixed phenomena, including gaze fixation, gaze pursuit, and gaze saccade.

Neural encoding of instantaneous kinematics of eye-head gaze shifts in monkey superior Colliculus

The midbrain superior colliculus is a crucial sensorimotor stage for programming and generating saccadic eye-head gaze shifts. Although it is well established that superior colliculus cells encode a neural command that specifies the amplitude and direction of the upcoming gaze-shift vector, there is controversy about the role of the firing-rate dynamics of these neurons during saccades. In our earlier work, we proposed a simple quantitative model that explains how the recruited superior colliculus population may specify the detailed kinematics (trajectories and velocity profiles) of head-restrained saccadic eye movements. We here show that the same principles may apply to a wide range of saccadic eye-head gaze shifts with strongly varying kinematics, despite the substantial nonlinearities and redundancy in programming and execute rapid goal-directed eye-head gaze shifts to peripheral targets. Our findings could provide additional evidence for an important role of the superior colliculus in the optimal control of saccades.

Dynamic control of eye-head gaze shifts by a spiking neural network model of the superior colliculus

INTRODUCTION

To reorient gaze (the eye's direction in space) towards a target is an overdetermined problem, as infinitely many combinations of eye- and head movements can specify the same gaze-displacement vector. Yet, behavioral measurements show that the primate gaze-control system selects a specific contribution of eye- and head movements to the saccade, which depends on the initial eye-in-head orientation. Single-unit recordings in the primate superior colliculus (SC) during head-unrestrained gaze shifts have further suggested that cells may encode the instantaneous trajectory of a desired straight gaze path in a feedforward way by the total cumulative number of spikes in the neural population, and that the instantaneous gaze kinematics are thus determined by the neural firing rates. The recordings also indicated that the latter is modulated by the initial eye position. We recently proposed a conceptual model that accounts for many of the observed properties of eye-head gaze shifts and on the potential role of the SC in gaze control.

METHODS

Here, we extend and test the model by incorporating a spiking neural network of the SC motor map, the output of which drives the eye-head motor control circuitry by linear cumulative summation of individual spike effects of each recruited SC neuron. We propose a simple neural mechanism on SC cells that explains the modulatory influence of feedback from an initial eye-in-head position signal on their spiking activity. The same signal also determines the onset delay of the head movement with respect to the eye. Moreover, the downstream eye- and head burst generators were taken to be linear, as our earlier work had indicated that much of the non-linear main-sequence kinematics of saccadic eye movements may be due to neural encoding at the collicular level, rather than at the brainstem.

RESULTS AND DISCUSSION

We investigate how the spiking activity of the SC population drives gaze to the intended target location within a dynamic local gaze-velocity feedback circuit that yields realistic eye- and head-movement kinematics and dynamic SC gaze-movement fields.

What are the visuo-motor tendencies of omnidirectional scene free-viewing in virtual reality?

Central and peripheral vision during visual tasks have been extensively studied on two-dimensional screens, highlighting their perceptual and functional disparities. This study has two objectives: replicating on-screen gaze-contingent experiments removing central or peripheral field of view in virtual reality, and identifying visuo-motor biases specific to the exploration of 360 scenes with a wide field of view. Our results are useful for vision modelling, with applications in gaze position prediction (e.g., content compression and streaming). We ask how previous on-screen findings translate to conditions where observers can use their head to explore stimuli. We implemented a gaze-contingent paradigm to simulate loss of vision in virtual reality, participants could freely view omnidirectional natural scenes. This protocol allows the simulation of vision loss with an extended field of view (\(\gt \)80°) and studying the head's contributions to visual attention. The time-course of visuo-motor variables in our pure free-viewing task reveals long fixations and short saccades during first seconds of exploration, contrary to literature in visual tasks guided by instructions. We show that the effect of vision loss is reflected primarily on eye movements, in a manner consistent with two-dimensional screens literature. We hypothesize that head movements mainly serve to explore the scenes during free-viewing, the presence of masks did not significantly impact head scanning behaviours. We present new fixational and saccadic visuo-motor tendencies in a 360° context that we hope will help in the creation of gaze prediction models dedicated to virtual reality.

Method for evaluating ophthalmic lens based on Eye-Lens-Object optical system

We propose an evaluation method to judge the fitting extent to ophthalmic lens for the individual wearer. An Eye-Lens-Object optical system is set according to wearer's visual performance and the characteristic of ophthalmic lens assembly. A visual reference surface is proposed to calculate the object distance. The RMS radius of the spot diagram and MTF average value from optical design software Zemax are regarded as the criterion of assessing the image quality on the retina. Three cases are simulated to verify that our method is effective. The wearers can experience a comfortable wearing feeling when the evaluation method is used during the design of ophthalmic lens. The validity of our method is demonstrated to instruct designing the progressive addition lens with the freeform surface.

Eye-head-hand coordination during visually guided reaches in head-unrestrained macaques

Nonhuman primates have been used extensively to study eye-head coordination and eye-hand coordination, but the combination-eye-head-hand coordination-has not been studied. Our goal was to determine whether reaching influences eye-head coordination (and vice versa) in rhesus macaques. Eye, head, and hand motion were recorded in two animals with search coil and touch screen technology, respectively. Animals were seated in a customized "chair" that allowed unencumbered head motion and reaching in depth. In the reach condition, animals were trained to touch a central LED at waist level while maintaining central gaze and were then rewarded if they touched a target appearing at 1 of 15 locations in a 40° × 20° (visual angle) array. In other variants, initial hand or gaze position was varied in the horizontal plane. In similar control tasks, animals were rewarded for gaze accuracy in the absence of reach. In the Reach task, animals made eye-head gaze shifts toward the target followed by reaches that were accompanied by prolonged head motion toward the target. This resulted in significantly higher head velocities and amplitudes (and lower eye-in-head ranges) compared with the gaze control condition. Gaze shifts had shorter latencies and higher velocities and were more precise, despite the lack of gaze reward. Initial hand position did not influence gaze, but initial gaze position influenced reach latency. These results suggest that eye-head coordination is optimized for visually guided reach, first by quickly and accurately placing gaze at the target to guide reach transport and then by centering the eyes in the head, likely to improve depth vision as the hand approaches the target.NEW & NOTEWORTHY Eye-head and eye-hand coordination have been studied in nonhuman primates but not the combination of all three effectors. Here we examined the timing and kinematics of eye-head-hand coordination in rhesus macaques during a simple reach-to-touch task. Our most novel finding was that (compared with hand-restrained gaze shifts) reaching produced prolonged, increased head rotation toward the target, tending to center the binocular field of view on the target/hand.

Motor action of the frontal eye field on the eyes and neck in the monkey

Focal stimulation in the frontal eye field (FEF) evoked eye movements that were often accompanied by neck movements. Experiments were performed with concurrent recording of both movements in trained monkeys. We recorded neck forces under a head-restrained condition with a force-measuring system. With the system, we measured forces along the x-, y-, and z-axes and torque about the z-axis. Torque about the z-axis that represented yaw rotation of the head was significantly affected by stimulation. We found that stimulation generated two types of motor actions of the eyes and neck. In the first type, contraversive neck forces were evoked by stimulation of the medial part of the FEF, where contraversive saccadic eye movements with large amplitudes were evoked. When the stimulus intensity was increased, saccades were evoked in an all-or-none manner, whereas the amplitude of neck forces increased gradually. In the second type, contraversive neck forces were evoked by stimulation of the medial and caudal part of the FEF, where ipsiversive slow eye movements were evoked. The depth profiles of amplitudes of neck forces were almost parallel to those of eye movements in individual stimulation tracks. The present results suggest that the FEF is involved in the control of motor actions of the neck as well as the eyes. The FEF area associated with contraversive saccades and contraversive neck movements may contribute to a gaze shift process, whereas that associated with ipsiversive slow eye movements and contraversive neck movements may contribute to a visual stabilization process. NEW & NOTEWORTHY Focal stimulation in the frontal eye field (FEF) evoked eye and neck movements. We recorded neck forces under a head-restrained condition with a force-measuring system. Taking advantage of this approach, we could analyze slow eye movements that were dissociated from the vestibuloocular reflex. We found ipsiversive slow eye movements in combination with contraversive neck forces, suggesting that the FEF may be a source of a corollary discharge signal for compensatory eye movements during voluntary neck movements.

Corrective response times in a coordinated eye-head-arm countermanding task

Inhibition of motor responses has been described as a race between two competing decision processes of motor initiation and inhibition, which manifest as the reaction time (RT) and the stop signal reaction time (SSRT); in the case where motor initiation wins out over inhibition, an erroneous movement occurs that usually needs to be corrected, leading to corrective response times (CRTs). Here we used a combined eye-head-arm movement countermanding task to investigate the mechanisms governing multiple effector coordination and the timing of corrective responses. We found a high degree of correlation between effector response times for RT, SSRT, and CRT, suggesting that decision processes are strongly dependent across effectors. To gain further insight into the mechanisms underlying CRTs, we tested multiple models to describe the distribution of RTs, SSRTs, and CRTs. The best-ranked model (according to 3 information criteria) extends the LATER race model governing RTs and SSRTs, whereby a second motor initiation process triggers the corrective response (CRT) only after the inhibition process completes in an expedited fashion. Our model suggests that the neural processing underpinning a failed decision has a residual effect on subsequent actions. NEW & NOTEWORTHY Failure to inhibit erroneous movements typically results in corrective movements. For coordinated eye-head-hand movements we show that corrective movements are only initiated after the erroneous movement cancellation signal has reached a decision threshold in an accelerated fashion.

Three-Dimensional Representation of Motor Space in the Mouse Superior Colliculus

From the act of exploring an environment to that of grasping a cup of tea, animals must put in register their motor acts with their surrounding space. In the motor domain, this is likely to be defined by a register of three-dimensional (3D) displacement vectors, whose recruitment allows motion in the direction of a target. One such spatially targeted action is seen in the head reorientation behavior of mice, yet the neural mechanisms underlying these 3D behaviors remain unknown. Here, by developing a head-mounted inertial sensor for studying 3D head rotations and combining it with electrophysiological recordings, we show that neurons in the mouse superior colliculus are either individually or conjunctively tuned to the three Eulerian components of head rotation. The average displacement vectors associated with motor-tuned colliculus neurons remain stable over time and are unaffected by changes in firing rate or the duration of spike trains. Finally, we show that the motor tuning of collicular neurons is largely independent from visual or landmark cues. By describing the 3D nature of motor tuning in the superior colliculus, we contribute to long-standing debate on the dimensionality of collicular motor decoding; furthermore, by providing an experimental paradigm for the study of the metric of motor tuning in mice, this study also paves the way to the genetic dissection of the circuits underlying spatially targeted motion.

•

Development of inertial sensor system for monitoring 3D head movements in real time

•

Neurons in the superior colliculus code for the full dimensionality of head rotations

•

Firing rate correlates with velocity, but not head displacement angle

•

The spatial tuning of collicular units is largely independent of visual or landmark cues

Acquisition of Predictable Vertical Visual Targets: Eye-Head Coordination and the Triggering Effect

The study was designed to investigate target acquisition in the vertical plane with emphasis on establishing strategy differences associated with acquisition triggering methods. Eight subjects were tested. Measurements consisted of target acquisition time, eye-head latency differences, velocity of gaze, eyes and head, and head amplitude. Using 3-way repeated measures analyses of variance the results show that the strategy for acquisition of predictable visual targets in vertical plane with the head unrestrained significantly depended on (a) the direction of the gaze motion with respect to the gravity vector (i.e., there is significant up-down asymmetry), (b) the angular distance of the target, and (c) the method of triggering the command to acquire the target-external versus internal. The data also show that when vertical acquisition is compared with triggering methods in the horizontal plane there is a difference in overall strategy for the acquisition of targets with the same spatial distances from straight ahead gaze when both the eyes and head are used. Among the factors contributing to the difference in strategy for vertical target acquisition are the gravitational vector, the relationship of target displacement and vestibular activitation, biomechanical and neural control asymmetries, and the difference in the vertical field of view.

Modeling eye-head gaze shifts in multiple contexts without motor planning

During gaze shifts, the eyes and head collaborate to rapidly capture a target (saccade) and fixate it. Accordingly, models of gaze shift control should embed both saccadic and fixation modes and a mechanism for switching between them. We demonstrate a model in which the eye and head platforms are driven by a shared gaze error signal. To limit the number of free parameters, we implement a model reduction approach in which steady-state cerebellar effects at each of their projection sites are lumped with the parameter of that site. The model topology is consistent with anatomy and neurophysiology, and can replicate eye-head responses observed in multiple experimental contexts: 1) observed gaze characteristics across species and subjects can emerge from this structure with minor parametric changes; 2) gaze can move to a goal while in the fixation mode; 3) ocular compensation for head perturbations during saccades could rely on vestibular-only cells in the vestibular nuclei with postulated projections to burst neurons; 4) two nonlinearities suffice, i.e., the experimentally-determined mapping of tectoreticular cells onto brain stem targets and the increased recruitment of the head for larger target eccentricities; 5) the effects of initial conditions on eye/head trajectories are due to neural circuit dynamics, not planning; and 6) "compensatory" ocular slow phases exist even after semicircular canal plugging, because of interconnections linking eye-head circuits. Our model structure also simulates classical vestibulo-ocular reflex and pursuit nystagmus, and provides novel neural circuit and behavioral predictions, notably that both eye-head coordination and segmental limb coordination are possible without trajectory planning.

Saliency-based gaze prediction based on head direction

Despite decades of attempts to create a model for predicting gaze locations by using saliency maps, a highly accurate gaze prediction model for general conditions has yet to be devised. In this study, we propose a gaze prediction method based on head direction that can improve the accuracy of any model. We used a probability distribution of eye position based on head direction (static eye-head coordination) and added this information to a model of saliency-based visual attention. Using empirical data on eye and head directions while observers were viewing natural scenes, we estimated a probability distribution of eye position. We then combined the relationship between eye position and head direction with visual saliency to predict gaze locations. The model showed that information on head direction improved the prediction accuracy. Further, there was no difference in the gaze prediction accuracy between the two models using information on head direction with and without eye-head coordination. Therefore, information on head direction is useful for predicting gaze location when it is available. Furthermore, this gaze prediction model can be applied relatively easily to many daily situations such as during walking.

Eye-head coordination for visual cognitive processing

We investigated coordinated movements between the eyes and head (“eye-head coordination”) in relation to vision for action. Several studies have measured eye and head movements during a single gaze shift, focusing on the mechanisms of motor control during eye-head coordination. However, in everyday life, gaze shifts occur sequentially and are accompanied by movements of the head and body. Under such conditions, visual cognitive processing influences eye movements and might also influence eye-head coordination because sequential gaze shifts include cycles of visual processing (fixation) and data acquisition (gaze shifts). In the present study, we examined how the eyes and head move in coordination during visual search in a large visual field. Subjects moved their eyes, head, and body without restriction inside a 360° visual display system. We found patterns of eye-head coordination that differed those observed in single gaze-shift studies. First, we frequently observed multiple saccades during one continuous head movement, and the contribution of head movement to gaze shifts increased as the number of saccades increased. This relationship between head movements and sequential gaze shifts suggests eye-head coordination over several saccade-fixation sequences; this could be related to cognitive processing because saccade-fixation cycles are the result of visual cognitive processing. Second, distribution bias of eye position during gaze fixation was highly correlated with head orientation. The distribution peak of eye position was biased in the same direction as head orientation. This influence of head orientation suggests that eye-head coordination is involved in gaze fixation, when the visual system processes retinal information. This further supports the role of eye-head coordination in visual cognitive processing.

Gaze shifts to auditory and visual stimuli in cats

While much is known about the metrics and kinematics of gaze shifts to visual targets in cats, little is known about gaze shifts to auditory targets. Here, cats were trained to localize auditory and visual targets via gaze shifts. Five properties of gaze shifts to sounds were observed. First, gaze shifts were accomplished primarily by large head movements. Unlike primates, the head movement in cats often preceded eye movement though the relative timing of eye in head and head latencies depended upon the target modality and gaze shift magnitude. Second, gaze shift latencies to auditory targets tended to be shorter than equivalent shifts to visual targets for some conditions. Third, the main sequences relating gaze amplitude to maximum gaze velocity for auditory and visual targets were comparable. However, head movements to auditory and visual targets were less consistent than gaze shifts and tended to undershoot the targets by 30 % for both modalities. Fourth, at the end of gaze movement, the proportion of the gaze shift accomplished by the eye-in-head movement was greater to visual than auditory targets. On the other hand, at the end of head movement, the proportion of the gaze shift accomplished by the head was greater to auditory than visual targets. Finally, gaze shifts to long-duration auditory targets were accurate and precise and were similar to accuracy of gaze shifts to long-duration visual targets. Because the metrics of gaze shifts to visual and auditory targets are nearly equivalent, as well as their accuracy, we conclude that both sensorimotor tasks use primarily the same neural substrates for the execution of movement.

Interactions between gaze-evoked blinks and gaze shifts in monkeys

Rapid eyelid closure, or a blink, often accompanies head-restrained and head-unrestrained gaze shifts. This study examines the interactions between such gaze-evoked blinks and gaze shifts in monkeys. Blink probability increases with gaze amplitude and at a faster rate for head-unrestrained movements. Across animals, blink likelihood is inversely correlated with the average gaze velocity of large-amplitude control movements. Gaze-evoked blinks induce robust perturbations in eye velocity. Peak and average velocities are reduced, duration is increased, but accuracy is preserved. The temporal features of the perturbation depend on factors such as the time of blink relative to gaze onset, inherent velocity kinematics of control movements, and perhaps initial eye-in-head position. Although variable across animals, the initial effect is a reduction in eye velocity, followed by a reacceleration that yields two or more peaks in its waveform. Interestingly, head velocity is not attenuated; instead, it peaks slightly later and with a larger magnitude. Gaze latency is slightly reduced on trials with gaze-evoked blinks, although the effect was more variable during head-unrestrained movements; no reduction in head latency is observed. Preliminary data also demonstrate a similar perturbation of gaze-evoked blinks during vertical saccades. The results are compared with previously reported effects of reflexive blinks (evoked by air-puff delivered to one eye or supraorbital nerve stimulation) and discussed in terms of effects of blinks on saccadic suppression, neural correlates of the altered eye velocity signals, and implications on the hypothesis that the attenuation in eye velocity is produced by a head movement command.

Target modality determines eye-head coordination in nonhuman primates: implications for gaze control

We have studied eye-head coordination in nonhuman primates with acoustic targets after finding that they are unable to make accurate saccadic eye movements to targets of this type with the head restrained. Three male macaque monkeys with experience in localizing sounds for rewards by pointing their gaze to the perceived location of sources served as subjects. Visual targets were used as controls. The experimental sessions were configured to minimize the chances that the subject would be able to predict the modality of the target as well as its location and time of presentation. The data show that eye and head movements are coordinated differently to generate gaze shifts to acoustic targets. Chiefly, the head invariably started to move before the eye and contributed more to the gaze shift. These differences were more striking for gaze shifts of <20-25° in amplitude, to which the head contributes very little or not at all when the target is visual. Thus acoustic and visual targets trigger gaze shifts with different eye-head coordination. This, coupled to the fact that anatomic evidence involves the superior colliculus as the link between auditory spatial processing and the motor system, suggests that separate signals are likely generated within this midbrain structure.

Eye-head coordination in the guinea pig II. Responses to self-generated (voluntary) head movements

Retinal image stability is essential for vision but may be degraded by head movements. The vestibulo-ocular reflex (VOR) compensates for passive perturbations of head position and is usually assumed to be the major neural mechanism for ocular stability. During our recent investigation of vestibular reflexes in guinea pigs free to move their heads (Shanidze et al. in Exp Brain Res, 2010), we observed compensatory eye movements that could not have been initiated either by vestibular or neck proprioceptive reflexes because they occurred with zero or negative latency with respect to head movement. These movements always occurred in association with self-generated (active) head or body movements and thus anticipated a voluntary movement. We found the anticipatory responses to differ from those produced by the VOR in two significant ways. First, anticipatory responses are characterized by temporal synchrony with voluntary head movements (latency approximately 1 versus approximately 7 ms for the VOR). Second, the anticipatory responses have higher gains (0.80 vs. 0.46 for the VOR) and thus more effectively stabilize the retinal image during voluntary head movements. We suggest that anticipatory responses act synergistically with the VOR to stabilize retinal images. Furthermore, they are independent of actual vestibular sensation since they occur in guinea pigs with complete peripheral vestibular lesions. Conceptually, anticipatory responses could be produced by a feed-forward neural controller that transforms efferent motor commands for head movement into estimates of the sensory consequences of those movements.

Eye-head coordination in the guinea pig I. Responses to passive whole-body rotations

Vestibular reflexes act to stabilize the head and eyes in space during locomotion. Head stability is essential for postural control, whereas retinal image stability enhances visual acuity and may be essential for an animal to distinguish self-motion from that of an object in the environment. Guinea pig eye and head movements were measured during passive whole-body rotation in order to assess the efficacy of vestibular reflexes. The vestibulo-ocular reflex (VOR) produced compensatory eye movements with a latency of approximately 7 ms that compensated for 46% of head movement in the dark and only slightly more in the light (54%). Head movements, in response to abrupt body rotations, also contributed to retinal stability (21% in the dark; 25% in the light) but exhibited significant variability. Although compensatory eye velocity produced by the VOR was well correlated with head-in-space velocity, compensatory head-on-body speed and direction were variable and poorly correlated with body speed. The compensatory head movements appeared to be determined by passive biomechanical (e.g., inertial effects, initial tonus) and active mechanisms (the vestibulo-collic reflex or VCR). Chemically induced, bilateral lesions of the peripheral vestibular system abolished both compensatory head and eye movement responses.

Decoding 3D search coil signals in a non-homogeneous magnetic field

We present a method for recording eye-head movements with the magnetic search coil technique in a small external magnetic field. Since magnetic fields are typically non-linear, except in a relative small region in the center small field frames have not been used for head-unrestrained experiments in oculomotor studies. Here we present a method for recording 3D eye movements by accounting for the magnetic non-linearities using the Biot-Savart law. We show that the recording errors can be significantly reduced by monitoring current head position and thereby taking the location of the eye in the external magnetic field into account.

The mesencephalic reticular formation as a conduit for primate collicular gaze control: tectal inputs to neurons targeting the spinal cord and medulla

The superior colliculus (SC), which directs orienting movements of both the eyes and head, is reciprocally connected to the mesencephalic reticular formation (MRF), suggesting the latter is involved in gaze control. The MRF has been provisionally subdivided to include a rostral portion, which subserves vertical gaze, and a caudal portion, which subserves horizontal gaze. Both regions contain cells projecting downstream that may provide a conduit for tectal signals targeting the gaze control centers which direct head movements. We determined the distribution of cells targeting the cervical spinal cord and rostral medullary reticular formation (MdRF), and investigated whether these MRF neurons receive input from the SC by the use of dual tracer techniques in Macaca fascicularis monkeys. Either biotinylated dextran amine or Phaseolus vulgaris leucoagglutinin was injected into the SC. Wheat germ agglutinin conjugated horseradish peroxidase was placed into the ipsilateral cervical spinal cord or medial MdRF to retrogradely label MRF neurons. A small number of medially located cells in the rostral and caudal MRF were labeled following spinal cord injections, and greater numbers were labeled in the same region following MdRF injections. In both cases, anterogradely labeled tectoreticular terminals were observed in close association with retrogradely labeled neurons. These close associations between tectoreticular terminals and neurons with descending projections suggest the presence of a trans-MRF pathway that provides a conduit for tectal control over head orienting movements. The medial location of these reticulospinal and reticuloreticular neurons suggests this MRF region may be specialized for head movement control.

3-Dimensional eye-head coordination in gaze shifts evoked during stimulation of the lateral intraparietal cortex

Coordinated eye-head gaze shifts have been evoked during electrical stimulation of the frontal cortex (supplementary eye field (SEF) and frontal eye field (FEF)) and superior colliculus (SC), but less is known about the role of lateral intraparietal cortex (LIP) in head-unrestrained gaze shifts. To explore this, two monkeys (M1 and M2) were implanted with recording chambers and 3-D eye+ head search coils. Tungsten electrodes delivered trains of electrical pulses (usually 200 ms duration) to and around area LIP during head-unrestrained gaze fixations. A current of 200 muA consistently evoked small, short-latency contralateral gaze shifts from 152 sites in M1 and 243 sites in M2 (Constantin et al., 2007). Gaze kinematics were independent of stimulus amplitude and duration, except that subsequent saccades were suppressed. The average amplitude of the evoked gaze shifts was 8.46 degrees for M1 and 8.25 degrees for M2, with average head components of only 0.36 and 0.62 degrees respectively. The head's amplitude contribution to these movements was significantly smaller than in normal gaze shifts, and did not increase with behavioral adaptation. Stimulation-evoked gaze, eye and head movements qualitatively obeyed normal 3-D constraints (Donders' law and Listing's law), but with less precision. As in normal behavior, when the head was restrained LIP stimulation evoked eye-only saccades in Listing's plane, whereas when the head was not restrained, stimulation evoked saccades with position-dependent torsional components (driving the eye out of Listing's plane). In behavioral gaze-shifts, the vestibuloocular reflex (VOR) then drives torsion back into Listing's plane, but in the absence of subsequent head movement the stimulation-induced torsion was "left hanging". This suggests that the position-dependent torsional saccade components are preprogrammed, and that the oculomotor system was expecting a head movement command to follow the saccade. These data show that, unlike SEF, FEF, and SC stimulation in nearly identical conditions, LIP stimulation fails to produce normally-coordinated eye-head gaze shifts.

Optimal control of gaze shifts

To explore the visible world, human beings and other primates often rely on gaze shifts. These are coordinated movements of the eyes and head characterized by stereotypical metrics and kinematics. It is possible to determine the rules that the effectors must obey to execute them rapidly and accurately and the neural commands needed to implement these rules with the help of optimal control theory. In this study, we demonstrate that head-fixed saccades and head-free gaze shifts obey a simple physical principle, "the minimum effort rule." By direct comparison with existing models of the neural control of gaze shifts, we conclude that the neural circuitry that implements the minimum effort rule is one that uses inhibitory cross talk between independent eye and head controllers.

Oblique gaze shifts: head movements reveal new aspects of component coupling

When the head is prevented from moving, it has been clearly demonstrated that the horizontal and vertical components of oblique saccades are not independently produced. The duration of the smaller of the two components is stretched in time to match the duration of the larger component. Several hypotheses have been proposed and each can account for the observed interaction between horizontal and vertical saccade components. When the head is free to move, gaze shifts can be accomplished by combining eye and head movements. During repeated gaze shifts of the same amplitude, as head contribution increases, saccade amplitude declines but saccade duration increases. Thus, the expected relationship between duration and amplitude of saccadic eye movements can be reversed. We have used this altered relationship to determine whether the duration of the vertical saccade component is affected by the amplitude or the duration of the horizontal component. We find that the relative amplitudes of horizontal and vertical saccades cannot account for the observed temporal stretching: vertical component duration increases despite a decrease in the amplitude of the horizontal component. These results are likely inconsistent with models that rely on calculating the vector or relative component amplitudes to account for component stretching.

Coordination of the eyes and head during visual orienting

Changing the direction of the line of sight is essential for the visual exploration of our environment. When the head does not move, re-orientation of the visual axis is accomplished with high velocity, conjugate movements of the eyes known as saccades. Our understanding of the neural mechanisms that control saccadic eye movements has advanced rapidly as specific hypotheses have been developed, evaluated and sometimes rejected on the basis of new observations. Constraints on new hypotheses and new tests of existing models have often arisen from the careful assessment of behavioral observations. The definition of the set of features (or rules) of saccadic eye movements was critical in the development of hypotheses of their neural control. When the head is free to move, changes in the direction of the line of sight can involve simultaneous saccadic eye movements and movements of the head. When the head moves in conjunction with the eyes to accomplish these shifts in gaze direction, the rules that helped define head-restrained saccadic eye movements are altered. For example, the slope relationship between duration and amplitude for saccadic eye movements is reversed (the slope is negative) during gaze shifts of similar amplitude initiated with the eyes in different orbital positions. Modifications to the hypotheses developed in head-restrained subjects may be needed to account for these new observations. This review briefly recounts features of head-restrained saccadic eye movements, and then describes some of the characteristics of coordinated eye-head movements that have led to development of new hypotheses describing the mechanisms of gaze shift control.

The coordination of eye, head, and arm movements during rapid gaze orienting and arm pointing

This study aimed to investigate the coordination of multiple control actions involved in human horizontal gaze orienting or arm pointing to a common visual target. The subjects performed a visually triggered reaction time task in three conditions: (1) gaze orienting with a combined eye saccade and head rotation (EH), (2) arm pointing with gaze orienting by an eye saccade without head rotation (EA), and (3) arm pointing with gaze orienting by a combined eye saccade and head rotation (EHA). The subjects initiated eye movement first with nearly constant latencies across all tasks, followed by head movement in the EH task, by arm movement in the EA task, and by head and then arm movements in the EHA task. The differences of onset times between eye and head movements in the EH task, and between eye and arm movements in the EA task, were both preserved in the EHA task, leading to an eye-to-head-to-arm sequence. The onset latencies of eye and head in the EH task, eye and arm in the EA task, and eye, head and arm in the EHA task, were all positively correlated on a trial-by-trial basis. In the EHA task, however, the correlation coefficients of eye-head coupling and of eye-arm coupling were reduced and increased, respectively, compared to those estimated in the two-effector conditions (EH, EA). These results suggest that motor commands for different motor effectors are linked differently to achieve coordination in a task-dependent manner.

Frames of reference for gaze saccades evoked during stimulation of lateral intraparietal cortex

Previous studies suggest that stimulation of lateral intraparietal cortex (LIP) evokes saccadic eye movements toward eye- or head-fixed goals, whereas most single-unit studies suggest that LIP uses an eye-fixed frame with eye-position modulations. The goal of our study was to determine the reference frame for gaze shifts evoked during LIP stimulation in head-unrestrained monkeys. Two macaques (M1 and M2) were implanted with recording chambers over the right intraparietal sulcus and with search coils for recording three-dimensional eye and head movements. The LIP region was microstimulated using pulse trains of 300 Hz, 100-150 microA, and 200 ms. Eighty-five putative LIP sites in M1 and 194 putative sites in M2 were used in our quantitative analysis throughout this study. Average amplitude of the stimulation-evoked gaze shifts was 8.67 degrees for M1 and 7.97 degrees for M2 with very small head movements. When these gaze-shift trajectories were rotated into three coordinate frames (eye, head, and body), gaze endpoint distribution for all sites was most convergent to a common point when plotted in eye coordinates. Across all sites, the eye-centered model provided a significantly better fit compared with the head, body, or fixed-vector models (where the latter model signifies no modulation of the gaze trajectory as a function of initial gaze position). Moreover, the probability of evoking a gaze shift from any one particular position was modulated by the current gaze direction (independent of saccade direction). These results provide causal evidence that the motor commands from LIP encode gaze command in eye-fixed coordinates but are also subtly modulated by initial gaze position.

Three-Dimensional Eye–Head Coordination After Injection of Muscimol Into the Interstitial Nucleus of Cajal (INC)

The interstitial nucleus of Cajal (INC) is thought to be the “neural integrator” for torsional/vertical eye position and head posture. Here, we investigated the coordination of eye and head movements after reversible INC inactivation. Three-dimensional (3-D) eye–head movements were recorded in three head-unrestrained monkeys using search coils. INC sites were identified by unit recording/electrical stimulation and then reversibly inactivated by 0.3 μl of 0.05% muscimol injection into 26 INC sites. After muscimol injection, the eye and head 1) began to drift (an inability to maintain stable fixation) torsionally: clockwise (CW)/counterclockwise (CCW) after left/right INC inactivation respectively. 2) The eye and head tilted torsionally CW/CCW after left/right INC inactivation, respectively. Horizontal gaze/head drifts were inconsistently present and did not result in considerable position offsets. Vertical eye drift was dependent on both vertical eye position and the magnitude of the previous vertical saccade, as in head-fixed condition. This correlation was smaller for gaze and head drift, suggesting that the gaze and head deficits could not be explained by a first-order integrator model. Ocular counterroll (OC) was completely disrupted. The gain of torsional vestibuloocular reflex (VOR) during spontaneous eye and head movements was reduced by 22% in both CW/CCW directions after either left or right INC inactivation. Our results suggest a complex interdependence of eye and head deficits after INC inactivation during fixation, gaze shifts, and VOR. Some of our results resemble the symptoms of spasmodic torticollis (ST).

Visual-Vestibular Interaction Hypothesis for the Control of Orienting Gaze Shifts by Brain Stem Omnipause Neurons

Models of combined eye-head gaze shifts all aim to realistically simulate behaviorally observed movement dynamics. One of the most problematic features of such models is their inability to determine when a saccadic gaze shift should be initiated and when it should be ended. This is commonly referred to as the switching mechanism mediated by omni-directional pause neurons (OPNs) in the brain stem. Proposed switching strategies implemented in existing gaze control models all rely on a sensory error between instantaneous gaze position and the spatial target. Accordingly, gaze saccades are initiated after presentation of an eccentric visual target and subsequently terminated when an internal estimate of gaze position becomes nearly equal to that of the target. Based on behavioral observations, we demonstrate that such a switching mechanism is insufficient and is unable to explain certain types of movements. We propose an improved hypothesis for how the OPNs control gaze shifts based on a visual-vestibular interaction of signals known to be carried on anatomical projections to the OPN area. The approach is justified by the analysis of recorded gaze shifts interrupted by a head brake in animal subjects and is demonstrated by implementing the switching mechanism in an anatomically based gaze control model. Simulated performance reveals that a weighted sum of three signals: gaze motor error, head velocity, and eye velocity, hypothesized as inputs to OPNs, successfully reproduces diverse behaviorally observed eye-head movements that no other existing model can account for.

Head movement control in visually guided tasks: postural goal and optimality

This work investigates the control of horizontal head movements in the context of unconstrained visually guided head and arm/finger aiming tasks. In a first experiment, the head was free to move while gaze was directed at randomly presented eccentric targets distributed horizontally (0 degrees-120 degrees) at eye level. In a second experiment, the horizontal head orientation was constrained to predetermined positions (0 degrees, 15 degrees, 30 degrees, 45 degrees or 60 degrees rightward) while the right index finger aimed at targets with the arm fully extended. Kinematics of head movements in gaze displacements exhibits an initial component weakly correlated with target position, followed by multiple corrections. Since the eyes are assumed to already be aimed at the target when the corrections occur, it is suggested that one goal of head movement control is to achieve a desired final orientation (posture). This hypothesis is supported by results from the second experiment that reveal an association between eye/head orientation angles and errors exhibited in the visuo-spatial representation of the environment. The minimization of error then underlies the control of head movement as a postural response optimized for a given target and task condition.

Variables contributing to the coordination of rapid eye/head gaze shifts

In this article results of several published studies are synthesized in order to address the neural system for the determination of eye and head movement amplitudes of horizontal eye/head gaze shifts with arbitrary initial head and eye positions. Target position, initial head position, and initial eye position span the space of physical parameters for a planned eye/head gaze saccade. The principal result is that a functional mechanism for determining the amplitudes of the component eye and head movements must use the entire space of variables. Moreover, it is shown that amplitudes cannot be determined additively by summing contributions from single variables. Many earlier models calculate amplitudes as a function of one or two variables and/or restrict consideration to best-fit linear formulae. Our analysis systematically eliminates such models as candidates for a system that can generate appropriate movements for all possible initial conditions. The results of this study are stated in terms of properties of the response system. Certain axiom sets for the intrinsic organization of the response system obey these properties. We briefly provide one example of such an axiomatic model. The results presented in this article help to characterize the actual neural system for the control of rapid eye/head gaze shifts by showing that, in order to account for behavioral data, certain physical quantities must be represented in and used by the neural system. Our theoretical analysis generates predictions and identifies gaps in the data. We suggest needed experiments.

Magnetic Resonance Imaging of Human Extraocular Muscles During Static Ocular Counter-Rolling

The rectus extraocular muscle (EOM) pulleys constrain EOM paths. During visual fixation with head immobile, actively controlled pulleys are known to maintain positions causing EOM pulling directions to change by one-half the change in eye position. This pulley behavior is consistent with Listing's law (LL) of ocular torsion as observed during fixation, saccades, and pursuit. However, pulley behavior during the vestibulo-ocular reflex (VOR) has been unstudied. This experiment studied ocular counter-rolling (OCR), a static torsional VOR that violates LL but can be evoked during MRI. Tri-planar MRI was performed in 10 adult humans during central target fixation while positioned in right and left side down positions known to evoke static OCR. EOM cross-sections and paths were determined from area centroids. Paths were used to locate pulleys in three dimensions. Significant ( P < 0.025) counter-rotational repositioning of the rectus pulley arrays of both orbits was observed in the coronal plane averaging 4.1° (maximum, 8.7°) from right to left side down positions for the inferior, medial, and superior rectus pulleys. There was a trend for the lateral rectus averaging 1.4°. Torsional shift of the rectus pulley array was associated with significant contractile cross-section changes in the superior and inferior oblique muscles. Torsional rectus pulley shift during OCR, which changes pulling directions of the rectus EOMs, correlates with known insertions of the oblique EOM orbital layers on rectus pulleys. The amount of pulley reconfiguration is roughly one-half of published values of ocular torsion during static OCR, an arrangement that would cause rectus pulling directions to change by less than one-half the amount of ocular torsion.

Head–eye interactions during vertical gaze shifts made by rhesus monkeys

Changing the direction of the line of sight (gaze) can involve coordinated movements of the eyes and head. During gaze shifts directed along the horizontal meridian, the contribution of the eyes and head depends upon the position of the eyes in the orbits; the contribution of the head to accomplishing the overall shift in gaze declines as the eyes increasingly are deviated away from the direction of the ensuing gaze shift. Also during horizontal gaze shifts, changes in the metrics and kinematics of the saccadic (eye movement) portion of coordinated movements, are correlated with the amplitude and velocity of the concurrent head movement. With increasing head contributions, saccade peak velocities decline, durations increase and velocity profiles develop two peaks. It remains unknown whether the interaction between head and eyes observed during horizontal gaze shifts also occurs during vertical gaze shifts. Yet, a full understanding of the neural control of eye-head coordination will depend upon the correlation of neural activity and features of vertical as well as horizontal movements. This report describes the metrics and kinematics of vertical gaze shifts made by head-unrestrained rhesus monkeys. Key observations include: (1) during vertical gaze shifts of a particular amplitude, relative eye and head contributions depend upon the initial vertical positions of the eyes in the orbits; (2) as head contribution increases, peak eye velocities decline, durations increase and vertical velocity profiles develop two peaks; (3) head movement metrics and kinematics are accurately predictable given knowledge only of head movement amplitude. In these ways, vertical gaze shifts were found to be qualitatively similar to horizontal gaze shifts. It seems probable that similar mechanisms mediate head-eye interactions during both horizontal and vertical movements. These observations are consistent with the hypothesis that a signal proportional to vertical head velocity reduces the gain of the vertical saccade burst generator.

Role of Superior Colliculus in Adaptive Eye–Head Coordination During Gaze Shifts

The goal of this study was to determine which aspects of adaptive eye–head coordination are implemented upstream or downstream from the motor output layers of the superior colliculus (SC). Two monkeys were trained to perform head-free gaze shifts while looking through a 10° aperture in opaque, head-fixed goggles. This training produced context-dependent alterations in eye–head coordination, including a coordinated pattern of saccade–vestibuloocular reflex (VOR) eye movements that caused eye position to converge toward the aperture, and an increased contribution of head movement to the gaze shift. One would expect the adaptations that were implemented downstream from the SC to be preserved in gaze shifts evoked by SC stimulation. To test this, we analyzed gaze shifts evoked from 19 SC sites in monkey 1 and 38 sites in monkey 2, both with and without goggles. We found no evidence that the goggle paradigm altered the basic gaze position–dependent spatial coding of the evoked movements (i.e., gaze was still coded in an eye-centered frame). However, several aspects of the context-dependent coordination strategy were preserved during stimulation, including the adaptive convergence of final eye position toward the goggles aperture, and the position-dependent patterns of eye and head movement required to achieve this. For example, when initial eye position was offset from the learned aperture location at the time of stimulation, a coordinated saccade–VOR eye movement drove it back to the original aperture, and the head compensated to preserve gaze kinematics. Some adapted amplitude–velocity relationships in eye, gaze, and head movement also may have been preserved. In contrast, context-dependent changes in overall eye and head contribution to gaze amplitude were not preserved during SC stimulation. We conclude that 1) the motor output command from the SC to the brain stem can be adapted to produce different position-dependent coordination strategies for different behavioral contexts, particularly for eye-in-head position, but 2) these brain stem coordination mechanisms implement only the default (normal) level of head amplitude contribution to the gaze shift. We propose that a parallel cortical drive, absent during SC stimulation, is required to adjust the overall head contribution for different behavioral contexts.

Electrical stimulation of rhesus monkey nucleus reticularis gigantocellularis. II. Effects on metrics and kinematics of ongoing gaze shifts to visual targets

Saccade kinematics are altered by ongoing head movements. The hypothesis that a head movement command signal, proportional to head velocity, transiently reduces the gain of the saccadic burst generator (Freedman 2001, Biol Cybern 84:453-462) can account for this observation. Using electrical stimulation of the rhesus monkey nucleus reticularis gigantocellularis (NRG) to alter the head contribution to ongoing gaze shifts, two critical predictions of this gaze control hypothesis were tested. First, this hypothesis predicts that activation of the head command pathway will cause a transient reduction in the gain of the saccadic burst generator. This should alter saccade kinematics by initially reducing velocity without altering saccade amplitude. Second, because this hypothesis does not assume that gaze amplitude is controlled via feedback, the added head contribution (produced by NRG stimulation on the side ipsilateral to the direction of an ongoing gaze shift) should lead to hypermetric gaze shifts. At every stimulation site tested, saccade kinematics were systematically altered in a way that was consistent with transient reduction of the gain of the saccadic burst generator. In addition, gaze shifts produced during NRG stimulation were hypermetric compared with control movements. For example, when targets were briefly flashed 30 degrees from an initial fixation location, gaze shifts during NRG stimulation were on average 140% larger than control movements. These data are consistent with the predictions of the tested hypothesis, and may be problematic for gaze control models that rely on feedback control of gaze amplitude, as well as for models that do not posit an interaction between head commands and the saccade burst generator.

The influence of future gaze orientation upon eye-head coupling during saccades

Mammals with foveas (or analogous retinal specializations) frequently shift gaze without moving the head, and their behavior contrasts sharply with "afoveate" mammals, in which eye and head movements are strongly coupled. The ability to move the eyes without moving the head could reflect a gating mechanism that blocks a default eye-head synergy when an attempted head movement would be energetically wasteful. Based upon such considerations of efficiency, we predicted that for saccades to targets lying within the ocular motor range, the tendency to generate a head movement would depend upon a subject's expectations regarding future directions of gaze. We tested this hypothesis in two experiments with normal human subjects instructed to fixate sequences of lighted targets on a semicircular array. In the target direction experiment, we determined whether subjects were more likely to move the head during a small gaze shift if they expected that they would be momentarily required to make a second, larger shift in the same direction. Adding the onward-directed target increased significantly the distribution of final head positions (customary head orientation range, CHOR) observed during fixation of the primary target from 16.6+/-4.9 degrees to 25.2+/-7.8 degrees. The difference reflected an increase in the probability, and possibly the amplitude, of head movements. In the target duration experiment, we determined whether head movements were potentiated when subjects expected that gaze would be held in the vicinity of the target for a longer period of time. Prolonging fixation increased CHOR significantly from 53.7+/-18.8 degrees to 63.2+/-15.9 degrees. Larger head movements were evoked for any given target eccentricity, due to a narrowing in the gap between the x-intercepts of the head amplitude:target eccentricity relationship. The results are consistent with the idea that foveate mammals use knowledge of future gaze direction to influence the coupling of saccadic commands to premotor circuitry of the head. While the circuits ultimately mediating the coupling may lie within the brainstem, our results suggest that the cerebrum plays a supervisory role, since it is a likely seat of expectation regarding target behavior. Eye-head coupling may reflect separate gating and scaling mechanisms, and changes in head movement tendencies may reflect parametric modulation of either mechanism.

Children's search for targets located within and beyond the field of view: effects of deafness and age

The localisation time of visual targets within and beyond the field of view and the relative timing of the onsets of eye and head movements were examined in deaf and hearing children of two age groups: 5-7 years and 10-12 years. Compared to their hearing peers, the deaf children showed more often a mode of eye-head coordination in which the head leads the eye. The discrepancy between the onsets of eye and head movements were greater for the younger than for the older groups. Furthermore, the deaf children took more time than the hearing children to localise the targets; especially the young deaf differed from their hearing contemporaries. These findings support the view that during development the differences in visual search between deaf and hearing children decrease. The results are discussed in the context of a distinction between representational and sensorimotor control of eye-head responses.

Three-dimensional eye-head coordination is implemented downstream from the superior colliculus

How the brain transforms two-dimensional visual signals into multi-dimensional motor commands, and subsequently how it constrains the redundant degrees of freedom, are fundamental problems in sensorimotor control. During fixations between gaze shifts, the redundant torsional degree of freedom is determined by various neural constraints. For example, the eye- and head-in-space are constrained by Donders' law, whereas the eye-in-head obeys Listing's law. However, where and how the brain implements these laws is not yet known. In this study, we show that eye and head movements, elicited by unilateral microstimulations of the superior colliculus (SC) in head-free monkeys, obey the same Donders' strategies observed in normal behavior (i.e., Listing's law for final eye positions and the Fick strategy for the head). Moreover, these evoked movements showed a pattern of three-dimensional eye-head coordination, consistent with normal behavior, where the eye is driven purposely out of Listing's plane during the saccade portion of the gaze shift in opposition to a subsequent torsional vestibuloocular reflex slow phase, such that the final net torsion at the end of each head-free gaze shift is zero. The required amount of saccade-related torsion was highly variable, depending on the initial position of the eye and head prior to a gaze shift and the size of the gaze shift, pointing to a neural basis of torsional control. Because these variable, context-appropriate torsional saccades were correctly elicited by fixed SC commands during head-free stimulations, this shows that the SC only encodes the horizontal and vertical components of gaze, leaving the complexity of torsional organization to downstream control systems. Thus we conclude that Listing's and Donders' laws of the eyes and head, and their three-dimensional coordination mechanisms, must be implemented after the SC.

Neck muscle responses to stimulation of monkey superior colliculus. II. Gaze shift initiation and volitional head movements

We report neck muscle activity and head movements evoked by electrical stimulation of the superior colliculus (SC) in head-unrestrained monkeys. Recording neck electromyography (EMG) circumvents complications arising from the head's inertia and the kinetics of muscle force generation and allows precise assessment of the neuromuscular drive to the head plant. This study served two main purposes. First, we sought to test the predictions made in the companion paper of a parallel drive from the SC onto neck muscles. Low-current, long-duration stimulation evoked both neck EMG responses and head movements either without or prior to gaze shifts, testifying to a SC drive to neck muscles that is independent of gaze-shift initiation. However, gaze-shift initiation was linked to a transient additional EMG response and head acceleration, confirming the presence of a SC drive to neck muscles that is dependent on gaze-shift initiation. We forward a conceptual neural architecture and suggest that this parallel drive provides the oculomotor system with the flexibility to orient the eyes and head independently or together, depending on the behavioral context. Second, we compared the EMG responses evoked by SC stimulation to those that accompanied volitional head movements. We found characteristic features in the underlying pattern of evoked neck EMG that were not observed during volitional head movements in spite of the seemingly natural kinematics of evoked head movements. These features included reciprocal patterning of EMG activity on the agonist and antagonist muscles during stimulation, a poststimulation increase in the activity of antagonist muscles, and synchronously evoked responses on agonist and antagonist muscles regardless of initial horizontal head position. These results demonstrate that the electrically evoked SC drive to the head cannot be considered as a neural replicate of the SC drive during volitional head movements and place important new constraints on the interpretation of electrically evoked head movements.

Head-free reading of horizontally and vertically arranged texts

Parameters of eye and head movements and their coordination in reading horizontally and vertically arranged texts were compared. Reading was faster for horizontally arranged than for vertically arranged texts by 24%, primarily due to larger gaze amplitude for horizontal reading, and thus smaller numbers of saccades and fixations. The higher velocity of gaze saccades for given amplitudes in horizontal than vertical reading also contributed to the difference in reading speed. The horizontal bias in reading is at least partly due to the oculomotor system, because the higher velocity for given amplitude of horizontal saccade was also observed in a control experiment devoid of lexical load, in which a sequentially stepping laser target was tracked. The analysis of instantaneous phase of eye and head movements with a new metric derived by the Hilbert transform suggests that eye and head coupling is stronger for vertical than for horizontal direction in both reading and laser-tracking tasks. These results, combined with previous evidence that text familiarity modulates the timing and strength of head movement commands with respect to eye movements (Vis. Res. 39 (1999) 3761), indicate that the coupling strength between eye and head movements is variable depending on the direction of gaze shift and cognitive context.

Task-dependent constraints in motor control: pinhole goggles make the head move like an eye

In the 19th century, Donders observed that only one three-dimensional eye orientation is used for each gaze direction. Listing's law further specifies that the full set of eye orientation vectors forms a plane, whereas the equivalent Donders' law for the head, the Fick strategy, specifies a twisted two-dimensional range. Surprisingly, despite considerable research and speculation, the biological reasons for choosing one such range over another remain obscure. In the current study, human subjects performed head-free gaze shifts between visual targets while wearing pinhole goggles. During fixations, the head orientation range still obeyed Donders' law, but in most subjects, it immediately changed from the twisted Fick-like range to a flattened Listing-like range. Further controls showed that this was not attributable to loss of binocular vision or increased range of head motion, nor was it attributable to blocked peripheral vision; when subjects pointed a helmet-mounted laser toward targets (a task with goggle-like motor demands but normal vision), the head followed Listing's law even more closely. Donders' law of the head only broke down (in favor of a "minimum-rotation strategy") when head motion was dissociated from gaze. These behaviors could not be modeled using current "Donders' operators" but were readily simulated nonholonomically, i.e., by modulating head velocity commands as a function of position and task. We conclude that the gaze control system uses such velocity rules to shape Donders' law on a moment-to-moment basis, not primarily to satisfy perceptual or anatomic demands, but rather for motor optimization; the Fick strategy optimizes the role of the head as a platform for eye movement, whereas Listing's law optimizes rapid control of the eye (or head) as a gaze pointer.

Donders' law in torticollis

We investigated head movements of patients with spasmodic torticollis toward targets in various directions. These patients, whose severe dystonia was reflected in an abnormal resting head position, appeared to retain a Donders'-type strategy for the control of the rotational degrees of freedom of the head. As in normals, rotation vectors, representing head orientation, were confined to a curved surface, which specifies how head torsion depends on gaze direction. The orientation of the surface in body coordinates, which was very stereotyped in normals, was different for patients. The same Donders surface was found for head movements and for stationary head postures, indicating that the same neural mechanism governs its implementation in both tasks. To interpret our results, we propose a conceptual scheme incorporating the basal ganglia, which are thought to be involved in the etiology of torticollis, and an implementation stage for Donders' law.

Human eye-head gaze shifts in a distractor task. II. Reduced threshold for initiation of early head movements

This study was motivated by the observation of early head movements (EHMs) occasionally generated before gaze shifts. Human subjects were presented with a visual or auditory target, along with an accompanying stimulus of the other modality, that either appeared at the same location as the target (enhancer condition) or at the diametrically opposite location (distractor condition). Gaze shifts generated to the target in the distractor condition sometimes were preceded by EHMs directed either to the side of the target (correct EHMs) or the side of the distractor (incorrect EHMs). During EHMs, the eyes performed compensatory eye movements to keep gaze stable. Incorrect EHMs were usually between 1 and 5 degrees in amplitude and reached peak velocities generally <50 degrees /s. These metrics increased for more eccentric distractors. The dynamics of incorrect EHMs initially followed a trajectory typical of much larger head movements. These results suggest that incorrect EHMs are head movements that initially were planned to orient to the peripheral distractor. Furthermore gaze shifts preceded by incorrect EHMs had longer reaction latencies than gaze shifts not preceded by incorrect EHMs, suggesting that the processes leading to incorrect EHMs also serve to delay gaze-shift initiation. These results demonstrate a form of distraction analogous to the incorrect gaze shifts (IGSs) described in the previous paper and suggest that a motor program encoding a gaze shift to a distractor is capable of initiating either an IGS or an incorrect EHM. A neural program not strong enough to initiate an IGS nevertheless can initiate an incorrect EHM.

Three-dimensional eye-head coordination during gaze saccades in the primate

The purpose of this investigation was to describe the neural constraints on three-dimensional (3-D) orientations of the eye in space (Es), head in space (Hs), and eye in head (Eh) during visual fixations in the monkey and the control strategies used to implement these constraints during head-free gaze saccades. Dual scleral search coil signals were used to compute 3-D orientation quaternions, two-dimensional (2-D) direction vectors, and 3-D angular velocity vectors for both the eye and head in three monkeys during the following visual tasks: radial to/from center, repetitive horizontal, nonrepetitive oblique, random (wide 2-D range), and random with pin-hole goggles. Although 2-D gaze direction (of Es) was controlled more tightly than the contributing 2-D Hs and Eh components, the torsional standard deviation of Es was greater (mean 3.55 degrees ) than Hs (3.10 degrees ), which in turn was greater than Eh (1.87 degrees ) during random fixations. Thus the 3-D Es range appeared to be the byproduct of Hs and Eh constraints, resulting in a pseudoplanar Es range that was twisted (in orthogonal coordinates) like the zero torsion range of Fick coordinates. The Hs fixation range was similarly Fick-like, whereas the Eh fixation range was quasiplanar. The latter Eh range was maintained through exquisite saccade/slow phase coordination, i.e., during each head movement, multiple anticipatory saccades drove the eye torsionally out of the planar range such that subsequent slow phases drove the eye back toward the fixation range. The Fick-like Hs constraint was maintained by the following strategies: first, during purely vertical/horizontal movements, the head rotated about constantly oriented axes that closely resembled physical Fick gimbals, i.e., about head-fixed horizontal axes and space-fixed vertical axes, respectively (although in 1 animal, the latter constraint was relaxed during repetitive horizontal movements, allowing for trajectory optimization). However, during large oblique movements, head orientation made transient but dramatic departures from the zero-torsion Fick surface, taking the shortest path between two torsionally eccentric fixation points on the surface. Moreover, in the pin-hole goggle task, the head-orientation range flattened significantly, suggesting a task-dependent default strategy similar to Listing's law. These and previous observations suggest two quasi-independent brain stem circuits: an oculomotor 2-D to 3-D transformation that coordinates anticipatory saccades with slow phases to uphold Listing's law, and a flexible "Fick operator" that selects head motor error; both nested within a dynamic gaze feedback loop.

Off-centric rotation axes in natural head movements: implications for vestibular reafference and kinematic redundancy

Until now, most studies concerning active head movements in three dimensions have used the classical rotation vector description. Although this description yields both the orientation of the head rotation axis and the amount of rotation, it is incomplete because it cannot specify the location of this rotation axis in space. The latter is of importance for a proper picture of the vestibular consequences of active head movements and has relevance for the problem of how the brain deals with the inherent kinematic redundancy of the multijoint head-neck system. With this in mind, we have extended the rotation vector description by applying the helical axes approach, which yields both the classical rotation vector as well as the location of the rotation axis in space. Subjects (n = 7), whose head movements were recorded optically, were instructed to shift gaze naturally to targets in 12 different directions at an eccentricity of 40 degrees. The results demonstrate that the axes for these head movements occupy consistently different spatial locations. For purely horizontal movements, the rotation axis is located near a point midway between the two ear canals. For gaze shifts in other directions, the rotation axes are located below the ear canals along two circles, one for movements with an upward component (up circle), the other (typically larger in size) for movements with a downward component (down circle). Purely vertical movement (up and down) axes were located on the lower pole of the up and down circles, respectively. It was found that both circles, the upper poles of which coincided, became larger in size as movement amplitude increased, which means that the axis location shifts to lower and more eccentric locations with respect to the skull for larger flexion and extension movements. Although this pattern could be recognized in most subjects, there were consistent intersubject differences in the absolute size of the circles, their increase with movement amplitude, and in the relative sizes of the up and down circles. Because multiple vertebrae are involved in head movements, there are theoretically many possibilities to execute a certain head movement. The differences in circle patterns among subjects indicate different strategies in resolving this kinematic redundancy problem, a fact that was not apparent from the classical rotation vector part of our description, which yielded a rather uniform picture. A simple model suggests that the downward shift of the location of the rotation axis requires a modulation in vestibulo-ocular reflex gain of </=10% to maintain fixation of a near target during vertical head movement. The involvement of the otolith system in this process remains to be determined.

Neural constraints on eye motion in human eye-head saccades

We examined two ways in which the neural control system for eye-head saccades constrains the motion of the eye in the head. The first constraint involves Listing's law, which holds ocular torsion at zero during head-fixed saccades. During eye-head saccades, does this law govern the eye's motion in space or in the head? Our subjects, instructed to saccade between space-fixed targets with the head held still in different positions, systematically violated Listing's law of the eye in space in a way that approximately, but not perfectly, preserved Listing's law of the eye in head. This finding implies that the brain does not compute desired eye position based on the desired gaze direction alone but also considers head position. The second constraint we studied was saturation, the process where desired-eye-position commands in the brain are "clipped" to keep them within an effective oculomotor range (EOMR), which is smaller than the mechanical range of eye motion. We studied the adaptability of the EOMR by asking subjects to make head-only saccades. As predicted by current eye-head models, subjects failed to hold their eyes still in their orbits. Unexpectedly, though, the range of eye-in-head motion in the horizontal-vertical plane was on average 31% smaller in area than during normal eye-head saccades, suggesting that the EOMR had been reduced by effort of will. Larger reductions were possible with altered visual input: when subjects donned pinhole glasses, the EOMR immediately shrank by 80%. But even with its reduced EOMR, the eye still moved into the "blind" region beyond the pinhole aperture during eye-head saccades. Then, as the head movement brought the saccade target toward the pinhole, the eyes reversed their motion, anticipating or roughly matching the target's motion even though it was still outside the pinhole and therefore invisible. This finding shows that the backward rotation of the eye is timed by internal computations, not by vision. When subjects wore slit glasses, their EOMRs shrank mostly in the direction perpendicular to the slit, showing that altered vision can change the shape as well as the size of the EOMR. A recent, three-dimensional model of eye-head coordination can explain all these findings if we add to it a mechanism for adjusting the EOMR.