Preparatory delay activity in the monkey parietal reach region predicts reach reaction times

Geometry of neural computation unifies working memory and planning

Real-world tasks require coordination of working memory, decision-making, and planning, yet these cognitive functions have disproportionately been studied as independent modular processes in the brain. Here, we propose that contingency representations, defined as mappings for how future behaviors depend on upcoming events, can unify working memory and planning computations. We designed a task capable of disambiguating distinct types of representations. In task-optimized recurrent neural networks, we investigated possible circuit mechanisms for contingency representations and found that these representations can explain neurophysiological observations from the prefrontal cortex during working memory tasks. Our experiments revealed that human behavior is consistent with contingency representations and not with traditional sensory models of working memory. Finally, we generated falsifiable predictions for neural data to identify contingency representations in neural data and to dissociate different models of working memory. Our findings characterize a neural representational strategy that can unify working memory, planning, and context-dependent decision-making.

Inferior parietal lobule involved in representation of "what" in a delayed-action Libet task

Intentional motor action is typically characterized by the decision about the timing, and the selection of the action variant, known as the "what" component. We compared free action selection with instructed action, where the movement type was externally cued, in order to investigate the action selection and action representation in a Libet's task. Temporal and spatial locus of these processes was examined using the combination of high-density electroencephalography, topographic analysis of variance, and source reconstruction. Instructed action, engaging representation of the response movement, was associated with distinct negativity at the parietal and centro-parietal channels starting around 750 ms before the movement, which has a source particularly in the bilateral inferior parietal lobule. This suggests that in delayed-action tasks, the process of action representation in the inferior parietal lobule may play an important part in the larger parieto-frontal activity responsible for movement selection.

Selective Modulation of Early Visual Cortical Activity by Movement Intention

The primate visual system contains myriad feedback projections from higher- to lower-order cortical areas, an architecture that has been implicated in the top-down modulation of early visual areas during working memory and attention. Here we tested the hypothesis that these feedback projections also modulate early visual cortical activity during the planning of visually guided actions. We show, across three separate human functional magnetic resonance imaging (fMRI) studies involving object-directed movements, that information related to the motor effector to be used (i.e., limb, eye) and action goal to be performed (i.e., grasp, reach) can be selectively decoded-prior to movement-from the retinotopic representation of the target object(s) in early visual cortex. We also find that during the planning of sequential actions involving objects in two different spatial locations, that motor-related information can be decoded from both locations in retinotopic cortex. Together, these findings indicate that movement planning selectively modulates early visual cortical activity patterns in an effector-specific, target-centric, and task-dependent manner. These findings offer a neural account of how motor-relevant target features are enhanced during action planning and suggest a possible role for early visual cortex in instituting a sensorimotor estimate of the visual consequences of movement.

Dissociation between Temporal and Spatial Anticipation in the Neural Dynamics of Goal-directed Movement Preparation

It is well documented that providing advanced information regarding the spatial location of a target stimulus (i.e., spatial anticipation) or its timing of occurrence (i.e., temporal anticipation) influences reach preparation, reducing RTs. Yet, it remains unknown whether the RT gains attributable to temporal and spatial anticipation are subtended by similar preparatory dynamics. Here, this issue is addressed in humans by investigating EEG beta-band activity during reach preparation. Participants performed a reach RT task in which they initiated a movement as fast as possible toward visual targets following their appearance. Temporal anticipation was manipulated by having the target appear after a constant or variable delay period, whereas spatial anticipation was manipulated by precueing participants about the upcoming target location in advance or not. Results revealed that temporal and spatial anticipation both reduced reach RTs, with no interaction. Interestingly, temporal and spatial anticipation were associated with fundamentally different patterns of beta-band modulations. Temporal anticipation was associated with beta-band desynchronization over contralateral sensorimotor regions specifically around the expected moment of target onset, the magnitude of which was correlated with RT modulations across participants. In contrast, spatial anticipation did not influence sensorimotor activity but rather led to increased beta-band power over bilateral parieto-occipital regions during the entire delay period. These results argue for distinct states of preparation incurred by temporal and spatial anticipation. In particular, sensorimotor beta-band desynchronization may reflect the timely disinhibition of movement-related neuronal ensembles at the expected time of movement initiation, without reflecting its spatial parameters per se.

Neural Dynamics of Variable Grasp-Movement Preparation in the Macaque Frontoparietal Network

Our voluntary grasping actions lie on a continuum between immediate action and waiting for the right moment, depending on the context. Therefore, studying grasping requires an investigation into how preparation time affects this process. Two macaque monkeys (Macaca mulatta; one male, one female) performed a grasping task with a short instruction followed by an immediate or delayed go cue (0-1300 ms) while we recorded in parallel from neurons in the grasp preparation relevant area F5 that is part of the ventral premotor cortex, and the anterior intraparietal area (AIP). Initial population dynamics followed a fixed trajectory in the neural state space unique to each grip type, reflecting unavoidable movement selection, then diverged depending on the delay, reaching unique states not achieved for immediately cued movements. Population activity in the AIP was less dynamic, whereas F5 activity continued to evolve throughout the delay. Interestingly, neuronal populations from both areas allowed for a readout tracking subjective anticipation of the go cue that predicted single-trial reaction time. However, the prediction of reaction time was better from F5 activity. Intriguingly, activity during movement initiation clustered into two trajectory groups, corresponding to movements that were either "as fast as possible" or withheld movements, demonstrating a widespread state shift in the frontoparietal grasping network when movements must be withheld. Our results reveal how dissociation between immediate and delay-specific preparatory activity, as well as differentiation between cortical areas, is possible through population-level analysis.SIGNIFICANCE STATEMENT Sometimes when we move, we consciously plan our movements. At other times, we move instantly, seemingly with no planning at all. Yet, it's unclear how preparation for movements along this spectrum of planned and seemingly unplanned movement differs in the brain. Two macaque monkeys made reach-to-grasp movements after varying amounts of preparation time while we recorded from the premotor and parietal cortex. We found that the initial response to a grasp instruction was specific to the required movement, but not to the preparation time, reflecting required movement selection. However, when more preparation time was given, neural activity achieved unique states that likely related to withholding movements and anticipation of movement, shedding light on the roles of the premotor and parietal cortex in grasp planning.

Single Units in the Posterior Parietal Cortex Encode Patterns of Bimanual Coordination

Bimanual coordination is critical for a broad array of behaviors. Drummers, for example, must carefully coordinate movements of their 2 arms, sometimes beating on the same drum and sometimes on different ones. While coordinated behavior is well-studied, the early stages of planning are not well understood. In the parietal reach region (PRR) of the posterior parietal cortex (PPC), the presence of neurons that modulate when either arm moves by itself has been taken as evidence for a role in bimanual coordination. To test this notion, we recorded neurons during both unilateral and bimanual movements. We find that the activity that precedes an ipsilateral arm movement is primarily a sensory response to a target in the neuron's visual receptive field and not a plan to move the ipsilateral arm. In contrast, the activity that precedes a contralateral arm movement is the sum of a movement plan plus a sensory response. Despite not coding ipsilateral arm movements, about half of neurons discriminate between different patterns of bimanual movements. These results provide direct evidence that PRR neurons represent bimanual reach plans, and suggest that bimanual coordination originates in the sensory-to-motor processing stream prior to the motor cortex, within the PPC.

Reward Size Informs Repeat-Switch Decisions and Strongly Modulates the Activity of Neurons in Parietal Cortex

Behavior is guided by previous experience. Good, positive outcomes drive a repetition of a previous behavior or choice, whereas poor or bad outcomes lead to an avoidance. How these basic drives are implemented by the brain has been of primary interest to psychology and neuroscience. We engaged animals in a choice task in which the size of a reward outcome strongly governed the animals' subsequent decision whether to repeat or switch the previous choice. We recorded the discharge activity of neurons implicated in reward-based choice in 2 regions of parietal cortex. We found that the tendency to retain previous choice following a large (small) reward was paralleled by a marked decrease (increase) in the activity of parietal neurons. This neural effect is independent of, and of sign opposite to, value-based modulations reported in parietal cortex previously. This effect shares the same basic properties with signals previously reported in the limbic system that detect the size of the recently obtained reward to mediate proper repeat-switch decisions. We conclude that the size of the obtained reward is a decision variable that guides the decision between retaining a choice or switching, and neurons in parietal cortex strongly respond to this novel decision variable.

Done in 100 ms: path-dependent visuomotor transformation in the human upper limb

A core assumption underlying mental chronometry is that more complex tasks increase cortical processing, prolonging reaction times. In this study we show that increases in task complexity alter the magnitude, rather than the latency, of the output for a circuit that rapidly transforms visual information into motor actions. We quantified visual stimulus-locked responses (SLRs), which are changes in upper limb muscle recruitment that evolve at a fixed latency ~100 ms after novel visual stimulus onset. First, we studied the underlying reference frame of the SLR by dissociating the initial eye and hand position. Despite its quick latency, we found that the SLR was expressed in a hand-centric reference frame, suggesting that the circuit mediating the SLR integrated retinotopic visual information with body configuration. Next, we studied the influence of planned movement trajectory, requiring participants to prepare and generate either curved or straight reaches in the presence of obstacles to attain the same visual stimulus location. We found that SLR magnitude was influenced by the planned movement trajectory to the same visual stimulus. On the basis of these results, we suggest that the circuit mediating the SLR lies in parallel to other well-studied corticospinal pathways. Although the fixed latency of the SLR precludes extensive cortical processing, inputs conveying information relating to task complexity, such as body configuration and planned movement trajectory, can preset nodes within the circuit underlying the SLR to modulate its magnitude. NEW & NOTEWORTHY We studied stimulus-locked responses (SLRs), which are changes in human upper limb muscle recruitment that evolve at a fixed latency ~100 ms after novel visual stimulus onset. We showed that despite its quick latency, the circuitry mediating the SLR transformed a retinotopic visual signal into a hand-centric motor command that is modulated by the planned movement trajectory. We suggest that the circuit generating the SLR is mediated through a tectoreticulospinal, rather than a corticospinal, pathway.

Differential Recruitment of Parietal Cortex during Spatial and Non-spatial Reach Planning

The planning of goal-directed arm reaching movements is associated with activity in the dorsal parieto-frontal cortex, within which multiple regions subserve the integration of arm- and target-related sensory signals to encode a motor goal. Surprisingly, many of these regions show sustained activity during reach preparation even when target location is not specified, i.e., when a motor goal cannot be unambiguously formed. The functional role of these non-spatial preparatory signals remains unresolved. Here this process was investigated in humans by comparing reach preparatory activity in the presence or absence of information regarding upcoming target location. In order to isolate the processes specific to reaching and to control for visuospatial attentional factors, the reaching task was contrasted to a finger movement task. Functional MRI and electroencephalography (EEG) were used to characterize the spatio-temporal pattern of reach-related activity in the parieto-frontal cortex. Reach planning with advance knowledge of target location induced robust blood oxygenated level dependent and EEG responses across parietal and premotor regions contralateral to the reaching arm. In contrast, reach preparation without knowledge of target location was associated with a significant BOLD response bilaterally in the parietal cortex. Furthermore, EEG alpha- and beta-band activity was restricted to parietal scalp sites, the magnitude of the latter being correlated with reach reaction times. These results suggest an intermediate stage of sensorimotor transformations in bilateral parietal cortex when target location is not specified.

Decoding Movement Goals from the Fronto-Parietal Reach Network

During reach planning, fronto-parietal brain areas need to transform sensory information into a motor code. It is debated whether these areas maintain a sensory representation of the visual cue or a motor representation of the upcoming movement goal. Here, we present results from a delayed pro-/anti-reach task which allowed for dissociating the position of the visual cue from the reach goal. In this task, the visual cue was combined with a context rule (pro vs. anti) to infer the movement goal. Different levels of movement goal specification during the delay were obtained by presenting the context rule either before the delay together with the visual cue (specified movement goal) or after the delay (underspecified movement goal). By applying functional magnetic resonance imaging (fMRI) multivoxel pattern analysis (MVPA), we demonstrate movement goal encoding in the left dorsal premotor cortex (PMd) and bilateral superior parietal lobule (SPL) when the reach goal is specified. This suggests that fronto-parietal reach regions (PRRs) maintain a prospective motor code during reach planning. When the reach goal is underspecified, only area PMd but not SPL represents the visual cue position indicating an incomplete state of sensorimotor integration. Moreover, this result suggests a potential role of PMd in movement goal selection.

Predicting Reaction Time from the Neural State Space of the Premotor and Parietal Grasping Network

Neural networks of the brain involved in the planning and execution of grasping movements are not fully understood. The network formed by macaque anterior intraparietal area (AIP) and hand area (F5) of the ventral premotor cortex is implicated strongly in the generation of grasping movements. However, the differential role of each area in this frontoparietal network is unclear. We recorded spiking activity from many electrodes in parallel in AIP and F5 while three macaque monkeys (Macaca mulatta) performed a delayed grasping task. By analyzing neural population activity during action preparation, we found that state space analysis of simultaneously recorded units is significantly more predictive of subsequent reaction times (RTs) than traditional methods. Furthermore, because we observed a wide variety of individual unit characteristics, we developed the sign-corrected average rate (SCAR) method of neural population averaging. The SCAR method was able to explain at least as much variance in RT overall as state space methods. Overall, F5 activity predicted RT (18% variance explained) significantly better than AIP (6%). The SCAR methods provides a straightforward interpretation of population activity, although other state space methods could provide richer descriptions of population dynamics. Together, these results lend support to the differential role of the parietal and frontal cortices in preparation for grasping, suggesting that variability in preparatory activity in F5 has a more potent effect on trial-to-trial RT variability than AIP.

SIGNIFICANCE STATEMENT

Grasping movements are planned before they are executed, but how is the preparatory activity in a population of neurons related to the subsequent reaction time (RT)? A population analysis of the activity of many neurons recorded in parallel in macaque premotor (F5) and parietal (AIP) cortices during a delayed grasping task revealed that preparatory activity in F5 could explain a threefold larger fraction of variability in trial-to-trial RT than AIP. These striking differences lend additional support to a differential role of the parietal and premotor cortices in grasp movement preparation, suggesting that F5 has a more direct influence on trial-to-trial variability and movement timing, whereas AIP might be more closely linked to overall movement intentions.

Overlapping representations for reach depth and direction in caudal superior parietal lobule of macaques

Reaching movements in the real world have typically a direction and a depth component. Despite numerous behavioral studies, there is no consensus on whether reach coordinates are processed in separate or common visuomotor channels. Furthermore, the neural substrates of reach depth in parietal cortex have been ignored in most neurophysiological studies. In the medial posterior parietal area V6A, we recently demonstrated the strong presence of depth signals and the extensive convergence of depth and direction information on single neurons during all phases of a fixate-to-reach task in 3-dimensional (3D) space. Using the same task, in the present work we examined the processing of direction and depth information in area PEc of the caudal superior parietal lobule (SPL) in three Macaca fascicularis monkeys. Across the task, depth and direction had a similar, high incidence of modulatory effect. The effect of direction was stronger than depth during the initial fixation period. As the task progressed toward arm movement execution, depth tuning became more prominent than directional tuning and the number of cells modulated by both depth and direction increased significantly. Neurons tuned by depth showed a small bias for far peripersonal space. Cells with directional modulations were more frequently tuned toward contralateral spatial locations, but ipsilateral space was also represented. These findings, combined with results from neighboring areas V6A and PE, support a rostral-to-caudal gradient of overlapping representations for reach depth and direction in SPL. These findings also support a progressive change from visuospatial (vergence angle) to somatomotor representations of 3D space in SPL.

Dorsal premotor cortex: neural correlates of reach target decisions based on a color-location matching rule and conflicting sensory evidence

We recorded single-neuron activity in dorsal premotor (PMd) and primary motor cortex (M1) of two monkeys in a reach-target selection task. The monkeys chose between two color-coded potential targets by determining which target's color matched the predominant color of a multicolored checkerboard-like Decision Cue (DC). Different DCs contained differing numbers of colored squares matching each target. The DCs provided evidence about the correct target ranging from unambiguous (one color only) to very ambiguous and conflicting (nearly equal number of squares of each color). Differences in choice behavior (reach response times and success rates as a function of DC ambiguity) of the monkeys suggested that each applied a different strategy for using the target-choice evidence in the DCs. Nevertheless, the appearance of the DCs evoked a transient coactivation of PMd neurons preferring both potential targets in both monkeys. Reach response time depended both on how long it took activity to increase in neurons that preferred the chosen target and on how long it took to suppress the activity of neurons that preferred the rejected target, in both correct-choice and error-choice trials. These results indicate that PMd neurons in this task are not activated exclusively by a signal proportional to the net color bias of the DCs. They are instead initially modulated by the conflicting evidence supporting both response choices; final target selection may result from a competition between representations of the alternative choices. The results also indicate a temporal overlap between action selection and action initiation processes in PMd and M1.

Region-Specific Summation Patterns Inform the Role of Cortical Areas in Selecting Motor Plans

Given an instruction regarding which effector to move and what location to move to, simply adding the effector and spatial signals together will not lead to movement selection. For this, a nonlinearity is required. Thresholds, for example, can be used to select a particular response and reject others. Here we consider another useful nonlinearity, a supralinear multiplicative interaction. To help select a motor plan, spatial and effector signals could multiply and thereby amplify each other. Such an amplification could constitute one step within a distributed network involved in response selection, effectively boosting one response while suppressing others. We therefore asked whether effector and spatial signals sum supralinearly for planning eye versus arm movements from the parietal reach region (PRR), the lateral intraparietal area (LIP), the frontal eye field (FEF), and a portion of area 5 (A5) lying just anterior to PRR. Unlike LIP neurons, PRR, FEF, and, to a lesser extent, A5 neurons show a supralinear interaction. Our results suggest that selecting visually guided eye versus arm movements is likely to be mediated by PRR and FEF but not LIP.

Spatial effects of shifting prisms on properties of posterior parietal cortex neurons

The posterior parietal cortex contains neurons that respond to visual stimulation and motor behaviour. The objective of the current study was to test short-term adaptation in neurons in macaque area 7a and the dorsal prelunate during visually guided reaching using Fresnel prisms that displaced the visual field. The visual perturbation shifted the eye position and created a mismatch between perceived and actual reach location. Two non-human primates were trained to reach to visual targets before, during and after prism exposure while fixating the reach target in different locations. They were required to reach to the physical location of the reach target and not the perceived, displaced location. While behavioural adaptation to the prisms occurred within a few trials, the majority of neurons responded to the distortion either with substantial changes in spatial eye position tuning or changes in overall firing rate. These changes persisted even after prism removal. The spatial changes were not correlated with the direction of induced prism shift. The transformation of gain fields between conditions was estimated by calculating the translation and rotation in Euler angles. Rotations and translations of the horizontal and vertical spatial components occurred in a systematic manner for the population of neurons suggesting that the posterior parietal cortex retains a constant representation of the visual field remapping between experimental conditions.

Identifying and quantifying multisensory integration: a tutorial review

We process information from the world through multiple senses, and the brain must decide what information belongs together and what information should be segregated. One challenge in studying such multisensory integration is how to quantify the multisensory interactions, a challenge that is amplified by the host of methods that are now used to measure neural, behavioral, and perceptual responses. Many of the measures that have been developed to quantify multisensory integration (and which have been derived from single unit analyses), have been applied to these different measures without much consideration for the nature of the process being studied. Here, we provide a review focused on the means with which experimenters quantify multisensory processes and integration across a range of commonly used experimental methodologies. We emphasize the most commonly employed measures, including single- and multiunit responses, local field potentials, functional magnetic resonance imaging, and electroencephalography, along with behavioral measures of detection, accuracy, and response times. In each section, we will discuss the different metrics commonly used to quantify multisensory interactions, including the rationale for their use, their advantages, and the drawbacks and caveats associated with them. Also discussed are possible alternatives to the most commonly used metrics.

Lateralized readiness potentials reveal properties of a neural mechanism for implementing a decision threshold

Many perceptual decision making models posit that participants accumulate noisy evidence over time to improve the accuracy of their decisions, and that in free response tasks, participants respond when the accumulated evidence reaches a decision threshold. Research on the neural correlates of these models' components focuses primarily on evidence accumulation. Far less attention has been paid to the neural correlates of decision thresholds, reflecting the final commitment to a decision. Inspired by a model of bistable neural activity that implements a decision threshold, we reinterpret human lateralized readiness potentials (LRPs) as reflecting the crossing of a decision threshold. Interestingly, this threshold crossing preserves signatures of a drift-diffusion process of evidence accumulation that feeds in to the threshold mechanism. We show that, as our model predicts, LRP amplitudes and growth rates recorded while participants performed a motion discrimination task correlate with individual differences in behaviorally-estimated prior beliefs, decision thresholds and evidence accumulation rates. As such LRPs provide a useful measure to test dynamical models of both evidence accumulation and decision commitment processes non-invasively.

Gamma synchrony predicts neuron-neuron correlations and correlations with motor behavior in extrastriate visual area MT

Correlated variability of neuronal responses is an important factor in estimating sensory parameters from a population response. Large correlations among neurons reduce the effective size of a neural population and increase the variation of the estimates. They also allow the activity of one neuron to be informative about impending perceptual decisions or motor actions on single trials. In extrastriate visual area MT of the rhesus macaque, for example, some but not all neurons show nonzero "choice probabilities" for perceptual decisions or non-zero "MT-pursuit" correlations between the trial-by-trial variations in neural activity and smooth pursuit eye movements. To understand the functional implications of zero versus nonzero correlations between neural responses and impending perceptions or actions, we took advantage of prior observations that specific frequencies of local field potentials reflect the correlated activity of neurons. We found that the strength of the spike-field coherence of a neuron in the gamma-band frequency range is related to the size of its MT-pursuit correlations for eye direction, as well as to the size of the neuron-neuron correlations. Spike-field coherence predicts MT-pursuit correlations better for direction than for speed, perhaps because the topographic organization of direction preference in MT is more amenable to creating meaningful local field potentials. We suggest that the relationship between spiking and local-field potentials is stronger for neurons that have larger correlations with their neighbors; larger neuron-neuron correlations create stronger MT-pursuit correlations. Neurons that lack strong correlations with their neighbors also have weaker correlations with pursuit behavior, but still could drive pursuit strongly.

The parietal reach region is limb specific and not involved in eye-hand coordination

Primates frequently reach toward visual targets. Neurons in early visual areas respond to stimuli in the contralateral visual hemifield and without regard to which limb will be used to reach toward that target. In contrast, neurons in motor areas typically respond when reaches are performed using the contralateral limb and with minimal regard to the visuospatial location of the target. The parietal reach region (PRR) is located early in the visuomotor processing hierarchy. PRR neurons are significantly modulated when targets for either limb or eye movement appear, similar to early sensory areas; however, they respond to targets in either visual field, similar to motor areas. The activity could reflect the subject's attentional locus, movement of a specific effector, or a related function, such as coordinating eye-arm movements. To examine the role of PRR in the visuomotor pathway, we reversibly inactivated PRR. Inactivation effects were specific to contralateral limb movements, leaving ipsilateral limb and saccadic movements intact. Neither visual hemifield bias nor visual attention deficits were observed. Thus our results are consistent with a motoric rather than visual organization in PRR, despite its early location in the visuomotor pathway. We found no effects on the temporal coupling of coordinated saccades and reaches, suggesting that this mechanism lies downstream of PRR. In sum, this study clarifies the role of PRR in the visuomotor hierarchy: despite its early position, it is a limb-specific area influencing reach planning and is positioned upstream from an active eye-hand coordination-coupling mechanism.

Where one hand meets the other: limb-specific and action-dependent movement plans decoded from preparatory signals in single human frontoparietal brain areas

Planning object-directed hand actions requires successful integration of the movement goal with the acting limb. Exactly where and how this sensorimotor integration occurs in the brain has been studied extensively with neurophysiological recordings in nonhuman primates, yet to date, because of limitations of non-invasive methodologies, the ability to examine the same types of planning-related signals in humans has been challenging. Here we show, using a multivoxel pattern analysis of functional MRI (fMRI) data, that the preparatory activity patterns in several frontoparietal brain regions can be used to predict both the limb used and hand action performed in an upcoming movement. Participants performed an event-related delayed movement task whereby they planned and executed grasp or reach actions with either their left or right hand toward a single target object. We found that, although the majority of frontoparietal areas represented hand actions (grasping vs reaching) for the contralateral limb, several areas additionally coded hand actions for the ipsilateral limb. Notable among these were subregions within the posterior parietal cortex (PPC), dorsal premotor cortex (PMd), ventral premotor cortex, dorsolateral prefrontal cortex, presupplementary motor area, and motor cortex, a region more traditionally implicated in contralateral movement generation. Additional analyses suggest that hand actions are represented independently of the intended limb in PPC and PMd. In addition to providing a unique mapping of limb-specific and action-dependent intention-related signals across the human cortical motor system, these findings uncover a much stronger representation of the ipsilateral limb than expected from previous fMRI findings.

Optical imaging of visually guided reaching in macaque posterior parietal cortex

Sensorimotor transformation for reaching movements in primates requires a large network of visual, parietal, and frontal cortical areas. We performed intrinsic optical imaging over posterior parietal cortex including areas 7a and the dorsal perilunate in macaque monkeys during visually guided hand movements. Reaching was performed while foveating one of nine static reach targets; thus eye-position-varied concurrently with reach position. The hemodynamic reflectance signal was analyzed during specific phases of the task including pre-reach, reach, and touch epochs. The eye position maps changed substantially as the task progressed: First, direction of spatial tuning shifted from a weak preference close to the center to the lower eye positions in both cortical areas. Overall tuning strength was greater in area 7a. Second, strength of spatial tuning increased from the early pre-reach to the later touch epoch. These consistent temporal changes suggest that dynamic properties of the reflectance signal were modulated by task parameters. The peak amplitude and peak delay of the reflectance signal showed considerable differences between eye position but were similar between areas. Compared with a detection task using a lever response, the reach task yielded higher amplitudes and longer delays. These findings demonstrate a spatially tuned topographical representation for reaching in both areas and suggest a strong synergistic combination of various feedback signals that result in a spatially tuned amplification of the hemodynamic response in posterior parietal cortex.

Motor planning modulates sensory-motor control of collision avoidance behavior in the bullfrog, Rana catesbeiana

In this study, we examined the collision avoidance behavior of the frog, Rana catesbeiana to an approaching object in the upper visual field. The angular velocity of the frog's escape turn showed a significant positive correlation with the turn angle (r² = 0.5741, P<0.05). A similar mechanism of velocity control has been known in head movements of the owl and in human saccades. By analogy, this suggests that the frog planned its escape velocity in advance of executing the turn, to make the duration of the escape behavior relatively constant. For escape turns less than 60°, the positive correlation was very strong (r² = 0.7097, P<0.05). Thus, the frog controlled the angular velocity of small escape turns very accurately and completed the behavior within a constant time. On the other hand, for escape turns greater than 60°, the same correlation was not significant (r² = 0.065, P>0.05). Thus, the frog was not able to control the velocity of the large escape turns accurately and did not complete the behavior within a constant time. In the latter case, there was a small but significant positive correlation between the threshold angular size and the angular velocity (r² = 0.1459, P<0.05). This suggests that the threshold is controlled to compensate for the insufficient escape velocity achieved during large turn angles, and could explain a significant negative correlation between the turn angle and the threshold angular size (r² = 0.1145, P<0.05). Thus, it is likely that the threshold angular size is also controlled by the turn angle and is modulated by motor planning.

Transcranial magnetic stimulation and preparation of visually-guided reaching movements

To better define the neural networks related to preparation of reaching, we applied transcranial magnetic stimulation (TMS) to the lateral parietal and frontal cortex. TMS did not evoke effects closely related to preparation of reaching, suggesting that neural networks already identified by our group are not larger than previously thought. We also replicated previous TMS/EEG data by applying TMS to the parietal cortex: new analyses were performed to better support reliability of already reported findings (Zanon et al., 2010; Brain Topography 22, 307-317). We showed the existence of neural circuits ranging from posterior to frontal regions of the brain after the stimulation of parietal cortex, supporting the idea of strong connections among these areas and suggesting their possible temporal dynamic. Connection with ventral stream was confirmed. The present work helps to define those areas which are involved in preparation of natural reaching in humans. They correspond to parieto-occipital, parietal and premotor medial regions of the left hemisphere, i.e., the contralateral one with respect to the moving hand, as suggested by previous studies. Behavioral data support the existence of a discrete stream involved in reaching. Besides the serial flow of activation from posterior to anterior direction, a parallel elaboration of information among parietal and premotor areas seems also to exist. Present cortico-cortical interactions (TMS/EEG experiment) show propagation of activity to frontal, temporal, parietal and more posterior regions, exhibiting distributed communication among various areas in the brain. The neural system highlighted by TMS/EEG experiments is wider with respect to the one disclosed by the TMS behavioral approach. Further studies are needed to unravel this paucity of overlap. Moreover, the understanding of these mechanisms is crucial for the comprehension of response inhibition and changes in prepared actions, which are common behaviors in everyday life.

Effector selection precedes reach planning in the dorsal parietofrontal cortex

Experimental evidence and computational modeling suggest that target selection for reaching is associated with the parallel encoding of multiple movement plans in the dorsomedial posterior parietal cortex (dmPPC) and the caudal part of the dorsal premotor cortex (PMdc). We tested the hypothesis that a similar mechanism also accounts for arm selection for unimanual reaching, with simultaneous and separate motor goal representations for the left and right arms existing in the right and left parietofrontal cortex, respectively. We recorded simultaneous electroencephalograms and functional MRI and studied a condition in which subjects had to select the appropriate arm for reaching based on the color of an appearing visuospatial target, contrasting it to a condition in which they had full knowledge of the arm to be used before target onset. We showed that irrespective of whether subjects had to select the arm or not, activity in dmPPC and PMdc was only observed contralateral to the reaching arm after target onset. Furthermore, the latency of activation in these regions was significantly delayed when arm selection had to be achieved during movement planning. Together, these results demonstrate that effector selection is not achieved through the simultaneous specification of motor goals tied to the two arms in bilateral parietofrontal cortex, but suggest that a motor goal is formed in these regions only after an arm is selected for action.

The representations of reach endpoints in posterior parietal cortex depend on which hand does the reaching

Neurons in the parietal reach region (PRR) have been implicated in the sensory-to-motor transformation required for reaching toward visually defined targets. The neurons in each cortical hemisphere might be specifically involved in planning movements of just one limb, or the PRR might code reach endpoints generically, independent of which limb will actually move. Previous work has shown that the preferred directions of PRR neurons are similar for right and left limb movements but that the amplitude of modulation may vary greatly. We now test the hypothesis that frames of reference and eye and hand gain field modulations will, like preferred directions, be independent of which hand moves. This was not the case. Many neurons show clear differences in both the frame of reference as well as in direction and strength of gain field modulations, depending on which hand is used to reach. The results suggest that the information that is conveyed from the PRR to areas closer to the motor output (the readout from the PRR) is different for each limb and that individual PRR neurons contribute either to controlling the contralateral-limb or else bimanual-limb control.

fMRI investigation of speed-accuracy strategy switching

Switching between rapid and accurate responses is an important aspect of decision-making. However, the brain mechanisms important to smoothly change the speed-accuracy strategy remain mostly unclear. This issue was addressed here by using functional magnetic resonance imaging (fMRI). On each trial, right-handed healthy participants had to stress speed or accuracy in performing a color discrimination task on a target stimulus according to the instructions given by an initial cue. Participants were capable of trading speed for accuracy and vice versa. Analyses of cue-related fMRI activations revealed a significant recruitment of left middle frontal gyrus and right cerebellum when switching from speed to accuracy. The left superior parietal lobule was activated in the same switching condition but only after the target onset. The anterior cingulate cortex was more recruited, also after target presentation, when speed had to be maintained from one trial to the next. These results are interpreted within a theoretical framework that attributes a role in criterion-setting to the left lateral prefrontal cortex, perceptual evidence accumulation to the superior parietal lobule, and action energization to the anterior cingulate cortex, extending previous findings to the domain of speed-accuracy tradeoff regulations.

Neural representation during visually guided reaching in macaque posterior parietal cortex

Visually guided hand movements in primates require an interconnected network of various cortical areas. Single unit firing rate from area 7a and dorsal prelunate (DP) neurons of macaque posterior parietal cortex (PPC) was recorded during reaching movements to targets at variable locations and under different eye position conditions. In the eye position-varied task, the reach target was always foveated; thus eye position varied with reach target location. In the retinal-varied task, the monkey reached to targets at variable retinotopic locations while eye position was kept constant in the center. Spatial tuning was examined with respect to temporal (task epoch) and contextual (task condition) aspects, and response fields were compared. The analysis showed distinct tuning types. The majority of neurons changed their gain field tuning and retinotopic tuning between different phases of the task. Between the onset of visual stimulation and the preparatory phase (before the go signal), about one half the neurons altered their firing rate significantly. Spatial response fields during preparation and initiation epochs were strongly influenced by the task condition (eye position varied vs. retinal varied), supporting a strong role of eye position during visually guided reaching. DP neurons, classically considered visual, showed reach related modulation similar to 7a neurons. This study shows that both area 7a and DP are modulated during reaching behavior in primates. The various tuning types in both areas suggest distinct populations recruiting different circuits during visually guided reaching.

Reference frames for reach planning in human parietofrontal cortex

To plan a reaching movement, the brain must integrate information about the spatial goal of the reach with positional information about the selected hand. Recent monkey neurophysiological evidence suggests that a mixture of reference frames is involved in this process. Here, using 3T functional magnetic resonance imaging (fMRI), we tested the role of gaze-centered and body-centered reference frames in reach planning in the human brain. Fourteen human subjects planned and executed arm movements to memorized visual targets, while hand starting position and gaze direction were monitored and varied on a trial-by-trial basis. We further introduced a variable delay between target presentation and movement onset to dissociate cerebral preparatory activity from stimulus- and movement-related responses. By varying the position of the target and hand relative to the gaze line, we distinguished cerebral responses that increased for those movements requiring the integration of peripheral target and hand positions in a gaze-centered frame. Posterior parietal and dorsal premotor areas showed such gaze-centered integration effects. In regions closer to the primary motor cortex, body-centered hand position effects were found. These results suggest that, in humans, spatially contiguous neuronal populations operate in different frames of reference, supporting sensorimotor transformations according to gaze-centered or body-centered coordinates. The former appears suited for calculating a difference vector between target and hand location, whereas the latter may be related to the implementation of a joint-based motor command.

Using a compound gain field to compute a reach plan

A gain field, the scaling of a tuned neuronal response by a postural signal, may help support neuronal computation. Here, we characterize eye and hand position gain fields in the parietal reach region (PRR). Eye and hand gain fields in individual PRR neurons are similar in magnitude but opposite in sign to one another. This systematic arrangement produces a compound gain field that is proportional to the distance between gaze location and initial hand position. As a result, the visual response to a target for an upcoming reach is scaled by the initial gaze-to-hand distance. Such a scaling is similar to what would be predicted in a neural network that mediates between eye- and hand-centered representations of target location. This systematic arrangement supports a role of PRR in visually guided reaching and provides strong evidence that gain fields are used for neural computations.

Changes in the response rate and response variability of area V4 neurons during the preparation of saccadic eye movements

The visually driven responses of macaque area V4 neurons are modulated during the preparation of saccadic eye movements, but the relationship between presaccadic modulation in area V4 and saccade preparation is poorly understood. Recent neurophysiological studies suggest that the variability across trials of spiking responses provides a more reliable signature of motor preparation than mean firing rate across trials. We compared the dynamics of the response rate and the variability in the rate across trials for area V4 neurons during the preparation of visually guided saccades. As in previous reports, we found that the mean firing rate of V4 neurons was enhanced when saccades were prepared to stimuli within a neuron's receptive field (RF) in comparison with saccades to a non-RF location. Further, we found robust decreases in response variability prior to saccades and found that these decreases predicted saccadic reaction times for saccades both to RF and non-RF stimuli. Importantly, response variability predicted reaction time whether or not there were any accompanying changes in mean firing rate. In addition to predicting saccade direction, the mean firing rate could also predict reaction time, but only for saccades directed to the RF stimuli. These results demonstrate that response variability of area V4 neurons, like mean response rate, provides a signature of saccade preparation. However, the two signatures reflect complementary aspects of that preparation.

The role of the monkey dorsal pontine nuclei in goal-directed eye and hand movements

Prevailing concepts on the control of goal-directed hand movements (HM) have focused on a network of cortical areas whose early parieto-occipital stages are thought to extract and integrate information on target and hand location, involving subsequent stages in frontal cortex forming and executing movement plans. The substantial experimental results supporting this "cortical network" concept for hand movements notwithstanding, the concept clearly needs refinement to account for the surprisingly mild HM disturbances resulting from disconnecting the parieto-occipital from the frontal stages of the network. Clinical observations have suggested the cerebropontocerebellar projection as an alternative pathway for the sensory guidance of HM. As a first step in assessing its role, we explored the pontine nuclei (PN) of rhesus monkeys, trained to make goal-directed hand and eye movements guided by spatial memory. We were indeed able to delineate a distinct cluster of neurons in the rostrodorsal PN, activated by the preparation and the execution of hand reaches, close to but distinct from the region in which saccade-related neurons may be observed. The movement-related activity of HM-related neurons starts earlier than that of saccade-related neurons and both neuron types are usually effector specific, i.e., they respond only to the movement of the preferred effector. This is also the case when motor synergies involving both effectors are executed. Our findings support the notion of a distinct precerebellar, pontine visuomotor channel for hand reaches that is anatomically and functionally largely separated from the one serving eye movements.

The neural and computational basis of controlled speed-accuracy tradeoff during task performance

People are capable, at will, of trading speed for accuracy when performing a task; they can focus on performing accurately at the cost of being slow, or emphasize speed at the cost of decreased accuracy. Here, we used functional magnetic resonance imaging to investigate the neural correlates of this ability. We show increased baseline activity during speed emphasis in a network of areas related to response preparation and execution, including the premotor areas of the frontal lobe, the basal ganglia, the thalamus, and the dorsolateral prefrontal and left parietal cortices. Furthermore, speed emphasis was associated with reduced transient response-related activation in several of these structures, suggesting that because of the greater baseline activity under speed emphasis, less activation is needed in these structures to reach response threshold, consistent with the assumptions of several computational theories. Moreover, we identify the dorsolateral prefrontal cortex as providing the top-down control signal that increases this baseline activity.

Detection of time-varying signals in event-related fMRI designs

In neuroimaging research on attention, cognitive control, decision-making, and other areas where response time (RT) is a critical variable, the temporal variability associated with the decision is often assumed to be inconsequential to the hemodynamic response (HDR) in rapid event-related designs. On this basis, the majority of published studies model brain activity lasting less than 4 s with brief impulses representing the onset of neural or cognitive events, which are then convolved with the hemodynamic impulse response function (HRF). However, electrophysiological studies have shown that decision-related neuronal activity is not instantaneous, but in fact, often lasts until the motor response. It is therefore possible that small differences in neural processing durations, similar to human RTs, will produce noticeable changes in the HDR, and therefore in the results of regression analyses. In this study we compare the effectiveness of traditional models that assume no temporal variance with a model that explicitly accounts for the duration of very brief epochs of neural activity. Using both simulations and fMRI data, we show that brief differences in duration are detectable, making it possible to dissociate the effects of stimulus intensity from stimulus duration, and that optimizing the model for the type of activity being detected improves the statistical power, consistency, and interpretability of results.

Limb-specific representation for reaching in the posterior parietal cortex

To reach for something we see, the brain must integrate the target location with the limb to be used for reaching. Neuronal activity in the parietal reach region (PRR) located in the posterior parietal cortex represents targets for reaching. Does this representation depend on the limb to be used? We found a continuum of limb-dependent and limb-independent responses: some neurons represented targets for movements of either limb, whereas others represented only contralateral-limb targets. Only a few cells represented ipsilateral-limb targets. Furthermore, these representations were not dependent on preferred direction. Additional experiments provide evidence that the PRR is specifically involved in contralateral-limb movements: firing rates are correlated with contralateral- but not ipsilateral-limb reaction times. The current study therefore provides novel evidence that the PRR operates as a limb-dependent stage that lies further along the sensory-motor transformation for visually guided reaching than previously expected.

Reaction time changes with the hazard rate for a behaviorally relevant event when monkeys perform a delayed wrist movement task

Anticipating the timing of behaviorally relevant events is crucial for organizing movement. The time to initiate actions based on events (i.e., reaction time (RT)) is a useful measure to quantify states of anticipation. Few studies have examined how anticipation affects the timing of limb movements. We addressed this question behaviorally with two macaque monkeys performing delayed wrist movement tasks. The interval between target onset and go signal (i.e., foreperiod) varied randomly from 1 to 2 s. The probability that the go signal was about to occur (i.e., hazard rate) increased as the foreperiod increased. The kinematics of wrist movements was not influenced by foreperiod duration. Analyzing RT data with the LATER model indicated that RT distributions swiveled on reciprobit plots as foreperiods increased, suggesting that changes in RT distributions were due to changes in anticipation. RT was inversely related to hazard rate. To better understand the general implications of anticipatory states, we introduced an additional rectangular foreperiod distribution that ranged from 0.9 to 1.5 s. For that distribution, the hazard rate peaks were higher than those of the 1-2 s distribution. Changes in RT were clearly explained by quantitative differences in hazard rate. The decrease in RT in the 0.9-1.5 s foreperiod distribution was greater than that in the 1-2 s foreperiod. Thus, monkeys learned the temporal structure of foreperiod distributions and anticipated the onset of the go signal, based on hazard rates.

Volitional control of movement: the physiology of free will

This review deals with the physiology of the initiation of a voluntary movement and the appreciation of whether it is voluntary or not. I argue that free will is not a driving force for movement, but a conscious awareness concerning the nature of the movement. Movement initiation and the perception of willing the movement can be separately manipulated. Movement is generated subconsciously, and the conscious sense of volition comes later, but the exact time of this event is difficult to assess because of the potentially illusory nature of introspection. Neurological disorders of volition are also reviewed. The evidence suggests that movement is initiated in the frontal lobe, particularly the mesial areas, and the sense of volition arises as the result of a corollary discharge likely involving multiple areas with reciprocal connections including those in the parietal lobe and insular cortex.