Multiple representation of reaching space in the medial posterior parietal area V6A

Machine learning methods detect arm movement impairments in a patient with parieto-occipital lesion using only early kinematic information

Patients with lesions of the parieto-occipital cortex typically misreach visual targets that they correctly perceive (optic ataxia). Although optic ataxia was described more than 30 years ago, distinguishing this condition from physiological behavior using kinematic data is still far from being an achievement. Here, combining kinematic analysis with machine learning methods, we compared the reaching performance of a patient with bilateral occipitoparietal damage with that of 10 healthy controls. They performed visually guided reaches toward targets located at different depths and directions. Using the horizontal, sagittal, and vertical deviation of the trajectories, we extracted classification accuracy in discriminating the reaching performance of patient from that of controls. Specifically, accurate predictions of the patient's deviations were detected after the 20% of the movement execution in all the spatial positions tested. This classification based on initial trajectory decoding was possible for both directional and depth components of the movement, suggesting the possibility of applying this method to characterize pathological motor behavior in wider frameworks.

Transcranial Magnetic Stimulation Over the Human Medial Posterior Parietal Cortex Disrupts Depth Encoding During Reach Planning

Accumulating evidence supports the view that the medial part of the posterior parietal cortex (mPPC) is involved in the planning of reaching, but while plenty of studies investigated reaching performed toward different directions, only a few studied different depths. Here, we investigated the causal role of mPPC (putatively, human area V6A-hV6A) in encoding depth and direction of reaching. Specifically, we applied single-pulse transcranial magnetic stimulation (TMS) over the left hV6A at different time points while 15 participants were planning immediate, visually guided reaching by using different eye-hand configurations. We found that TMS delivered over hV6A 200 ms after the Go signal affected the encoding of the depth of reaching by decreasing the accuracy of movements toward targets located farther with respect to the gazed position, but only when they were also far from the body. The effectiveness of both retinotopic (farther with respect to the gaze) and spatial position (far from the body) is in agreement with the presence in the monkey V6A of neurons employing either retinotopic, spatial, or mixed reference frames during reach plan. This work provides the first causal evidence of the critical role of hV6A in the planning of visually guided reaching movements in depth.

Mixed Selectivity in Macaque Medial Parietal Cortex during Eye-Hand Reaching

The activity of neurons of the medial posterior parietal area V6A in macaque monkeys is modulated by many aspects of reach task. In the past, research was mostly focused on modulating the effect of single parameters upon the activity of V6A cells. Here, we used Generalized Linear Models (GLMs) to simultaneously test the contribution of several factors upon V6A cells during a fix-to-reach task. This approach resulted in the definition of a representative “functional fingerprint” for each neuron. We first studied how the features are distributed in the population. Our analysis highlighted the virtual absence of units strictly selective for only one factor and revealed that most cells are characterized by “mixed selectivity.” Then, exploiting our GLM framework, we investigated the dynamics of spatial parameters encoded within V6A. We found that the tuning is not static, but changed along the trial, indicating the sequential occurrence of visuospatial transformations helpful to guide arm movement.

•

The parietal cortex integrates a variety of sensorimotor inputs to guide reaching

•

GLM disentangled the effect of various reaching parameters upon cell activity

•

V6A neurons were not functionally clustered, but characterized by mixed selectivity

•

Spatial selectivity was dynamic and reached its peak during the movement phase

A Brief History of the Encoding of Hand Position by the Cerebral Cortex: Implications for Motor Control and Cognition

Encoding hand position by the cerebral cortex is essential not only for the neural representation of the body image but also for different actions based on eye-hand coordination. These include reaching for visual objects as well as complex movement sequences, such as tea-making, tool use, and object construction, among many others. All these functions depend on a continuous refreshing of the hand position representation, relying on both predictive signaling and afferent information. The hand position influence on neural activity in the parietofrontal system, together with eye position signals, are the basic elements of an eye-hand matrix from which all the above functions can emerge and could be regarded as key features of a network with several entry points, command nodes and outflow pathways, as confirmed by the discovery of a direct parietospinal projection for the control of hand action. The integrity of this system is crucial for daily life, as testified by the consequences of cortical lesions, spanning from severe paralysis to complex forms of apraxia. In this review, I will sketch my personal understanding of the scientific and conceptual trajectory of a line of investigation with many unexpected influences on cortical function and disease, from motor behavior to cognition.

Neural coding of action in three dimensions: Task- and time-invariant reference frames for visuospatial and motor-related activity in parietal area V6A

Goal-directed movements involve a series of neural computations that compare the sensory representations of goal location and effector position, and transform these into motor commands. Neurons in posterior parietal cortex (PPC) control several effectors (e.g., eye, hand, foot) and encode goal location in a variety of spatial coordinate systems, including those anchored to gaze direction, and to the positions of the head, shoulder, or hand. However, there is little evidence on whether reference frames depend also on the effector and/or type of motor response. We addressed this issue in macaque PPC area V6A, where previous reports using a fixate-to-reach in depth task, from different starting arm positions, indicated that most units use mixed body/hand-centered coordinates. Here, we applied singular value decomposition and gradient analyses to characterize the reference frames in V6A while the animals, instead of arm reaching, performed a nonspatial motor response (hand lift). We found that most neurons used mixed body/hand coordinates, instead of "pure" body-, or hand-centered coordinates. During the task progress the effect of hand position on activity became stronger compared to target location. Activity consistent with body-centered coding was present only in a subset of neurons active early in the task. Applying the same analyses to a population of V6A neurons recorded during the fixate-to-reach task yielded similar results. These findings suggest that V6A neurons use consistent reference frames between spatial and nonspatial motor responses, a functional property that may allow the integration of spatial awareness and movement control.

Eye position signals in the dorsal pulvinar during fixation and goal-directed saccades

Sensorimotor cortical areas contain eye position information thought to ensure perceptual stability across saccades and underlie spatial transformations supporting goal-directed actions. One pathway by which eye position signals could be relayed to and across cortical areas is via the dorsal pulvinar. Several studies have demonstrated saccade-related activity in the dorsal pulvinar, and we have recently shown that many neurons exhibit postsaccadic spatial preference. In addition, dorsal pulvinar lesions lead to gaze-holding deficits expressed as nystagmus or ipsilesional gaze bias, prompting us to investigate the effects of eye position. We tested three starting eye positions (−15°, 0°, 15°) in monkeys performing a visually cued memory saccade task. We found two main types of gaze dependence. First, ~50% of neurons showed dependence on static gaze direction during initial and postsaccadic fixation, and might be signaling the position of the eyes in the orbit or coding foveal targets in a head/body/world-centered reference frame. The population-derived eye position signal lagged behind the saccade. Second, many neurons showed a combination of eye-centered and gaze-dependent modulation of visual, memory, and saccadic responses to a peripheral target. A small subset showed effects consistent with eye position-dependent gain modulation. Analysis of reference frames across task epochs from visual cue to postsaccadic fixation indicated a transition from predominantly eye-centered encoding to representation of final gaze or foveated locations in nonretinocentric coordinates. These results show that dorsal pulvinar neurons carry information about eye position, which could contribute to steady gaze during postural changes and to reference frame transformations for visually guided eye and limb movements.

NEW & NOTEWORTHY Work on the pulvinar focused on eye-centered visuospatial representations, but position of the eyes in the orbit is also an important factor that needs to be taken into account during spatial orienting and goal-directed reaching. We show that dorsal pulvinar neurons are influenced by eye position. Gaze direction modulated ongoing firing during stable fixation, as well as visual and saccade responses to peripheral targets, suggesting involvement of the dorsal pulvinar in spatial coordinate transformations.

Corticocortical Systems Underlying High-Order Motor Control

Cortical networks are characterized by the origin, destination, and reciprocity of their connections, as well as by the diameter, conduction velocity, and synaptic efficacy of their axons. The network formed by parietal and frontal areas lies at the core of cognitive-motor control because the outflow of parietofrontal signaling is conveyed to the subcortical centers and spinal cord through different parallel pathways, whose orchestration determines, not only when and how movements will be generated, but also the nature of forthcoming actions. Despite intensive studies over the last 50 years, the role of corticocortical connections in motor control and the principles whereby selected cortical networks are recruited by different task demands remain elusive. Furthermore, the synaptic integration of different cortical signals, their modulation by transthalamic loops, and the effects of conduction delays remain challenging questions that must be tackled to understand the dynamical aspects of parietofrontal operations. In this article, we evaluate results from nonhuman primate and selected rodent experiments to offer a viewpoint on how corticocortical systems contribute to learning and producing skilled actions. Addressing this subject is not only of scientific interest but also essential for interpreting the devastating consequences for motor control of lesions at different nodes of this integrated circuit. In humans, the study of corticocortical motor networks is currently based on MRI-related methods, such as resting-state connectivity and diffusion tract-tracing, which both need to be contrasted with histological studies in nonhuman primates.

Reduced neural representation of arm/hand actions in the medial posterior parietal cortex

Several investigations at a single-cell level demonstrated that the medial posterior parietal area V6A is involved in encoding reaching and grasping actions in different visual conditions. Here, we looked for a “low-dimensional” representation of these encoding processes by studying macaque V6A neurons tested in three different tasks with a dimensionality reduction technique, the demixed principal component analysis (dPCA), which is very suitable for neuroprosthetics readout. We compared neural activity in reaching and grasping tasks by highlighting the portions of population variance involved in the encoding of visual information, target position, wrist orientation and grip type. The weight of visual information and task parameters in the encoding process was dependent on the task. We found that the distribution of variance captured by visual information in the three tasks did not differ significantly among the tasks, whereas the variance captured by target position and grip type parameters were significantly higher with respect to that captured by wrist orientation regardless of the number of conditions considered in each task. These results suggest a different use of relevant information according to the type of planned and executed action. This study shows a simplified picture of encoding that describes how V6A processes relevant information for action planning and execution.

Preparatory activity for purposeful arm movements in the dorsomedial parietal area V6A: Beyond the online guidance of movement

Over the years, electrophysiological recordings in macaque monkeys performing visuomotor tasks brought about accumulating evidence for the expression of neuronal properties (e.g., selectivity in the visuospatial and somatosensory domains, encoding of visual affordances and motor cues) in the posterior parietal area V6A that characterize it as an ideal neural substrate for online control of prehension. Interestingly, neuroimaging studies suggested a role of putative human V6A also in action preparation; moreover, pre-movement population activity in monkey V6A has been recently shown to convey grip-related information for upcoming grasping. Here we directly test whether macaque V6A neurons encode preparatory signals that effectively differentiate between dissimilar actions before movement. We recorded the activity of single V6A neurons during execution of two visuomotor tasks requiring either reach-to-press or reach-to-grasp movements in different background conditions, and described the nature and temporal dynamics of V6A activity preceding movement execution. We found striking consistency in neural discharges measured during pre-movement and movement epochs, suggesting that the former is a preparatory activity exquisitely linked to the subsequent execution of particular motor actions. These findings strongly support a role of V6A beyond the online guidance of movement, with preparatory activity implementing suitable motor programs that subsequently support action execution.

Memory-guided saccades show effect of a perceptual illusion whereas visually guided saccades do not

The double-drift stimulus (a drifting Gabor with orthogonal internal motion) generates a large discrepancy between its physical and perceived path. Surprisingly, saccades directed to the double-drift stimulus land along the physical, and not perceived, path (Lisi M, Cavanagh P. Curr Biol 25: 2535-2540, 2015). We asked whether memory-guided saccades exhibited the same dissociation from perception. Participants were asked to keep their gaze centered on a fixation dot while the double-drift stimulus moved back and forth on a linear path in the periphery. The offset of the fixation was the go signal to make a saccade to the target. In the visually guided saccade condition, the Gabor kept moving on its trajectory after the go signal but was removed once the saccade began. In the memory conditions, the Gabor disappeared before or at the same time as the go-signal (0- to 1,000-ms delay) and participants made a saccade to its remembered location. The results showed that visually guided saccades again targeted the physical rather than the perceived location. However, memory saccades, even with 0-ms delay, had landing positions shifted toward the perceived location. Our result shows that memory- and visually guided saccades are based on different spatial information. NEW & NOTEWORTHY We compared the effect of a perceptual illusion on two types of saccades, visually guided vs. memory-guided saccades, and found that whereas visually guided saccades were almost unaffected by the perceptual illusion, memory-guided saccades exhibited a strong effect of the illusion. Our result is the first evidence in the literature to show that visually and memory-guided saccades use different spatial representations.

Multiple Coordinate Systems and Motor Strategies for Reaching Movements When Eye and Hand Are Dissociated in Depth and Direction

Reaching behavior represents one of the basic aspects of human cognitive abilities important for the interaction with the environment. Reaching movements towards visual objects are controlled by mechanisms based on coordinate systems that transform the spatial information of target location into appropriate motor response. Although recent works have extensively studied the encoding of target position for reaching in three-dimensional space at behavioral level, the combined analysis of reach errors and movement variability has so far been investigated by few studies. Here we did so by testing 12 healthy participants in an experiment where reaching targets were presented at different depths and directions in foveal and peripheral viewing conditions. Each participant executed a memory-guided task in which he/she had to reach the memorized position of the target. A combination of vector and gradient analysis, novel for behavioral data, was applied to analyze patterns of reach errors for different combinations of eye/target positions. The results showed reach error patterns based on both eye- and space-centered coordinate systems: in depth more biased towards a space-centered representation and in direction mixed between space- and eye-centered representation. We calculated movement variability to describe different trajectory strategies adopted by participants while reaching to the different eye/target configurations tested. In direction, the distribution of variability between configurations that shared the same eye/target relative configuration was different, whereas in configurations that shared the same spatial position of targets, it was similar. In depth, the variability showed more similar distributions in both pairs of eye/target configurations tested. These results suggest that reaching movements executed in geometries that require hand and eye dissociations in direction and depth showed multiple coordinate systems and different trajectory strategies according to eye/target configurations and the two dimensions of space.

Mixed Body/Hand Reference Frame for Reaching in 3D Space in Macaque Parietal Area PEc

The neural correlates of coordinate transformations from vision to action are expressed in the activity of posterior parietal cortex (PPC). It has been demonstrated that among the medial-most areas of the PPC, reaching targets are represented mainly in hand-centered coordinates in area PE, and in eye-centered, body-centered, and mixed body/hand-centered coordinates in area V6A. Here, we assessed whether neurons of area PEc, located between V6A and PE in the medial PPC, encode targets in body-centered, hand-centered, or mixed frame of reference during planning and execution of reaching. We studied 104 PEc cells in 3 Macaca fascicularis. The animals performed a reaching task toward foveated targets located at different depths and directions in darkness, starting with the hand from 2 positions located at different depths, one next to the trunk and the other far from it. We show that most PEc neurons encoded targets in a mixed body/hand-centered frame of reference. Although the effect of hand position was often rather strong, it was not as strong as reported previously in area PE. Our results suggest that area PEc represents an intermediate node in the gradual transformation from vision to action that takes place in the reaching network of the dorsomedial PPC.

The Pointing Errors in Optic Ataxia Reveal the Role of "Peripheral Magnification" of the PPC

Interaction with visual objects in the environment requires an accurate correspondence between visual space and its internal representation within the brain. Many clinical conditions involve some impairment in visuo-motor control and the errors created by the lesion of a specific brain region are neither random nor uninformative. Modern approaches to studying the neuropsychology of action require powerful data-driven analyses and error modeling in order to understand the function of the lesioned areas. In the present paper we carried out mixed-effect analyses of the pointing errors of seven optic ataxia patients and seven control subjects. We found that a small parameter set is sufficient to explain the pointing errors produced by unilateral optic ataxia patients. In particular, the extremely stereotypical errors made when pointing toward the contralesional visual field can be fitted by mathematical models similar to those used to model central magnification in cortical or sub-cortical structure(s). Our interpretation is that visual areas that contain this footprint of central magnification guide pointing movements when the posterior parietal cortex (PPC) is damaged and that the functional role of the PPC is to actively compensate for the under-representation of peripheral vision that accompanies central magnification. Optic ataxia misreaching reveals what would be hand movement accuracy and precision if the human motor system did not include elaborated corrective processes for reaching and grasping to non-foveated targets.

Neural activity in the medial parietal area V6A while grasping with or without visual feedback

Recent works have reported that grasping movements are controlled not only by the dorsolateral visual stream, as generally thought, but also by the dorsomedial visual stream, and in particular by the medial posterior parietal area V6A. To date, the grasping activity of V6A neurons has been studied only in darkness. Here we studied the effect of visual feedback on grasp-related discharges of V6A neurons while the monkey was preparing and executing the grasping of a handle. We found that V6A grasping activity could be excited or inhibited by visual information. The neural population was divided into Visual, Motor, and Visuomotor cells. The majority of Visual and Visuomotor neurons did not respond to passive observation of the handle, suggesting that vision of action, rather than object vision, is the most effective factor. The present findings highlight the role of the dorsomedial visual stream in integrating visual and motor signals to monitor and correct grasping.

Reference frames for reaching when decoupling eye and target position in depth and direction

Spatial representations in cortical areas involved in reaching movements were traditionally studied in a frontoparallel plane where the two-dimensional target location and the movement direction were the only variables to consider in neural computations. No studies so far have characterized the reference frames for reaching considering both depth and directional signals. Here we recorded from single neurons of the medial posterior parietal area V6A during a reaching task where fixation point and reaching targets were decoupled in direction and depth. We found a prevalent mixed encoding of target position, with eye-centered and spatiotopic representations differently balanced in the same neuron. Depth was stronger in defining the reference frame of eye-centered cells, while direction was stronger in defining that of spatiotopic cells. The predominant presence of various typologies of mixed encoding suggests that depth and direction signals are processed on the basis of flexible coordinate systems to ensure optimal motor response.

Planning Movements in Visual and Physical Space in Monkey Posterior Parietal Cortex

Neurons in the posterior parietal cortex respond selectively for spatial parameters of planned goal-directed movements. Yet, it is still unclear which aspects of the movement the neurons encode: the spatial parameters of the upcoming physical movement (physical goal), or the upcoming visual limb movement (visual goal). To test this, we recorded neuronal activity from the parietal reach region while monkeys planned reaches under either normal or prism-reversed viewing conditions. We found predominant encoding of physical goals while fewer neurons were selective for visual goals during planning. In contrast, local field potentials recorded in the same brain region exhibited predominant visual goal encoding, similar to previous imaging data from humans. The visual goal encoding in individual neurons was neither related to immediate visual input nor to visual memory, but to the future visual movement. Our finding suggests that action planning in parietal cortex is not exclusively a precursor of impending physical movements, as reflected by the predominant physical goal encoding, but also contains spatial kinematic parameters of upcoming visual movement, as reflected by co-existing visual goal encoding in neuronal spiking. The co-existence of visual and physical goals adds a complementary perspective to the current understanding of parietal spatial computations in primates.