Sensory monitoring of prehension in the parietal lobe: a study using digital video

Neural representation in M1 and S1 cortex of bilateral hand actions during prehension

Bimanual movements that require coordinated actions of the two hands may be coordinated by synchronous bilateral activation of somatosensory and motor cortical areas in both hemispheres, by enhanced activation of individual neurons specialized for bimanual actions, or by both mechanisms. To investigate cortical neural mechanisms that mediate unimanual and bimanual prehension, we compared actions of the left and right hands in a reach to grasp-and-pull instructed-delay task. Spike trains were recorded with multiple electrode arrays placed in the hand area of primary motor (M1) and somatosensory (S1) cortex of the right hemisphere in macaques, allowing us to measure and compare the relative timing, amplitude, and synchronization of cortical activity in these areas as animals grasped and manipulated objects that differed in shape and location. We report that neurons in the right hemisphere show common task-related firing patterns for the two hands but actions of the ipsilateral hand elicited weaker and shorter-duration responses than those of the contralateral hand. We report significant bimanual activation of neurons in M1 but not in S1 cortex when animals have free choice of hand use in prehension tasks. Population ensemble responses in M1 thereby provide an accurate depiction of hand actions during skilled manual tasks. These studies also demonstrate that somatosensory cortical areas serve important cognitive and motor functions in skilled hand actions. Bilateral representation of hand actions may serve an important role in "motor equivalence" when the same movements are performed by either hand and in transfer of skill learning between the hands.NEW & NOTEWORTHY Humans can manipulate small objects with the right or left hand but typically select the dominant hand to handle them. We trained monkeys to grasp and manipulate objects with either hand, while recording neural activity in primary motor (M1) and somatosensory (S1) cortex. Actions of both hands activate M1 neurons, but S1 neurons respond only to the contralateral hand. Bilateral sensitivity in M1 may aid skill transfer between hands after stroke or head injury.

The Cortical Motor Areas and the Emergence of Motor Skills: A Neuroanatomical Perspective

What changes in neural architecture account for the emergence and expansion of dexterity in primates? Dexterity, or skill in performing motor tasks, depends on the ability to generate highly fractionated patterns of muscle activity. It also involves the spatiotemporal coordination of activity in proximal and distal muscles across multiple joints. Many motor skills require the generation of complex movement sequences that are only acquired and refined through extensive practice. Improvements in dexterity have enabled primates to manufacture and use tools and humans to engage in skilled motor behaviors such as typing, dance, musical performance, and sports. Our analysis leads to the following synthesis: The neural substrate that endows primates with their enhanced motor capabilities is due, in part, to (a) major organizational changes in the primary motor cortex and (b) the proliferation of output pathways from other areas of the cerebral cortex, especially from the motor areas on the medial wall of the hemisphere.

Action Planning Modulates Peripersonal Space

Peripersonal space is a multisensory representation relying on the processing of tactile and visual stimuli presented on and close to different body parts. The most studied peripersonal space representation is perihand space (PHS), a highly plastic representation modulated following tool use and by the rapid approach of visual objects. Given these properties, PHS may serve different sensorimotor functions, including guidance of voluntary actions such as object grasping. Strong support for this hypothesis would derive from evidence that PHS plastic changes occur before the upcoming movement rather than after its initiation, yet to date, such evidence is scant. Here, we tested whether action-dependent modulation of PHS, behaviorally assessed via visuotactile perception, may occur before an overt movement as early as the action planning phase. To do so, we probed tactile and visuotactile perception at different time points before and during the grasping action. Results showed that visuotactile perception was more strongly affected during the planning phase (250 msec after vision of the target) than during a similarly static but earlier phase (50 msec after vision of the target). Visuotactile interaction was also enhanced at the onset of hand movement, and it further increased during subsequent phases of hand movement. Such a visuotactile interaction featured interference effects during all phases from action planning onward as well as a facilitation effect at the movement onset. These findings reveal that planning to grab an object strengthens the multisensory interaction of visual information from the target and somatosensory information from the hand. Such early updating of the visuotactile interaction reflects multisensory processes supporting motor planning of actions.

Neural Basis of Touch and Proprioception in Primate Cortex

The sense of proprioception allows us to keep track of our limb posture and movements and the sense of touch provides us with information about objects with which we come into contact. In both senses, mechanoreceptors convert the deformation of tissues-skin, muscles, tendons, ligaments, or joints-into neural signals. Tactile and proprioceptive signals are then relayed by the peripheral nerves to the central nervous system, where they are processed to give rise to percepts of objects and of the state of our body. In this review, we first examine briefly the receptors that mediate touch and proprioception, their associated nerve fibers, and pathways they follow to the cerebral cortex. We then provide an overview of the different cortical areas that process tactile and proprioceptive information. Next, we discuss how various features of objects-their shape, motion, and texture, for example-are encoded in the various cortical fields, and the susceptibility of these neural codes to attention and other forms of higher-order modulation. Finally, we summarize recent efforts to restore the senses of touch and proprioception by electrically stimulating somatosensory cortex. © 2018 American Physiological Society. Compr Physiol 8:1575-1602, 2018.

Posterior parietal cortex contains a command apparatus for hand movements

Mountcastle and colleagues proposed that the posterior parietal cortex contains a "command apparatus" for the operation of the hand in immediate extrapersonal space [Mountcastle et al. (1975) J Neurophysiol 38(4):871-908]. Here we provide three lines of converging evidence that a lateral region within area 5 has corticospinal neurons that are directly linked to the control of hand movements. First, electrical stimulation in a lateral region of area 5 evokes finger and wrist movements. Second, corticospinal neurons in the same region of area 5 terminate at spinal locations that contain last-order interneurons that innervate hand motoneurons. Third, this lateral region of area 5 contains many neurons that make disynaptic connections with hand motoneurons. The disynaptic input to motoneurons from this portion of area 5 is as direct and prominent as that from any of the premotor areas in the frontal lobe. Thus, our results establish that a region within area 5 contains a motor area with corticospinal neurons that could function as a command apparatus for operation of the hand.

Functional Properties of Parietal Hand Manipulation–related Neurons and Mirror Neurons Responding to Vision of Own Hand Action

Parietofrontal pathways play an important role in visually guided motor control. In this pathway, hand manipulation-related neurons in the inferior parietal lobule represent 3-D properties of an object and motor patterns to grasp it. Furthermore, mirror neurons show visual responses that are concerned with the actions of others and motor-related activity during execution of the same grasping action. Because both of these categories of neurons integrate visual and motor signals, these neurons may play a role in motor control based on visual feedback signals. The aim of this study was to investigate whether these neurons in inferior parietal lobule including the anterior intraparietal area and PFG of macaques represent visual images of the monkey's own hand during a self-generated grasping action. We recorded 235 neurons related to hand manipulation tasks. Of these, 54 responded to video clips of the monkey's own hand action, the same as visual feedback during that action or clips of the experimenter's hand action in a lateral view. Of these 54 neurons, 25 responded to video clips of the monkey's own hand, even without an image of the target object. We designated these 25 neurons as “hand-type.” Thirty-three of 54 neurons that were defined as mirror neurons showed visual responses to the experimenter's action and motor responses. Thirteen of these mirror neurons were classified as hand-type. These results suggest that activity of hand manipulation-related and mirror neurons in anterior intraparietal/PFG plays a fundamental role in monitoring one's own body state based on visual feedback.

Vision for action in the macaque medial posterior parietal cortex

Area V6A encodes hand configurations for grasping objects (Fattori et al., 2010). The aim of the present study was to investigate whether V6A cells also encode three-dimensional objects, and the relationship between object encoding and grip encoding. Single neurons were recorded in V6A of two monkeys trained to perform two tasks. In the first task, the monkeys were required to passively view an object without performing any action on it. In the second task, the monkeys viewed an object at the beginning of each trial and then they needed to grasp that object in darkness. Five different objects were used. Both tasks revealed that object presentation activates ∼60% of V6A neurons, with about half of them displaying object selectivity. In the Reach-to-Grasp task, the majority of V6A cells discharged during both object presentation and grip execution, displaying selectivity for either the object or the grip, or in some cases for both object and grip. Although the incidence of neurons encoding grips was twofold that of neurons encoding objects, object selectivity in single cells was as strong as grip selectivity, indicating that V6A cells were able to discriminate both the different objects and the different grips required to grasp them. Hierarchical cluster analysis revealed that clustering of the object-selective responses depended on the task requirements (view only or view to grasp) and followed a visual or a visuomotor rule, respectively. Object encoding in V6A reflects representations for action, useful for motor control in reach-to-grasp.

Self-organisation in the human visual system--visuo-motor processing with congenitally abnormal V1 input

Due to an abnormal projection of the temporal retina the albinotic primary visual cortex receives substantial input from the ipsilateral visual field. To test whether representation abnormalities are also evident in higher tier visual, and in motor and somatosensory cortices, brain activity was measured with fMRI in 14 subjects with albinism performing a visuo-motor task. During central fixation, a blue or red target embedded in a distractor array was presented for 250 ms in the left or right visual hemifield. After a delay, the subjects were prompted to indicate with left or right thumb button presses the target presence in the upper or lower hemifield. The fMRI responses were evaluated for different regions of interest concerned with visual, motor and somatosensory processing and compared to previously acquired data from 14 controls. The following results were obtained: (1) in albinism the hit rates in the visuo-motor task were indistinguishable from normal. (2) In area MT and the intraparietal sulcus there was an indication of abnormal lateralisation patterns. (3) Largely normal lateralisation patterns were evident in motor and somatosensory cortices. It is concluded that in human albinism, the abnormal visual field representation is made available for visuo-motor processing with a motor cortex that comprises an essentially normal lateralisation. Consequently, specific adaptations of the mechanisms mediating visuo-motor integration are required in albinism.

The neuroscience of vision-based grasping: a functional review for computational modeling and bio-inspired robotics

The topic of vision-based grasping is being widely studied in humans and in other primates using various techniques and with different goals. The fundamental related findings are reviewed in this paper, with the aim of providing researchers from different fields, including intelligent robotics and neural computation, a comprehensive but accessible view on the subject. A detailed description of the principal sensorimotor processes and the brain areas involved is provided following a functional perspective, in order to make this survey especially useful for computational modeling and bio-inspired robotic applications.

A tactile stimulator for studying passive shape perception

We describe a computer-controlled tactile stimulator for use in human psychophysical and monkey neurophysiological studies of 3D shape perception. The stimulator is constructed primarily of commercially available parts, as well as a few custom-built pieces for which we will supply diagrams upon request. There are two components to the stimulator: a tactile component and a hand positioner component. The tactile component consists of multiple stimulating units that move about in a Cartesian plane above the restrained hand. Each stimulating unit contains a servo-controlled linear motor with an attached small rotary stepper motor, allowing arbitrary stimulus shapes to contact the skin through vibration, static indentation, or scanning. The hand positioner component modifies the conformation of the restrained hand through a set of mechanical linkages under motorized control. The present design controls the amount of spread between digits 2 and 3, the spread between digits 4 and 3, and the degree to which digit 3 is flexed or extended, thereby simulating different conformations of the hand in contact with objects. This design is easily modified to suit the needs of the experimenter. Because the two components of the stimulator are independently controlled, the stimulator allows for parametric study of the mechanoreceptive and proprioceptive contributions to 3D tactile shape perception.

Neural representation of hand kinematics during prehension in posterior parietal cortex of the macaque monkey

Studies of hand manipulation neurons in posterior parietal cortex of monkeys suggest that their spike trains represent objects by the hand postures needed for grasping or by the underlying patterns of muscle activation. To analyze the role of hand kinematics and object properties in a trained prehension task, we correlated the firing rates of neurons in anterior area 5 with hand behaviors as monkeys grasped and lifted knobs of different shapes and locations in the workspace. Trials were divided into four classes depending on the approach trajectory: forward, lateral, and local approaches, and regrasps. The task factors controlled by the animal-how and when he used the hand-appeared to play the principal roles in modulating firing rates of area 5 neurons. In all, 77% of neurons studied (58/75) showed significant effects of approach style on firing rates; 80% of the population responded at higher rates and for longer durations on forward or lateral approaches that included reaching, wrist rotation, and hand preshaping prior to contact, but only 13% distinguished the direction of reach. The higher firing rates in reach trials reflected not only the arm movements needed to direct the hand to the target before contact, but persisted through the contact, grasp, and lift stages. Moreover, the approach style exerted a stronger effect on firing rates than object features, such as shape and location, which were distinguished by half of the population. Forty-three percent of the neurons signaled both the object properties and the hand actions used to acquire them. However, the spread in firing rates evoked by each knob on reach and no-reach trials was greater than distinctions between different objects grasped with the same approach style. Our data provide clear evidence for synergies between reaching and grasping that may facilitate smooth, coordinated actions of the arm and hand.

A distinct representation of three-dimensional shape in macaque anterior intraparietal area: fast, metric, and coarse

Differences in the horizontal positions of retinal images--binocular disparity--provide important cues for three-dimensional object recognition and manipulation. We investigated the neural coding of three-dimensional shape defined by disparity in anterior intraparietal (AIP) area. Robust selectivity for disparity-defined slanted and curved surfaces was observed in a high proportion of AIP neurons, emerging at relatively short latencies. The large majority of AIP neurons preserved their three-dimensional shape preference over different positions in depth, a hallmark of higher-order disparity selectivity. Yet both stimulus type (concave-convex) and position in depth could be reliably decoded from the AIP responses. The neural coding of three-dimensional shape was based on first-order (slanted surfaces) and second-order (curved surfaces) disparity selectivity. Many AIP neurons tolerated the presence of disparity discontinuities in the stimulus, but the population of AIP neurons provided reliable information on the degree of curvedness of the stimulus. Finally, AIP neurons preserved their three-dimensional shape preference over different positions in the frontoparallel plane. Thus, AIP neurons extract or have access to three-dimensional object information defined by binocular disparity, consistent with previous functional magnetic resonance imaging data. Unlike the known representation of three-dimensional shape in inferior temporal cortex, the neural representation in AIP appears to emphasize object parameters required for the planning of grasping movements.

The Cortical Control of Visually Guided Grasping

People have always been fascinated by the exquisite precision and flexibility of the human hand. When hand meets object, we confront the overlapping worlds of sensorimotor and cognitive functions. The complex apparatus of the human hand is used to reach for objects, grasp and lift them, manipulate them, and use them to act on other objects. This review examines what is known about the control of the hand by the cerebral cortex. It compares and summarizes results from behavioral neuroscience, electrophysiology, and neuroimaging to provide a detailed description of the neural circuits that facilitate the formation of grip patterns in human and nonhuman primates. NEUROSCIENTIST 14(2):157—170, 2008. DOI: 10.1177/1073858407312080

Neurophysiology of prehension. III. Representation of object features in posterior parietal cortex of the macaque monkey

Neurons in posterior parietal cortex (PPC) may serve both proprioceptive and exteroceptive functions during prehension, signaling hand actions and object properties. To assess these roles, we used digital video recordings to analyze responses of 83 hand-manipulation neurons in area 5 as monkeys grasped and lifted objects that differed in shape (round and rectangular), size (large and small spheres), and location (identical rectangular blocks placed lateral and medial to the shoulder). The task contained seven stages -- approach, contact, grasp, lift, hold, lower, relax -- plus a pretrial interval. The four test objects evoked similar spike trains and mean rate profiles that rose significantly above baseline from approach through lift, with peak activity at contact. Although representation by the spike train of specific hand actions was stronger than distinctions between grasped objects, 34% of these neurons showed statistically significant effects of object properties or hand postures on firing rates. Somatosensory input from the hand played an important role as firing rates diverged most prominently on contact as grasp was secured. The small sphere -- grasped with the most flexed hand posture -- evoked the highest firing rates in 43% of the population. Twenty-one percent distinguished spheres that differed in size and weight, and 14% discriminated spheres from rectangular blocks. Location in the workspace modulated response amplitude as objects placed across the midline evoked higher firing rates than positions lateral to the shoulder. We conclude that area 5 neurons, like those in area AIP, integrate object features, hand actions, and grasp postures during prehension.

FMRI reveals a dissociation between grasping and perceiving the size of real 3D objects

BACKGROUND

Almost 15 years after its formulation, evidence for the neuro-functional dissociation between a dorsal action stream and a ventral perception stream in the human cerebral cortex is still based largely on neuropsychological case studies. To date, there is no unequivocal evidence for separate visual computations of object features for performance of goal-directed actions versus perceptual tasks in the neurologically intact human brain. We used functional magnetic resonance imaging to test explicitly whether or not brain areas mediating size computation for grasping are distinct from those mediating size computation for perception.

METHODOLOGY/PRINCIPAL FINDINGS

Subjects were presented with the same real graspable 3D objects and were required to perform a number of different tasks: grasping, reaching, size discrimination, pattern discrimination or passive viewing. As in prior studies, the anterior intraparietal area (AIP) in the dorsal stream was more active during grasping, when object size was relevant for planning the grasp, than during reaching, when object properties were irrelevant for movement planning (grasping>reaching). Activity in AIP showed no modulation, however, when size was computed in the context of a purely perceptual task (size = pattern discrimination). Conversely, the lateral occipital (LO) cortex in the ventral stream was modulated when size was computed for perception (size>pattern discrimination) but not for action (grasping = reaching).

CONCLUSIONS/SIGNIFICANCE

While areas in both the dorsal and ventral streams responded to the simple presentation of 3D objects (passive viewing), these areas were differentially activated depending on whether the task was grasping or perceptual discrimination, respectively. The demonstration of dual coding of an object for the purposes of action on the one hand and perception on the other in the same healthy brains offers a substantial contribution to the current debate about the nature of the neural coding that takes place in the dorsal and ventral streams.

Neurophysiology of prehension. II. Response diversity in primary somatosensory (S-I) and motor (M-I) cortices

Prehension responses of 76 neurons in primary somatosensory (S-I) and motor (M-I) cortices were analyzed in three macaques during performance of a grasp and lift task. Digital video recordings of hand kinematics synchronized to neuronal spike trains were compared with responses in posterior parietal areas 5 and AIP/7b (PPC) of the same monkeys during seven task stages: 1) approach, 2) contact, 3) grasp, 4) lift, 5) hold, 6) lower, and 7) relax. S-I and M-I firing patterns signaled particular hand actions, rather than overall task goals. S-I responses were more diverse than those in PPC, occurred later in time, and focused primarily on grasping. Sixty-three percent of S-I neurons fired at peak rates during contact and/or grasping. Lift, hold, and lowering excited fewer S-I cells. Only 8% of S-I cells fired at peak rates before contact, compared with 27% in PPC. M-I responses were also diverse, forming functional groups for hand preshaping, object acquisition, and grip force application. M-I activity began < or =500 ms before contact, coinciding with the earliest activity in PPC. Activation of specific muscle groups in the hand was paralleled by matching patterns of somatosensory feedback from S-I needed for efficient performance. These findings support hypotheses that predictive and planning components of prehension are represented in PPC and premotor cortex, whereas performance and feedback circuits dominate activity in M-I and S-I. Somatosensory feedback from the hand to S-I enables real-time adjustments of grasping by connections to M-I and updates future prehension plans through projections to PPC.

Neurophysiology of prehension. I. Posterior parietal cortex and object-oriented hand behaviors

Hand manipulation neurons in areas 5 and 7b/anterior intraparietal area (AIP) of posterior parietal cortex were analyzed in three macaque monkeys during a trained prehension task. Digital video recordings of hand kinematics synchronized to neuronal spike trains were used to correlate firing rates of 128 neurons with hand actions as the animals grasped and lifted rectangular and round objects. We distinguished seven task stages: approach, contact, grasp, lift, hold, lower, and relax. Posterior parietal cortex (PPC) firing rates were highest during object acquisition; 88% of task-related area 5 neurons and 77% in AIP/7b fired maximally during stages 1, 2, or 3. Firing rates rose 200-500 ms before contact, peaked at contact, and declined after grasp was secured. 83% of area 5 neurons and 72% in AIP/7b showed significant increases in mean rates during approach as the fingers were preshaped for grasp. Somatosensory signals at contact provided feedback concerning the accuracy of reach and helped guide the hand to grasp sites. In error trials, tactile information was used to abort grasp, or to initiate corrective actions to achieve task goals. Firing rates declined as lift began. 41% of area 5 neurons and 38% in AIP/7b were inhibited during holding, and returned to baseline when grasp was relaxed. Anatomical connections suggest that area 5 provides somesthetic information to circuits linking AIP/7b to frontal motor areas involved in grasping. Area 5 may also participate in sensorimotor transformations coordinating reach and grasp behaviors and provide on-line feedback needed for goal-directed hand movements.

Alcohol-induced suppression of BOLD activity during goal-directed visuomotor performance

The neurophysiological influence of alcohol produces deficits of many cognitive functions, including executive and motor control processes. This study examined the acute effects of alcohol in the context of goal-directed visuomotor performance during functional magnetic resonance imaging (fMRI). Subjects consumed alcohol-laced gelatin during one scan session and non-alcoholic placebo gelatin in another. During each session, subjects performed a visuomotor target capture where they received continuous or terminal positional feedback information. Blood-oxygen level-dependent (BOLD) activity in the cerebellum was suppressed in the presence of alcohol, consistent with the known ethanol sensitivity of the cerebellum. A fronto-parietal network was identified as most affected by alcohol consumption, with differential patterns of BOLD contingent on visual feedback. Results indicate that alcohol selectively suppresses cognitive activity in frontal and posterior parietal brain regions that, in conjunction with cerebellar nuclei, are believed to contribute to the formation of internal cognitive models of motor representation and action.

The role of parietal cortex in visuomotor control: what have we learned from neuroimaging?

Research from macaque neurophysiology and human neuropsychology has implicated the parietal cortex in the sensory control of action. Functional neuroimaging has been very valuable in localizing and characterizing specific regions of the human brain involved in visuomotor actions involving different effectors, such as the eyes, head, arms and hands. Here, we review the areas discovered by human neuroimaging, including the putative functional equivalents of the following macaque regions: parietal eye fields (PEF), ventral intraparietal (VIP) area, parietal reach region (PRR) and the anterior intraparietal (AIP) area. We discuss the challenges of studying realistic movements in the imaging environment, the lateralization of visuomotor function, caveats involved in proposing interspecies homologies and the limitations and future directions for neuroimaging studies of visuomotor control.

The neuroscience of grasping

People have always been fascinated by the exquisite precision and flexibility of the human hand. When hand meets object, we confront the overlapping worlds of sensorimotor and cognitive functions. We reach for objects, grasp and lift them, manipulate them and use them to act on other objects. This review examines one of these actions--grasping. Recent research in behavioural neuroscience, neuroimaging and electrophysiology has the potential to reveal where in the brain the process of grasping is organized, but has yet to address several questions about the sensorimotor transformations that relate to the control of the hands.

Evidence for both reaching and grasping activity in the medial parieto-occipital cortex of the macaque

In humans, the caudal pole of the superior parietal lobule is involved in the control of both reaching and grasping movements, whereas in monkey it is reported to be involved only in the control of reaching. Using single-unit recordings from trained macaque monkeys, we investigated whether area V6A, a visuomotor area located in the caudal part of the posterior parietal cortex, is involved in both components of prehension, the hand transport towards the visual target and the grip formation to secure the grasp. In Experiment 1, neural activity was recorded in V6A while two monkeys performed two instructed-delay reaching tasks (reach-to-point and reach-to-grasp) under controlled conditions in darkness. Fourty-five of 93 tested neurons (48%) were modulated during reach-to-point and 62% (52/84) during reach-to-grasp. In 63% of cells (51/81) neural activity was significantly different between reach-to-point and reach-to-grasp tasks, suggesting that grip formation could influence neural activity. In Experiment 2, two monkeys performed natural reach-to-grasp movements in fully lit environment; V6A neural activity and arm-hand movements were recorded by a digital camcorder and analysed frame-by-frame using a digital video technique. Thirty of the 58 tested neurons (52%) were modulated during natural prehension; about 30% of these neurons (8/30) were modulated only during the last phase of prehension, i.e. during finger flexion around the object to be grasped. This is the first direct demonstration that both reaching and grasping modulate neural activity in the caudal part of the posterior parietal cortex of the macaque. Our work suggests a strict functional homology between human and monkey superior parietal lobule.