The role of lateral occipitotemporal junction and area MT/V5 in the visual analysis of upper-limb postures

Gesture meaning modulates the neural correlates of effector-specific imitation deficits in left hemisphere stroke

BACKGROUND

Previous studies on left hemisphere (LH) stroke patients reported effector-specific (hand, fingers, bucco-facial) differences in imitation performance. Furthermore, imitation performance differed between meaningless (ML) and meaningful (MF) gestures. Recent work suggests that a gesture's meaning impacts the body-part specificity of gesture imitation.

METHODS

We tested the hypothesis that the gesture's meaning (ML vs MF) affects the lesion correlates of effector-specific imitation deficits (here: bucco-facial vs arm/hand gestures) using behavioural data and support vector regression-based lesion-symptom mapping (SVR-LSM) in a large sample of 194 sub-acute LH stroke patients.

RESULTS

Behavioural data revealed a significant interaction between the effector used for imitation and the meaning of the imitated gesture. SVR-LSM analyses revealed shared lesion correlates for impaired imitation independent of effector or gesture meaning in the left supramarginal (SMG) and superior temporal gyri (STG). Besides, within the territory of the left middle cerebral artery, impaired imitation of bucco-facial gestures was associated with more anterior lesions, while arm/hand imitation deficits were associated with more posterior lesions. MF gestures were specifically associated with lesions in the left inferior frontal gyrus and the left insular region. Notably, an interaction of effector-specificity and gesture meaning was also present at the lesion level: A more pronounced difference in imitation performance between the effectors for ML (versus MF) gestures was associated with left-hemispheric lesions in the STG, SMG, putamen, precentral gyrus and white matter tracts.

CONCLUSION

The current behavioural data show that ML gestures are particularly sensitive in assessing effector-specific imitation deficits in LH stroke patients. Moreover, a gesture's meaning modulated the effector-specific lesion correlates of bucco-facial and arm/hand gesture imitation. Hence, it is crucial to consider gesture meaning in apraxia assessments.

A neural mechanism underlying predictive visual motion processing in patients with schizophrenia

Psychotic symptoms may be traced back to sensory sensitivity. Thereby, visual motion (VM) processing particularly has been suggested to be impaired in schizophrenia (SCZ). In healthy brains, VM underlies predictive processing within hierarchically structured systems. However, less is known about predictive VM processing in SCZ. Therefore, we performed fMRI during a VM paradigm with three conditions of varying predictability, i.e., Predictable-, Random-, and Arbitrary motion. The study sample comprised 17 SCZ patients and 23 healthy controls. We calculated general linear model (GLM) analysis to assess group differences in VM processing across motion conditions. Here, we identified significantly lower activity in right temporoparietal junction (TPJ) for SCZ patients. Therefore, right TPJ was set as seed for connectivity analyses. For patients, across conditions we identified increased connections to higher regions, namely medial prefrontal cortex, or paracingulate gyrus. Healthy subjects activated sensory regions as area V5, or superior parietal lobule. Reduced TPJ activity may reflect both a failure in the bottom-up flow of visual information and a decrease of signal processing as consequence of increased top-down input from frontal areas. In sum, these altered neural patterns provide a framework for future studies focusing on predictive VM processing to identify potential biomarkers of psychosis.

OUP accepted manuscript

Neuralgic amyotrophy is a common peripheral nerve disorder caused by autoimmune inflammation of the brachial plexus, clinically characterized by acute pain and weakness of the shoulder muscles, followed by motor impairment. Despite recovery of the peripheral nerves, patients often have residual motor dysfunction of the upper extremity, leading to persistent pain related to altered biomechanics of the shoulder region. Building on clinical signs that suggest a role for cerebral mechanisms in these residual complaints, here we show and characterize cerebral alterations following neuralgic amyotrophy. Neuralgic amyotrophy patients often develop alternative motor strategies, which suggests that (mal)adaptations may occur in somatomotor and/or visuomotor brain areas. Here, we tested where changes in cerebral sensorimotor representations occur in neuralgic amyotrophy, while controlling for altered motor execution due to peripheral neuropathy. We additionally explore the relation between potential cerebral alterations in neuralgic amyotrophy and clinical symptoms. During functional MRI scanning, 39 neuralgic amyotrophy patients with persistent, lateralized symptoms in the right upper extremity and 23 matched healthy participants solved a hand laterality judgement task that can activate sensorimotor representations of the upper extremity, across somatomotor and visuomotor brain areas. Behavioural and cerebral responses confirmed the involvement of embodied, sensorimotor processes across groups. Compared with healthy participants, neuralgic amyotrophy patients were slower in hand laterality judgement and had decreased cerebral activity specific to their affected limb in two higher-order visual brain regions: the right extrastriate cortex and the parieto-occipital sulcus. Exploratory analyses revealed that across patients, extrastriate activity specific to the affected limb decreased as persistent pain increased, and affected limb-related parieto-occipital activity decreased as imagery performance of the affected limb became slower. These findings suggest that maladaptive cerebral plasticity in visuomotor areas involved in sensorimotor integration plays a role in residual motor dysfunction and subsequent persistent pain in neuralgic amyotrophy. Rehabilitation interventions that apply visuomotor strategies to improve sensorimotor integration may help to treat neuralgic amyotrophy patients.

Anatomical correlates of recovery in apraxia: A longitudinal lesion-mapping study in stroke patients

OBJECTIVE

This study investigates the clinical course of recovery of apraxia after left-hemisphere stroke and the underlying neuroanatomical correlates for persisting or recovering deficits in relation to the major processing streams in the network for motor cognition.

METHODS

90 patients were examined during the acute (4.74 ± 2.73 days) and chronic (14.3 ± 15.39 months) stage after left-hemisphere stroke for deficits in meaningless imitation, as well as production and conceptual errors in tool use pantomime. Lesion correlates for persisting or recovering deficits were analyzed with an extension of the non-parametric Brunner-Munzel rank-order test for multi-factorial designs (two-way repeated-measures ANOVA) using acute images.

RESULTS

Meaningless imitation and tool use production deficits persisted into the chronic stage. Conceptual errors in tool use pantomime showed an almost complete recovery. Imitation errors persisted after occipitotemporal and superior temporal lesions in the dorso-dorsal stream. Chronic pantomime production errors were related to the supramarginal gyrus, the key structure of the ventro-dorsal stream. More anterior lesions in the ventro-dorsal stream (ventral premotor cortex) were additionally associated with poor recovery of production errors in pantomime. Conceptual errors in pantomime after temporal and supramarginal gyrus lesions persisted into the chronic stage. However, they resolved completely when related to angular gyrus or insular lesions.

CONCLUSION

The diverging courses of recovery in different apraxia tasks can be related to different mechanisms. Critical lesions to key structures of the network or entrance areas of the processing streams lead to persisting deficits in the corresponding tasks. Contrary, lesions located outside the core network but inducing a temporary network dysfunction allow good recovery e.g., of conceptual errors in pantomime. The identification of lesion correlates for different long-term recovery patterns in apraxia might also allow early clinical prediction of the course of recovery.

Flexible Orientation Tuning of Visual Representations of Human Body Postures: Evidence From Long-Term Priming

The proficiency of human observers to identify body postures is examined in three experiments. We use a posture decision task in which participants are primed with either anatomically possible or impossible postures (in the latter case the upper and lower body face in opposite directions). In a long-term priming paradigm (i.e., in an initial priming block of trials and a subsequent test phase several minutes later), we manipulate the relation between priming and test postures with respect to the identity of the person in the body postures (Experiment 1), the prototypicality of the depth orientations (Experiment 2), and the variability of the priming orientations (Experiment 3). Reaction time to the test postures is the main dependent variable. In Experiment 1 it is found that priming of postures does not depend on the exact visual appearance of the actor (either same priming and test female or male figure or different figures), supporting the hypothesis that posture priming primarily is determined by the spatial relations between the body parts and much less by characteristics of the person involved. Long-term priming in our paradigm apparently is based on the reactivation of high-level posture representations that make abstraction of the identity of the human figure. In Experiment 2 we observe that privileged or prototypical orientations (e.g., 3/4 views) do not affect long-term priming of body postures. In Experiment 3, we find that increasing or decreasing the variability between the priming and test figures influences reaction time performance. Collectively, these results provide a better understanding of the flexibility (e.g., invariant to identity) and limits (e.g., depending on depth orientation) of the processes supporting human posture recognition.

Neural correlates of differential finger gesture imitation deficits in left hemisphere stroke

Behavioural studies in apraxic patients revealed dissociations between the processing of meaningful (MF) and meaningless (ML) gestures. Consequently, the existence of two differential neural mechanisms for the imitation of either gesture type has been postulated. While the indirect (semantic) route exclusively enables the imitation of MF gestures, the direct route can be used for the imitation of any gesture type, irrespective of meaning, and thus especially for ML gestures. Concerning neural correlates, it is debated which of the visuo-motor streams (i.e., the ventral steam, the ventro-dorsal stream, or the dorso-dorsal stream) supports the postulated indirect and direct imitation routes.

To probe the hypotheses that regions of the dorso-dorsal stream are involved differentially in the imitation of ML gestures and that regions of the ventro-dorsal stream are involved differentially in the imitation of MF gestures, we analysed behavioural (imitation of MF and ML finger gestures) and lesion data of 293 patients with a left hemisphere (LH) stroke.

Confirming previous work, the current sample of LH stroke patients imitated MF finger gestures better than ML finger gestures. The analysis using voxel-based lesion symptom mapping (VLSM) revealed that LH damage to dorso-dorsal stream areas was associated with an impaired imitation of ML finger gestures, whereas damage to ventro-dorsal regions was associated with a deficient imitation of MF finger gestures.

Accordingly, the analyses of the imitation of visually uniform and thus highly comparable MF and ML finger gestures support the dual-route model for gesture imitation at the behavioural and lesion level in a substantial patient sample. Furthermore, the data show that the direct route for ML finger gesture imitation depends on the dorso-dorsal visuo-motor stream while the indirect route for MF finger gesture imitation is related to regions of the ventro-dorsal visuo-motor stream.

•

Identification of differential neural correlates for the imitation of meaningful and meaningless finger gestures.

•

Support for the dual-route model for gesture imitation in a substantial patient sample (n = 293).

•

Left hemispheric damage to dorso-dorsal stream areas is associated with an impaired imitation of meaningless finger gestures

•

Damage to ventro-dorsal regions is associated with a deficient imitation of meaningful finger gestures

The "social brain" is highly sensitive to the mere presence of social information: An automated meta-analysis and an independent study

How the human brain processes social information is an increasingly researched topic in psychology and neuroscience, advancing our understanding of basic human cognition and psychopathologies. Neuroimaging studies typically seek to isolate one specific aspect of social cognition when trying to map its neural substrates. It is unclear if brain activation elicited by different social cognitive processes and task instructions are also spontaneously elicited by general social information. In this study, we investigated whether these brain regions are evoked by the mere presence of social information using an automated meta-analysis and confirmatory data from an independent study of simple appraisal of social vs. non-social images. Results of 1,000 published fMRI studies containing the keyword of “social” were subject to an automated meta-analysis (http://neurosynth.org). To confirm that significant brain regions in the meta-analysis were driven by a social effect, these brain regions were used as regions of interest (ROIs) to extract and compare BOLD fMRI signals of social vs. non-social conditions in the independent study. The NeuroSynth results indicated that the dorsal and ventral medial prefrontal cortex, posterior cingulate cortex, bilateral amygdala, bilateral occipito-temporal junction, right fusiform gyrus, bilateral temporal pole, and right inferior frontal gyrus are commonly engaged in studies with a prominent social element. The social–non-social contrast in the independent study showed a strong resemblance to the NeuroSynth map. ROI analyses revealed that a social effect was credible in 9 out of the 11 NeuroSynth regions in the independent dataset. The findings support the conclusion that the “social brain” is highly sensitive to the mere presence of social information.

Neural activity associated with attention orienting triggered by implied action cues

Spatial attention can be directed by the actions of others. We used ERPs method to investigate the neural underpins associated with attention orienting which is induced by implied body action. Participants performed a standard non-predictive cuing task, in which a directional implied action (throwing and running) or non-action (standing) cue was randomly presented and then followed by a target to the left or right of the central cue, despite cue direction. The cue-triggered ERPs results demonstrated that implied action cues, rather than the non-action cue, could shift the observers' spatial attention as demonstrated by the robust anterior directing attention negativity (ADAN) effects in throwing and running cues. Further, earlier N1 (100-170ms) and P2 (170-260ms) waveform differences occurred between implied action and non-action cues over posterior electrodes. The P2 component might reflect implied motion signal perception of implied action cues, and this implied motion perception might play an important role in facilitating the attentional shifts induced by implied action cues. Target-triggered ERPs data (mainly P3a component) indicated that implied action cues (throwing and running) speeded and enhanced the responses to valid targets compared to invalid targets. Furthermore, P3a might imply that implied action orienting may share similar mechanisms of action with voluntary attention, especially at the novel stimuli processing decision-level. These results further support previous behavioral findings that implied body actions direct spatial attention and extend our understanding about the nature of the attentional shifts that are elicited by implied action cues.

Bistability and Biasing Effects in the Perception of Ambiguous Point-Light Walkers

The perceptually bistable character of point-light walkers has been examined in three experiments. A point-light figure without explicit depth cues constitutes a perfectly ambiguous stimulus: from all viewpoints, multiple interpretations are possible concerning the depth orientation of the figure. In the first experiment, it is shown that non-lateral views of the walker are indeed interpreted in two orientations, either as facing towards the viewer or as facing away from the viewer, but that the interpretation in which the walker is oriented towards the viewer is reported more frequently. In the second experiment the point-light figure was walking backwards, making the global orientation of the point-light figure opposite to the direction of global motion. The interpretation in which the walker was facing the viewer was again reported more frequently. The robustness of these findings was examined in the final experiment, in which the effects of disambiguating the stimulus by introducing a local depth cue (occlusion) or a more global depth cue (applying perspective projection) were explored.

Emotional and movement-related body postures modulate visual processing

Human body postures convey useful information for understanding others' emotions and intentions. To investigate at which stage of visual processing emotional and movement-related information conveyed by bodies is discriminated, we examined event-related potentials elicited by laterally presented images of bodies with static postures and implied-motion body images with neutral, fearful or happy expressions. At the early stage of visual structural encoding (N190), we found a difference in the sensitivity of the two hemispheres to observed body postures. Specifically, the right hemisphere showed a N190 modulation both for the motion content (i.e. all the observed postures implying body movements elicited greater N190 amplitudes compared with static postures) and for the emotional content (i.e. fearful postures elicited the largest N190 amplitude), while the left hemisphere showed a modulation only for the motion content. In contrast, at a later stage of perceptual representation, reflecting selective attention to salient stimuli, an increased early posterior negativity was observed for fearful stimuli in both hemispheres, suggesting an enhanced processing of motivationally relevant stimuli. The observed modulations, both at the early stage of structural encoding and at the later processing stage, suggest the existence of a specialized perceptual mechanism tuned to emotion- and action-related information conveyed by human body postures.

Mismatch and lexical retrieval gestures are associated with visual information processing, verbal production, and symptomatology in youth at high risk for psychosis

INTRODUCTION

Gesture is integrally linked with language and cognitive systems, and recent years have seen a growing attention to these movements in patients with schizophrenia. To date, however, there have been no investigations of gesture in youth at ultra high risk (UHR) for psychosis. Examining gesture in UHR individuals may help to elucidate other widely recognized communicative and cognitive deficits in this population and yield new clues for treatment development.

METHOD

In this study, mismatch (indicating semantic incongruency between the content of speech and a given gesture) and retrieval (used during pauses in speech while a person appears to be searching for a word or idea) gestures were evaluated in 42 UHR individuals and 36 matched healthy controls. Cognitive functions relevant to gesture production (i.e., speed of visual information processing and verbal production) as well as positive and negative symptomatologies were assessed.

RESULTS

Although the overall frequency of cases exhibiting these behaviors was low, UHR individuals produced substantially more mismatch and retrieval gestures than controls. The UHR group also exhibited significantly poorer verbal production performance when compared with controls. In the patient group, mismatch gestures were associated with poorer visual processing speed and elevated negative symptoms, while retrieval gestures were associated with higher speed of visual information-processing and verbal production, but not symptoms.

CONCLUSIONS

Taken together these findings indicate that gesture abnormalities are present in individuals at high risk for psychosis. While mismatch gestures may be closely related to disease processes, retrieval gestures may be employed as a compensatory mechanism.

Effect of observation of simple hand movement on brain activations in patients with unilateral cerebral palsy: an fMRI study

The aim of this functional magnetic resonance imaging (fMRI) study was to examine and compare brain activation in patients with unilateral cerebral palsy (CP) during observation of simple hand movement performed by the paretic and nonparetic hand. Nineteen patients with clinical unilateral CP (14 male, mean age 14 years, 7-21 years) participated in the study. Hand motor impairment was assessed using the sequential finger opposition task. Using fMRI block design, brain activation was examined following observation at rest of a simple opening-closing hand movement, performed by either the left or right hand of an actor. Eighteen fMRI dataset were analyzed. Observing hand movement produced large bilateral activations in temporo-parieto-fronto-occipital network, comprising most of the nodes of the well described action-observation network. For either side, observing hand movements recruits the primary motor cortex (M1), contralateral to the viewed hand, as would be expected in healthy persons. Viewing movement performed by an actor's hand representing the paretic side of patients activated more strongly ipsilesional M1 than viewing movement performed by an actor's hand representing the nonparetic side of patients. Observation of hand movement in patients with CP engaged the motor execution network regardless of the degree of motor impairment.

MEG premotor abnormalities in children with Asperger's syndrome: determinants of social behavior?

Children with Asperger's syndrome show deficits in social functioning while their intellectual and language development is intact suggesting a specific dysfunction in mechanisms mediating social cognition. An action observation/execution matching system might be one such mechanism. Recent studies indeed showed that electrophysiological modulation of the "Mu-rhythm" in the 10-12Hz range is weaker when individuals with Asperger's syndrome observe actions performed by others compared to controls. However, electrophysiological studies typically fall short in revealing the neural generators of this activity. To fill this gap we assessed magnetoencephalographic Mu-modulations in Asperger's and typically developed children, while observing grasping movements. Mu-power increased at frontal and central sensors during movement observation. This modulation was stronger in typical than in Asperger children. Source localization revealed stronger sources in premotor cortex, the intraparietal lobule (IPL) and the mid-occipito-temporal gyrus (MOTG) and weaker sources in prefrontal cortex in typical participants compared to Asperger. Activity in premotor regions, IPL and MOTG correlated positively with social competence, whereas prefrontal Mu-sources correlated negatively with social competence. No correlation with intellectual ability was found at any of these sites. These findings localize abnormal Mu-activity in the brain of Asperger children providing evidence which associates motor-system abnormalities with social-function deficits.

The impact of iconic gestures on foreign language word learning and its neural substrate

Vocabulary acquisition represents a major challenge in foreign language learning. Research has demonstrated that gestures accompanying speech have an impact on memory for verbal information in the speakers' mother tongue and, as recently shown, also in foreign language learning. However, the neural basis of this effect remains unclear. In a within-subjects design, we compared learning of novel words coupled with iconic and meaningless gestures. Iconic gestures helped learners to significantly better retain the verbal material over time. After the training, participants' brain activity was registered by means of fMRI while performing a word recognition task. Brain activations to words learned with iconic and with meaningless gestures were contrasted. We found activity in the premotor cortices for words encoded with iconic gestures. In contrast, words encoded with meaningless gestures elicited a network associated with cognitive control. These findings suggest that memory performance for newly learned words is not driven by the motor component as such, but by the motor image that matches an underlying representation of the word's semantics.

Functional MRI comparison of passive and active movement: possible inhibitory role of supplementary motor area

Recent studies have hypothesized that the supplementary motor area plays a role in motor inhibition. To study this possible role, we used functional MRI study to compare conditions, which require various level of inhibition of motor patterns. Seventeen healthy participants were scanned while executing - actively or passively - rhythmic opening/closing movements of their right hand, with and without congruent visual information. The contrast passive>active movement in the visual guidance condition which requires inhibition in order 'not' to perform the movement, yields to significant activation of areas commonly involved in the inhibitory brain circuitry among which, notably, controlateral supplementary motor area.

Neurofunctional modulation of brain regions by distinct forms of motor cognition and movement features

Extrastriate, parietal, and frontal brain regions are differentially involved in distinct kinds of body movements and motor cognition. Using functional magnetic resonance imaging, we investigated the neural mechanisms underlying the observation and mental imagery of meaningful face and limb movements with or without objects. The supplementary motor area was differentially recruited by the mental imagery of movements while there were differential responses of the extrastriate body area (EBA) during the observation conditions. Contrary to most previous reports, the EBA responded to face movements, albeit to a lesser degree than to limb movements. The medial wall of the intraparietal sulcus and adjacent intraparietal cortex was selectively recruited by the processing of meaningful upper limb movements, irrespective of whether these were object-related or not. Besides reach and grasp movements, the intraparietal sulcus may thus be involved in limb gesture processing, that is, in an important aspect of human social communication. We conclude that subregions of a frontal-parietal network differentially interact during the cognitive processing of body movements according to the specific motor-related task at hand and the particular movement features involved.

The mirror-neuron system and handedness: a "right" world?

To assess the relationship between the mirror-neuron system (MNS), an observation-execution matching system, and handedness, we acquired functional magnetic resonance imaging from 11 right-handed (RH) and eight left-handed (LH) subjects to identify regions involved in processing action (execution and observation) of the right and left upper limbs. During the execution tasks, LH subjects had a more bilateral pattern of activation than RH. An interaction between handedness and hand observed during the observation conditions was detected in several areas of the MNS and the motor system. The within- and between-groups analyses confirmed different lateralizations of the MNS and motor system activations in RH and LH subjects during the observation tasks of the dominant and nondominant limbs. The comparison of the execution vs. observation task demonstrated that during the execution task with their dominant limbs, RH subjects activated areas of the motor system in the left hemisphere, whereas LH subjects also activated areas of the MNS. During the execution task with the nondominant limbs, both groups activated regions of the MNS and motor system. Albeit this study is based on a small sample, the patterns of MNS activations observed in RH and LH subjects support the theory that suggests that this system is involved in brain functions lateralization. In LH people, this system might contribute to their adaptation to a world essentially built for right-handers through a mechanism of mirroring and imitation.

Functional Interactions during the Retrieval of Conceptual Action Knowledge: An fMRI Study

Impaired retrieval of conceptual knowledge for actions has been associated with lesions of left premotor, left parietal, and left middle temporal areas [Tranel, D., Kemmerer, D., Adolphs, R., Damasio, H., & Damasio, A. R. Neural correlates of conceptual knowledge for actions. Cognitive Neuropsychology, 409–432, 2003]. Here we aimed at characterizing the differential contribution of these areas to the retrieval of conceptual knowledge about actions. During functional magnetic resonance imaging (fMRI), different categories of pictograms (whole-body actions, manipulable and nonmanipulable objects) were presented to healthy subjects. fMRI data were analyzed using SPM2. A conjunction analysis of the neural activations elicited by all pictograms revealed ( p < .05, corrected) a bilateral inferior occipito-temporal neural network with strong activations in the right and left fusiform gyri. Action pictograms contrasted to object pictograms showed differential activation of area MT+, the inferior and superior parietal cortex, and the premotor cortex bilaterally. An analysis of psychophysiological interactions identified contribution-dependent changes in the neural responses when pictograms triggered the retrieval of conceptual action knowledge: Processing of action pictograms specifically enhanced the neural interaction between the right and left fusiform gyri, the right and left middle temporal cortices (MT+), and the left superior and inferior parietal cortex. These results complement and extend previous neuropsychological and neuroimaging studies by showing that knowledge about action concepts results from an increased coupling between areas concerned with semantic processing (fusiform gyrus), movement perception (MT+), and temporospatial movement control (left parietal cortex).

Apraxia: a review

Praxic functions are frequently altered following brain lesion, giving rise to apraxia - a complex pattern of impairments that is difficult to assess or interpret. In this chapter, we review the current taxonomies of apraxia and related cognitive and neuropsychological models. We also address the questions of the neuroanatomical correlates of apraxia, the relation between apraxia and aphasia and the analysis of apraxic errors. We provide a possible explanation for the difficulties encountered in investigating apraxia and also several approaches to overcome them, such as systematic investigation and modeling studies. Finally, we argue for a multidisciplinary approach. For example, apraxia should be studied in consideration with and could contribute to other fields such as normal motor control, neuroimaging and neurophysiology.

Mapping implied body actions in the human motor system

The human visual system is highly tuned to perceive actual motion as well as to extrapolate dynamic information from static pictures of objects or creatures captured in the middle of motion. Processing of implied motion activates higher-order visual areas that are also involved in processing biological motion. Imagery and observation of actual movements performed by others engenders selective activation of motor and premotor areas that are part of a mirror-neuron system matching action observation and execution. By using single-pulse transcranial magnetic stimulation, we found that the mere observation of static snapshots of hands suggesting a pincer grip action induced an increase in corticospinal excitability as compared with observation of resting, relaxed hands, or hands suggesting a completed action. This facilitatory effect was specific for the muscle that would be activated during actual execution of the observed action. We found no changes in responsiveness of the tested muscles during observation of nonbiological entities with (e.g., waterfalls) or without (e.g., icefalls) implied motion. Thus, extrapolation of motion information concerning human actions induced a selective activation of the motor system. This indicates that overlapping motor regions are engaged in the visual analysis of physical and implied body actions. The absence of motor evoked potential modulation during observation of end posture stimuli may indicate that the observation-execution matching system is preferentially activated by implied, ongoing but not yet completed actions.

Cortical memory mechanisms and language origins

We have previously proposed that cortical auditory-vocal networks of the monkey brain can be partly homologized with language networks that participate in the phonological loop. In this paper, we suggest that other linguistic phenomena like semantic and syntactic processing also rely on the activation of transient memory networks, which can be compared to active memory networks in the primate. Consequently, short-term cortical memory ensembles that participate in language processing can be phylogenetically tracked to more simple networks present in the primate brain, which became increasingly complex in hominid evolution. This perspective is discussed in the context of two current interpretations of language origins, the "mirror-system hypothesis" and generativist grammar.

Conceptual representations of action in the lateral temporal cortex

Retrieval of conceptual information from action pictures causes greater activation than from object pictures bilaterally in human motion areas (MT/MST) and nearby temporal regions. By contrast, retrieval of conceptual information from action words causes greater activation in left middle and superior temporal gyri, anterior and dorsal to the MT/MST. We performed two fMRI experiments to replicate and extend these findings regarding action words. In the first experiment, subjects performed conceptual judgments of action and object words under conditions that stressed visual semantic information. Under these conditions, action words again activated posterior temporal regions close to, but not identical with, the MT/MST. In the second experiment, we included conceptual judgments of manipulable object words in addition to judgments of action and animal words. Both action and manipulable object judgments caused greater activity than animal judgments in the posterior middle temporal gyrus. Both of these experiments support the hypothesis that middle temporal gyrus activation is related to accessing conceptual information about motion attributes, rather than alternative accounts on the basis of lexical or grammatical factors. Furthermore, these experiments provide additional support for the notion of a concrete to abstract gradient of motion representations with the lateral occipito-temporal cortex, extending anterior and dorsal from the MT/MST towards the peri-sylvian cortex.

Differential cerebral activation during observation of expressive gestures and motor acts

We compared brain activation involved in the observation of isolated right hand movements (e.g. twisting a lid), body-referred movements (e.g. brushing teeth) and expressive gestures (e.g. threatening) in 20 healthy subjects by using functional magnetic resonance imaging (fMRI). Perception-related areas in the occipital and inferior temporal lobe but also the mirror neuron system in the lateral frontal (ventral premotor cortex and BA 44) and superior parietal lobe were active during all three conditions. Observation of body-referred compared to common hand actions induced increased activity in the bilateral posterior superior temporal sulcus (STS), the left temporo-parietal lobe and left BA 45. Expressive gestures involved additional areas related to social perception (bilateral STS, temporal poles, medial prefrontal lobe), emotional processing (bilateral amygdala, bilateral ventrolateral prefrontal cortex (VLPFC), speech and language processing (Broca's and Wernicke's areas) and the pre-supplementary motor area (pre-SMA). In comparison to body-referred actions, expressive gestures evoked additional activity only in the left VLPFC (BA 47). The valence-ratings for expressive gestures correlated significantly with activation intensity in the VLPFC during expressive gesture observation. Valence-ratings for negative expressive gestures correlated with right STS-activity. Our data suggest that both, the VLPFC and the STS are coding for differential emotional valence during the observation of expressive gestures.

Specificity of regions processing biological motion

Using functional magnetic resonance imaging and point light displays portraying six different human actions, we were able to show that several visual cortical regions, including human MT/V5 complex, posterior inferior temporal gyrus and superior temporal sulcus, are differentially active in the subtraction comparing biological motion to scrambled motion. Comparison of biological motion to three-dimensional rotation (of a human figure), articulated motion and translation suggests that human superior temporal sulcus activity reflects the action portrayed in the biological motion stimuli, whereas posterior inferior temporal gyrus responds to the figure and hMT/V5+ to the complex motion pattern present in biological motion stimuli. These results were confirmed with implied action stimuli.

An fMRI study of imitation: action representation and body schema

Recent neuropsychological investigations of apraxia have led to new hypotheses about the representational defects associated with imitation impairments in neurological patients. This fMRI experiment investigated the relation between imitation and the body schema in healthy subjects. Experimental conditions were derived from a factorial plan, and participants were asked to watch a human model performing bodily gestures and then to execute either an identical or a different action, with the same or different limbs. Brain areas activated when subjects imitated the model were traced to the representation of the action (main effect of performing an identical action regardless of limb), to the body schema (using the same limb regardless of action), or to both. The first set of analyses yielded a network associated with visual perception, indicating that action representation is primarily visuospatial not motor, while the second analysis highlighted regions involved in body schema including the inferior parietal cortex and the insula. It is suggested that imitation of simple body gestures requires both a visuospatial description of the observed model, sustained by visual perception areas in the right occipitotemporal and superior parietal cortices and a visuospatial description of one's own body, supported by the left inferior parietal lobule. These results favor a model of praxis proposing that imitation deficits in left inferior parietal lobe patients with apraxia reflect primarily an impairment of the body schema, while deficits of praxis in right parietal patients are limited to gestures demanding in terms of visuospatial analysis.

Left inferior parietal dominance in gesture imitation: an fMRI study

The inability to imitate gestures is an essential feature of apraxia. However, discrepancies exist between clinical studies in apraxic patients and neuroimaging findings on imitation. We therefore aimed to investigate: (1) which areas are recruited during imitation under conditions similar to clinical tests for apraxic deficits; (2) whether there are common lateralized areas subserving imitation irrespective of the acting limb side; and also (3) whether there are differences between hand and finger gestures. We used fMRI in 12 healthy, right handed subjects to investigate the imitation of four types of variable gestures that were presented by video clips (16 different finger and 16 different hand gestures with either the right or the left arm). The respective control conditions consisted of stereotyped gestures (only two gestures presented in pseudorandom order). Subtraction analysis of each type of gesture imitation (variable>stereotyped) revealed a bilateral activation pattern including the inferior parietal cortex Brodmann Area (BA 40), the superior parietal cortex, the inferior frontal cortex (opercular region), the prefrontal motor cortex, the lateral occipito-temporal junction, and the cerebellum. These results were supported by statistical conjunction of all four subtraction analyses and by the common analysis of all four types of gesture imitation. The direct comparison of the right and left hemispheric activation revealed a lateralization to the left only of the inferior parietal cortex. Comparisons between different types of gesture imitation yielded no significant results. In conclusion, gesture imitation recruits bilateral fronto-parietal regions, with significant lateralization of only one area, namely the left inferior parietal cortex. These in vivo data indicate left inferior parietal dominance for gesture imitation in right handers, confirming lesion-based theories of apraxia.

Cortical mechanisms of visual self-recognition

Several lines of evidence have suggested that visual self-recognition is supported by a special brain mechanism; however, its functional anatomy is of great controversy. We performed an event-related functional magnetic resonance imaging (fMRI) study to identify brain regions selectively involved in recognition of one's own face. We presented pictures of each subject's own face (SELF) and a prelearned face of an unfamiliar person (CONT), as well as two personally familiar faces with high and low familiarity (HIGH and LOW, respectively) to test selectivity of activation to the SELF face. Compared with the CONT face, activation selective to the SELF face was observed in the right occipito-temporo-parietal junction and frontal operculum, as well as in the left fusiform gyrus. On the contrary, the temporoparietal junction in both the hemispheres and the left anterior temporal cortex, which were activated during recognition of HIGH and/or LOW faces, were not activated during recognition of the SELF face. The results confirmed the partial distinction of the brain mechanism involved in recognition of personally familiar faces and that in recognition of one's own face. The right occipito-temporo-parietal junction and frontal operculum appear to compose a network processing motion-action contingency, a role of which in visual self-recognition has been suggested in previous behavioral studies. Activation of the left fusiform gyrus selective to one's own face was consistent with the results of two previous functional imaging studies and a neuropsychological report, possibly suggesting its relationship with lexical processing.

Magnetic Stimulation of Extrastriate Body Area Impairs Visual Processing of Nonfacial Body Parts

Functional magnetic resonance imaging indicates that observation of the human body induces a selective activation of a lateral occipitotemporal cortical area called extrastriate body area (EBA). This area is responsive to static and moving images of the human body and parts of it, but it is insensitive to faces and stimulus categories unrelated to the human body. With event-related repetitive transcranial magnetic stimulation, we tested the possible causal relation between neural activity in EBA and visual processing of body-related, nonfacial stimuli. Facial and noncorporeal stimuli were used as a control. Interference with neural activity in EBA induced a clear impairment, consisting of a significant increase in discriminative reaction time, in the visual processing of body parts. The effect was selective for stimulus type, because it affected responses to nonfacial body stimuli but not to noncorporeal and facial stimuli, and for locus of stimulation, because the effect from the interfering stimulation of EBA was absent during a corresponding stimulation of primary visual cortex. The results provide strong evidence that neural activity in EBA is not only correlated with but also causally involved in the visual processing of the human body and its parts, except the face.

Imaging a cognitive model of apraxia: the neural substrate of gesture-specific cognitive processes

The present study aimed to ascertain the neuroanatomical basis of an influential neuropsychological model for upper limb apraxia [Rothi LJ, et al. The Neuropsychology of Action. 1997. Hove, UK: Psychology Press]. Regional cerebral blood flow was measured in healthy volunteers using H2 15O PET during performance of four tasks commonly used for testing upper limb apraxia, i.e., pantomime of familiar gestures on verbal command, imitation of familiar gestures, imitation of novel gestures, and an action-semantic task that consisted in matching objects for functional use. We also re-analysed data from a previous PET study in which we investigated the neural basis of the visual analysis of gestures. First, we found that two sets of discrete brain areas are predominantly engaged in the imitation of familiar and novel gestures, respectively. Segregated brain activation for novel gesture imitation concur with neuropsychological reports to support the hypothesis that knowledge about the organization of the human body mediates the transition from visual perception to motor execution when imitating novel gestures [Goldenberg Neuropsychologia 1995;33:63-72]. Second, conjunction analyses revealed distinctive neural bases for most of the gesture-specific cognitive processes proposed in this cognitive model of upper limb apraxia. However, a functional analysis of brain imaging data suggested that one single memory store may be used for "to-be-perceived" and "to-be-produced" gestural representations, departing from Rothi et al.'s proposal. Based on the above considerations, we suggest and discuss a revised model for upper limb apraxia that might best account for both brain imaging findings and neuropsychological dissociations reported in the apraxia literature.

Body scheme gates visual processing

We used functional magnetic resonance imaging (fMRI) to explore how guidance of motor acts is influenced by the visually perceived body scheme. We found that when subjects view their hand as their opposite hand, i.e., the right hand is seen as the left hand and vice versa, activation in the visual cortex was lateralized opposite to the seen hand. This demonstrates for the first time that our body scheme to which vision relates our environment is already represented at the level of visual cortex.

Viewing lip forms: cortical dynamics

Viewing other persons' actions automatically activates brain areas belonging to the mirror-neuron system (MNS) assumed to link action execution and observation. We followed, by magnetoencephalographic cortical dynamics, subjects who observed still pictures of lip forms, on-line imitated them, or made similar forms in a self-paced manner. In all conditions and in both hemispheres, cortical activation progressed in 20-70 ms steps from the occipital cortex to the superior temporal region (where the strongest activation took place), the inferior parietal lobule, and the inferior frontal lobe (Broca's area), and finally, 50-140 ms later, to the primary motor cortex. The signals of Broca's area and motor cortex were significantly stronger during imitation than other conditions. These results demonstrate that still pictures, only implying motion, activate the human MNS in a well-defined temporal order.

Deconstructing apraxia: understanding disorders of intentional movement after stroke

Impairments in praxic functioning are common after stroke, most frequently when the left hemisphere is affected. Several recent studies of apraxia after stroke have made advances in understanding the right hemisphere contribution to praxis, particularly for the performance of novel actions. Moreover, quantitative lesion analysis in stroke patients indicates the importance of cortical regions such as the intraparietal sulcus and the middle frontal gyrus for subserving praxic function. Complex neuropsychological models have been developed to account for the many dissociations observed in the types of errors observed in stroke patients. Relatively lacking, however, are models that attempt to relate the neurological data to what is known about praxis from functional neuroimaging in normal subjects and from physiological studies in the monkey. Moreover, a coherent interpretation of the results of apraxia studies remains hampered by the lack of a standard testing instrument to assess the nature and severity of apraxic impairments in the groups tested.

Imitation and Matching of Hand and Finger Postures

Converging evidence from patients with unilateral brain lesions, from a patient with callosal disconnection, and from functional imaging in healthy subjects suggests different competencies of both hemispheres for imitation and matching of hand and finger postures. Whereas the left hemisphere is fully competent for processing hand postures, an additional right hemisphere contribution is needed for finger postures. I propose that the left hemisphere is responsible for coding gestures with reference to knowledge about the structure of the human body, whereas a right hemisphere contribution is needed for visuospatial exploration and analysis of gestures. Single case studies of patients with visuoimitative apraxia and results of functional imaging suggest a prominent role for left area 40 for body-part coding. Additional activation of left MT/V5 in the functional neuroimaging study may be related to processing of the motion implied by the gesture which is presented as a static image.

Cortical correlates of gesture processing: clues to the cerebral mechanisms underlying apraxia during the imitation of meaningless gestures

The clinical test of imitation of meaningless gestures is highly sensitive in revealing limb apraxia after dominant left brain damage. To relate lesion locations in apraxic patients to functional brain activation and to reveal the neuronal network subserving gesture representation, repeated H2(15O)-PET measurements were made in seven healthy subjects during a gesture discrimination task. Observing paired images of either meaningless hand or meaningless finger gestures, subjects had to indicate whether they were identical or different. As a control condition subjects simply had to indicate whether two portrayed persons were identical or not. Brain activity during the discrimination of hand gestures was strongly lateralized to the left hemisphere, a prominent peak activation being localized within the inferior parietal cortex (BA40). The discrimination of finger gestures induced a more symmetrical activation and rCBF peaks in the right intraparietal sulcus and in medial visual association areas (BA18/19). Two additional foci of prominent rCBF increase were found. One focus was located at the left lateral occipitotemporal junction (BA 19/37) and was related to both tasks; the other in the pre-SMA was particularly related to hand gestures. The pattern of task-dependent activation corresponds closely to the predictions made from the clinical findings, and underlines the left brain dominance for meaningless hand gestures and the critical involvement of the parietal cortex. The lateral visual association areas appear to support first stages of gesture representation, and the parietal cortex is part of the dorsal action stream. Finger gestures may require in addition precise visual analysis and spatial attention enabled by occipital and right intraparietal activity. Pre-SMA activity during the perception of hand gestures may reflect engagement of a network that is intimately related to gesture execution.

Imaging image processing in the human brain

Functional imaging in humans reveals the interplay of the many components of the human visual system: how they process the various types of information contained in the image to recover characteristics of the three-dimensional world surrounding us, but also how, in the course of this process, the retinal image is gradually integrated with non-retinal signals to provide information about the outside world in a format useful to other non-visual brain regions.