Cortical networks related to human use of tools

Spatio-temporal dynamics of the mirror neuron system during social intentions

Previous research has shown that specific goals and intentions influence a person's allocation of social attention. From a neural viewpoint, a growing body of evidence suggests that the inferior fronto-parietal network, including the mirror neuron system, plays a role in the planning and the understanding of motor intentions. However, it is unclear whether and when the mirror neuron system plays a role in social intentions. Combining a behavioral task with electrical neuroimaging in 22 healthy male participants, the current study investigates whether the temporal brain dynamic of the mirror neuron system differs during two types of social intentions i.e., lust vs. romantic intentions. Our results showed that 62% of the stimuli evoking lustful intentions also evoked romantic intentions, and both intentions were sustained by similar activations of the inferior frontal gyrus and the inferior parietal lobule/angular gyrus for the first 432 ms after stimulus onset. Intentions to not love or not lust, on the other hand, were characterized by earlier differential activations of the inferior fronto-parietal network i.e., as early as 244 ms after stimulus onset. These results suggest that the mirror neuron system may not only code for the motor correlates of intentions, but also for the social meaning of intentions and its valence at both early/automatic and later/more elaborative stages of information processing.

The large-scale organization of shape processing in the ventral and dorsal pathways

Although shape perception is considered a function of the ventral visual pathway, evidence suggests that the dorsal pathway also derives shape-based representations. In two psychophysics and neuroimaging experiments, we characterized the response properties, topographical organization and perceptual relevance of these representations. In both pathways, shape sensitivity increased from early visual cortex to extrastriate cortex but then decreased in anterior regions. Moreover, the lateral aspect of the ventral pathway and posterior regions of the dorsal pathway were sensitive to the availability of fundamental shape properties, even for unrecognizable images. This apparent representational similarity between the posterior-dorsal and lateral-ventral regions was corroborated by a multivariate analysis. Finally, as with ventral pathway, the activation profile of posterior dorsal regions was correlated with recognition performance, suggesting a possible contribution to perception. These findings challenge a strict functional dichotomy between the pathways and suggest a more distributed model of shape processing.

We rely on our sense of vision to perceive the world around us and the objects within it. We also use vision to guide our interactions with objects. One of the most influential theories in cognitive neuroscience is the idea that separate pathways within the brain support these two processes. The ventral pathway is in charge of vision-for-perception. It analyses the features that help us recognize objects, such as their color, size or shape, enabling us to identify the hammer in a toolbox, for example. The dorsal pathway is responsible for vision-for-action. It processes features that help us interact with objects, such as their movement and location, enabling us to use the hammer to strike a nail.

However, recent studies have suggested that the ventral and dorsal pathways may not be as independent as originally thought. Freud et al. now test this idea by examining if the dorsal vision-for-action pathway can also perceive and process objects.

Healthy volunteers viewed pictures of objects while lying inside a brain scanner. Some of the objects in the pictures were intact, whereas others had been distorted. If a brain region shows greater activation when viewing intact objects than distorted ones, it implies that that region is sensitive to the normal shapes of objects. Freud et al. found that both the ventral and dorsal pathways were sensitive to shape, with some areas in the two pathways showing highly similar responses. Furthermore, the shape sensitivity of certain regions within the dorsal pathway correlated with the volunteers’ ability to recognize the objects. This suggests that regions distributed across both pathways – and not just the ventral one – may contribute to object recognition.

The two-pathways hypothesis has governed our understanding of vision and of other sensory systems including hearing for several decades. By challenging the binary distinction between the two pathways, the results of Freud et al. suggest that models of sensory processing may require updating. This improved understanding may ultimately improve diagnosis and treatment of perceptual disorders such as agnosia, in which patients struggle to recognize objects.

Unaware Processing of Tools in the Neural System for Object-Directed Action Representation

The hypothesis that the brain constitutively encodes observed manipulable objects for the actions they afford is still debated. Yet, crucial evidence demonstrating that, even in the absence of perceptual awareness, the mere visual appearance of a manipulable object triggers a visuomotor coding in the action representation system including the premotor cortex, has hitherto not been provided. In this fMRI study, we instantiated reliable unaware visual perception conditions by means of continuous flash suppression, and we tested in 24 healthy human participants (13 females) whether the visuomotor object-directed action representation system that includes left-hemispheric premotor, parietal, and posterior temporal cortices is activated even under subliminal perceptual conditions. We found consistent activation in the target visuomotor cortices, both with and without perceptual awareness, specifically for pictures of manipulable versus non-manipulable objects. By means of a multivariate searchlight analysis, we also found that the brain activation patterns in this visuomotor network enabled the decoding of manipulable versus non-manipulable object picture processing, both with and without awareness. These findings demonstrate the intimate neural coupling between visual perception and motor representation that underlies manipulable object processing: manipulable object stimuli specifically engage the visuomotor object-directed action representation system, in a constitutive manner that is independent from perceptual awareness. This perceptuo-motor coupling endows the brain with an efficient mechanism for monitoring and planning reactions to external stimuli in the absence of awareness.SIGNIFICANCE STATEMENT Our brain constantly encodes the visual information that hits the retina, leading to a stimulus-specific activation of sensory and semantic representations, even for objects that we do not consciously perceive. Do these unconscious representations encompass the motor programming of actions that could be accomplished congruently with the objects' functions? In this fMRI study, we instantiated unaware visual perception conditions, by dynamically suppressing the visibility of manipulable object pictures with mondrian masks. Despite escaping conscious perception, manipulable objects activated an object-directed action representation system that includes left-hemispheric premotor, parietal, and posterior temporal cortices. This demonstrates that visuomotor encoding occurs independently of conscious object perception.

Connectivity-based constraints on category-specificity in the ventral object processing pathway

Recent efforts to characterize visual object representations in the ventral object processing pathway in the human brain have led to contrasting proposals about the causes of neural specificity for different categories. Here we use multivariate techniques in a novel way to relate patterns of functional connectivity to patterns of stimulus preferences. Stimulus preferences were measured throughout the ventral stream to tools, animals, faces and places; separately, we measured the strength of functional connectivity of each voxel in the ventral stream to category-preferring regions outside the ventral stream. Multivariate analyses were then performed over ventral stream voxels, relating 'category-preferences' to 'functional connectivity preferences'. We show that the relation of those two measures doubly dissociates 'tools' and 'places', within what is ostensibly 'place' selective cortex (parahippocampal gyrus). Specifically, in the parahippocampal gyrus, functional connectivity to the left inferior parietal lobule is selectively related to stimulus preferences for tools (and not places), while functional connectivity to retrosplenial cortex is selectively related to place preferences (and not tools preferences). These findings indicate that functional connectivity can be used to index representational content rather than just provide an understanding of 'which regions are talking to which regions'. We suggest that the connectivity of the brain is what drives category-specificity in the ventral stream, and that if this is correct, then understanding the connectivity of the ventral stream will be key to understanding the causes and function of category-specific neural organization.

Predicting Intentions of a Familiar Significant Other Beyond the Mirror Neuron System

Inferring intentions of others is one of the most intriguing issues in interpersonal interaction. Theories of embodied cognition and simulation suggest that this mechanism takes place through a direct and automatic matching process that occurs between an observed action and past actions. This process occurs via the reactivation of past self-related sensorimotor experiences within the inferior frontoparietal network (including the mirror neuron system, MNS). The working model is that the anticipatory representations of others' behaviors require internal predictive models of actions formed from pre-established, shared representations between the observer and the actor. This model suggests that observers should be better at predicting intentions performed by a familiar actor, rather than a stranger. However, little is known about the modulations of the intention brain network as a function of the familiarity between the observer and the actor. Here, we combined functional magnetic resonance imaging (fMRI) with a behavioral intention inference task, in which participants were asked to predict intentions from three types of actors: A familiar actor (their significant other), themselves (another familiar actor), and a non-familiar actor (a stranger). Our results showed that the participants were better at inferring intentions performed by familiar actors than non-familiar actors and that this better performance was associated with greater activation within and beyond the inferior frontoparietal network i.e., in brain areas related to familiarity (e.g., precuneus). In addition, and in line with Hebbian principles of neural modulations, the more the participants reported being cognitively close to their partner, the less the brain areas associated with action self-other comparison (e.g., inferior parietal lobule), attention (e.g., superior parietal lobule), recollection (hippocampus), and pair bond (ventral tegmental area, VTA) were recruited, suggesting that the more a shared mental representation has been pre-established, the more neurons show suppression in their response to the presentation of information to which they are sensitive. These results suggest that the relation of performance to the extent of neural activation during intention understanding may display differential relationships based on the cognitive domain, brain region, and the cognitive interdependence between the observer and the actor.

A brain-based account of "basic-level" concepts

This study provides a brain-based account of how object concepts at an intermediate (basic) level of specificity are represented, offering an enriched view of what it means for a concept to be a basic-level concept, a research topic pioneered by Rosch and others (Rosch et al., 1976). Applying machine learning techniques to fMRI data, it was possible to determine the semantic content encoded in the neural representations of object concepts at basic and subordinate levels of abstraction. The representation of basic-level concepts (e.g. bird) was spatially broad, encompassing sensorimotor brain areas that encode concrete object properties, and also language and heteromodal integrative areas that encode abstract semantic content. The representation of subordinate-level concepts (robin) was less widely distributed, concentrated in perceptual areas that underlie concrete content. Furthermore, basic-level concepts were representative of their subordinates in that they were neurally similar to their typical but not atypical subordinates (bird was neurally similar to robin but not woodpecker). The findings provide a brain-based account of the advantages that basic-level concepts enjoy in everyday life over subordinate-level concepts: the basic level is a broad topographical representation that encompasses both concrete and abstract semantic content, reflecting the multifaceted yet intuitive meaning of basic-level concepts.

Learning, remembering, and predicting how to use tools: Distributed neurocognitive mechanisms: Comment on Osiurak and Badets (2016)

The reasoning-based approach championed by Francois Osiurak and Arnaud Badets (Osiurak & Badets, 2016) denies the existence of sensory-motor memories of tool use except in limited circumstances, and suggests instead that most tool use is subserved solely by online technical reasoning about tool properties. In this commentary, I highlight the strengths and limitations of the reasoning-based approach and review a number of lines of evidence that manipulation knowledge is in fact used in tool action tasks. In addition, I present a "two route" neurocognitive model of tool use called the "Two Action Systems Plus (2AS+)" framework that posits a complementary role for online and stored information and specifies the neurocognitive substrates of task-relevant action selection. This framework, unlike the reasoning based approach, has the potential to integrate the existing psychological and functional neuroanatomic data in the tool use domain. (PsycINFO Database Record

Effects of motion speed in action representations

Grounded cognition accounts of semantic representation posit that brain regions traditionally linked to perception and action play a role in grounding the semantic content of words and sentences. Sensory-motor systems are thought to support partially abstract simulations through which conceptual content is grounded. However, which details of sensory-motor experience are included in, or excluded from these simulations, is not well understood. We investigated whether sensory-motor brain regions are differentially involved depending on the speed of actions described in a sentence. We addressed this issue by examining the neural signature of relatively fast (The old lady scurried across the road) and slow (The old lady strolled across the road) action sentences. The results showed that sentences that implied fast motion modulated activity within the right posterior superior temporal sulcus and the angular and middle occipital gyri, areas associated with biological motion and action perception. Sentences that implied slow motion resulted in greater signal within the right primary motor cortex and anterior inferior parietal lobule, areas associated with action execution and planning. These results suggest that the speed of described motion influences representational content and modulates the nature of conceptual grounding. Fast motion events are represented more visually whereas motor regions play a greater role in representing conceptual content associated with slow motion.

How do the two visual streams interact with each other?

The current consensus divides primate cortical visual processing into two broad networks or "streams" composed of highly interconnected areas (Milner and Goodale 2006, 2008; Goodale 2014). The ventral stream, passing from primary visual cortex (V1) through to inferior parts of the temporal lobe, is considered to mediate the transformation of the contents of the visual signal into the mental furniture that guides memory, recognition and conscious perception. In contrast the dorsal stream, passing from V1 through to various areas in the posterior parietal lobe, is generally considered to mediate the visual guidance of action, primarily in real time. The brain, however, does not work through mutually insulated subsystems, and indeed there are well-documented interconnections between the two streams. Evidence for contributions from ventral stream systems to the dorsal stream comes from human neuropsychological and neuroimaging research, and indicates a crucial role in mediating complex and flexible visuomotor skills. Complementary evidence points to a role for posterior dorsal-stream visual analysis in certain aspects of 3-D perceptual function in the ventral stream. A series of studies of a patient with visual form agnosia has been instrumental in shaping our knowledge of what each stream can achieve in isolation; but it has also helped us to tease apart the relative dependence of parietal visuomotor systems on direct bottom-up visual inputs versus inputs redirected via perceptual systems within the ventral stream.

Motor skill for tool-use is associated with asymmetries in Broca's area and the motor hand area of the precentral gyrus in chimpanzees (Pan troglodytes)

Among nonhuman primates, chimpanzees are well known for their sophistication and diversity of tool use in both captivity and the wild. The evolution of tool manufacture and use has been proposed as a driving mechanism for the development of increasing brain size, complex cognition and motor skills, as well as the population-level handedness observed in modern humans. Notwithstanding, our understanding of the neurological correlates of tool use in chimpanzees and other primates remains poorly understood. Here, we assessed the hand preference and performance skill of chimpanzees on a tool use task and correlated these data with measures of neuroanatomical asymmetries in the inferior frontal gyrus (IFG) and the pli-de-passage fronto-parietal moyen (PPFM). The IFG is the homolog to Broca's area in the chimpanzee brain and the PPFM is a buried gyrus that connects the pre- and post-central gyri and corresponds to the motor-hand area of the precentral gyrus. We found that chimpanzees that performed the task better with their right compared to left hand showed greater leftward asymmetries in the IFG and PPFM. This association between hand performance and PPFM asymmetry was particularly robust for right-handed individuals. Based on these findings, we propose that the evolution of tool use was associated with increased left hemisphere specialization for motor skill. We further suggest that lateralization in motor planning, rather than hand preference per se, was selected for with increasing tool manufacture and use in Hominid evolution.

Facets of Pantomime

OBJECTIVES

Exploring the nature of defective pantomime in apraxia.

METHODS

Critical review of behavioral associations and dissociations between defective pantomime, imitation of gestures, and real tool use. Analysis of congruencies between crucial lesions for pantomime, imitation, and tool use.

RESULTS

There are behavioral double dissociations between pantomime and imitation, and their cerebral substrates show very little overlap. Whereas defective pantomime is bound to temporal and inferior frontal lesions, imitation is mainly affected by parietal lesions. Pantomime usually replicates the motor actions of real use but on scrutiny there are important differences between the movements of real use and of pantomime that cast doubt on the assumption that pantomime is produced by the same motor programs as actual use. A more plausible proposal posits that pantomime is a communicative gesture that uses manual actions for conveying information about objects and their use. The manual actions are constructed by selection and combination of distinctive features of tools and actions. They frequently include replications of characteristic motor actions of real use, but the main criterion for selection and modification of features is the comprehensibility of the gestures rather than the accurate replication of the motor actions of real use.

CONCLUSIONS

Pantomime of tool use is a communicative gesture rather than a replication of the motor actions of real use. (JINS, 2017, 23, 121-127).

A brief comparative review of primate posterior parietal cortex: A novel hypothesis on the human toolmaker

The primate visual system contains two major cortical pathways: a ventral-temporal pathway that has been associated with object processing and recognition, and a dorsal-parietal pathway that has been associated with spatial processing and action guidance. Our understanding of the role of the dorsal pathway, in particular, has greatly evolved within the framework of the two-pathway hypothesis since its original conception. Here, we present a comparative review of the primate dorsal pathway in humans and monkeys based on electrophysiological, neuroimaging, neuropsychological, and neuroanatomical studies. We consider similarities and differences across species in terms of the topographic representation of visual space; specificity for eye, reaching, or grasping movements; multi-modal response properties; and the representation of objects and tools. We also review the relative anatomical location of functionally- and topographically-defined regions of the posterior parietal cortex. An emerging theme from this comparative analysis is that non-spatial information is represented to a greater degree, and with increased complexity, in the human dorsal visual system. We propose that non-spatial information in the primate parietal cortex contributes to the perception-to-action system aimed at manipulating objects in peripersonal space. In humans, this network has expanded in multiple ways, including the development of a dorsal object vision system mirroring the complexity of the ventral stream, the integration of object information with parietal working memory systems, and the emergence of tool-specific object representations in the anterior intraparietal sulcus and regions of the inferior parietal lobe. We propose that these evolutionary changes have enabled the emergence of human-specific behaviors, such as the sophisticated use of tools.

The involvement of the dorsal stream in processing implied actions between paired objects: A TMS study

Perceiving and selecting the action possibilities (affordances) provided by objects is an important challenge to human vision, and is not limited to single-object scenarios. Xu et al. (2015) identified two effects of implied actions between paired objects on response selection: an inhibitory effect on responses aligned with the passive object in the pair (e.g. a bowl) and an advantage associated with responses aligned with the active objects (e.g. a spoon). The present study investigated the neurocognitive mechanisms behind these effects by examining the involvement of the ventral (vision for perception) and the dorsal (vision for action) visual streams, as defined in Goodale and Milner's (1992) two visual stream theory. Online repetitive transcranial magnetic stimulation (rTMS) applied to the left anterior intraparietal sulcus (aIPS) reduced both the inhibitory effect of implied actions on responses aligned with the passive objects and the advantage of those aligned with the active objects, but only when the active objects were contralateral to the stimulation. rTMS to the left lateral occipital areas (LO) did not significantly alter the influence of implied actions. The results reveal that the dorsal visual stream is crucial not only in single-object affordance processing, but also in responding to implied actions between objects.

Neural Pathway of Renovative and Innovative Products Appreciation

According to the level of change an invention makes on existing things and how it overrides people’s mental schemas on established categories, new inventions can be classified into two groups: incremental inventions (i.e., renovations), which make minor improvements on existing designs, and radical inventions (i.e., innovations), which make major developments that enable people to do things they have never been able to do before. Although innovation and renovation are two fundamentally different types of creation that feature new changes ranging from those in product development to those in large scale social changes, and people tend to report higher subjective preferences for incremental inventions compared to radical inventions, the cognitive brain mechanisms underlying the mental representation of these two types of inventions remains unknown. Through the use of innovative and renovative designs as materials, we found that relative to non-creative designs, creative (renovative &innovative) designs enhanced memory or association-related activation in the right parahippocampus. In particular, innovations evoked more activation in the conceptual pathway for representing objects than did renovations, whereas renovations evoked more activation in the motor pathway than innovations. These results suggest that operating experiences may provide advantages for understanding and appreciating creative designs.

Disrupted development and imbalanced function in the global neuronal workspace: a positive-feedback mechanism for the emergence of ASD in early infancy

Autism spectrum disorder (ASD) is increasingly being conceptualized as a spectrum disorder of connectome development. We review evidence suggesting that ASD is characterized by a positive feedback loop that amplifies small functional variations in early-developing sensory-processing pathways into structural and functional imbalances in the global neuronal workspace. Using vision as an example, we discuss how early functional variants in visual processing may be feedback-amplified to produce variant object categories and disrupted top-down expectations, atypically large expectation-to-perception mismatches, problems re-identifying individual people and objects, socially inappropriate, generally aversive emotional responses and disrupted sensory-motor coordination. Viewing ASD in terms of feedback amplification of small functional variants allows a number of recent models of ASD to be integrated with neuroanatomical, neurofunctional and genetic data.

Multivariate Pattern Analysis Reveals Category-Related Organization of Semantic Representations in Anterior Temporal Cortex

The neural substrates of semantic representation have been the subject of much controversy. The study of semantic representations is complicated by difficulty in disentangling perceptual and semantic influences on neural activity, as well as in identifying stimulus-driven, "bottom-up" semantic selectivity unconfounded by top-down task-related modulations. To address these challenges, we trained human subjects to associate pseudowords (TPWs) with various animal and tool categories. To decode semantic representations of these TPWs, we used multivariate pattern classification of fMRI data acquired while subjects performed a semantic oddball detection task. Crucially, the classifier was trained and tested on disjoint sets of TPWs, so that the classifier had to use the semantic information from the training set to correctly classify the test set. Animal and tool TPWs were successfully decoded based on fMRI activity in spatially distinct subregions of the left medial anterior temporal lobe (LATL). In addition, tools (but not animals) were successfully decoded from activity in the left inferior parietal lobule. The tool-selective LATL subregion showed greater functional connectivity with left inferior parietal lobule and ventral premotor cortex, indicating that each LATL subregion exhibits distinct patterns of connectivity. Our findings demonstrate category-selective organization of semantic representations in LATL into spatially distinct subregions, continuing the lateral-medial segregation of activation in posterior temporal cortex previously observed in response to images of animals and tools, respectively. Together, our results provide evidence for segregation of processing hierarchies for different classes of objects and the existence of multiple, category-specific semantic networks in the brain.

SIGNIFICANCE STATEMENT

The location and specificity of semantic representations in the brain are still widely debated. We trained human participants to associate specific pseudowords with various animal and tool categories, and used multivariate pattern classification of fMRI data to decode the semantic representations of the trained pseudowords. We found that: (1) animal and tool information was organized in category-selective subregions of medial left anterior temporal lobe (LATL); (2) tools, but not animals, were encoded in left inferior parietal lobe; and (3) LATL subregions exhibited distinct patterns of functional connectivity with category-related regions across cortex. Our findings suggest that semantic knowledge in LATL is organized in category-related subregions, providing evidence for the existence of multiple, category-specific semantic representations in the brain.

'What' Is Happening in the Dorsal Visual Pathway

The cortical visual system is almost universally thought to be segregated into two anatomically and functionally distinct pathways: a ventral occipitotemporal pathway that subserves object perception, and a dorsal occipitoparietal pathway that subserves object localization and visually guided action. Accumulating evidence from both human and non-human primate studies, however, challenges this binary distinction and suggests that regions in the dorsal pathway contain object representations that are independent of those in ventral cortex and that play a functional role in object perception. We review here the evidence implicating dorsal object representations, and we propose an account of the anatomical organization, functional contributions, and origins of these representations in the service of perception.

Arguments about the nature of concepts: Symbols, embodiment, and beyond

How are the meanings of words, events, and objects represented and organized in the brain? This question, perhaps more than any other in the field, probes some of the deepest and most foundational puzzles regarding the structure of the mind and brain. Accordingly, it has spawned a field of inquiry that is diverse and multidisciplinary, has led to the discovery of numerous empirical phenomena, and has spurred the development of a wide range of theoretical positions. This special issue brings together the most recent theoretical developments from the leaders in the field, representing a range of viewpoints on issues of fundamental significance to a theory of meaning representation. Here we introduce the special issue by way of pulling out some key themes that cut across the contributions that form this issue and situating those themes in the broader literature. The core issues around which research on conceptual representation can be organized are representational format, representational content, the organization of concepts in the brain, and the processing dynamics that govern interactions between the conceptual system and sensorimotor representations. We highlight areas in which consensus has formed; for those areas in which opinion is divided, we seek to clarify the relation of theory and evidence and to set in relief the bridging assumptions that undergird current discussions.

Persistent sparing of action conceptual processing in spite of increasing disorders of action production: A case against motor embodiment of action concepts

In this study, we addressed the issue of whether the brain sensorimotor circuitry that controls action production is causally involved in representing and processing action-related concepts. We examined the three-year pattern of evolution of brain atrophy, action production disorders, and action-related concept processing in a patient (J.R.) diagnosed with corticobasal degeneration. During the period of investigation, J.R. presented with increasing action production disorders resulting from increasing bilateral atrophy in cortical and subcortical regions involved in the sensorimotor control of actions (notably, the superior parietal cortex, the primary motor and premotor cortex, the inferior frontal gyrus, and the basal ganglia). In contrast, the patient's performance in processing action-related concepts remained intact during the same period. This finding indicated that action concept processing hinges on cognitive and neural resources that are mostly distinct from those underlying the sensorimotor control of actions.

The neural network for tool-related cognition: An activation likelihood estimation meta-analysis of 70 neuroimaging contrasts

The ability to recognize and use a variety of tools is an intriguing human cognitive function. Multiple neuroimaging studies have investigated neural activations with various types of tool-related tasks. In the present paper, we reviewed tool-related neural activations reported in 70 contrasts from 56 neuroimaging studies and performed a series of activation likelihood estimation (ALE) meta-analyses to identify tool-related cortical circuits dedicated either to general tool knowledge or to task-specific processes. The results indicate the following: (a) Common, task-general processing regions for tools are located in the left inferior parietal lobule (IPL) and ventral premotor cortex; and (b) task-specific regions are located in superior parietal lobule (SPL) and dorsal premotor area for imagining/executing actions with tools and in bilateral occipito-temporal cortex for recognizing/naming tools. The roles of these regions in task-general and task-specific activities are discussed with reference to evidence from neuropsychology, experimental psychology and other neuroimaging studies.

Thematic knowledge, artifact concepts, and the left posterior temporal lobe: Where action and object semantics converge

Converging evidence supports the existence of functionally and neuroanatomically distinct taxonomic (similarity-based; e.g., hammer-screwdriver) and thematic (event-based; e.g., hammer-nail) semantic systems. Processing of thematic relations between objects has been shown to selectively recruit the left posterior temporoparietal cortex. Similar posterior regions have also been shown to be critical for knowledge of relationships between actions and manipulable human-made objects (artifacts). Based on the hypothesis that thematic relationships for artifacts rely, at least in part, on action relationships, we assessed the prediction that the same regions of the left posterior temporoparietal cortex would be critical for conceptual processing of artifact-related actions and thematic relations for artifacts. To test this hypothesis, we evaluated processing of taxonomic and thematic relations for artifacts and natural objects as well as artifact action knowledge (gesture recognition) abilities in a large sample of 48 stroke patients with a range of lesion foci in the left hemisphere. Like control participants, patients identified thematic relations faster than taxonomic relations for artifacts, whereas they identified taxonomic relations faster than thematic relations for natural objects. Moreover, response times (RTs) for identifying thematic relations for artifacts selectively predicted performance in gesture recognition. Whole brain Voxel-based Lesion-Symptom Mapping (VLSM) analyses and Region of Interest (ROI) regression analyses further demonstrated that lesions to the left posterior temporal cortex, overlapping with LTO and visual motion area hMT+, were associated both with relatively slower RTs in identifying thematic relations for artifacts and poorer artifact action knowledge in patients. These findings provide novel insights into the functional role of left posterior temporal cortex in thematic knowledge, and suggest that the close association between thematic relations for artifacts and action representations may reflect their common dependence on visual motion and manipulation information.

Representing object categories by connections: Evidence from a mutivariate connectivity pattern classification approach

The representation of object categories is a classical question in cognitive neuroscience and compelling evidence has identified specific brain regions showing preferential activation to categories of evolutionary significance. However, the potential contributions to category processing by tuning the connectivity patterns are largely unknown. Adopting a continuous multicategory paradigm, we obtained whole-brain functional connectivity (FC) patterns of each of four categories (faces, scenes, animals and tools) in healthy human adults and applied multivariate connectivity pattern classification analyses. We found that the whole-brain FC patterns made high-accuracy predictions of which category was being viewed. The decoding was successful even after the contributions of regions showing classical category-selective activations were excluded. We further identified the discriminative network for each category, which span way beyond the classical category-selective regions. Together, these results reveal novel mechanisms about how categorical information is represented in large-scale FC patterns, with general implications for the interactive nature of distributed brain areas underlying high-level cognition. Hum Brain Mapp 37:3685-3697, 2016. © 2016 Wiley Periodicals, Inc.

The Semantics of Syntax: The Grounding of Transitive and Intransitive Constructions

Embodied theories of language maintain that brain areas associated with perception and action are also involved in the processing and representation of word meaning. A number of studies have shown that sentences with action verbs elicit activation within sensory–motor brain regions, arguing that sentence-induced mental simulations provide a means for grounding their lexical-semantic meaning. Constructionist theories argue, however, that form–meaning correspondence is present not only at the lexical level but also at the level of constructions. We investigated whether sentence-induced motor resonance is present for syntactic constructions. We measured the BOLD signal while participants read sentences with (di)transitive (caused motion) or intransitive constructions that contained either action or abstract verbs. The results showed a distinct neuronal signature for caused motion and intransitive syntactic frames. Caused motion frames activated regions associated with reaching and grasping actions, including the left anterior intraparietal sulcus and the parietal reach region. Intransitive frames activated lateral temporal regions commonly associated with abstract word processing. The left pars orbitalis showed an interaction between the syntactic frame and verb class. These findings show that sensory–motor activation elicited by sentences entails both motor resonance evoked by single words as well as at the level of syntactic constructions.

Resilience to the contralateral visual field bias as a window into object representations

Viewing images of manipulable objects elicits differential blood oxygen level-dependent (BOLD) contrast across parietal and dorsal occipital areas of the human brain that support object-directed reaching, grasping, and complex object manipulation. However, it is unknown which object-selective regions of parietal cortex receive their principal inputs from the ventral object-processing pathway and which receive their inputs from the dorsal object-processing pathway. Parietal areas that receive their inputs from the ventral visual pathway, rather than from the dorsal stream, will have inputs that are already filtered through object categorization and identification processes. This predicts that parietal regions that receive inputs from the ventral visual pathway should exhibit object-selective responses that are resilient to contralateral visual field biases. To test this hypothesis, adult participants viewed images of tools and animals that were presented to the left or right visual fields during functional magnetic resonance imaging (fMRI). We found that the left inferior parietal lobule showed robust tool preferences independently of the visual field in which tool stimuli were presented. In contrast, a region in posterior parietal/dorsal occipital cortex in the right hemisphere exhibited an interaction between visual field and category: tool-preferences were strongest contralateral to the stimulus. These findings suggest that action knowledge accessed in the left inferior parietal lobule operates over inputs that are abstracted from the visual input and is contingent on analysis by the ventral visual pathway, consistent with its putative role in supporting object manipulation knowledge.

Tool-use: An open window into body representation and its plasticity

Over the last decades, scientists have questioned the origin of the exquisite human mastery of tools. Seminal studies in monkeys, healthy participants and brain-damaged patients have primarily focused on the plastic changes that tool-use induces on spatial representations. More recently, we focused on the modifications tool-use must exert on the sensorimotor system and highlighted plastic changes at the level of the body representation used by the brain to control our movements, i.e., the Body Schema. Evidence is emerging for tool-use to affect also more visually and conceptually based representations of the body, such as the Body Image. Here we offer a critical review of the way different tool-use paradigms have been, and should be, used to try disentangling the critical features that are responsible for tool incorporation into different body representations. We will conclude that tool-use may offer a very valuable means to investigate high-order body representations and their plasticity.

The embodiment of assistive devices-from wheelchair to exoskeleton

Spinal cord injuries (SCIs) place a heavy burden on the healthcare system and have a high personal impact and marked socio-economic consequences. Clinically, no absolute cure for these conditions exists. However, in recent years, there has been an increased focus on new robotic technologies that can change the frame we think about the prognosis for recovery and for treating some functions of the body affected after SCIs. This review has two goals. The first is to assess the possibility of the embodiment of functional assistive tools after traumatic disruption of the neural pathways between the brain and the body. To this end, we will examine how altered sensorimotor information modulates the sense of the body in SCI. The second goal is to map the phenomenological experience of using external tools that typically extend the potential of the body physically impaired by SCI. More specifically, we will focus on the difference between the perception of one's physically augmented and non-augmented affected body based on observable and measurable behaviors. We discuss potential clinical benefits of enhanced embodiment of the external objects by way of multisensory interventions. This review argues that the future evolution of human robotic technologies will require adopting an embodied approach, taking advantage of brain plasticity to allow bionic limbs to be mapped within the neural circuits of physically impaired individuals.

Shared and Distinct Neuroanatomic Regions Critical for Tool-related Action Production and Recognition: Evidence from 131 Left-hemisphere Stroke Patients

The inferior frontal gyrus and inferior parietal lobe have been characterized as human homologues of the monkey "mirror neuron" system, critical for both action production (AP) and action recognition (AR). However, data from brain lesion patients with selective impairment on only one of these tasks provide evidence of neural and cognitive dissociations. We sought to clarify the relationship between AP and AR, and their critical neural substrates, by directly comparing performance of 131 chronic left-hemisphere stroke patients on both tasks--to our knowledge, the largest lesion-based experimental investigation of action cognition to date. Using voxel-based lesion-symptom mapping, we found that lesions to primary motor and somatosensory cortices and inferior parietal lobule were associated with disproportionately impaired performance on AP, whereas lesions to lateral temporo-occipital cortex were associated with a relatively rare pattern of disproportionately impaired performance on AR. In contrast, damage to posterior middle temporal gyrus was associated with impairment on both AP and AR. The distinction between lateral temporo-occipital cortex, critical for recognition, and posterior middle temporal gyrus, important for both tasks, suggests a rough gradient from modality-specific to abstract representations in posterior temporal cortex, the first lesion-based evidence for this phenomenon. Overall, the results of this large patient study help to bring closure to a long-standing debate by showing that tool-related AP and AR critically depend on both common and distinct left hemisphere neural substrates, most of which are external to putative human mirror regions.

Identifying environmental sounds: a multimodal mapping study

Our environment is full of auditory events such as warnings or hazards, and their correct recognition is essential. We explored environmental sounds (ES) recognition in a series of studies. In study 1 we performed an Activation Likelihood Estimation (ALE) meta-analysis of neuroimaging experiments addressing ES processing to delineate the network of areas consistently involved in ES processing. Areas consistently activated in the ALE meta-analysis were the STG/MTG, insula/rolandic operculum, parahippocampal gyrus and inferior frontal gyrus bilaterally. Some of these areas truly reflect ES processing, whereas others are related to design choices, e.g., type of task, type of control condition, type of stimulus. In study 2 we report on 7 neurosurgical patients with lesions involving the areas which were found to be activated by the ALE meta-analysis. We tested their ES recognition abilities and found an impairment of ES recognition. These results indicate that deficits of ES recognition do not exclusively reflect lesions to the right or to the left hemisphere but both hemispheres are involved. The most frequently lesioned area is the hippocampus/insula/STG. We made sure that any impairment in ES recognition would not be related to language problems, but reflect impaired ES processing. In study 3 we carried out an fMRI study on patients (vs. healthy controls) to investigate how the areas involved in ES might be functionally deregulated because of a lesion. The fMRI evidenced that controls activated the right IFG, the STG bilaterally and the left insula. We applied a multimodal mapping approach and found that, although the meta-analysis showed that part of the left and right STG/MTG activation during ES processing might in part be related to design choices, this area was one of the most frequently lesioned areas in our patients, thus highlighting its causal role in ES processing. We found that the ROIs we drew on the two clusters of activation found in the left and in the right STG overlapped with the lesions of at least 4 out of the 7 patients' lesions, indicating that the lack of STG activation found for patients is related to brain damage and is crucial for explaining the ES deficit.

A topographical organization for action representation in the human brain

How the human brain represents distinct motor features into a unique finalized action still remains undefined. Previous models proposed the distinct features of a motor act to be hierarchically organized in separated, but functionally interconnected, cortical areas. Here, we hypothesized that distinct patterns across a wide expanse of cortex may actually subserve a topographically organized coding of different categories of actions that represents, at a higher cognitive level and independently from the distinct motor features, the action and its final aim as a whole. Using functional magnetic resonance imaging and pattern classification approaches on the neural responses of 14 right-handed individuals passively watching short movies of hand-performed tool-mediated, transitive, and meaningful intransitive actions, we were able to discriminate with a high accuracy and characterize the category-specific response patterns. Actions are distinctively coded in distributed and overlapping neural responses within an action-selective network, comprising frontal, parietal, lateral occipital and ventrotemporal regions. This functional organization, that we named action topography, subserves a higher-level and more abstract representation of finalized actions and has the capacity to provide unique representations for multiple categories of actions.

Functional connectivity associated with hand shape generation: Imitating novel hand postures and pantomiming tool grips challenge different nodes of a shared neural network

Clinical research suggests that imitating meaningless hand postures and pantomiming tool-related hand shapes rely on different neuroanatomical substrates. We investigated the BOLD responses to different tasks of hand posture generation in 14 right handed volunteers. Conjunction and contrast analyses were applied to select regions that were either common or sensitive to imitation and/or pantomime tasks. The selection included bilateral areas of medial and lateral extrastriate cortex, superior and inferior regions of the lateral and medial parietal lobe, primary motor and somatosensory cortex, and left dorsolateral prefrontal, and ventral and dorsal premotor cortices. Functional connectivity analysis revealed that during hand shape generation the BOLD-response of every region correlated significantly with every other area regardless of the hand posture task performed, although some regions were more involved in some hand postures tasks than others. Based on between-task differences in functional connectivity we predict that imitation of novel hand postures would suffer most from left superior parietal disruption and that pantomiming hand postures for tools would be impaired following left frontal damage, whereas both tasks would be sensitive to inferior parietal dysfunction. We also unveiled that posterior temporal cortex is committed to pantomiming tool grips, but that the involvement of this region to the execution of hand postures in general appears limited. We conclude that the generation of hand postures is subserved by a highly interconnected task-general neural network. Depending on task requirements some nodes/connections will be more engaged than others and these task-sensitive findings are in general agreement with recent lesion studies.