Representational content of occipitotemporal and parietal tool areas

Tool Representations in Human Visual Cortex

Tools such as pens, forks, and scissors play an important role in many daily-life activities, an importance underscored by the presence in visual cortex of a set of tool-selective brain regions. This review synthesizes decades of neuroimaging research that investigated the representational spaces in the visual ventral stream for objects, such as tools, that are specifically characterized by action-related properties. Overall, results reveal a dissociation between representational spaces in ventral and lateral occipito-temporal cortex (OTC). While lateral OTC encodes both visual (shape) and action-related properties of objects, distinguishing between objects acting as end-effectors (e.g., tools, hands) versus similar noneffector manipulable objects (e.g., a glass), ventral OTC primarily represents objects' visual features such as their surface properties (e.g., material and texture). These areas act in concert with regions outside of OTC to support object interaction and tool use. The parallel investigation of the dimensions underlying object representations in artificial neural networks reveals both the possibilities and the difficulties in capturing the action-related dimensions that distinguish tools from other objects. Although artificial neural networks offer promise as models of visual cortex computations, challenges persist in replicating the action-related dimensions that go beyond mere visual features. Taken together, we propose that regions in OTC support the representation of tools based on a behaviorally relevant action code and suggest future paths to generate a computational model of this object space.

A 7T fMRI investigation of hand and tool areas in the lateral and ventral occipitotemporal cortex

Previous studies demonstrated the existence of hand and tool areas in lateral and ventral occipitotemporal cortex (OTC), as well as an overlap between them. We reinvestigated this organization using 7T fMRI, benefiting from a higher signal-to-noise ratio than 3T. This enabled us to include a wider array of categories to achieve a more holistic perspective, and to omit certain spatial preprocessing steps. Despite these improvements, univariate analysis confirmed the existence of hand-tool overlap across OTC, which is striking given the omission of the spatial preprocessing steps that can influence overlap. There was significantly more overlap between hands and tools, compared to other overlap types in the left hemisphere of OTC. The overlap was also larger in the left lateral OTC as compared to the right lateral OTC. We found in all hand areas a differentiation between tools and other types of objects, although they still responded more to bodies than to tools. Regarding the tool areas, we observed a differentiation between hands and other categories such as faces and non-tool objects. Left hemisphere tool areas also differentiated between hands and bodies. When excluding the overlapping voxels from the hand and tool areas, they still showed a significant response to tools or hands (compared to objects or faces) respectively. Multi-voxel pattern analysis indicated that neural representations in the hand areas showed greater similarity between hands and tools than between hands and other objects. In the tool areas, the neural representations between tools and hands and between tools and other type of objects were all equally similar. To summarize, capitalizing on the benefits of 7T fMRI, we further substantiate the evidence in favor of hand-tool overlap in several regions of occipitotemporal cortex.

Gesture profiles distinguish primary progressive aphasia variants: A preliminary study

Background

Primary progressive aphasia (PPA) is a neurodegenerative syndrome characterized by progressive language deficits. The main variants of PPA -semantic (svPPA), logopenic (lvPPA), and nonfluent (nfvPPA)- can be challenging to distinguish. Limb apraxia often co-occurs with PPA, but it is unclear whether PPA variants are associated with different gesture deficits. Prior evidence from stroke indicates that temporal lobe lesions are associated with reduced benefit from meaning in gesture performance. Temporal lesions are also associated with greater deficits in hand postures compared to arm kinematics in gesture imitation.

Aims

We tested the hypothesis that svPPA, who primarily exhibit temporal lobe atrophy, would differentially show this pattern. In addition, we predicted that as a group, individuals with PPA would more accurately produce meaningful than meaningless gestures and kinematic components than hand postures, as found in neurotypical adults and individuals with stroke.

Methods & Procedures

Participants with PPA completed meaningful and meaningless gesture imitation tasks. Performance was scored for hand posture and arm kinematic components. Bayesian mixed-effect models examined trial-level gesture imitation accuracy, while controlling for dementia severity and random effects of subjects and items. Fixed effects included an interaction between PPA variant, task condition/meaning, and gesture component.

Outcomes & Results

We found a critical interaction between PPA variant, meaning, and gesture component. In particular, unlike lvPPA and nfvPPA, svPPA subjects' hand postures failed to benefit from gesture meaning. This preliminary research extends prior findings on the role of the temporal lobe in action representations associated with manipulable objects, and is among the first to demonstrate distinct gesture imitation patterns between PPA variants.

Conclusions

Characterizing gesture deficits in PPA may help inform diagnostics, compensatory communication strategies, and models of praxis.

Temporal differences and commonalities between hand and tool neural processing

Object recognition is a complex cognitive process that relies on how the brain organizes object-related information. While spatial principles have been extensively studied, less studied temporal dynamics may also offer valuable insights into this process, particularly when neural processing overlaps for different categories, as it is the case of the categories of hands and tools. Here we focus on the differences and/or similarities between the time-courses of hand and tool processing under electroencephalography (EEG). Using multivariate pattern analysis, we compared, for different time points, classification accuracy for images of hands or tools when compared to images of animals. We show that for particular time intervals (~ 136-156 ms and ~ 252-328 ms), classification accuracy for hands and for tools differs. Furthermore, we show that classifiers trained to differentiate between tools and animals generalize their learning to classification of hand stimuli between ~ 260-320 ms and ~ 376-500 ms after stimulus onset. Classifiers trained to distinguish between hands and animals, on the other hand, were able to extend their learning to the classification of tools at ~ 150 ms. These findings suggest variations in semantic features and domain-specific differences between the two categories, with later-stage similarities potentially related to shared action processing for hands and tools.

Understanding the concept of a novel tool requires interaction of the dorsal and ventral streams

The left hemisphere tool-use network consists of the dorso-dorsal, ventro-dorsal, and ventral streams, each with distinct computational abilities. In the dual-loop model, the ventral pathway through the extreme capsule is associated with conceptual understanding. We performed a learning experiment with fMRI to investigate how these streams interact when confronted with novel tools. In session one, subjects observed pictures and video sequences in real world action of known and unknown tools and were asked whether they knew the tools and whether they understood their function. In session two, video sequences of unknown tools were presented again, followed again by the question of understanding their function. Different conditions were compared to each other and effective connectivity (EC) in the tool-use network was examined. During concept acquisition of an unknown tool, EC between dorsal and ventral streams was found posterior in fusiform gyrus and anterior in inferior frontal gyrus, with a functional interaction between BA44d and BA45. When previously unknown tools were presented for a second time, EC was prominent only between dorsal stream areas. Understanding the concept of a novel tool requires an interaction of the ventral stream with the dorsal streams. Once the concept is acquired, dorsal stream areas are sufficient.

Tool mastering today - an interdisciplinary perspective

Tools have coined human life, living conditions, and culture. Recognizing the cognitive architecture underlying tool use would allow us to comprehend its evolution, development, and physiological basis. However, the cognitive underpinnings of tool mastering remain little understood in spite of long-time research in neuroscientific, psychological, behavioral and technological fields. Moreover, the recent transition of tool use to the digital domain poses new challenges for explaining the underlying processes. In this interdisciplinary review, we propose three building blocks of tool mastering: (A) perceptual and motor abilities integrate to tool manipulation knowledge, (B) perceptual and cognitive abilities to functional tool knowledge, and (C) motor and cognitive abilities to means-end knowledge about tool use. This framework allows for integrating and structuring research findings and theoretical assumptions regarding the functional architecture of tool mastering via behavior in humans and non-human primates, brain networks, as well as computational and robotic models. An interdisciplinary perspective also helps to identify open questions and to inspire innovative research approaches. The framework can be applied to studies on the transition from classical to modern, non-mechanical tools and from analogue to digital user-tool interactions in virtual reality, which come with increased functional opacity and sensorimotor decoupling between tool user, tool, and target. By working towards an integrative theory on the cognitive architecture of the use of tools and technological assistants, this review aims at stimulating future interdisciplinary research avenues.

Novel objects with causal event schemas elicit selective responses in tool- and hand-selective lateral occipitotemporal cortex

Tool-selective lateral occipitotemporal cortex (LOTC) responds preferentially to images of tools (hammers, brushes) relative to non-tool objects (clocks, shoes). What drives these responses? Unlike other objects, tools exert effects on their surroundings. We tested whether LOTC responses are influenced by event schemas that denote different temporal relations. Participants learned about novel objects embedded in different event sequences. Causer objects moved prior to the appearance of an environmental event (e.g. stars), while Reactor objects moved after an event. Visual features and motor association were controlled. During functional magnetic resonance imaging, participants viewed still images of the objects. We localized tool-selective LOTC and non-tool-selective parahippocampal cortex (PHC) by contrasting neural responses to images of familiar tools and non-tools. We found that LOTC responded more to Causers than Reactors, while PHC did not. We also measured responses to images of hands, which elicit overlapping responses with tools. Across inferior temporal cortex, voxels' tool and hand selectivity positively predicted a preferential response to Causers. We conclude that an event schema typical of tools is sufficient to drive LOTC and that category-preferential responses across the temporal lobe may reflect relational event structures typical of those domains.

Gesture profiles distinguish primary progressive aphasia variants

Primary progressive aphasia (PPA) is a neurodegenerative syndrome characterized by progressive language deficits. There are three main variants of PPA - semantic (svPPA), logopenic (lvPPA), and nonfluent (nfvPPA) - that can be challenging to distinguish. Limb praxis may also be affected in PPA, but it is unclear whether different variants of PPA are associated with differences in gesture production. Prior research with neurotypical individuals indicates that the left temporal lobe is a critical locus of manipulable object and hand posture representations. Moreover, when imitating gestures, individuals whose strokes include the left temporal lobe show reduced benefit of gesture meaning and disproportionate impairment in hand posture as compared to arm kinematics. We tested the hypothesis that svPPA - who typically exhibit primarily temporal lobe atrophy - would differentially show these expected patterns of gesture imitation performance. Nineteen participants with PPA completed meaningful and meaningless gesture imitation tasks, and performance was scored for hand posture and arm kinematics accuracy. Generalized logistic mixed-effect regression models controlling for dementia severity showed overall benefits from gesture meaning, and greater impairments in hand posture than arm kinematics. We also found that svPPA participants were the most impaired in gesture imitation overall. Critically, there was also a significant three-way interaction of group, meaning, and gesture component: only svPPA participants showed relative impairments of hand posture for meaningful gestures as well as meaningless gestures. Thus, unlike lvPPA and nfvPPA, the hand postures of svPPA failed to benefit from gesture meaning. This research extends prior findings on the role of the temporal lobe in hand posture representations associated with manipulable objects, and is the first to indicate that there may be distinct gesture imitation patterns as a function of PPA variant. Characterizing componential gesture deficits in PPA may help to inform differential diagnosis, compensatory communication strategies, and cognitive praxis models of PPA.

Disentangling hand and tool processing: Distal effects of neuromodulation

Neural processing within a local brain region that responds to more than one object category (e.g., hands and tools) nonetheless have different functional connectivity patterns with other distal brain areas, which suggests that local processing can affect and/or be affected by processing in distal areas, in a category-specific way. Here we wanted to test whether administering either a hand- or tool-related training task in tandem with transcranial direct current stimulation (tDCS) to a region that responds both to hands and tools (posterior middle temporal gyrus; pMTG), modulated local and distal neural processing more for the trained than the untrained category in a subsequent fMRI task. After each combined tDCS/training session, participants viewed images of tools, hands, and animals, in an fMRI scanner. Using multivoxel pattern analysis, we found that tDCS stimulation to pMTG indeed improved the classification accuracy between tools vs. animals, but only when combined with a tool and not a hand training task. Surprisingly, tDCS stimulation to pMTG also improved classification accuracy between hands vs. animals when combined with a tool but not a hand training task. Our findings suggest that overlapping but functionally-specific networks may be engaged separately by using a category-specific training task together with tDCS - a strategy that can be applied more broadly to other cognitive domains using tDCS. By hypothesis, these effects on local processing are a direct result of within-domain connectivity constraints from domain-specific networks that are at play in the processing and organization of object representations.

Neural encoding and functional interactions underlying pantomimed movements

Pantomimes are a unique movement category which can convey complex information about our intentions in the absence of any interaction with real objects. Indeed, we can pretend to use the same tool to perform different actions or to achieve the same goal adopting different tools. Nevertheless, how our brain implements pantomimed movements is still poorly understood. In our study, we explored the neural encoding and functional interactions underlying pantomimes adopting multivariate pattern analysis (MVPA) and connectivity analysis of fMRI data. Participants performed pantomimed movements, either grasp-to-move or grasp-to-use, as if they were interacting with two different tools (scissors or axe). These tools share the possibility to achieve the same goal. We adopted MVPA to investigate two levels of representation during the planning and execution of pantomimes: (1) distinguishing different actions performed with the same tool, (2) representing the same final goal irrespective of the adopted tool. We described widespread encoding of action information within regions of the so-called “tool” network. Several nodes of the network—comprising regions within the ventral and the dorsal stream—also represented goal information. The spatial distribution of goal information changed from planning—comprising posterior regions (i.e. parietal and temporal)—to execution—including also anterior regions (i.e. premotor cortex). Moreover, connectivity analysis provided evidence for task-specific bidirectional coupling between the ventral stream and parieto-frontal motor networks. Overall, we showed that pantomimes were characterized by specific patterns of action and goal encoding and by task-dependent cortical interactions.

Anatomical correlates of recovery in apraxia: A longitudinal lesion-mapping study in stroke patients

OBJECTIVE

This study investigates the clinical course of recovery of apraxia after left-hemisphere stroke and the underlying neuroanatomical correlates for persisting or recovering deficits in relation to the major processing streams in the network for motor cognition.

METHODS

90 patients were examined during the acute (4.74 ± 2.73 days) and chronic (14.3 ± 15.39 months) stage after left-hemisphere stroke for deficits in meaningless imitation, as well as production and conceptual errors in tool use pantomime. Lesion correlates for persisting or recovering deficits were analyzed with an extension of the non-parametric Brunner-Munzel rank-order test for multi-factorial designs (two-way repeated-measures ANOVA) using acute images.

RESULTS

Meaningless imitation and tool use production deficits persisted into the chronic stage. Conceptual errors in tool use pantomime showed an almost complete recovery. Imitation errors persisted after occipitotemporal and superior temporal lesions in the dorso-dorsal stream. Chronic pantomime production errors were related to the supramarginal gyrus, the key structure of the ventro-dorsal stream. More anterior lesions in the ventro-dorsal stream (ventral premotor cortex) were additionally associated with poor recovery of production errors in pantomime. Conceptual errors in pantomime after temporal and supramarginal gyrus lesions persisted into the chronic stage. However, they resolved completely when related to angular gyrus or insular lesions.

CONCLUSION

The diverging courses of recovery in different apraxia tasks can be related to different mechanisms. Critical lesions to key structures of the network or entrance areas of the processing streams lead to persisting deficits in the corresponding tasks. Contrary, lesions located outside the core network but inducing a temporary network dysfunction allow good recovery e.g., of conceptual errors in pantomime. The identification of lesion correlates for different long-term recovery patterns in apraxia might also allow early clinical prediction of the course of recovery.

Distinct Functional and Structural Connectivity of the Human Hand-Knob Supported by Intraoperative Findings

Fine motor skills rely on the control of hand muscles exerted by a region of primary motor cortex (M1) that has been extensively investigated in monkeys. Although neuroimaging enables the exploration of this system also in humans, indirect measurements of brain activity prevent causal definitions of hand motor representations, which can be achieved using data obtained during brain mapping in tumor patients. High-frequency direct electrical stimulation delivered at rest (HF-DES-Rest) on the hand-knob region of the precentral gyrus has identified two sectors showing differences in cortical excitability. Using quantitative analysis of motor output elicited with HF DES-Rest, we characterized two sectors based on their excitability, higher in the posterior and lower in the anterior sector. We studied whether the different cortical excitability of these two regions reflected differences in functional connectivity (FC) and structural connectivity (SC). Using healthy adults from the Human Connectome Project (HCP), we computed FC and SC of the anterior and the posterior hand-knob sectors identified within a large cohort of patients. The comparison of FC of the two seeds showed that the anterior hand-knob, relative to the posterior hand-knob, showed stronger functional connections with a bilateral set of parietofrontal areas responsible for integrating perceptual and cognitive hand-related sensorimotor processes necessary for goal-related actions. This was reflected in different patterns of SC between the two sectors. Our results suggest that the human hand-knob is a functionally and structurally heterogeneous region organized along a motor-cognitive gradient.SIGNIFICANCE STATEMENT The capability to perform complex manipulative tasks is one of the major characteristics of primates and relies on the fine control of hand muscles exerted by a highly specialized region of the precentral gyrus, often termed the "hand-knob" sector. Using intraoperative brain mapping, we identify two hand-knob sectors (posterior and anterior) characterized by differences in cortical excitability. Based on resting-state functional connectivity (FC) and tractography in healthy subjects, we show that posterior and anterior hand-knob sectors differ in their functional connectivity (FC) and structural connectivity (SC) with frontoparietal regions. Thus, anteroposterior differences in cortical excitability are paralleled by differences in FC and SC that likely reflect a motor (posterior) to cognitive (anterior) organization of this cortical region.

Overlapping but distinct: Distal connectivity dissociates hand and tool processing networks

The processes and organizational principles of information involved in object recognition have been a subject of intense debate. These research efforts led to the understanding that local computations and feedforward/feedback connections are essential to our representations and their organization. Recent data, however, has demonstrated that distal computations also play a role in how information is locally processed. Here we focus on how long-range connectivity and local functional organization of information are related, by exploring regions that show overlapping category-preferences for two categories and testing whether their connections are related with distal representations in a category-specific way. We used an approach that relates functional connectivity with distal areas to local voxel-wise category-preferences. Specifically, we focused on two areas that show an overlap in category-preferences for tools and hands-the inferior parietal lobule/anterior intraparietal sulcus (IPL/aIPS) and the posterior middle temporal gyrus/lateral occipital temporal cortex (pMTG/LOTC) - and how connectivity from these two areas relate to voxel-wise category-preferences in two ventral temporal regions dedicated to the processing of tools and hands separately-the left medial fusiform gyrus and the fusiform body area respectively-as well as across the brain. We show that the functional connections of the two overlap areas correlate with categorical preferences for each category independently. These results show that regions that process both tools and hands maintain object topography in a category-specific way. This potentially allows for a category-specific flow of information that is pertinent to computing object representations.

Decoding stimuli (tool-hand) and viewpoint invariant grasp-type information

When we see a manipulable object (henceforth tool) or a hand performing a grasping movement, our brain is automatically tuned to how that tool can be grasped (i.e., its affordance) or what kind of grasp that hand is performing (e.g., a power or precision grasp). However, it remains unclear where visual information related to tools or hands are transformed into abstract grasp representations. We therefore investigated where different levels of abstractness in grasp information are processed: grasp information that is invariant to the kind of stimuli that elicits it (tool-hand invariance); and grasp information that is hand-specific but viewpoint-invariant (viewpoint invariance). We focused on brain areas activated when viewing both tools and hands, i.e., the posterior parietal cortices (PPC), ventral premotor cortices (PMv), and lateral occipitotemporal cortex/posterior middle temporal cortex (LOTC/pMTG). To test for invariant grasp representations, we presented participants with tool images and grasp videos (from first or third person perspective; 1pp or 3pp) inside an MRI scanner, and cross-decoded power versus precision grasps across (i) grasp perspectives (viewpoint invariance), (ii) tool images and grasp 1pp videos (tool-hand 1pp invariance), and (iii) tool images and grasp 3pp videos (tool-hand 3pp invariance). Tool-hand 1pp, but not tool-hand 3pp, invariant grasp information was found in left PPC, whereas viewpoint-invariant information was found bilaterally in PPC, left PMv, and left LOTC/pMTG. These findings suggest different levels of abstractness-where visual information is transformed into stimuli-invariant grasp representations/tool affordances in left PPC, and viewpoint invariant but hand-specific grasp representations in the hand network.

It's not all about looks: The role of object shape in parietal representations of manual tools

The ability to build and expertly manipulate manual tools sets humans apart from other animals. Watching images of manual tools has been shown to elicit a distinct pattern of neural activity in a network of parietal areas, assumingly because tools entail a potential for action-a unique feature related to their functional use and not shared with other manipulable objects. However, a question has been raised whether this selectivity reflects a processing of low-level visual properties-such as elongated shape that is idiosyncratic to most tool-objects-rather than action-specific features. To address this question, we created and behaviourally validated a stimulus set that dissociates objects that are manipulable and nonmanipulable, as well as objects with different degrees of body extension property (tools and non-tools), while controlling for object shape and low-level image properties. We tested the encoding of action-related features by investigating neural representations in two parietal regions of interest (intraparietal sulcus and superior parietal lobule) using functional MRI. Univariate differences between tools and non-tools were not observed when controlling for visual properties, but strong evidence for the action account was nevertheless revealed when using a multivariate approach. Overall, this study provides further evidence that the representational content in the dorsal visual stream reflects encoding of action-specific properties.

Individual face- and house-related eye movement patterns distinctively activate FFA and PPA

We investigated if the fusiform face area (FFA) and the parahippocampal place area (PPA) contain a representation of fixation sequences that are typically used when looking at faces or houses. Here, we instructed observers to follow a dot presented on a uniform background. The dot’s movements represented gaze paths acquired separately from observers looking at face or house pictures. Even when gaze dispersion differences were controlled, face- and house-associated gaze patterns could be discriminated by fMRI multivariate pattern analysis in FFA and PPA, more so for the current observer’s own gazes than for another observer’s gaze. The discrimination of the observer’s own gaze patterns was not observed in early visual areas (V1 – V4) or superior parietal lobule and frontal eye fields. These findings indicate a link between perception and action—the complex gaze patterns that are used to explore faces and houses—in the FFA and PPA.

The fusiform face area and parahippocampal place area respond to face and scene stimuli respectively. Here, the authors show using fMRI that these brain areas are also preferentially activated by eye movements associated with looking at faces and scenes even when no images are shown.

Using neural distance to predict reaction time for categorizing the animacy, shape, and abstract properties of objects

A large number of neuroimaging studies have shown that information about object category can be decoded from regions of the ventral visual pathway. One question is how this information might be functionally exploited in the brain. In an attempt to help answer this question, some studies have adopted a neural distance-to-bound approach, and shown that distance to a classifier decision boundary through neural activation space can be used to predict reaction times (RT) on animacy categorization tasks. However, these experiments have not controlled for possible visual confounds, such as shape, in their stimulus design. In the present study we sought to determine whether, when animacy and shape properties are orthogonal, neural distance in low- and high-level visual cortex would predict categorization RTs, and whether a combination of animacy and shape distance might predict RTs when categories crisscrossed the two stimulus dimensions, and so were not linearly separable. In line with previous results, we found that RTs correlated with neural distance, but only for animate stimuli, with similar, though weaker, asymmetric effects for the shape and crisscrossing tasks. Taken together, these results suggest there is potential to expand the neural distance-to-bound approach to other divisions beyond animacy and object category.

What Role Does "Elongation" Play in "Tool-Specific" Activation and Connectivity in the Dorsal and Ventral Visual Streams?

Images of tools induce stronger activation than images of nontools in a left-lateralized network that includes ventral-stream areas implicated in tool identification and dorsal-stream areas implicated in tool manipulation. Importantly, however, graspable tools tend to be elongated rather than stubby, and so the tool-selective responses in some of these areas may, to some extent, reflect sensitivity to elongation rather than "toolness" per se. Using functional magnetic resonance imaging, we investigated the role of elongation in driving tool-specific activation in the 2 streams and their interconnections. We showed that in some "tool-selective" areas, the coding of toolness and elongation coexisted, but in others, elongation and toolness were coded independently. Psychophysiological interaction analysis revealed that toolness, but not elongation, had a strong modulation of the connectivity between the ventral and dorsal streams. Dynamic causal modeling revealed that viewing tools (either elongated or stubby) increased the connectivity from the ventral- to the dorsal-stream tool-selective areas, but only viewing elongated tools increased the reciprocal connectivity between these areas. Overall, these data disentangle how toolness and elongation affect the activation and connectivity of the tool network and help to resolve recent controversies regarding the relative contribution of "toolness" versus elongation in driving dorsal-stream "tool-selective" areas.

The Neural Representations of Movement across Semantic Categories

Previous evidence from neuropsychological and neuroimaging studies suggests functional specialization for tools and related semantic knowledge in a left frontoparietal network. It is still debated whether these areas are involved in the representation of rudimentary movement-relevant knowledge regardless of semantic domains (animate vs. inanimate) or categories (tools vs. nontool objects). Here, we used fMRI to record brain activity while 13 volunteers performed two semantic judgment tasks on visually presented items from three different categories: animals, tools, and nontool objects. Participants had to judge two distinct semantic features: whether two items typically move in a similar way (e.g., a fan and a windmill move in circular motion) or whether they are usually found in the same environment (e.g., a seesaw and a swing are found in a playground). We investigated differences in overall activation (which areas are involved) as well as representational content (which information is encoded) across semantic features and categories. Results of voxel-wise mass univariate analysis showed that, regardless of semantic category, a dissociation emerges between processing information on prototypical location (involving the anterior temporal cortex and the angular gyrus) and movement (linked to left inferior parietal and frontal activation). Multivoxel pattern correlation analyses confirmed the representational segregation of networks encoding task- and category-related aspects of semantic processing. Taken together, these findings suggest that the left frontoparietal network is recruited to process movement properties of items (including both biological and nonbiological motion) regardless of their semantic category.

Action and semantic tool knowledge - Effective connectivity in the underlying neural networks

Evidence from neuropsychological and imaging studies indicate that action and semantic knowledge about tools draw upon distinct neural substrates, but little is known about the underlying interregional effective connectivity. With fMRI and dynamic causal modeling (DCM) we investigated effective connectivity in the left-hemisphere (LH) while subjects performed (i) a function knowledge and (ii) a value knowledge task, both addressing semantic tool knowledge, and (iii) a manipulation (action) knowledge task. Overall, the results indicate crosstalk between action nodes and semantic nodes. Interestingly, effective connectivity was weakened between semantic nodes and action nodes during the manipulation task. Furthermore, pronounced modulations of effective connectivity within the fronto-parietal action system of the LH (comprising lateral occipito-temporal cortex, intraparietal sulcus, supramarginal gyrus, inferior frontal gyrus) were observed in a bidirectional manner during the processing of action knowledge. In contrast, the function and value knowledge tasks resulted in a significant strengthening of the effective connectivity between visual cortex and fusiform gyrus. Importantly, this modulation was present in both semantic tasks, indicating that processing different aspects of semantic knowledge about tools evokes similar effective connectivity patterns. Data revealed that interregional effective connectivity during the processing of tool knowledge occurred in a bidirectional manner with a weakening of connectivity between areas engaged in action and semantic knowledge about tools during the processing of action knowledge. Moreover, different semantic tool knowledge tasks elicited similar effective connectivity patterns.

Visual and visuomotor processing of hands and tools as a case study of cross talk between the dorsal and ventral streams

A major principle of organization of the visual system is between a dorsal stream that processes visuomotor information and a ventral stream that supports object recognition. Most research has focused on dissociating processing across these two streams. Here we focus on how the two streams interact. We tested neurologically-intact and impaired participants in an object categorization task over two classes of objects that depend on processing within both streams-hands and tools. We measured how unconscious processing of images from one of these categories (e.g., tools) affects the recognition of images from the other category (i.e., hands). Our findings with neurologically-intact participants demonstrated that processing an image of a hand hampers the subsequent processing of an image of a tool, and vice versa. These results were not present in apraxic patients (N = 3). These findings suggest local and global inhibitory processes working in tandem to co-register information across the two streams.

Task Context Overrules Object- and Category-Related Representational Content in the Human Parietal Cortex

The dorsal, parietal visual stream is activated when seeing objects, but the exact nature of parietal object representations is still under discussion. Here we test 2 specific hypotheses. First, parietal cortex is biased to host some representations more than others, with a different bias compared with ventral areas. A prime example would be object action representations. Second, parietal cortex forms a general multiple-demand network with frontal areas, showing similar task effects and representational content compared with frontal areas. To differentiate between these hypotheses, we implemented a human neuroimaging study with a stimulus set that dissociates associated object action from object category while manipulating task context to be either action- or category-related. Representations in parietal as well as prefrontal areas represented task-relevant object properties (action representations in the action task), with no sign of the irrelevant object property (category representations in the action task). In contrast, irrelevant object properties were represented in ventral areas. These findings emphasize that human parietal cortex does not preferentially represent particular object properties irrespective of task, but together with frontal areas is part of a multiple-demand and content-rich cortical network representing task-relevant object properties.

On the partnership between neural representations of object categories and visual features in the ventral visual pathway

A dominant view in the cognitive neuroscience of object vision is that regions of the ventral visual pathway exhibit some degree of category selectivity. However, recent findings obtained with multivariate pattern analyses (MVPA) suggest that apparent category selectivity in these regions is dependent on more basic visual features of stimuli. In which case a rethinking of the function and organization of the ventral pathway may be in order. We suggest that addressing this issue of functional specificity requires clear coding hypotheses, about object category and visual features, which make contrasting predictions about neuroimaging results in ventral pathway regions. One way to differentiate between categorical and featural coding hypotheses is to test for residual categorical effects: effects of category selectivity that cannot be accounted for by visual features of stimuli. A strong method for testing these effects, we argue, is to make object category and target visual features orthogonal in stimulus design. Recent studies that adopt this approach support a feature-based categorical coding hypothesis according to which regions of the ventral stream do indeed code for object category, but in a format at least partially based on the visual features of stimuli.

Dissociation between Semantic Representations for Motion and Action Verbs: Evidence from Patients with Left Hemisphere Lesions

This multiple single case study contrasted left hemisphere stroke patients (N = 6) to healthy age-matched control participants (N = 15) on their understanding of action (e.g., holding, clenching) and motion verbs (e.g., crumbling, flowing). The tasks required participants to correctly identify the matching verb or associated picture. Dissociations on action and motion verb content depending on lesion site were expected. As predicted for verbs containing an action and/or motion content, modified t-tests confirmed selective deficits in processing motion verbs in patients with lesions involving posterior parietal and lateral occipitotemporal cortex. In contrast, deficits in verbs describing motionless actions were found in patients with more anterior lesions sparing posterior parietal and lateral occipitotemporal cortex. These findings support the hypotheses that semantic representations for action and motion are behaviorally and neuro-anatomically dissociable. The findings clarify the differential and critical role of perceptual and motor regions in processing modality-specific semantic knowledge as opposed to a supportive but not necessary role. We contextualize these results within theories from both cognitive psychology and cognitive neuroscience that make claims over the role of sensory and motor information in semantic representation.