Preserved tool knowledge in the context of impaired action knowledge: implications for models of semantic memory

Mechanisms and neuroanatomy of response selection in tool and non-tool action tasks: Evidence from left-hemisphere stroke

The ability to select between potential actions is central to the complex process of tool use. After left hemisphere stroke, individuals with limb apraxia make more hand action errors when gesturing the use of tools with conflicting hand actions for grasping-to-move and use (e.g., screwdriver) relative to tools that are grasped-to-move and used with the same hand action (e.g., hammer). Prior research indicates that this grasp-use interference effect is driven by abnormalities in the competitive action selection process. The goal of this project was to determine whether common mechanisms and neural substrates support the competitive selection of task-appropriate responses in both tool and non-tool domains. If so, the grasp-use interference effect in a tool use gesturing task should be correlated with response interference effects in the classic Eriksen flanker and Simon tasks, and at least partly overlapping neural regions should subserve the 3 tasks. Sixty-four left hemisphere stroke survivors (33 with apraxia) participated in the tool- and non-tool interference tasks and underwent T1 anatomical MRI. There were robust grasp-use interference effects (grasp-use conflict test) and response interference effects (Eriksen flanker and Simon tasks), but these effects were not correlated. Lesion-symptom mapping analyses showed that lesions to the left inferior parietal lobule, ventral premotor cortex, and insula were associated with grasp-use interference. Lesions to the left inferior parietal lobule, postcentral gyrus, insula, caudate, and putamen were associated with response interference in the Eriksen flanker task. Lesions to the left caudate and putamen were also associated with response interference in the Simon task. Our results suggest that the selection of hand posture for tool use is mediated by distinct cognitive mechanisms and partly distinct neuroanatomic substrates from those mapping a stimulus to an appropriate motor response in non-tool domains.

Semantic feature production norms for manipulable objects

Feature generation tasks and feature databases are important for understanding how knowledge is organized in semantic memory, as they reflect not only the kinds of information that individuals hold about objects but also how objects are conceptually represented. Traditionally, semantic norms focus on a variety of object categories and, as a result, have a small number of concepts per semantic category. Here, our main goal is to create a more fine-grained feature database exclusively for one category of objects-manipulable objects. This database contributes to the understanding of within-category, content-specific processing. To achieve this, we asked 130 participants to freely generate features for 80 manipulable objects and another group of 32 participants to generate action features for the same objects. We then compared our databases with other published semantic norms and found high similarity between them. In our databases, we calculated the similarity between objects in terms of visual, functional, encyclopaedic, and action feature types using Spearman correlation, Baker's gamma index, and cophenetic correlation. We discovered that objects were grouped in a distinctive and meaningful way according to feature type. Finally, we tested the validity of our databases by asking three groups of participants to perform a feature verification experiment while manipulating production frequency. Our results demonstrate that participants can recognize and associate the features of our databases with specific manipulable objects. Participants were faster to verify high-frequency features than low-frequency features. Overall, our data provide important insights into how we process manipulable objects and can be used to further inform cognitive and neural theories of object processing and identification.

The noun-verb distinction

The comparison between nouns and verbs has been a topic of interest for many researchers over the last 50 years. This comparison, and subsequent behavioral and (partly) anatomic dissociation, has allowed researchers to delve into many topics including the behavioral architecture of the language system and its neural correlates, the underlying nature of the linguistic impairment in individuals with different neurologic disorders, the assessment of language treatment protocols, and the proposal of new protocols aimed to protect the language system of individuals undergoing surgery for brain tumors and epilepsy. Specific to the left temporal lobe, classic accounts have shown its relevance for the processing of nouns and less for the processing of verbs. Nonetheless, more recent accounts indicate that different areas in the left temporal lobe can subserve different functions for the processing of both nouns and verbs. In this chapter, we outlined an overview of key findings of the study of nouns and verbs, with a particular focus on the left temporal lobe. This chapter contextualizes the literature on category-specific impairments and neural correlates of nouns and verbs with linguistic and psycholinguistic theories, and provides new ways to investigate and understand the intricacies of this comparison.

Social and emotion dimensional organizations in the abstract semantic space: the neuropsychological evidence

An essential aspect of human cognition is supported by a rich reservoir of abstract concepts without tangible external referents (e.g., “honor”, “relationship”, “direction”). While decades of research showed that the neural organization of conceptual knowledge referring to concrete words respects domains of evolutionary salience and sensorimotor attributes, the organization principles of abstract word meanings are poorly understood. Here, we provide neuropsychological evidence for a domain (sociality) and attribute (emotion) structure in abstract word processing. Testing 34 brain-damaged patients on a word-semantic judgment task, we observed double dissociations between social and nonsocial words and a single dissociation of sparing of emotional (relative to non-emotional) words. The lesion profiles of patients with specific dissociations suggest potential neural correlates positively or negatively associated with each dimension. These results unravel a general domain-attribute architecture of word meanings and highlight the roles of the social domain and the emotional attribute in the non-object semantic space.

Structural Disconnection of the Tool Use Network after Left Hemisphere Stroke Predicts Limb Apraxia Severity

Producing a tool use gesture is a complex process drawing upon the integration of stored knowledge of tools and their associated actions with sensory-motor mechanisms supporting the planning and control of hand and arm actions. Understanding how sensory-motor systems in parietal cortex interface with semantic representations of actions and objects in the temporal lobe remains a critical issue and is hypothesized to be a key determinant of the severity of limb apraxia, a deficit in producing skilled action after left hemisphere stroke. We used voxel-based and connectome-based lesion-symptom mapping with data from 57 left hemisphere stroke participants to assess the lesion sites and structural disconnection patterns associated with poor tool use gesturing. We found that structural disconnection among the left inferior parietal lobule, lateral and ventral temporal cortices, and middle and superior frontal gyri predicted the severity of tool use gesturing performance. Control analyses demonstrated that reductions in right-hand grip strength were associated with motor system disconnection, largely bypassing regions supporting tool use gesturing. Our findings provide evidence that limb apraxia may arise, in part, from a disconnection between conceptual representations in the temporal lobe and mechanisms enabling skilled action production in the inferior parietal lobule.

Degradation of Praxis Brain Networks and Impaired Comprehension of Manipulable Nouns in Stroke

Distributed brain systems contribute to representation of semantic knowledge. Whether sensory and motor systems of the brain are causally involved in representing conceptual knowledge is an especially controversial question. Here, we tested 57 chronic left-hemisphere stroke patients using a semantic similarity judgment task consisting of manipulable and nonmanipulable nouns. Three complementary methods were used to assess the neuroanatomical correlates of semantic processing: voxel-based lesion-symptom mapping, resting-state functional connectivity, and gray matter fractional anisotropy. The three measures provided converging evidence that injury to the brain networks required for action observation, execution, planning, and visuomotor coordination are associated with specific deficits in manipulable noun comprehension relative to nonmanipulable items. Damage or disrupted connectivity of areas such as the middle posterior temporal gyrus, anterior inferior parietal lobe, and premotor cortex was related specifically to the impairment of manipulable noun comprehension. These results suggest that praxis brain networks contribute especially to the comprehension of manipulable object nouns.

Reorganized language network connectivity after left arcuate fasciculus resection: A case study

Understanding the neural mechanisms that support spontaneous recovery of cognitive abilities can place important constraints on mechanistic theories of brain organization and function, and holds potential to inform clinical interventions. Connectivity-based MRI measures have emerged as a way to study how recovery from brain injury is modulated by changes in intra- and inter-hemispheric connectivity. Here we report a detailed and multi-modal case study of a 26 year-old male who presented with a left inferior parietal glioma infiltrating the left arcuate fasciculus. The patient underwent pre- and post-operative functional MRI and Diffusion Tensor Imaging, as well as behavioral assessments of language, motor, vision and praxis. The surgery for removal of the tumor was carried out with the patient awake, and direct electrical stimulation mapping was used to evaluate cortical language centers. The patient developed a specific difficulty with repeating sentences toward the end of the surgery, after resection of the tumor and partial transection of the arcuate fasciculus. The patient recovered from the sentence repetition impairments over several months after the operation. Coincident with the patient's cognitive recovery, we document a pattern whereby intra-hemispheric functional connectivity was reduced in the left hemisphere, while inter-hemispheric connectivity increased between classic left hemisphere language regions and their right hemisphere homologues. These findings suggest that increased synchrony between the two hemispheres, in the setting of focal transection of the left arcuate fasciculus, can facilitate functional recovery.

Neurosurgical lesions to sensorimotor cortex do not impair action verb processing

There is ongoing debate regarding the role that sensorimotor regions play in conceptual processing, with embodied theories supporting their direct involvement in processing verbs describing body part movements. Patient lesion studies examining a causal role for sensorimotor activation in conceptual task performance have suffered the caveat of lesions being largely diffuse and extensive beyond sensorimotor cortices. The current study addresses this limitation in reporting on 20 pre-operative neurosurgical patients with focal lesion to the pre- and post-central area corresponding to somatotopic representations. Patients were presented with a battery of neuropsychological tests and experimental tasks tapping into motor imagery and verbal conceptual verb processing in addition to neurophysiological measures including DTI, fMRI, and MEP being measured. Results indicated that left tumor patients who presented with a lesion at or near somatotopic hand representations performed significantly worse on the mental rotation hand task and that performance correlated with MEP amplitudes in the upper limb motor region. Furthermore, performance on tasks of verbal processing was within the normal range. Taken together, while our results evidence the involvement of the motor system in motor imagery processes, they do not support the embodied view that sensorimotor regions are necessary to tasks of action verb processing.

To Watch is to Work: a Review of NeuroImaging Data on Tool Use Observation Network

Since the discovery of mirror neurons in the 1990s, many neuroimaging studies have tackled the issue of action observation with the aim of unravelling a putative homolog human system. However, these studies do not distinguish between non-tool-use versus tool-use actions, implying that a common brain network is systematically involved in the observation of any action. Here we provide evidence for a brain network dedicated to tool-use action observation, called the tool-use observation network, mostly situated in the left hemisphere, and distinct from the non-tool-use action observation network. Areas specific for tool-use action observation are the left cytoarchitectonic area PF within the left inferior parietal lobe and the left inferior frontal gyrus. The neural correlates associated with the observation of tool-use reported here offer new insights into the neurocognitive bases of action observation and tool use, as well as addressing more fundamental issues on the origins of specifically human phenomena such as cumulative technological evolution.

Semantic memory for objects, actions, and events: A novel test of event-related conceptual semantic knowledge

People possess significant knowledge about how real-world events typically unfold. Such event-related semantic memory connects action and object knowledge, is essential for multiple stages of language processing, and may be impaired in neurological conditions like aphasia. However, current assessments are not well designed for measuring this knowledge. This study presents and tests a novel measure of event-related semantic memory. Task-performance data were collected from unimpaired adults across the lifespan and a sample of stroke survivors with aphasia. Individuals with aphasia also completed measures of language processing and action-/object-related semantic memory, to establish the novel measure's convergent validity. Results demonstrate that performance on the event-knowledge measure correlated with action and object semantic-memory measures and was also associated with a broader range of language-processing performance than other semantic-memory measures. These findings suggest that the novel measure can be used to detect the presence and impact of event-knowledge impairments in neurological conditions.

Direct electrical stimulation of the left frontal aslant tract disrupts sentence planning without affecting articulation

Sentence production involves mapping from deep structures that specify meaning and thematic roles to surface structures that specify the order and sequencing of production ready elements. We propose that the frontal aslant tract is a key pathway for sequencing complex actions with deep hierarchical structure. In the domain of language, and primarily with respect to the left FAT, we refer to this as the 'Syntagmatic Constraints On Positional Elements' (SCOPE) hypothesis. One prediction made by the SCOPE hypothesis is that disruption of the frontal aslant tract should disrupt sentence production at grammatical phrase boundaries, with no disruption of articulatory processes.  We test this prediction in a patient undergoing direct electrical stimulation mapping of the frontal aslant tract during an awake craniotomy to remove a left frontal brain tumor. We found that stimulation of the left FAT prolonged inter-word durations at the start of grammatical phrases, while inter-word durations internal to noun phrases were unaffected, and there was no effect on intra-word articulatory duration. These results provide initial support for the SCOPE hypothesis, and motivate novel directions for future research to explore the functions of this recently discovered component of the language system.

Italian norms and naming latencies for 357 high quality color images

In the domain of cognitive studies on the lexico-semantic representational system, one of the most important means of ensuring effective experimental designs is using ecological stimulus sets accompanied by normative data on the most relevant variables affecting the processing of their items. In the context of image sets, color photographs are particularly suited to this purpose as they reduce the difficulty of visual decoding processes that may emerge with traditional image sets of line drawings. This is especially so in clinical populations. In this study we provide Italian norms for a set of 357 high quality image-items belonging to 23 semantic subcategories from the Moreno-Martínez and Montoro database. Data from several variables affecting image processing were collected from a sample of 255 Italian-speaking participants: age of acquisition, familiarity, lexical frequency, manipulability, name agreement, typicality and visual complexity. Lexical frequency data were derived from the CoLFIS corpus. Furthermore, we collected data on image oral naming latencies to explore how the variance in these latencies could be explained by these critical variables. Multiple regression analyses on the naming latencies show classical psycholinguistic phenomena, such as the effects of age of acquisition and name agreement. In addition, manipulability was also a significant predictor. The described Italian normative data and naming latencies are available for download as supplementary material.

How to change your memory of an object with a posture and a verb

According to grounded cognition, the format of representation of knowledge is sensorimotor. This means that long-term memory shares processing resources with the sensorimotor system. The main objective of this work is to provide new evidence in favour of two claims from the embodied cognition framework: (1) memory is grounded on the sensorimotor system, that is, memory shares processing resources with the sensorimotor system, and (2) memory serves at least in part to support action. For this purpose, the present experiment aimed to show that the action context modulates the motor simulation and, consequently, the memory of manipulable objects. Participants were presented with short phrases comprising the name of a manipulable object, and an action verb (“To take a cup”) or an attentional verb (“To see a cup”). During this phase, they had to put their hands in front of them in the control condition, whereas they had to keep them behind their back in the interfering condition. A cued recall test followed after a short distractive letter-matching task, with the verbs serving as cues. Results showed that memory of the words denoting manipulable objects was impaired by the interfering posture when associated with an action verb, but not when associated with an attentional verb. This suggests that a context which does not favour action interferes with motor simulation and thus decreases the memory of manipulable objects. These results provide strong evidence for a grounded account of memory and language.

Task- and domain-specific modulation of functional connectivity in the ventral and dorsal object-processing pathways

A whole-brain network of regions collectively supports the ability to recognize and use objects-the Tool Processing Network. Little is known about how functional interactions within the Tool Processing Network are modulated in a task-dependent manner. We designed an fMRI experiment in which participants were required to either generate object pantomimes or to carry out a picture matching task over the same images of tools, while holding all aspects of stimulus presentation constant across the tasks. The Tool Processing Network was defined with an independent functional localizer, and functional connectivity within the network was measured during the pantomime and picture matching tasks. Relative to tool picture matching, tool pantomiming led to an increase in functional connectivity between ventral stream regions and left parietal and frontal-motor areas; in contrast, the matching task was associated with an increase in functional connectivity among regions in ventral temporo-occipital cortex, and between ventral temporal regions and the left inferior parietal lobule. Graph-theory analyses over the functional connectivity data indicated that the left premotor cortex and left lateral occipital complex were hub-like (exhibited high betweenness centrality) during tool pantomiming, while ventral stream regions (left medial fusiform gyrus and left posterior middle temporal gyrus) were hub-like during the picture matching task. These results demonstrate task-specific modulation of functional interactions among a common set of regions, and indicate dynamic coupling of anatomically remote regions in task-dependent manner.

Tool selection and the ventral-dorsal organization of tool-related knowledge

Tool selection is a cognitive process necessary for tool use, and may rely on distinct knowledge under different conditions. This fMRI experiment was designed to identify neural substrates mediating tool selection under different conditions. Participants performed a picture‐matching task that presented a recipient object and an action‐goal, and required the selection of the best tool object from among four candidates. Some trials allowed selection of the prototypical tool, whereas others forced selection of either a functionally substitutable or impossible tool. Statistical contrasts revealed significantly different activation between Proto and Sub conditions in frontal, parietal, and temporal lobes. The middle temporal gyrus (MTG) bilaterally, and the right posterior cingulate were more strongly activated by prototypical tool selection, and left inferior parietal lobule (IPL), intraparietal sulcus (IPS), middle frontal gyrus, and precuneus were more strongly activated when selecting substitutable objects. These findings are concordant with previous neuroimaging studies of tool use knowledge in demonstrating that activation of the MTG represents functional knowledge for conventional tool usage, and activation of the IPL/IPS supports action (i.e., praxic) knowledge representations. These results contribute to the literature that dissociates the roles of ventral and dorsal streams in tool‐related knowledge and behavior, and emphasize the role of the left hemisphere for processing goal‐directed object interactions.

Abstract Representations of Object-Directed Action in the Left Inferior Parietal Lobule

Prior neuroimaging and neuropsychological research indicates that the left inferior parietal lobule in the human brain is a critical substrate for representing object manipulation knowledge. In the present functional MRI study we used multivoxel pattern analyses to test whether action similarity among objects can be decoded in the inferior parietal lobule independent of the task applied to objects (identification or pantomime) and stimulus format in which stimuli are presented (pictures or printed words). Participants pantomimed the use of objects, cued by printed words, or identified pictures of objects. Classifiers were trained and tested across task (e.g., training data: pantomime; testing data: identification), stimulus format (e.g., training data: word format; testing format: picture) and specific objects (e.g., training data: scissors vs. corkscrew; testing data: pliers vs. screwdriver). The only brain region in which action relations among objects could be decoded across task, stimulus format and objects was the inferior parietal lobule. By contrast, medial aspects of the ventral surface of the left temporal lobe represented object function, albeit not at the same level of abstractness as actions in the inferior parietal lobule. These results suggest compulsory access to abstract action information in the inferior parietal lobe even when simply identifying objects.

Visual and visuomotor processing of hands and tools as a case study of cross talk between the dorsal and ventral streams

A major principle of organization of the visual system is between a dorsal stream that processes visuomotor information and a ventral stream that supports object recognition. Most research has focused on dissociating processing across these two streams. Here we focus on how the two streams interact. We tested neurologically-intact and impaired participants in an object categorization task over two classes of objects that depend on processing within both streams-hands and tools. We measured how unconscious processing of images from one of these categories (e.g., tools) affects the recognition of images from the other category (i.e., hands). Our findings with neurologically-intact participants demonstrated that processing an image of a hand hampers the subsequent processing of an image of a tool, and vice versa. These results were not present in apraxic patients (N = 3). These findings suggest local and global inhibitory processes working in tandem to co-register information across the two streams.

A Role for the Frontal Aslant Tract in Speech Planning: A Neurosurgical Case Study

Frontal and temporal white matter pathways play key roles in language processing, but the specific computations supported by different tracts remain a matter of study. A role in speech planning has been proposed for a recently described pathway, the frontal aslant tract (FAT), which connects the posterior inferior frontal gyrus to the pre-SMA. Here, we use longitudinal functional and structural MRI and behavioral testing to evaluate the behavioral consequences of a lesion to the left FAT that was incurred during surgical resection of a frontal glioma in a 60-year-old woman, Patient AF. The pattern of performance in AF is compared, using the same measures, with that in a 37-year-old individual who underwent a left anterior temporal resection and hippocampectomy (Patient AG). AF and AG were both cognitively intact preoperatively but exhibited specific and doubly dissociable behavioral deficits postoperatively: AF had dysfluent speech but no word finding difficulty, whereas AG had word finding difficulty but otherwise fluent speech. Probabilistic tractography showed that the left FAT was lesioned postoperatively in AF (but not AG) whereas the inferior longitudinal fasciculus was lesioned in AG (but not AF). Those structural changes were supported by corresponding changes in functional connectivity to the posterior inferior frontal gyrus: decreased functional connectivity postoperatively between the posterior inferior frontal gyrus and pre-SMA in AF (but not AG) and decreased functional connectivity between the posterior inferior frontal gyrus and the middle temporal gyrus in AG (but not AF). We suggest from these findings that the left FAT serves as a key communicative link between sentence planning and lexical access processes.

Decoding intransitive actions in primary motor cortex using fMRI: toward a componential theory of 'action primitives' in motor cortex

Multivoxel pattern analysis (MVPA) over functional MRI data can distinguish neural representational states that do not differ in their overall amplitude of BOLD contrast. Here we used MVPA to test whether simple intransitive actions can be distinguished in primary motor cortex. Participants rotated and flexed each of their extremities (hands and feet) during fMRI scanning. The primary motor cortex for the hand/wrist was functionally defined in each hemisphere in each subject. Within those subject-specific ROIs, we found that the average amplitude of BOLD contrast for two different movements of the contralateral hand (rotation, flexion) were higher than for the ipsilateral hand, as well as movements by both feet; however, there was no difference in amplitude between the two different types of movements for the contralateral hand. Using multivoxel pattern analysis (linear correlation), we were able to distinguish the two movements for the contralateral hand. These findings demonstrate that simple intransitive actions can be distinguished in primary motor areas using multivoxel pattern analysis.

The amodal brain and the offloading hypothesis

In this article, I argue that a growing body of evidence shows that concepts are amodal and I provide a novel interpretation of the body of evidence that was taken to support neo-empiricist theories of concepts: the offloading hypothesis in the 1990s and 2000s.

From meaning to categorization: The hierarchical recruitment of brain circuits selective for action verbs

Sensorimotor and affective brain systems are known to be involved in language processing. However, to date it is still debated whether this involvement is a crucial step of semantic processing or, on the contrary, it is dependent on the specific context or strategy adopted to solve a task at hand. The present electroencephalographic (EEG) study is aimed at investigating which brain circuits are engaged when processing written verbs. By aligning event-related potentials (ERPs) both to the verb onset and to the motor response indexing the accomplishment of a semantic task of categorization, we were able to dissociate the relative stimulus-related and response-related cognitive components at play, respectively. EEG signal source reconstruction showed that while the recruitment of sensorimotor fronto-parietal circuits was time-locked with action verb onset, a left temporal-parietal circuit was time-locked to the task accomplishment. Crucially, by comparing the time course of both these bottom-up and top-down cognitive components, it appears that the frontal motor involvement precedes the task-related temporal-parietal activity. The present findings suggest that the recruitment of fronto-parietal sensorimotor circuits is independent of the specific strategy adopted to solve a semantic task and, given its temporal hierarchy, it may provide crucial information to brain circuits involved in the categorization task. Eventually, a discussion on how the present results may contribute to the clinical literature on patients affected by disorders specifically impairing the motor system is provided.

Direct Electrical Stimulation in the Human Brain Disrupts Melody Processing

Prior research using functional magnetic resonance imaging (fMRI) [1-4] and behavioral studies of patients with acquired or congenital amusia [5-8] suggest that the right posterior superior temporal gyrus (STG) in the human brain is specialized for aspects of music processing (for review, see [9-12]). Intracranial electrical brain stimulation in awake neurosurgery patients is a powerful means to determine the computations supported by specific brain regions and networks [13-21] because it provides reversible causal evidence with high spatial resolution (for review, see [22, 23]). Prior intracranial stimulation or cortical cooling studies have investigated musical abilities related to reading music scores [13, 14] and singing familiar songs [24, 25]. However, individuals with amusia (congenitally, or from a brain injury) have difficulty humming melodies but can be spared for singing familiar songs with familiar lyrics [26]. Here we report a detailed study of a musician with a low-grade tumor in the right temporal lobe. Functional MRI was used pre-operatively to localize music processing to the right STG, and the patient subsequently underwent awake intraoperative mapping using direct electrical stimulation during a melody repetition task. Stimulation of the right STG induced "music arrest" and errors in pitch but did not affect language processing. These findings provide causal evidence for the functional segregation of music and language processing in the human brain and confirm a specific role of the right STG in melody processing. VIDEO ABSTRACT.

Motor experience influences object knowledge

An object's perceived readiness-for-action (e.g., its size, the degree of rotation from its canonical position, the user's viewpoint) can influence semantic knowledge retrieval. Yet, the organization of object knowledge may also be affected by body-specific sensorimotor experiences. Here, we investigated whether people's history of performing motor actions with their hands influences the knowledge they store and retrieve about graspable objects. We compared object representations between healthy right- and left-handers (Experiment 1), and between unilateral stroke patients, whose motor experience was changed by impairment of either their right or left hand (Experiment 2). Participants saw pictures of graspable everyday items with the handles oriented toward either the left or right hand, and they generated the type of grasp they would employ (i.e., clench or pinch) when using each object, responding orally. In both experiments, hand dominance and object orientation interacted to predict response times. In Experiment 1, judgments were fastest when objects were oriented toward the right hand in right-handers, but not in left-handers. In Experiment 2, judgments were fastest when objects were oriented toward the left hand in patients who had lost the use of their right hand, even though these patients were right-handed prior to brain injury. Results suggest that at least some aspects of object knowledge are determined by motor experience, and can be changed by new patterns of motor experience. People with different bodily characteristics, who interact with objects in systematically different ways, form correspondingly different neurocognitive representations of the same common objects. (PsycINFO Database Record

The burden of embodied cognition

The thesis of embodied cognition has developed as an alternative to the view that cognition is mediated, at least in part, by symbolic representations. A useful testing ground for the embodied cognition hypothesis is the representation of concepts. An embodied view of concept representation argues that concepts are represented in a modality-specific format. I argue that questions about representational format are tractable only in the context of explicit hypotheses about how information spreads among conceptual representations and sensorimotor systems. When reasonable alternatives to the embodied cognition hypothesis are clearly defined, the available evidence does not distinguish between the embodied cognition hypothesis and those alternatives. Furthermore, I argue, the available data that are theoretically constraining indicate that concepts are more than just sensory and motor content. As such, the embodied/nonembodied debate is either largely resolved or at a point where the embodied and nonembodied approaches are no longer coherently distinct theories. This situation merits a reconsideration of what the available evidence can tell us about the structure of the conceptual system. I suggest that it is the independence of thought from perception and action that makes human cognition special-and that independence is made possible by the representational distinction between concepts and sensorimotor representations.

ERPs Differentially Reflect Automatic and Deliberate Processing of the Functional Manipulability of Objects

It is known that the functional properties of an object can interact with perceptual, cognitive, and motor processes. Previously we have found that a between-subjects manipulation of judgment instructions resulted in different manipulability-related memory biases in an incidental memory test. To better understand this effect we recorded electroencephalography (EEG) while participants made judgments about images of objects that were either high or low in functional manipulability (e.g., hammer vs. ladder). Using a between-subjects design, participants judged whether they had seen the object recently (Personal Experience), or could manipulate the object using their hand (Functionality). We focused on the P300 and slow-wave event-related potentials (ERPs) as reflections of attentional allocation. In both groups, we observed higher P300 and slow wave amplitudes for high-manipulability objects at electrodes Pz and C3. As P300 is thought to reflect bottom-up attentional processes, this may suggest that the processing of high-manipulability objects recruited more attentional resources. Additionally, the P300 effect was greater in the Functionality group. A more complex pattern was observed at electrode C3 during slow wave: processing the high-manipulability objects in the Functionality instruction evoked a more positive slow wave than in the other three conditions, likely related to motor simulation processes. These data provide neural evidence that effects of manipulability on stimulus processing are further mediated by automatic vs. deliberate motor-related processing.

Arguments about the nature of concepts: Symbols, embodiment, and beyond

How are the meanings of words, events, and objects represented and organized in the brain? This question, perhaps more than any other in the field, probes some of the deepest and most foundational puzzles regarding the structure of the mind and brain. Accordingly, it has spawned a field of inquiry that is diverse and multidisciplinary, has led to the discovery of numerous empirical phenomena, and has spurred the development of a wide range of theoretical positions. This special issue brings together the most recent theoretical developments from the leaders in the field, representing a range of viewpoints on issues of fundamental significance to a theory of meaning representation. Here we introduce the special issue by way of pulling out some key themes that cut across the contributions that form this issue and situating those themes in the broader literature. The core issues around which research on conceptual representation can be organized are representational format, representational content, the organization of concepts in the brain, and the processing dynamics that govern interactions between the conceptual system and sensorimotor representations. We highlight areas in which consensus has formed; for those areas in which opinion is divided, we seek to clarify the relation of theory and evidence and to set in relief the bridging assumptions that undergird current discussions.

Learning Is Better with the Hands Free: The Role of Posture in the Memory of Manipulable Objects

Grounded cognition proposes that memory shares processing resources with sensorimotor systems. The aim of the present study was to show that motor simulation participates in the conceptual representation of manipulable objects in long-term memory. In two experiments, lists of manipulable and nonmanipulable objects were presented. Participants were instructed to memorize the items while adopting different postures. In the control condition, they had to keep their hands at rest in front of them. In the interference condition, participants had to keep their hands crossed behind their back to make their hands less free for action. After each list, participants had to perform first a distractive task, and then an oral free recall. The results showed that the interfering posture produced a specific decrease in the recall of manipulable objects, but not of nonmanipulable ones. This decrease was similar when the items were presented as pictures (Experiment 1) or as words (Experiment 2), thus excluding a purely visual effect. These results provide strong evidence that the motor simulation plays a role in the memory trace of the object.

Resilience to the contralateral visual field bias as a window into object representations

Viewing images of manipulable objects elicits differential blood oxygen level-dependent (BOLD) contrast across parietal and dorsal occipital areas of the human brain that support object-directed reaching, grasping, and complex object manipulation. However, it is unknown which object-selective regions of parietal cortex receive their principal inputs from the ventral object-processing pathway and which receive their inputs from the dorsal object-processing pathway. Parietal areas that receive their inputs from the ventral visual pathway, rather than from the dorsal stream, will have inputs that are already filtered through object categorization and identification processes. This predicts that parietal regions that receive inputs from the ventral visual pathway should exhibit object-selective responses that are resilient to contralateral visual field biases. To test this hypothesis, adult participants viewed images of tools and animals that were presented to the left or right visual fields during functional magnetic resonance imaging (fMRI). We found that the left inferior parietal lobule showed robust tool preferences independently of the visual field in which tool stimuli were presented. In contrast, a region in posterior parietal/dorsal occipital cortex in the right hemisphere exhibited an interaction between visual field and category: tool-preferences were strongest contralateral to the stimulus. These findings suggest that action knowledge accessed in the left inferior parietal lobule operates over inputs that are abstracted from the visual input and is contingent on analysis by the ventral visual pathway, consistent with its putative role in supporting object manipulation knowledge.

Influences of motor contexts on the semantic processing of action-related language

The contribution of the sensory-motor system to the semantic processing of language stimuli is still controversial. To address the issue, the present article focuses on the impact of motor contexts (i.e., comprehenders' motor behaviors, motor-training experiences, and motor expertise) on the semantic processing of action-related language and reviews the relevant behavioral and neuroimaging findings. The existing evidence shows that although motor contexts can influence the semantic processing of action-related concepts, the mechanism of the contextual influences is still far from clear. Future investigations will be needed to clarify (1) whether motor contexts only modulate activity in motor regions, (2) whether the contextual influences are specific to the semantic features of language stimuli, and (3) what factors can determine the facilitatory or inhibitory contextual influences on the semantic processing of action-related language.

Inborn and experience-dependent models of categorical brain organization. A position paper

The present review aims to summarize the debate in contemporary neuroscience between inborn and experience-dependent models of conceptual representations that goes back to the description of category-specific semantic disorders for biological and artifact categories. Experience-dependent models suggest that categorical disorders are the by-product of the differential weighting of different sources of knowledge in the representation of biological and artifact categories. These models maintain that semantic disorders are not really category-specific, because they do not respect the boundaries between different categories. They also argue that the brain structures which are disrupted in a given type of category-specific semantic disorder should correspond to the areas of convergence of the sensory-motor information which play a major role in the construction of that category. Furthermore, they provide a simple interpretation of gender-related categorical effects and are supported by studies assessing the importance of prior experience in the cortical representation of objects On the other hand, inborn models maintain that category-specific semantic disorders reflect the disruption of innate brain networks, which are shaped by natural selection to allow rapid identification of objects that are very relevant for survival. From the empirical point of view, these models are mainly supported by observations of blind subjects, which suggest that visual experience is not necessary for the emergence of category-specificity in the ventral stream of visual processing. The weight of the data supporting experience-dependent and inborn models is thoroughly discussed, stressing the fact observations made in blind subjects are still the subject of intense debate. It is concluded that at the present state of knowledge it is not possible to choose between experience-dependent and inborn models of conceptual representations.

Parcellation of left parietal tool representations by functional connectivity

Manipulating a tool according to its function requires the integration of visual, conceptual, and motor information, a process subserved in part by left parietal cortex. How these different types of information are integrated and how their integration is reflected in neural responses in the parietal lobule remains an open question. Here, participants viewed images of tools and animals during functional magnetic resonance imaging (fMRI). k-Means clustering over time series data was used to parcellate left parietal cortex into subregions based on functional connectivity to a whole brain network of regions involved in tool processing. One cluster, in the inferior parietal cortex, expressed privileged functional connectivity to the left ventral premotor cortex. A second cluster, in the vicinity of the anterior intraparietal sulcus, expressed privileged functional connectivity with the left medial fusiform gyrus. A third cluster in the superior parietal lobe expressed privileged functional connectivity with dorsal occipital cortex. Control analyses using Monte Carlo style permutation tests demonstrated that the clustering solutions were outside the range of what would be observed based on chance 'lumpiness' in random data, or mere anatomical proximity. Finally, hierarchical clustering analyses were used to formally relate the resulting parcellation scheme of left parietal tool representations to previous work that has parcellated the left parietal lobule on purely anatomical grounds. These findings demonstrate significant heterogeneity in the functional organization of manipulable object representations in left parietal cortex, and outline a framework that generates novel predictions about the causes of some forms of upper limb apraxia.

When concepts lose their color: a case of object-color knowledge impairment

Color is important in our daily interactions with objects, and plays a role in both low- and high-level visual processing. Previous neuropsychological studies have shown that color perception and object-color knowledge can doubly dissociate, and that both can dissociate from processing of object form. We present a case study of an individual who displayed an impairment for knowledge of the typical colors of objects, with preserved color perception and color naming. Our case also presented with a pattern of, if anything, worse performance for naming living items compared to non-living things. The findings of the experimental investigation are evaluated in light of two theories of conceptual organization in the brain: the Sensory/Functional Theory and the Domain-Specific Hypothesis. The dissociations observed in this case compel a model in which sensory/motor modality and semantic domain jointly constrain the organization of object knowledge.

Abnormal dynamics of activation of object use information in apraxia: evidence from eyetracking

Action representations associated with object use may be incidentally activated during visual object processing, and the time course of such activations may be influenced by lexical-semantic context (e.g., Lee, Middleton, Mirman, Kalénine, & Buxbaum (2012). Journal of Experimental Psychology: Human Perception and Performance, 39(1), 257-270). In this study we used the "visual world" eye-tracking paradigm to examine whether a deficit in producing skilled object-use actions (apraxia) is associated with abnormalities in incidental activation of action information, and assessed the neuroanatomical substrates of any such deficits. Twenty left hemisphere stroke patients, ten of whom were apraxic, performed a task requiring identification of a named object in a visual display containing manipulation-related and unrelated distractor objects. Manipulation relationships among objects were not relevant to the identification task. Objects were cued with neutral ("S/he saw the…."), or action-relevant ("S/he used the….") sentences. Non-apraxic participants looked at use-related non-target objects significantly more than at unrelated non-target objects when cued both by neutral and action-relevant sentences, indicating that action information is incidentally activated. In contrast, apraxic participants showed delayed activation of manipulation-based action information during object identification when cued by neutral sentences. The magnitude of delayed activation in the neutral sentence condition was reliably predicted by lower scores on a test of gesture production to viewed objects, as well as by lesion loci in the inferior parietal and posterior temporal lobes. However, when cued by a sentence containing an action verb, apraxic participants showed fixation patterns that were statistically indistinguishable from non-apraxic controls. In support of grounded theories of cognition, these results suggest that apraxia and temporal-parietal lesions may be associated with abnormalities in incidental activation of action information from objects. Further, they suggest that the previously-observed facilitative role of action verbs in the retrieval of object-related action information extends to participants with apraxia.

Controversies over the mechanisms underlying the crucial role of the left fronto-parietal areas in the representation of tools

Anatomo-clinical and neuroimaging data show that the left fronto-parietal areas play an important role in representing tools. As manipulation is an important source of knowledge about tools, it has been assumed that motor activity explains the link between tool knowledge and the left fronto-parietal areas. However, controversies exist over the exact mechanisms underlying this relationship. According to a strong version of the “embodied cognition theory,” activation of a tool concept necessarily involves re-enactment of the corresponding kind of action. Impairment of the ability to use tools should, therefore, lead to impairment of tool knowledge. Both the “domains of knowledge hypothesis” and the “sensory-motor model of conceptual knowledge” refute the strong version of the “embodied cognition hypothesis” but acknowledge that manipulation and other action schemata play an important role in our knowledge of tools. The basic difference between these two models is that the former is based on an innate model and the latter holds that the brain’s organization of categories is experience dependent. Data supporting and arguing against each of these models are briefly reviewed. In particular, the following lines of research, which argue against the innate nature of the brain’s categorical organization, are discussed: (1) the observation that in patients with category-specific disorders the semantic impairment does not respect the boundaries between biological entities and artifact items; (2) data showing that experience-driven neuroplasticity in musicians is not confined to alterations of perceptual and motor maps but also leads to the establishment of higher-level semantic representations for musical instruments; (3) results of experiments using previously unfamiliar materials showing that the history of our sensory-motor experience with an object significantly affects its neural representation.

What happens to the motor theory of perception when the motor system is damaged?

Motor theories of perception posit that motor information is necessary for successful recognition of actions. Perhaps the most well known of this class of proposals is the motor theory of speech perception, which argues that speech recognition is fundamentally a process of identifying the articulatory gestures (i.e. motor representations) that were used to produce the speech signal. Here we review neuropsychological evidence from patients with damage to the motor system, in the context of motor theories of perception applied to both manual actions and speech. Motor theories of perception predict that patients with motor impairments will have impairments for action recognition. Contrary to that prediction, the available neuropsychological evidence indicates that recognition can be spared despite profound impairments to production. These data falsify strong forms of the motor theory of perception, and frame new questions about the dynamical interactions that govern how information is exchanged between input and output systems.

Tool manipulation knowledge is retrieved by way of the ventral visual object processing pathway

Using functional Magnetic Resonance Imaging (fMRI), we find that object manipulation knowledge is accessed by way of the ventral object processing pathway. We exploit the fact that parvocellular channels project to the ventral but not the dorsal stream, and show that increased neural responses for tool stimuli are observed in the inferior parietal lobule when those stimuli are visible only to the ventral object processing stream. In a control condition, tool-preferences were observed in a superior and posterior parietal region for stimuli titrated so as to be visible by the dorsal visual pathway. Functional connectivity analyses confirm the dissociation between sub-regions of parietal cortex according to whether their principal afferent input is via the ventral or dorsal visual pathway. These results challenge the 'Embodied Hypothesis of Tool Recognition', according to which tool identification critically depends on simulation of object manipulation knowledge. Instead, these data indicate that retrieval of object-associated manipulation knowledge is contingent on accessing the identity of the object, a process that is subserved by the ventral visual pathway.