Effects of relative embodiment in lexical and semantic processing of verbs

The role of emotion in acquisition of verb meaning

Children's earliest acquired words are often learned through sensorimotor experience, but it is less clear how children learn the meaning of concepts whose referents are less associated with sensorimotor experience. The Affective Embodiment Account postulates that children use emotional experience to learn more abstract word meanings. There is mixed evidence for this account; analyses using mega-study datasets suggest that negative or positively valenced abstract words are learned earlier than emotionally neutral abstract words, yet the relationship between sensorimotor experience and valence is inconsistent across different methods of operationalising sensorimotor experience. In the present study, we tested the Affective Embodiment Account specifically in the context of verb acquisition. We tested two semantic dimensions of sensorimotor experience: concreteness and embodiment ratings. Our analyses showed that more positive and negative abstract verbs are acquired at an earlier age than neutral abstract verbs, consistent with the Affective Embodiment Account. When sensorimotor experience is operationalised as embodiment, high embodiment verbs are acquired at an earlier age than low embodiment verbs, and there is further benefit for high embodiment and positively valenced verbs. The findings further clarify the role of Affective Embodiment as a mechanism of language acquisition.

The Italian Sensorimotor Norms: Perception and action strength measures for 959 words

Neuroscience research has provided evidence that semantic information is stored in a distributed brain network involved in sensorimotor and linguistic processing. More specifically, according to the embodied cognition accounts, the representation of concepts is deemed as grounded in our bodily states. For these reasons, normative measures of words should provide relevant information about the extent to which each word embeds perceptual and action properties. In the present study, we collected ratings for 959 Italian nouns and verbs from 398 volunteers, recruited via an online platform. The words were mostly taken from the Italian adaptation of the Affective Norms for English Words (ANEW). A pool of 145 verbs was added to the original set. All the words were rated on 11 sensorimotor dimensions: six perceptual modalities (vision, audition, taste, smell, touch, and interoception) and five effectors (hand-arm, foot-leg, torso, mouth, head). The new verbs were also rated on the ANEW dimensions. Results showed good reliability and consistency with previous studies. Relations between perceptual and motor dimensions are described and interpreted, along with relations between the sensorimotor and the affective dimensions. The currently developed dataset represents an important novelty, as it includes different word classes, i.e., both nouns and verbs, and integrates ratings of both sensorimotor and affective dimensions, along with other psycholinguistic parameters; all features only partially accomplished in previous studies.

Meaning in hand: Investigating shared mechanisms of motor imagery and sensorimotor simulation in language processing

There is substantial evidence to support grounded theories of semantic representation, however the mechanisms of simulation in most theories are underspecified. In the present study, we used an individual differences approach to test whether motor imagery may share some mechanisms with sensorimotor simulations engaged during semantic processing. We quantified individual differences in motor imagery ability via implicit imagery tasks and explicit imagery questionnaires and tested their relationship to sensorimotor effects in syntactic classification tasks. In Experiment 1 (N = 185) we tested relationships between motor imagery and semantic processing of body-object interaction meaning (BOI; the degree to which you can interact with a word's referent) and foot/leg action meaning. We observed two interactions between imagery ability measured on the Florida Praxis Imagery Questionnaire (FPIQ) and BOI effects in semantic processing (response time and accuracy). In both interactions poorer imagery ability was associated with null BOI effects, whereas better imagery was associated with BOI effects. We also observed faster and more accurate responses to verbs associated with more foot/leg action meaning than verbs with less foot/leg action meaning, but this foot/leg action effect did not significantly interact with individual differences in motor imagery. In Experiment 2 (N = 195) we tested whether the interactions observed in Experiment 1 were dependent on the object-directed nature of the actions, or whether similar effects would be observed for hand actions not associated with objects. We also expanded our investigation beyond hand and foot imagery to consider whole body imagery. We observed an interaction between performance on a hand laterality judgement task (HLJT; assessing hand motor imagery) and sensorimotor effects in semantic processing of verbs associated with hand/arm action meaning. Participants with the fastest responses on the most difficult trials of the HLJT showed no significant difference in their response times to words with high and low hand/arm action meaning. We also observed faster and more accurate responses to high relative to low embodiment verbs, but this sensorimotor effect did not interact with individual differences in motor imagery. The results suggest specific (and not general) associations, in that some, but not all forms of hand and object-directed motor imagery are related to sensorimotor effects in language processing of hand/arm action verbs and nouns describing objects that are easy to interact with. As such, hand and object-directed motor imagery may share mechanisms with sensorimotor simulation during semantic processing.

Embodiment of action-related language in the native and a late foreign language - An fMRI-study

Theories of embodied cognition postulate that language processing activates similar sensory-motor structures as when interacting with the environment. Only little is known about the neural substrate of embodiment in a foreign language (L2) as compared to the mother tongue (L1). In this fMRI study, we investigated embodiment of motor and non-motor action verbs in L1 and L2 including 31 late bilinguals. Half had German as L1 and French as L2, and the other half vice-versa. We collapsed across languages to avoid the confound between language and order of language acquisition. Region of interest analyses showed stronger activation in motor regions during L2 than during L1 processing, independently of the motor-relatedness of the verbs. Moreover, a stronger involvement of motor regions for motor-related as compared to non-motor-related verbs, similarly for L1 and L2, was found. Overall, the similarity between L1 and L2 embodiment seems to depend on individual and contextual factors.

Ultimate Grounding of Abstract Concepts: A Graded Account

Abstraction, one of the hallmarks of human cognition, continues to be the topic of a strong debate. The primary disagreement concerns whether or not abstract concepts can be accounted for within the scope of embodied cognition. In this paper, we introduce the embodied approach to conceptual knowledge and distinguish between embodiment and grounding, where grounding is the general term for how concepts initially acquire their meaning. Referring to numerous pieces of empirical evidence, we emphasise that, ultimately, all concepts are acquired via interaction with the world via two main pathways: embodiment and social interaction. The first pathway is direct and primarily involves action/perception, interoception and emotions. The second pathway is indirect, being mediated by language in particular. Evidence from neuroscience, psychology and cognitive linguistics shows these pathways have different properties, roles in cognition and temporal profiles. Human development also places revealing constraints on how children develop the ability to reason more abstractly as they grow up. We recognize language as a crucial cognitive faculty with several roles enabling the acquisition of abstract concepts indirectly. Three detailed case studies on body-specificity hypothesis, abstract verbs and mathematics are used to argue that a compelling case has accumulated in favour of the ultimate grounding of abstract concepts in an agent’s interaction with its world, primarily relying on the direct pathway. We consolidate the debate through multidisciplinary evidence for the idea that abstractness is a graded, rather than a binary property of concepts.

Does Embodiment of Verbs Influence Predicate Metaphor Processing in a Second Language? Evidence From Picture Priming

Distinct from nominal metaphors, predicate metaphors entail metaphorical abstraction from concrete verbs, which generally involve more action and stronger motor simulation than nouns. It remains unclear whether and how the concrete, embodied aspects of verbs are connected with abstract, disembodied thinking in the brains of L2 learners. Since English predicate metaphors are unfamiliar to Chinese L2 learners, the study of embodiment effect on English predicate metaphor processing may provide new evidence for embodied cognition and categorization models that remain controversial, and offer practical insights into L2 metaphor processing and pedagogy. Hence, we aim to investigate whether the embodiment of verbs, via the activation of sensorimotor information, influences two groups of L2 learners during their comprehension of conventional and novel predicate metaphors. The results show a significant effect of embodiment: a stronger facilitation for novel predicate metaphors in both higher-level and lower-level groups, and a weaker facilitation for conventional predicate metaphors in the lower-level group. The findings demonstrate preliminary evidence for a graded effect of embodiment on predicate metaphors processing, modulated by L2 proficiency and metaphor novelty. The study supports a hybrid view of embodied cognition and reveals that sensorimotor aspects of verbs may be the intermediate entity involved in the indirect categorization.

The Lancaster Sensorimotor Norms: multidimensional measures of perceptual and action strength for 40,000 English words

Sensorimotor information plays a fundamental role in cognition. However, the existing materials that measure the sensorimotor basis of word meanings and concepts have been restricted in terms of their sample size and breadth of sensorimotor experience. Here we present norms of sensorimotor strength for 39,707 concepts across six perceptual modalities (touch, hearing, smell, taste, vision, and interoception) and five action effectors (mouth/throat, hand/arm, foot/leg, head excluding mouth/throat, and torso), gathered from a total of 3,500 individual participants using Amazon’s Mechanical Turk platform. The Lancaster Sensorimotor Norms are unique and innovative in a number of respects: They represent the largest-ever set of semantic norms for English, at 40,000 words × 11 dimensions (plus several informative cross-dimensional variables), they extend perceptual strength norming to the new modality of interoception, and they include the first norming of action strength across separate bodily effectors. In the first study, we describe the data collection procedures, provide summary descriptives of the dataset, and interpret the relations observed between sensorimotor dimensions. We then report two further studies, in which we (1) extracted an optimal single-variable composite of the 11-dimension sensorimotor profile (Minkowski 3 strength) and (2) demonstrated the utility of both perceptual and action strength in facilitating lexical decision times and accuracy in two separate datasets. These norms provide a valuable resource to researchers in diverse areas, including psycholinguistics, grounded cognition, cognitive semantics, knowledge representation, machine learning, and big-data approaches to the analysis of language and conceptual representations. The data are accessible via the Open Science Framework (http://osf.io/7emr6/) and an interactive web application (https://www.lancaster.ac.uk/psychology/lsnorms/).

Heterogeneity in abstract verbs: An ERP study

It has been well documented that different types of nouns and action verbs are associated with behavioral and neural differences. In contrast, abstract verbs (e.g., think, dissolve) are often treated as a homogeneous category. We compared event-related potentials recorded during a syntactic classification task of four verb types; 1) abstract mental, 2) abstract emotional, 3) abstract nonbodily, and 4) concrete. Abstract nonbodily state verbs showed a sustained negativity at frontocentral electrodes and sustained positivity at parietal and occipital electrodes beginning 400 ms post-stimulus onset relative to abstract mental state and concrete verbs. Discrete source localization revealed a right inferior parietal source for all verbs and a distributed source estimation localized sources that distinguished between abstract mental state and abstract nonbodily state verbs to bilateral parietal cortex, left temporal cortex and right ventromedial prefrontal cortex. These findings suggest that different types of abstract verbs are associated with representational differences.

Heterogenous abstract concepts: is "ponder" different from "dissolve"?

words have usually been treated as a homogenous group, with limited investigation of the influence of different underlying representational systems for these words. In the present study we examined lexical-semantic processing of abstract verbs, separating them into mental state, emotional state and nonembodied state types. We used a syntactic classification task and a memory task to investigate behavioural differences amongst the abstract verb types. Semantic richness effects of each of the verbs' associates were then investigated to determine the relationship of linguistic associations to semantic processing response times for abstract verbs. We found a modest effect of abstract verb type, with mental state abstract verbs processed more quickly than nonembodied abstract verbs in the syntactic classification task; however, this effect was task dependent. We also found that memory was less accurate for the mental state abstract verbs. The semantic richness analysis of abstract verb associates revealed (1) that the concreteness of an abstract verb's associates has a positive relationship to the verb's response time and (2) a negative relationship between response time and age of acquisition for associates of nonembodied verbs. The results provide support for the proposal that abstract concepts engage complex representations in modal and linguistic systems.

Subthalamic nucleus activity in the processing of body and mental action verbs in people with Parkinson's disease

Local field potentials evoked by body action and mental action verbs were recorded in the subthalamic nucleus (STN) of 18 patients with Parkinson's disease through the electrodes implanted for deep brain stimulation. Compared with the medication on-condition, the medication off-condition showed a difference in activity in the early time segments, mainly in the right STN, with larger amplitudes for body action verbs. In the on-condition a similar pattern was detected in the left STN. These patterns of early differences in activity evoked by different types of verbs might indicate the potential of the STN to rapidly detect relevant behavioural clues in verbal content and to integrate these in subsequent cortico-subcortical interactions. In addition, these lateralizations allow speculations about shifts in processing activity correlating with dopaminergic denervation. Whether this detection relies on phonological, semantic or grammatical clues remains an open question.

Language as a disruptive technology: abstract concepts, embodiment and the flexible mind

A growing body of evidence suggests that cognition is embodied and grounded. Abstract concepts, though, remain a significant theoretical challenge. A number of researchers have proposed that language makes an important contribution to our capacity to acquire and employ concepts, particularly abstract ones. In this essay, I critically examine this suggestion and ultimately defend a version of it. I argue that a successful account of how language augments cognition should emphasize its symbolic properties and incorporate a view of embodiment that recognizes the flexible, multimodal and task-related nature of action, emotion and perception systems. On this view, language is an ontogenetically disruptive cognitive technology that expands our conceptual reach.This article is part of the theme issue 'Varieties of abstract concepts: development, use and representation in the brain'.

Fine Motor Skills Enhance Lexical Processing of Embodied Vocabulary: A Test of the Nimble-Hands, Nimble-Minds Hypothesis

Research suggests that fine motor skills (FMS) are linked to aspects of cognitive development in children. Additionally, lexical processing advantages exist for words implying a high body–object interaction (BOI), with initial findings indicating that such words in turn link to children's FMS—for which we propose and evaluate four competing hypotheses. First, a maturational account argues that any links between FMS and lexical processing should not exist once developmental variables are controlled for. Second, functionalism posits that any link between FMS and lexical processing arises due to environmental interactions. Third, the semantic richness hypothesis argues that sensorimotor input improves lexical processing, but predicts no links between FMS and lexical processing. A fourth account, the nimble-hands, nimble minds (NHNM) hypothesis, proposes that having greater FMS improves lexical processing for high-BOI words. In two experiments, the response latencies of preschool children ( n = 90, n = 76, ages = 5;1) to 45 lexical items encompassing high-BOI, low-BOI, and less imageable words were measured, alongside measures of FMS, reasoning, and general receptive/expressive vocabulary. High-BOI words appeared to show unique links to FMS, which remained after accounting for low-BOI and less imageable words, general vocabulary, reasoning, and chronological age. Although further work is needed, the findings provide initial support for the NHNM hypothesis.

Semantic Richness Effects in Syntactic Classification: The Role of Feedback

Words with richer semantic representations are recognized faster across a range of lexical processing tasks. The most influential account of this finding is based on the idea that semantic richness effects are mediated by feedback from semantic-level to lower-level representations. In an earlier lexical decision study, Yap et al. (2015) tested this claim by examining the joint effects of stimulus quality and four semantic richness dimensions (imageability, number of features, semantic neighborhood density, semantic diversity). The results of that study showed that joint effects of stimulus quality and richness were generally additive, consistent with the idea that semantic feedback does not typically reach the earliest levels of representation in lexical decision. The present study extends this earlier work by investigating the joint effects of stimulus quality and the same four semantic richness dimensions on syntactic classification performance (is this a noun or verb?), which places relatively more emphasis on semantic processing. Additive effects of stimulus quality and richness were found for two of the four targeted dimensions (concreteness, number of features) while semantic neighborhood density and semantic diversity did not seem to influence syntactic classification response times. These findings provide further support against the view that semantic information reaches early letter-level processes.

Effects of Emotional Experience in Lexical Decision

Previous research has examined the effects of emotional experience (i.e., the ease with which words evoke emotion information) in semantic categorization (SCT), word naming, and Stroop tasks (Newcombe et al., 2012; Siakaluk et al., 2014; Moffat et al., 2015). However, to date there are no published reports on whether emotional experience influences performance in the lexical decision task (LDT). In the present study, we examined the influence of emotional experience in LDT using three different stimulus sets. In Experiment 1 we used a stimulus set used by both Kousta et al. (2009; Experiment 1) and Yap and Seow (2014) that is comprised of 40 negative, 40 positive, and 40 neutral words; in Experiment 2 we used a stimulus set comprised of 150 abstract nouns; and in Experiment 3 we used a stimulus set comprised of 373 verbs. We observed facilitatory effects of emotional experience in each of the three experiments, such that words with higher emotional experience ratings were associated with faster response latencies. These results are important because the influence of emotional experience: (a) is observed in stimulus sets comprised of different types of words, demonstrating the generalizability of the effect in LDT; (b) accounts for LDT response latency variability above and beyond the influences of valence and arousal, and is thus a robust dimension of conceptual knowledge; (c) suggests that a richer representation of emotional experience provides more reliable evidence that a stimulus is a word, which facilitates responding in LDT; and (d) is consistent with grounded cognition frameworks that propose that emotion information may be grounded in bodily experience with the world (Barsalou, 2003, 2009; Vigliocco et al., 2009).

Is Moving More Memorable than Proving? Effects of Embodiment and Imagined Enactment on Verb Memory

Theories of embodied cognition propose that sensorimotor information is simulated during language processing (e.g., Barsalou, 1999). Previous studies have demonstrated that differences in simulation can have implications for word processing; for instance, lexical processing is facilitated for verbs that have relatively more embodied meanings (e.g., Sidhu et al., 2014). Here we examined the effects of these differences on memory for verbs. We observed higher rates of recognition (Experiments 1a-2a) and recall accuracy (Experiments 2b-3b) for verbs with a greater amount of associated bodily information (i.e., an embodiment effect). We also examined how this interacted with the imagined enactment effect: a memory benefit for actions that one imagines performing (e.g., Ditman et al., 2010). We found that these two effects did not interact (Experiment 3b), suggesting that the memory benefits of automatic simulation (i.e., the embodiment effect) and deliberate simulation (i.e., the imagined enactment effect) are distinct. These results provide evidence for the role of simulation in language processing, and its effects on memory.

Is More Always Better for Verbs? Semantic Richness Effects and Verb Meaning

We examined how several semantic richness variables contribute to verb meaning, across a number of tasks. Because verbs can vary in tense, and the manner in which tense is coded (i.e., regularity), we also examined how these factors moderated the effects of semantic richness. In Experiment 1 we found that age of acquisition (AoA), valence, arousal and embodiment predicted faster response times in LDT. In Experiment 2 we examined a particular semantic richness variable, verb embodiment, and found that it was moderated by tense and regularity. In Experiment 3a we found that AoA predicted faster response times in verb reading. Finally, in Experiment 3b, semantic diversity predicted response times in a past tense generation task, either facilitating or inhibiting responses for regular or irregular verbs, respectively. These results demonstrate that semantic richness variables contribute to verb meaning even when verbs are presented in isolation, and that these effects depend on several factors unique to verbs.

Emotions and language about motion: Differentiating affective dominance with syntax from valence with semantics

Motion as encoded in linguistic cues is used to differentiate affective valence and dominance. Participants were invited to rate their affective responses to different words along valence and dominance scales. The words were nouns describing static cues and verbs describing motion, connected to DOWN/UP and Avoidance/Approach cues. The results of three studies showed that valence and dominance could be differentiated through syntax and semantics of motion. On one hand, dominance feelings, compared to valence ones, are particularly influenced by motion encoded in syntactic classes (verbs vs. nouns). On the other hand, valence feelings, compared to dominance ones, are influenced by a semantics of motion through DOWN/UP and Avoidance/Approach cues, considered as polarities. A polarity correspondence effect is proposed to explain these results.

Developing embodied cognition: insights from children's concepts and language processing

Over the past decade, theories of embodied cognition have become increasingly influential with research demonstrating that sensorimotor experiences are involved in cognitive processing; however, this embodied research has primarily focused on adult cognition. The notion that sensorimotor experience is important for acquiring conceptual knowledge is not a novel concept for developmental researchers, and yet theories of embodied cognition often do not fully integrate developmental findings. We propose that in order for an embodied cognition perspective to be refined and advanced as a lifelong theory of cognition, it is important to consider what can be learned from research with children. In this paper, we focus on development of concepts and language processing, and examine the importance of children's embodied experiences for these aspects of cognition in particular. Following this review, we outline what we see as important developmental issues that need to be addressed in order to determine the extent to which language and conceptual knowledge are embodied and to refine theories of embodied cognition.