Embodied Processing at Six Linguistic Granularity Levels: A Consensus Paper

Improving lexico-semantic integration with gesture-enriched pictures: A word-learning study using the Picture-Word Interference paradigm

This study aimed to evaluate the impact of static gesture cues on word learning and integration. Following embodied theories of language, gesture-enhanced images displaying the object-use gesture should favor learning and integration of object nouns. Sixty-two adult French speakers learned low-familiarity French nouns of manipulable objects (e.g., "étrille" - currycomb) with gesture-enhanced or neutral images during a short learning session. Immediately after, word recognition (lexical decision) and word production (Picture-Word Interference, PWI) tasks were used to evaluate the impact of image type on word learning and lexical integration, respectively. In the PWI, participants had to name a picture of a familiar object (e.g. "brosse" - brush) while ignoring a written distractor word. Words learned with gesture-enhanced or neutral images were used as distractors. Depending on the condition, they could be semantically related ("étrille" - currycomb) or unrelated ("burin" - chisel) to the target object to name. A control condition with unrelated distractor words not involved in learning ("salière" - salt shaker) was also added. Naming latencies in presence of related distractors, compared to unrelated distractors, indicated whether learned lexical representations engaged in competition during production. Lexical decision results did not show any influence of the image condition used during learning on word recognition. Critically, however, PWI results demonstrated that words trained with gesture-enhanced pictures entailed semantic interference effects during naming. Words trained with neutral pictures did not induce semantic interference. Findings highlight the relevance of gesture cues for lexico-semantic integration of object nouns and suggest considering the role of contextual images in vocabulary acquisition.

Invariant representations in abstract concept grounding - the physical world in grounded cognition

Grounded cognition states that mental representations of concepts consist of experiential aspects. For example, the concept "cup" consists of the sensorimotor experiences from interactions with cups. Typical modalities in which concepts are grounded are: The sensorimotor system (including interoception), emotion, action, language, and social aspects. Here, we argue that this list should be expanded to include physical invariants (unchanging features of physical motion; e.g., gravity, momentum, friction). Research on physical reasoning consistently demonstrates that physical invariants are represented as fundamentally as other grounding substrates, and therefore should qualify. We assess several theories of concept representation (simulation, conceptual metaphor, conceptual spaces, predictive processing) and their positions on physical invariants. We find that the classic grounded cognition theories, simulation and conceptual metaphor theory, have not considered physical invariants, while conceptual spaces and predictive processing have. We conclude that physical invariants should be included into grounded cognition theories, and that the core mechanisms of simulation and conceptual metaphor theory are well suited to do this. Furthermore, conceptual spaces and predictive processing are very promising and should also be integrated with grounded cognition in the future.

Linguistic markedness and body specificity in parity judgments: evidence from a go/no-go task

In two experiments we tested the contribution of linguistic markedness and affective evaluation (i.e., body specificity) to the representation of abstract numerical concepts, such as parity. To this end, we employed speeded parity judgments of digits (Exp 1) or number words (Exp 2) in a go/no-go task. Fifty right-handed participants completed four blocks of trials in each experiment. In two blocks, they responded to even numbers (2, 4, 6, or 8) and in the other two blocks they responded to odd numbers (1, 3, 7, or 9). In each pair of blocks, they responded once with their right hand and once with their left hand. Results revealed faster right-hand responses to even than to odd digits (Exp 1), and faster left-hand response to odd than to even number words (Exp 2). In addition, in both experiments, we found faster responses to small-odd than large-odd digits and number words. The results support the conclusion that the affective evaluation of parity and linguistic markedness makes independent contributions to the representation of parity.

On the embodied nature of knowledge: From neurons to numbers

Interdisciplinary investigations of the human mind through the cognitive sciences have identified a key role of the body in representing knowledge. After characterizing knowledge at grounded, embodied, and situated levels, number knowledge is analyzed from this hierarchical perspective. Lateralized cortical processing of coarse versus fine detail is identified as a grounding substrate for the population stereotype few/left, many/right, which then contributes to number-related sensory and motor biases at the embodied and situated levels. Implications of this perspective for education and rehabilitation are discussed.

The role of visual imagery in story reading: Evidence from aphantasia

Aphantasia is a condition in which people are unable to experience visual imagery. Since visual imagery is thought to be key to language processing, we hypothesized the experience of a story would differ between individuals with aphantasia and controls. Forty-seven individuals with aphantasia were compared to fifty-one matched controls on their experience of reading a short story and their general reading habits. Aphantasics were less likely to be engaged with, interested in, and absorbed in the story, and experienced reduced emotional engagement with and sympathy for the story characters, compared to controls. Yet, aphantasics and controls did not differ in how much they liked or appreciated the story, and in general, the reading habits of the two groups also did not differ. Results have implications for embodied theories of language, suggesting visual imagery may influence how a story is experienced, but it is not the only route to story enjoyment.

Articulation posture influences pitch during singing imagery

Facial muscle activity contributes to singing and to articulation: in articulation, mouth shape can alter vowel identity; and in singing, facial movement correlates with pitch changes. Here, we examine whether mouth posture causally influences pitch during singing imagery. Based on perception-action theories and embodied cognition theories, we predict that mouth posture influences pitch judgments even when no overt utterances are produced. In two experiments (total N = 160), mouth posture was manipulated to resemble the articulation of either /i/ (as in English meet; retracted lips) or /o/ (as in French rose; protruded lips). Holding this mouth posture, participants were instructed to mentally "sing" given songs (which were all positive in valence) while listening with their inner ear and, afterwards, to assess the pitch of their mental chant. As predicted, compared to the o-posture, the i-posture led to higher pitch in mental singing. Thus, bodily states can shape experiential qualities, such as pitch, during imagery. This extends embodied music cognition and demonstrates a new link between language and music.