Are Automatic Conceptual Cores the Gold Standard of Semantic Processing? The Context-Dependence of Spatial Meaning in Grounded Congruency Effects

Experiential traces first: Does holding a location in visuospatial working memory affect the processing of space-associated words?

This study aimed to systematically examine whether actively maintaining a visual location in working memory can influence the processing of spatially related words. In five experiments, we asked participants to maintain either the location or the shape of a visually presented stimulus in working memory so that it could later be compared with a test stimulus concerning the relevant target features. In between, we presented participants with words that refer to objects typically encountered in the upper or lower vertical space (roof vs. root, respectively). The task participants performed as a response to these words differed between experiments. In Experiments 1-3, participants performed a lexical decision task, in Experiment 4 they performed a semantic task (deciding whether the word refers to an occupation), and in Experiment 5 they performed a spatial task (deciding whether the word refers to something in the upper or lower visual field.) Only in Experiment 5 did we observe an interaction between the position of the visual stimulus held in working memory (up vs. down) and the meaning of the spatial words (associated with up vs. down). Our results therefore suggest that actively maintaining a stimulus location in working memory does not automatically affect the processing of spatially related words, but does so if the relevant spatial dimension is made highly salient by the task. The results are thus in line with studies showing a strong context-dependency of embodiment effects and thus allow the conclusion that language processing proper is not operating on a sensorimotor representational format.

To what extent do children's expressions of time actually refer to time? An investigation into the temporal and discursive usages of temporal adverbs in family interaction

Many studies have explored children's acquisition of temporal adverbs. However, the extent to which children's early temporal language has discursive instead of solely temporal meanings has been largely ignored. We report two corpus-based studies that investigated temporal adverbs in Finnish child-parent interaction between the children's ages of 1;7 and 4;11. Study 1 shows that the two corpus children used temporal adverbs to construe both temporal and discursive meanings from their early adverb production and that the children's usage syntactically broadly reflected the input received. Study 2 shows that the discursive uses of adverbs appeared to be learned from contextually anchored caregiver constructions that convey discourse functions like urging and reassuring, and that the usage is related to the children's and caregivers' interactional roles. Our study adds to the literature on the acquisition of temporal adverbs by demonstrating that these items are learned also with additional discursive meanings in family interaction.

Flexible and fine-grained simulation of speed in language processing

According to the embodied cognition theory, language comprehension is achieved through mental simulation. This account is supported by a number of studies reporting action simulations during language comprehension. However, which details of sensory-motor experience are included in these simulations is still controversial. Here, three experiments were carried out to examine the simulation of speed in action language comprehension. Experiment 1 adopted a lexical decision task and a semantic similarity judgment task on isolated fast and slow action verbs. It has been shown that fast action verbs were processed significantly faster than slow action verbs when deep semantic processing is required. Experiment 2 and Experiment 3 investigated the contextual influence on the simulation of speed, showing that the processing of verbs, either depicting fast actions or neutral actions, would be slowed down when embedded in the slow action sentences. These experiments together demonstrate that the fine-gained information, speed, is an important part of action representation and can be simulated but may not in an automatic way. Moreover, the speed simulation is flexible and can be modulated by the context.

The influence of sentence focus on mental simulation: A possible cause of ACE instability

Recent studies have revealed the instability of the action-sentence compatibility effect (ACE). The current study was designed to demonstrate the hypothesis that the instability of the ACE may be attributed to the instability of focused information in a sentence. A pilot study indicated that the focused information of sentences was relatively stable in the sentence-picture verification task but exhibited significant interindividual variability in the action-sentence compatibility paradigm in previous studies. Experiments 1 and 2 examined the effect of sentence focus on the shape match effect and the ACE by manipulating the focused information of sentences using the focus marker word "" (is). Experiment 1 found that the shape match effect occurred in the original sentence, while it disappeared when the word "" (is) was used to make an object noun no longer the focus of a sentence. Experiment 2 failed to observe the ACE regardless of whether the sentence focus was on the action information. Experiment 3 modified the focus manipulation to observe its impact on the ACE using different fonts and underlines to highlight the focused information. The results indicated that the ACE only occurred when the action information was the sentence focus. These findings suggest that sentence focus influences mental simulation, and the instability of the ACE is likely to be associated with the instability of sentence focus in previous studies. This outcome highlights the crucial role of identifying specific information as the critical element expressed in the current linguistic context for successful simulation.

Modal and amodal cognition: an overarching principle in various domains of psychology

Accounting for how the human mind represents the internal and external world is a crucial feature of many theories of human cognition. Central to this question is the distinction between modal as opposed to amodal representational formats. It has often been assumed that one but not both of these two types of representations underlie processing in specific domains of cognition (e.g., perception, mental imagery, and language). However, in this paper, we suggest that both formats play a major role in most cognitive domains. We believe that a comprehensive theory of cognition requires a solid understanding of these representational formats and their functional roles within and across different domains of cognition, the developmental trajectory of these representational formats, and their role in dysfunctional behavior. Here we sketch such an overarching perspective that brings together research from diverse subdisciplines of psychology on modal and amodal representational formats so as to unravel their functional principles and their interactions.

The Primacy of Experience in Language Processing: Semantic Priming Is Driven Primarily by Experiential Similarity

The organization of semantic memory, including memory for word meanings, has long been a central question in cognitive science. Although there is general agreement that word meaning representations must make contact with sensory-motor and affective experiences in a non-arbitrary fashion, the nature of this relationship remains controversial. One prominent view proposes that word meanings are represented directly in terms of their experiential content (i.e., sensory-motor and affective representations). Opponents of this view argue that the representation of word meanings reflects primarily taxonomic structure, that is, their relationships to natural categories. In addition, the recent success of language models based on word co-occurrence (i.e., distributional) information in emulating human linguistic behavior has led to proposals that this kind of information may play an important role in the representation of lexical concepts. We used a semantic priming paradigm designed for representational similarity analysis (RSA) to quantitatively assess how well each of these theories explains the representational similarity pattern for a large set of words. Crucially, we used partial correlation RSA to account for intercorrelations between model predictions, which allowed us to assess, for the first time, the unique effect of each model. Semantic priming was driven primarily by experiential similarity between prime and target, with no evidence of an independent effect of distributional or taxonomic similarity. Furthermore, only the experiential models accounted for unique variance in priming after partialling out explicit similarity ratings. These results support experiential accounts of semantic representation and indicate that, despite their good performance at some linguistic tasks, the distributional models evaluated here do not encode the same kind of information used by the human semantic system.

Ecological Meanings: A Consensus Paper on Individual Differences and Contextual Influences in Embodied Language

Embodied theories of cognition consider many aspects of language and other cognitive domains as the result of sensory and motor processes. In this view, the appraisal and the use of concepts are based on mechanisms of simulation grounded on prior sensorimotor experiences. Even though these theories continue receiving attention and support, increasing evidence indicates the need to consider the flexible nature of the simulation process, and to accordingly refine embodied accounts. In this consensus paper, we discuss two potential sources of variability in experimental studies on embodiment of language: individual differences and context. Specifically, we show how factors contributing to individual differences may explain inconsistent findings in embodied language phenomena. These factors include sensorimotor or cultural experiences, imagery, context-related factors, and cognitive strategies. We also analyze the different contextual modulations, from single words to sentences and narratives, as well as the top-down and bottom-up influences. Similarly, we review recent efforts to include cultural and language diversity, aging, neurodegenerative diseases, and brain disorders, as well as bilingual evidence into the embodiment framework. We address the importance of considering individual differences and context in clinical studies to drive translational research more efficiently, and we indicate recommendations on how to correctly address these issues in future research. Systematically investigating individual differences and context may contribute to understanding the dynamic nature of simulation in language processes, refining embodied theories of cognition, and ultimately filling the gap between cognition in artificial experimental settings and cognition in the wild (i.e., in everyday life).

Consensus Paper: Current Perspectives on Abstract Concepts and Future Research Directions

concepts are relevant to a wide range of disciplines, including cognitive science, linguistics, psychology, cognitive, social, and affective neuroscience, and philosophy. This consensus paper synthesizes the work and views of researchers in the field, discussing current perspectives on theoretical and methodological issues, and recommendations for future research. In this paper, we urge researchers to go beyond the traditional abstract-concrete dichotomy and consider the multiple dimensions that characterize concepts (e.g., sensorimotor experience, social interaction, conceptual metaphor), as well as the mediating influence of linguistic and cultural context on conceptual representations. We also promote the use of interactive methods to investigate both the comprehension and production of abstract concepts, while also focusing on individual differences in conceptual representations. Overall, we argue that abstract concepts should be studied in a more nuanced way that takes into account their complexity and diversity, which should permit us a fuller, more holistic understanding of abstract cognition.

Grounded Cognition Entails Linguistic Relativity: A Neglected Implication of a Major Semantic Theory

According to the popular Grounded Cognition Model (GCM), the sensory and motor features of concepts, including word meanings, are stored directly within neural systems for perception and action. More precisely, the core claim is that these concrete conceptual features reuse some of the same modality-specific representations that serve to categorize experiences involving the relevant kinds of objects and events. Research in semantic typology, however, has shown that word meanings vary significantly across the roughly 6500 languages in the world. I argue that this crosslinguistic semantic diversity has significant yet previously unrecognized theoretical consequences for the GCM. In particular, to accommodate the typological data, the GCM must assume that the concrete features of word meanings are not merely stored within sensory/motor brain systems, but are represented there in ways that are, to a nontrivial degree, language-specific. Moreover, it must assume that these conceptual representations are also activated during the nonlinguistic processing of the relevant kinds of objects and events (e.g., during visual perception and action planning); otherwise, they would not really be grounded, which is to say, embedded inside sensory/motor systems. Crucially, however, such activations would constitute what is traditionally called linguistic relativity-that is, the influence of language-specific semantic structures on other forms of cognition. The overarching aim of this paper is to elaborate this argument more fully and explore its repercussions. To that end, I discuss in greater detail the key aspects of the GCM, the evidence for crosslinguistic semantic diversity, pertinent work on linguistic relativity, the central claim that the GCM entails linguistic relativity, some initial supporting results, and some important limitations and future directions.

Conceptual representations in the default, control and attention networks are task-dependent and cross-modal

Conceptual knowledge is central to human cognition. Neuroimaging studies suggest that conceptual processing involves modality-specific and multimodal brain regions in a task-dependent fashion. However, it remains unclear (1) to what extent conceptual feature representations are also modulated by the task, (2) whether conceptual representations in multimodal regions are indeed cross-modal, and (3) how the conceptual system relates to the large-scale functional brain networks. To address these issues, we conducted multivariate pattern analyses on fMRI data. 40 participants performed three tasks-lexical decision, sound judgment, and action judgment-on written words. We found that (1) conceptual feature representations are strongly modulated by the task, (2) conceptual representations in several multimodal regions are cross-modal, and (3) conceptual feature retrieval involves the default, frontoparietal control, and dorsal attention networks. Conceptual representations in these large-scale networks are task-dependent and cross-modal. Our findings support theories that assume conceptual processing to rely on a flexible, multi-level architecture.

The Situated Assessment Method (SAM2): Establishing individual differences in habitual behavior

From the perspectives of grounded, situated, and embodied cognition, we have developed a new approach for assessing individual differences. Because this approach is grounded in two dimensions of situatedness-situational experience and the Situated Action Cycle-we refer to it as the Situated Assessment Method (SAM2). Rather than abstracting over situations during assessment of a construct (as in traditional assessment instruments), SAM2 assesses a construct in situations where it occurs, simultaneously measuring factors from the Situated Action Cycle known to influence it. To demonstrate this framework, we developed the SAM2 Habitual Behavior Instrument (SAM2 HBI). Across three studies with a total of 442 participants, the SAM2 HBI produced a robust and replicable pattern of results at both the group and individual levels. Trait-level measures of habitual behavior exhibited large reliable individual differences in the regularity of performing positive versus negative habits. Situational assessments established large effects of situations and large situation by individual interactions. Several sources of evidence demonstrated construct and content validity for SAM2 measures of habitual behavior. At both the group and individual levels, these measures were associated with factors from the Situated Action Cycle known to influence habitual behavior in the literature (consistency, automaticity, immediate reward, long-term reward). Regressions explained approximately 65% of the variance at the group level and a median of approximately 75% at the individual level. SAM2 measures further exhibited well-established interactions with personality measures for self-control and neuroticism. Cognitive-affective processes from the Situated Action Cycle explained nearly all the variance in these interactions. Finally, a composite measure of habitualness established habitual behaviors at both the group and individual levels. Additionally, a composite measure of reward was positively related to the composite measure of habitualness, increasing with self-control and decreasing with neuroticism.

Continuous cursor-captured conceptual competition: Investigating the spatiotemporal dynamics of spoken word comprehension

Semantically related concepts are coactivated during spoken word comprehension. Two internet-mediated cursor-tracking experiments examined the spatiotemporal dynamics of this coactivation. Participants viewed visual arrays containing images of a target (e.g., accordion) and a semantically related (e.g., banjo) or unrelated (e.g., plum) distractor whilst hearing the target word (e.g., "accordion"). Participants were tasked with moving their cursor from the bottom of the visual array to the target in one of the upper corners. In contrast to Experiment 1, the onset of stimulus presentation was triggered by cursor movement in Experiment 2. Across both experiments, temporal (e.g., RT) and spatial (e.g., AUC) measures revealed significantly greater attraction to images of semantically related compared with unrelated distractors. These results reveal that online cursor-tracking methods are sensitive to semantic competition and suitable for studying the activation of semantic knowledge during language comprehension.

Space-valence mapping of social concepts: Do we arrange negative and positive ethnic stereotypes from left to right?

Introduction

The body-specificity hypothesis states that in right-handers, positive concepts should be associated with the right side and negative concepts with the left side of the body. Following this hypothesis, our study postulated that negative out-group ethnic stereotypes would be associated with the left side, and positive in-group stereotypes would be associated with the right side.

Methods

The experiment consisted of two parts. First, we measured the spatial mapping of ethnic stereotypes by using a sensibility judgment task, in which participants had to decide whether a sentence was sensible or not by pressing either a left or a right key. The sentences included German vs. Arabic proper names. Second, we measured implicit ethnic stereotypes in the same participants using the Go/No-go Association Task (GNAT), in which Arabic vs. German proper names were presented in combination with positive vs. negative adjectives. Right-handed German native speakers (N = 92) participated in an online study.

Results

As predicted, in the GNAT, participants reacted faster to German names combined with positive adjectives and to Arabic names combined with negative adjectives, which is diagnostic of existing valenced in-and outgroup ethnic stereotypes. However, we failed to find any reliable effects in the sensibility judgment task, i.e., there was no evidence of spatial mapping of positive and negative ethnic stereotypes. There was no correlation between the results of the two tasks at the individual level. Further Bayesian analysis and exploratory analysis in the left-handed subsample (N = 9) corroborated the evidence in favor of null results.

Discussion

Our study suggests that ethnic stereotypes are not automatically mapped in a body-specific manner.

Motor features of abstract verbs determine their representations in the motor system

Embodied cognition theory posits that concept representations inherently rely on sensorimotor experiences that accompany their acquisitions. This is well established through concrete concepts. However, it is debatable whether representations of abstract concepts are based on sensorimotor representations. This study investigated the causal role of associated motor experiences that accompany concept acquisition in the involvement of the motor system in the abstract verb processing. Through two experiments, we examined the action–sentence compatibility effect, in the test phase after an increase in motor features during the learning phase for abstract verbs with low motor features (Experiment 1) or novel words with no conceptual features at all (Experiment 2). After associated motor experiences were added in the word learning phase, action–sentence compatibility effect was found in the semantic processing tasks during the test phase for abstract verbs (Experiment 1a) and novel words (Experiment 2). This was lacking in the word font color judgment task requiring no semantic processing (Experiment 1b). Coupled with our previous study, these findings suggest that motor features formed during word learning could causally affect embodiment in the motor system for abstract verbs, and reactivation of motor experiences in abstract verb processing depends on a given task’s demands. Our study supports the view that conceptual representations, even abstract concepts, can be grounded in sensorimotor experiences.

Copredication in Context: A Predictive Processing Approach

We propose a cognitive‐psychological model of linguistic intuitions about copredication statements. In copredication statements, like “The book is heavy and informative,” the nominal denotes two ontologically distinct entities at the same time. This has been considered a problem for standard truth‐conditional semantics. In this paper, we discuss two questions that have so far received less attention: What kinds of word representations and cognitive mechanisms are responsible for judgments about the felicitousness of copredication statements? Relatedly, why can similar copredication statements have different degrees of felicitousness? We first propose a cognitive‐computational model of copredication within the predictive processing framework. We then suggest that certain asymmetries in felicitousness judgments can be modeled in terms of a set of expectations that are influenced by higher‐order priors associated with discourse context and world knowledge.

The limits of automatic sensorimotor processing during word processing: investigations with repeated linguistic experience, memory consolidation during sleep, and rich linguistic learning contexts

While a number of studies have repeatedly demonstrated an automatic activation of sensorimotor experience during language processing in the form of action-congruency effects, as predicted by theories of grounded cognition, more recent research has not found these effects for words that were just learned from linguistic input alone, without sensorimotor experience with their referents. In the present study, we investigate whether this absence of effects can be attributed to a lack of repeated experience and consolidation of the associations between words and sensorimotor experience in memory. To address these issues, we conducted four experiments in which (1 and 2) participants engaged in two separate learning phases in which they learned novel words from language alone, with an intervening period of memory-consolidating sleep, and (3 and 4) we employed familiar words whose referents speakers have no direct experience with (such as plankton). However, we again did not observe action-congruency effects in subsequent test phases in any of the experiments. This indicates that direct sensorimotor experience with word referents is a necessary requirement for automatic sensorimotor activation during word processing.

Task-Dependent Functional and Effective Connectivity during Conceptual Processing

Conceptual knowledge is central to cognition. Previous neuroimaging research indicates that conceptual processing involves both modality-specific perceptual-motor areas and multimodal convergence zones. For example, our previous functional magnetic resonance imaging (fMRI) study revealed that both modality-specific and multimodal regions respond to sound and action features of concepts in a task-dependent fashion (Kuhnke P, Kiefer M, Hartwigsen G. 2020b. Task-dependent recruitment of modality-specific and multimodal regions during conceptual processing. Cereb Cortex. 30:3938–3959.). However, it remains unknown whether and how modality-specific and multimodal areas interact during conceptual tasks. Here, we asked 1) whether multimodal and modality-specific areas are functionally coupled during conceptual processing, 2) whether their coupling depends on the task, 3) whether information flows top-down, bottom-up or both, and 4) whether their coupling is behaviorally relevant. We combined psychophysiological interaction analyses with dynamic causal modeling on the fMRI data of our previous study. We found that functional coupling between multimodal and modality-specific areas strongly depended on the task, involved both top-down and bottom-up information flow, and predicted conceptually guided behavior. Notably, we also found coupling between different modality-specific areas and between different multimodal areas. These results suggest that functional coupling in the conceptual system is extensive, reciprocal, task-dependent, and behaviorally relevant. We propose a new model of the conceptual system that incorporates task-dependent functional interactions between modality-specific and multimodal areas.

Semantic memory: A review of methods, models, and current challenges

Adult semantic memory has been traditionally conceptualized as a relatively static memory system that consists of knowledge about the world, concepts, and symbols. Considerable work in the past few decades has challenged this static view of semantic memory, and instead proposed a more fluid and flexible system that is sensitive to context, task demands, and perceptual and sensorimotor information from the environment. This paper (1) reviews traditional and modern computational models of semantic memory, within the umbrella of network (free association-based), feature (property generation norms-based), and distributional semantic (natural language corpora-based) models, (2) discusses the contribution of these models to important debates in the literature regarding knowledge representation (localist vs. distributed representations) and learning (error-free/Hebbian learning vs. error-driven/predictive learning), and (3) evaluates how modern computational models (neural network, retrieval-based, and topic models) are revisiting the traditional "static" conceptualization of semantic memory and tackling important challenges in semantic modeling such as addressing temporal, contextual, and attentional influences, as well as incorporating grounding and compositionality into semantic representations. The review also identifies new challenges regarding the abundance and availability of data, the generalization of semantic models to other languages, and the role of social interaction and collaboration in language learning and development. The concluding section advocates the need for integrating representational accounts of semantic memory with process-based accounts of cognitive behavior, as well as the need for explicit comparisons of computational models to human baselines in semantic tasks to adequately assess their psychological plausibility as models of human semantic memory.

When Abstract Concepts Rely on Multiple Metaphors: Metaphor Selection in the Case of Power

The study examines metaphor selection for the same abstract concept when multiple concrete dimensions are available for use. Drawing on the power concept, four studies investigated the roles of attention and visual features of concrete dimensions in metaphoric mapping. In Studies 1 and 2, two concrete dimensions (vertical space and size) were visually connected to power-related target words simultaneously, and one was salient. Attention driven by stimulus saliency allowed the attended concrete dimension to have a higher activation level and to be used. In Studies 3 and 4, the attended and the non-attended concrete dimensions were presented separately, and the latter was visually associated with power-related target words. This time, the attended dimension did not have an activation advantage, allowing the non-attended dimension to be used for metaphoric mapping simultaneously. The findings suggest that attention is important, but not necessary, and that features of concrete dimensions can guide metaphor use.

Avoiding Conflict: When Speaker Coordination Does Not Require Conceptual Agreement

In this paper we discuss the socialization hypothesis-the idea that speakers of the same (linguistic) community should share similar concepts given that they are exposed to similar environments and operate in highly-coordinated social contexts-and challenge the fact that it is assumed to constitute a prerequisite to successful communication. We do so using distributional semantic models of meaning (DSMs) which create lexical representations via latent aggregation of co-occurrence information between words and contexts. We argue that DSMs constitute particularly adequate tools for exploring the socialization hypothesis given that 1) they provide full control over the notion of background environment, formally characterized as the training corpus from which distributional information is aggregated; and 2) their geometric structure allows for exploiting alignment-based similarity metrics to measure inter-subject alignment over an entire semantic space, rather than a set of limited entries. We propose to model coordination between two different DSMs trained on two distinct corpora as dimensionality selection over a dense matrix obtained via Singular Value Decomposition This approximates an ad-hoc coordination scenario between two speakers as the attempt to align their similarity ratings on a set of word pairs. Our results underline the specific way in which linguistic information is spread across singular vectors, and highlight the need to distinguish agreement from mere compatibility in alignment-based notions of conceptual similarity. Indeed, we show that compatibility emerges from idiosyncrasy so that the unique and distinctive aspects of speakers' background experiences can actually facilitate-rather than impede-coordination and communication between them. We conclude that the socialization hypothesis may constitute an unnecessary prerequisite to successful communication and that, all things considered, communication is probably best formalized as the cooperative act of avoiding conflict, rather than maximizing agreement.

The influence of congruency proportion, target eccentricity, and valence strength on the spatial-valence metaphoric congruency effect in a word valence judgment task

In a word valence judgment task, positive words (e.g., excellence) are judged faster when presented at the top (congruent position) than at the bottom of the screen (incongruent position), whereas the opposite pattern occurs for negative words (e.g., disaster). This spatial-valence metaphoric congruency effect reflects top-positive/bottom-negative metaphoric association and may be attributed to at least three possible mechanisms: spreading activation between spatial and valence concepts (activation account), epistemic function that a conceptual metaphor serves to reduce the uncertainty associated with valence concepts (epistemic account), and/or the extent to which spatial-valence metaphoric association is relevant to task demand (relevance account). In three experiments, we manipulated congruency proportion, target eccentricity, and valence strength in a word valence judgment task to test these three possible accounts. Results showed that the metaphoric congruency effect was larger when a high (vs. equal) proportion of targets appears in congruent, relative to incongruent, position, and for targets with strong (vs. weak) valence. However, the effect in reaction time measure was not modulated by whether the target appeared in the position being near vs. far away from the center of the screen. The overall findings are better accommodated by the relevance account. The implications of the current findings on other theoretical accounts, such as Conceptual Metaphor Theory and polarity correspondence account, are also discussed.

The Embodied Penman: Effector-Specific Motor-Language Integration During Handwriting

Several studies have illuminated how processing manual action verbs (MaVs) affects the programming or execution of concurrent hand movements. Here, to circumvent key confounds in extant designs, we conducted the first assessment of motor-language integration during handwriting-a task in which linguistic and motoric processes are co-substantiated. Participants copied MaVs, non-manual action verbs, and non-action verbs as we collected measures of motor programming and motor execution. Programming latencies were similar across conditions, but execution was faster for MaVs than for the other categories, regardless of whether word meanings were accessed implicitly or explicitly. In line with the Hand-Action-Network Dynamic Language Embodiment (HANDLE) model, such findings suggest that effector-congruent verbs can prime manual movements even during highly automatized tasks in which motoric and verbal processes are naturally intertwined. Our paradigm opens new avenues for fine-grained explorations of embodied language processes.

Influences of task and attention on action verb congruence effects: How automatic are embodiment effects?

Three experiments investigated changes in the sizes of Stroop-like congruency effects of hand- and foot-related action verbs on the latencies of hand and foot motor responses. Congruency effects were present in all experiments, with faster responses for a verb associated with the responding limb than for a verb associated with the opposite limb (e.g., faster foot than hand responses in the presence of the verb "kick"). As compared with a task in which the verbs were completely irrelevant, this congruency effect was greatly increased when participants had to make lexical decisions about the verbs, and the effect was also increased-although to a lesser extent-when participants had to make physical (i.e., size) judgments about them. In some cases, the congruence effect was also larger when the hand/foot discrimination response was determined by a reading task than by a color discrimination task. We conclude that the Stroop-like congruence effects of action verbs do not result from fully automatic processing but instead depend on at least the duration and linguistic nature of verb processing.

Left posterior inferior parietal cortex causally supports the retrieval of action knowledge

Conceptual knowledge is central to human cognition. The left posterior inferior parietal lobe (pIPL) is implicated by neuroimaging studies as a multimodal hub representing conceptual knowledge related to various perceptual-motor modalities. However, the causal role of left pIPL in conceptual processing remains unclear. Here, we transiently disrupted left pIPL function with transcranial magnetic stimulation (TMS) to probe its causal relevance for the retrieval of action and sound knowledge. We compared effective TMS over left pIPL with sham TMS, while healthy participants performed three different tasks-lexical decision, action judgment, and sound judgment-on words with a high or low association to actions and sounds. We found that pIPL-TMS selectively impaired action judgments on low sound-low action words. For the first time, we directly related computational simulations of the TMS-induced electrical field to behavioral performance, which revealed that stronger stimulation of left pIPL is associated with worse performance for action but not sound judgments. These results indicate that left pIPL causally supports conceptual processing when action knowledge is task-relevant and cannot be compensated by sound knowledge. Our findings suggest that left pIPL is specialized for the retrieval of action knowledge, challenging the view of left pIPL as a multimodal conceptual hub.

Challenges and Opportunities for Grounding Cognition

According to the grounded perspective, cognition emerges from the interaction of classic cognitive processes with the modalities, the body, and the environment. Rather than being an autonomous impenetrable module, cognition incorporates these other domains intrinsically into its operation. The Situated Action Cycle offers one way of understanding how the modalities, the body, and the environment become integrated to ground cognition. Seven challenges and opportunities are raised for this perspective: (1) How does cognition emerge from the Situated Action Cycle and in turn support it? (2) How can we move beyond simply equating embodiment with action, additionally establishing how embodiment arises in the autonomic, neuroendocrine, immune, cardiovascular, respiratory, digestive, and integumentary systems? (3) How can we better understand the mechanisms underlying multimodal simulation, its functions across the Situated Action Cycle, and its integration with other representational systems? (4) How can we develop and assess theoretical accounts of symbolic processing from the grounded perspective (perhaps using the construct of simulators)? (5) How can we move beyond the simplistic distinction between concrete and abstract concepts, instead addressing how concepts about the external and internal worlds pattern to support the Situated Action Cycle? (6) How do individual differences emerge from different populations of situational memories as the Situated Action Cycle manifests itself differently across individuals? (7) How can constructs from grounded cognition provide insight into the replication and generalization crises, perhaps from a quantum perspective on mechanisms (as exemplified by simulators).

Polarities influence implicit associations between colour and emotion

Colours are linked to emotional concepts. Research on the effect of red in particular has been extensive, and evidence shows that positive as well as negative associations can be salient in different contexts. In this paper, we investigate the impact of the contextual factor of polarity. According to the polarity-correspondence principle, negative and positive category poles are assigned to the binary response categories (here positive vs. negative valence) and the perceptual dimension (green vs. red) in a discrimination task. Response facilitation occurs only where the conceptual category (valence) and the perceptual feature (colour) share the same pole (i.e., where both are plus or both are minus). We asked participants (n = 140) to classify the valence of green and red words within two types of blocks: (a) where all words were of the same colour (monochromatic conditions) providing no opposition in the perceptual dimension, and (b) where red and green words were randomly mixed (mixed-colour conditions). Our results show that red facilitates responses to negative words when the colour green is present (mixed-colour conditions) but not when it is absent (monochromatic conditions). This is in line with the polarity-correspondence principle, but colour-specific valence-affect associations contribute to the found effects.

Object combination in mental simulations

Studies on the presence of mental simulations during language comprehension have typically focused only on single object properties. This study investigates whether two objects are combined in mental simulations, and whether this is influenced by task instructions. In both experiments, participants read sentences describing animals using a tool in some way. After each sentence, they saw an image of a cartoon animal holding a tool, and they indicated whether the animal (Experiment 1) or the tool (Experiment 2) was mentioned in the previous sentence or not. The shown image completely matched, partially matched, partially mismatched, or completely mismatched the preceding sentence. In total, 90 Dutch psychology students took part in Experiment 1, and 92 students took part in Experiment 2, both experiments were pre-registered. The results suggest that mental simulations indeed combine multiple objects during language comprehension and that this is not influenced by task instructions. Regardless of the instruction type, participants always responded quickest in the complete match condition compared to the partial match condition, suggesting that language comprehension leads to the creation of a complete mental simulation.

Task-Dependent Recruitment of Modality-Specific and Multimodal Regions during Conceptual Processing

Conceptual knowledge is central to cognitive abilities such as word comprehension. Previous neuroimaging evidence indicates that concepts are at least partly composed of perceptual and motor features that are represented in the same modality-specific brain regions involved in actual perception and action. However, it is unclear to what extent the retrieval of perceptual-motor features and the resulting engagement of modality-specific regions depend on the concurrent task. To address this issue, we measured brain activity in 40 young and healthy participants using functional magnetic resonance imaging, while they performed three different tasks-lexical decision, sound judgment, and action judgment-on words that independently varied in their association with sounds and actions. We found neural activation for sound and action features of concepts selectively when they were task-relevant in brain regions also activated during auditory and motor tasks, respectively, as well as in higher-level, multimodal regions which were recruited during both sound and action feature retrieval. For the first time, we show that not only modality-specific perceptual-motor areas but also multimodal regions are engaged in conceptual processing in a flexible, task-dependent fashion, responding selectively to task-relevant conceptual features.

Core features: measures and characterization for different languages

According to the feature-based view of semantic representation, concepts can be represented as distributed networks of semantic features, which contribute with different weights to determine the overall meaning of a concept. The study of semantic features, typically collected in property generation tasks, is enriched with measures indicating the informativeness and distinctiveness of a given feature for the related concepts. However, while these measures have been provided in several languages (e.g. Italian, Spanish and English), they have hardly been applied comparatively across languages. The purpose of this paper is to investigate language-related differences and similarities emerging from the semantic representation of aggregated core features. Features with higher salience for a set of concrete concepts are identified and described in terms of their feature type. Then, comparisons are made between domains (natural vs. artefacts) and languages (Italian, Spanish and English) and descriptive statistics are provided. These results show that the characterization of concrete concepts is overall fairly stable across languages, although interesting cross-linguistic differences emerged. We will discuss the implications of our findings in relation to the theoretical paradigm of semantic feature norms, as well as in relation to speakers' mutual understanding in multilingual settings.

The sampling precision of research in five major areas of psychology

After obtaining a sample of published, peer-reviewed articles from journals with high and low impact factors in social, cognitive, neuro-, developmental, and clinical psychology, we used a priori equations recently derived by Trafimow (Educational and Psychological Measurement, 77, 831-854, 2017; Trafimow & MacDonald in Educational and Psychological Measurement, 77, 204-219, 2017) to compute the articles' median levels of precision. Our findings indicate that developmental research performs best with respect to precision, whereas cognitive research performs the worst; however, none of the psychology subfields excelled. In addition, we found important differences in precision between journals in the upper versus lower echelons with respect to impact factors in cognitive, neuro-, and clinical psychology, whereas the difference was dramatically attenuated for social and developmental psychology. Implications are discussed.

Hands show where things are: The close similarity between sign and natural space

Many of the signs produced across sign languages are iconic, in the sense that they resemble the concepts they represent. We examined whether location, one of basic sign parameters along with handshape and movement, is systematically used for purposes of iconicity. Our findings revealed a mapping of vertical sign space that is exploited in its entirety for encoding typical locations in natural space. In all of the twenty sign languages we analyzed, signs were more likely to have high locations with concepts typically occurring in high vs. low regions of natural space (e.g., cloud vs. root). Furthermore, the height of signs produced to identify a visual object varied depending on object position (e.g., it was higher for basketball in the basket than basketball on the floor). It thus appears that signing space is permeable to semantic and episodic features, and iconicity plays a crucial role in making signing space so adaptable.

Perspective in the conceptualization of categories

The ability to differently perceive and represent entities depending on their perspective is crucial for humans. We report five experiments that investigate how the different perspectives adopted while experiencing entities are reflected in conceptualizations (towards vs. away, near vs. far, beside vs. above, inside vs. outside and vision vs. audition vs. touch). Different groups of participants generated object properties while imagining the same scenario from different perspectives (e.g. entities coming toward them/going away from them while on a highway overpass). If conceptualizations have perspectives, then participants should produce features from a perspective entrenched in memory that reflects typical interactions with objects, independently of their assigned perspective (entrenched perspective). In addition, the perspective adopted in a given experiment should influence the properties generated (situated perspective). Results across the experiments indicate that conceptualizations contain both entrenched and situational perspectives. While entrenched perspectives emerge from canonical actions typically performed with objects, locations and entities, situational perspectives reflect online adaptations to current task contexts. The implications of the interplay between entrenched and situational perspectives for grounded cognition are discussed.

Neural dynamics of semantic composition

Human speech comprehension is remarkable for its immediacy and rapidity. The listener interprets an incrementally delivered auditory input, millisecond by millisecond as it is heard, in terms of complex multilevel representations of relevant linguistic and nonlinguistic knowledge. Central to this process are the neural computations involved in semantic combination, whereby the meanings of words are combined into more complex representations, as in the combination of a verb and its following direct object (DO) noun (e.g., "eat the apple"). These combinatorial processes form the backbone for incremental interpretation, enabling listeners to integrate the meaning of each word as it is heard into their dynamic interpretation of the current utterance. Focusing on the verb-DO noun relationship in simple spoken sentences, we applied multivariate pattern analysis and computational semantic modeling to source-localized electro/magnetoencephalographic data to map out the specific representational constraints that are constructed as each word is heard, and to determine how these constraints guide the interpretation of subsequent words in the utterance. Comparing context-independent semantic models of the DO noun with contextually constrained noun models reflecting the semantic properties of the preceding verb, we found that only the contextually constrained model showed a significant fit to the brain data. Pattern-based measures of directed connectivity across the left hemisphere language network revealed a continuous information flow among temporal, inferior frontal, and inferior parietal regions, underpinning the verb's modification of the DO noun's activated semantics. These results provide a plausible neural substrate for seamless real-time incremental interpretation on the observed millisecond time scales.

Six Challenges for Embodiment Research

Twenty years after Barsalou’s seminal perceptual-symbols article, embodied cognition, the notion that cognition involves simulations of sensory, motor, or affective states, has moved from an outlandish proposal to a mainstream position adopted by many researchers in the psychological and cognitive sciences (and neurosciences). Though it has generated productive work in the cognitive sciences as a whole, it has had a particularly strong impact on research into language comprehension. The view of a mental lexicon based on symbolic word representations, which are arbitrarily linked to sensory aspects of their referents, was generally accepted since the cognitive revolution in the 1950s. This has radically changed. Given the current status of embodiment as a main theory of cognition, it is somewhat surprising that a close look at the literature reveals that the debate about the nature of the processes involved in language comprehension is far from settled, and key questions remain unanswered. We present several suggestions for a productive way forward.

Typicality: Stable structures and flexible functions

Some research suggests typicality is stable, other research suggests it is malleable, and some suggests it is unstable. The two ends of this continuum-stability and instability-make somewhat contradictory claims. Stability claims that typicality is determined by our experience of decontextualized feature correlations in the world and is therefore fairly consistent. Instability claims that typicality depends on context and is therefore extremely inconsistent. After reviewing evidence for these two claims, we argue that typicality's stability and instability are not contradictory but rather complementary when they are understood as operating on two different levels. Stability reflects how information gets encoded into semantic memory-what we call structural typicality. Instability reflects the task-dependent recruitment of semantic knowledge-what we call functional typicality. Finally, we speculate on potential factors that may mediate between the recruitment of structural or functional typicality.

Moving beyond the distinction between concrete and abstract concepts

From the perspective of the situated conceptualization framework, the primary purpose of concepts is for categorizing and integrating elements of situations to support goal-directed action (including communication and social interaction). To the extent that important situational elements are categorized and integrated properly, effective goal-directed action follows. Over time, frequent patterns of co-occurring concepts within situations become established in memory as situated conceptualizations, conditioning the conceptual system and producing habitual patterns of conceptual processing. As a consequence, individual concepts are most basically represented within patterns of concepts that become entrained with specific kinds of physical situations. In this framework, the concrete versus abstract distinction between concepts is no longer useful, with two other distinctions becoming important instead: (i) external versus internal situational elements, (ii) situational elements versus situational integrations. Whereas concepts for situational elements originate in distributed neural networks that provide continual feeds about components of situations, concepts for situational integrations originate in association areas that establish temporal co-occurrence relations between situational elements, both external and internal. We propose that studying concepts in the context of situated action is necessary for establishing complete accounts of them, and that continuing to study concepts in isolation is likely to provide relatively incomplete and distorted accounts.This article is part of the theme issue 'Varieties of abstract concepts: development, use and representation in the brain'.

Dynamic grounding of emotion concepts

Emotion concepts are important. They help us to understand, experience and predict human behaviour. Emotion concepts also link the realm of the abstract with the realm of bodily experience and actions. Accordingly, the key question is how such concepts are created, represented and used. Embodied cognition theories hold that concepts are grounded in neural systems that produce experiential and motor states. Concepts are also contextually situated and thus engage sensorimotor resources in a dynamic, flexible way. Finally, on that framework, conceptual understanding unfolds in time, reflecting embodied as well as linguistic and cultural influences. In this article, we review empirical work on emotion concepts and show how it highlights their grounded, yet dynamic and context-sensitive nature. The conclusions are consistent with recent developments in embodied cognition that allow concepts to be linked to sensorimotor systems, yet be flexibly sensitive to current representational and action needs.This article is part of the theme issue 'Varieties of abstract concepts: development, use and representation in the brain'.

Boundaries to grounding abstract concepts

Grounded theories of cognition claim that concept representation relies on the systems for perception and action. The sensory-motor grounding of abstract concepts presents a challenge for these theories. Some accounts propose that abstract concepts are indirectly grounded via image schemas or situations. Recent research, however, indicates that the role of sensory-motor processing for concrete concepts may be limited, providing evidence against the idea that abstract concepts are grounded via concrete concepts. Hybrid models that combine language and sensory-motor experience may provide a more viable account of abstract and concrete representations. We propose that sensory-motor grounding is important during acquisition and provides structure to concepts. Later activation of concepts relies on this structure but does not necessarily involve sensory-motor processing. Language is needed to create coherent concepts from diverse sensory-motor experiences.This article is part of the theme issue 'Varieties of abstract concepts: development, use and representation in the brain'.

Time-Course of Motor Involvement in Literal and Metaphoric Action Sentence Processing: A TMS Study

There is evidence that the motor cortex is involved in reading sentences containing an action verb ("The spike was hammered into the ground") as well as metaphoric sentences ("The army was hammered in the battle"). Verbs such as 'hammered' may be homonyms, with separate meanings belonging to the literal action and metaphoric action, or they may be polysemous, with the metaphoric sense grounded in the literal sense. We investigated the time course of the effects of single-pulse transcranial magnetic stimulation to primary motor cortex on literal and metaphoric sentence comprehension. Stimulation 300 ms post-verb presentation impaired comprehension of both literal and metaphoric sentences, supporting a causal role of sensory-motor areas in comprehension. Results suggest that the literal meaning of an action verb remains activated during metaphor comprehension, even after the temporal window of homonym disambiguation. This suggests that such verbs are polysemous, and both senses are related and grounded in motor cortex.

Concepts dissolve artificial boundaries in the study of emotion and cognition, uniting body, brain, and mind

Theories of emotion have often maintained artificial boundaries: for instance, that cognition and emotion are separable, and that an emotion concept is separable from the emotional events that comprise its category (e.g. "fear" is distinct from instances of fear). Over the past several years, research has dissolved these artificial boundaries, suggesting instead that conceptual construction is a domain-general process-a process by which the brain makes meaning of the world. The brain constructs emotion concepts, but also cognitions and perceptions, all in the service of guiding action. In this view, concepts are multimodal constructions, dynamically prepared from a set of highly variable instances. This approach obviates old questions (e.g. how does cognition regulate emotion?) but generates new ones (e.g. how does a brain learn emotion concepts?). In this paper, we review this constructionist, predictive coding account of emotion, considering its implications for health and well-being, culture and development.