Language-motor interference reflected in MEG beta oscillations

Causal role of frontocentral beta oscillation in comprehending linguistic communicative functions

Linguistic communication is often considered as an action serving the function of conveying the speaker's goal to the addressee. Although neuroimaging studies have suggested a role of the motor system in comprehending communicative functions, the underlying mechanism is yet to be specified. Here, by two EEG experiments and a tACS experiment, we demonstrate that the frontocentral beta oscillation, which represents action states, plays a crucial part in linguistic communication understanding. Participants read scripts involving two interlocutors and rated the interlocutors' attitudes. Each script included a critical sentence said by the speaker expressing a context-dependent function of either promise, request, or reply to the addressee's query. These functions were behaviorally discriminated, with higher addressee's will rating for the promise than for the reply and higher speaker's will rating for the request than for the reply. EEG multivariate analyses showed that different communicative functions were represented by different patterns of the frontocentral beta activity but not by patterns of alpha activity. Further tACS results showed that, relative to alpha tACS and sham stimulation, beta tACS improved the predictability of communicative functions of request or reply, as measured by the speaker's will rating. These results convergently suggest a causal role of the frontocentral beta activities in comprehending linguistic communications.

Enhancing motor imagery practice using synchronous action observation

In this paper, we discuss a variety of ways in which practising motor actions by means of motor imagery (MI) can be enhanced via synchronous action observation (AO), that is, by AO + MI. We review the available research on the (mostly facilitatory) behavioural effects of AO + MI practice in the early stages of skill acquisition, discuss possible theoretical explanations, and consider several issues related to the choice and presentation schedules of suitable models. We then discuss considerations related to AO + MI practice at advanced skill levels, including expertise effects, practical recommendations such as focussing attention on specific aspects of the observed action, using just-ahead models, and possible effects of the perspective in which the observed action is presented. In section "Coordinative AO + MI", we consider scenarios where the observer imagines performing an action that complements or responds to the observed action, as a promising and yet under-researched application of AO + MI training. In section "The dual action simulation hypothesis of AO + MI", we review the neurocognitive hypothesis that AO + MI practice involves two parallel action simulations, and we consider opportunities for future research based on recent neuroimaging work on parallel motor representations. In section "AO + MI training in motor rehabilitation", we review applications of AO, MI, and AO + MI training in the field of neurorehabilitation. Taken together, this evidence-based, exploratory review opens a variety of avenues for future research and applications of AO + MI practice, highlighting several clear advantages over the approaches of purely AO- or MI-based practice.

The Role of the Motor System in L1 and L2 Action Verb Processing for Chinese Learners of English: Evidence from Mu Rhythm Desynchronization

The nature of semantic representation has long been a key question in linguistic research. The Embodied Cognition theory challenges the traditional view of language representation, stating that semantic information stems from the sensory-motor cortex, which is activated automatically during semantic processing. However, most of the evidence comes from monolingual studies; it remains unclear whether second-language (L2) comprehension involves different semantic representations or mirrors the pattern seen in first-language (L1) processing. Therefore, the present study investigated the role of the sensory-motor system in language processing via making Electroencephalography (EEG) recordings during the processing of L1 and L2 action verbs. The results showed that L1 (Chinese) action verbs generated higher mu-event-related desynchronization (ERD) than L1 abstract verbs in the early processing stage (250 ms after verb presentation), and the same phenomenon was also observed for L2 (English). The results also indicated that language modulated the processing of action verbs, with L1 action verbs eliciting stronger ERD than L2 action verbs. These results demonstrate that the sensory-motor cortex plays a crucial role in comprehending both L1 and L2 action verbs.

An F-ratio-based method for estimating the number of active sources in MEG

Introduction

Magnetoencephalography (MEG) is a powerful technique for studying the human brain function. However, accurately estimating the number of sources that contribute to the MEG recordings remains a challenging problem due to the low signal-to-noise ratio (SNR), the presence of correlated sources, inaccuracies in head modeling, and variations in individual anatomy.

Methods

To address these issues, our study introduces a robust method for accurately estimating the number of active sources in the brain based on the F-ratio statistical approach, which allows for a comparison between a full model with a higher number of sources and a reduced model with fewer sources. Using this approach, we developed a formal statistical procedure that sequentially increases the number of sources in the multiple dipole localization problem until all sources are found.

Results

Our results revealed that the selection of thresholds plays a critical role in determining the method's overall performance, and appropriate thresholds needed to be adjusted for the number of sources and SNR levels, while they remained largely invariant to different inter-source correlations, translational modeling inaccuracies, and different cortical anatomies. By identifying optimal thresholds and validating our F-ratio-based method in simulated, real phantom, and human MEG data, we demonstrated the superiority of our F-ratio-based method over existing state-of-the-art statistical approaches, such as the Akaike Information Criterion (AIC) and Minimum Description Length (MDL).

Discussion

Overall, when tuned for optimal selection of thresholds, our method offers researchers a precise tool to estimate the true number of active brain sources and accurately model brain function.

The cross-linguistic comparison of perceptual strength norms for Korean, English and L2 English

This study aimed to establish perceptual strength norms for 1,000 words in the languages of Korean, English, and L2 English, in order to investigate the similarity and difference across languages as well as the influence of the environment on semantic processing. The perceptual strength norms, which are a collection of word profiles that summarize how a word is experienced through different sensory modalities including the five common senses and interoception, provide a valuable tool for testing embodiment cognition theory. The results of this study demonstrated that language users had parallel sensory experiences with concepts, and that L2 learners were also able to associate their sensory experiences with linguistic concepts. Additionally, the results highlighted the importance of incorporating interoception as a sensory modality in the development of perceptual strength norms, as it had a negative correlation with both vision and concreteness. This study was the first to establish norms for Korean and L2 English and directly compare languages using the identical and translation-equivalent word list.

Learning of new associations invokes a major change in modulations of cortical beta oscillations in human adults

Large-scale cortical beta (β) oscillations were implicated in the learning processes, but their exact role is debated. We used MEG to explore the dynamics of movement-related β-oscillations while 22 adults learned, through trial and error, novel associations between four auditory pseudowords and movements of four limbs. As learning proceeded, spatial-temporal characteristics of β-oscillations accompanying cue-triggered movements underwent a major transition. Early in learning, widespread suppression of β-power occurred long before movement initiation and sustained throughout the whole behavioral trial. When learning advanced and performance reached asymptote, β-suppression after the initiation of correct motor response was replaced by a rise in β-power mainly in the prefrontal and medial temporal regions of the left hemisphere. This post-decision β-power predicted trial-by-trial response times (RT) at both stages of learning (before and after the rules become familiar), but with different signs of interaction. When a subject just started to acquire associative rules and gradually improved task performance, a decrease in RT correlated with the increase in the post-decision β-band power. When the participants implemented the already acquired rules, faster (more confident) responses were associated with the weaker post-decision β-band synchronization. Our findings suggest that maximal beta activity is pertinent to a distinct stage of learning and may serve to strengthen the newly learned association in a distributed memory network.

Spatiotemporal Dynamics of Activation in Motor and Language Areas Suggest a Compensatory Role of the Motor Cortex in Second Language Processing

The involvement of the motor cortex in language understanding has been intensively discussed in the framework of embodied cognition. Although some studies have provided evidence for the involvement of the motor cortex in different receptive language tasks, the role that it plays in language perception and understanding is still unclear. In the present study, we explored the degree of involvement of language and motor areas in a visually presented sentence comprehension task, modulated by language proficiency (L1: native language, L2: second language) and linguistic abstractness (literal, metaphorical, and abstract). Magnetoencephalography data were recorded from 26 late Chinese learners of English. A cluster-based permutation F test was performed on the amplitude of the source waveform for each motor and language region of interest (ROI). Results showed a significant effect of language proficiency in both language and motor ROIs, manifested as overall greater involvement of language ROIs (short insular gyri and planum polare of the superior temporal gyrus) in the L1 than the L2 during 300-500 ms, and overall greater involvement of motor ROI (central sulcus) in the L2 than the L1 during 600-800 ms. We interpreted the over-recruitment of the motor area in the L2 as a higher demand for cognitive resources to compensate for the inadequate engagement of the language network. In general, our results indicate a compensatory role of the motor cortex in L2 understanding.

Motor imagery training to improve language processing: What are the arguments?

Studies showed that motor expertise was found to induce improvement in language processing. Grounded and situated approaches attributed this effect to an underlying automatic simulation of the motor experience elicited by action words, similar to motor imagery (MI), and suggest shared representations of action conceptualization. Interestingly, recent results also suggest that the mental simulation of action by MI training induces motor-system modifications and improves motor performance. Consequently, we hypothesize that, since MI training can induce motor-system modifications, it could be used to reinforce the functional connections between motor and language system, and could thus lead to improved language performance. Here, we explore these potential interactions by reviewing recent fundamental and clinical literature in the action-language and MI domains. We suggested that exploiting the link between action language and MI could open new avenues for complementary language improvement programs. We summarize the current literature to evaluate the rationale behind this novel training and to explore the mechanisms underlying MI and its impact on language performance.

Grasping the semantic of actions: a combined behavioral and MEG study

There is experimental evidence that the brain systems involved in action execution also play a role in action observation and understanding. Recently, it has been suggested that the sensorimotor system is also involved in language processing. Supporting results are slower response times and weaker motor-related MEG Beta band power suppression in semantic decision tasks on single action verbs labels when the stimulus and the motor response involve the same effector. Attenuated power suppression indicates decreased cortical excitability and consequent decreased readiness to act. The embodied approach forwards that the simultaneous involvement of the sensorimotor system in the processing of the linguistic content and in the planning of the response determines this language-motor interference effect. Here, in a combined behavioral and MEG study we investigated to what extent the processing of actions visually presented (i.e., pictures of actions) and verbally described (i.e., verbs in written words) share common neural mechanisms. The findings demonstrated that, whether an action is experienced visually or verbally, its processing engages the sensorimotor system in a comparable way. These results provide further support to the embodied view of semantic processing, suggesting that this process is independent from the modality of presentation of the stimulus, including language.

The Semantics of Natural Objects and Tools in the Brain: A Combined Behavioral and MEG Study

Current literature supports the notion that the recognition of objects, when visually presented, is sub-served by neural structures different from those responsible for the semantic processing of their nouns. However, embodiment foresees that processing observed objects and their verbal labels should share similar neural mechanisms. In a combined behavioral and MEG study, we compared the modulation of motor responses and cortical rhythms during the processing of graspable natural objects and tools, either verbally or pictorially presented. Our findings demonstrate that conveying meaning to an observed object or processing its noun similarly modulates both motor responses and cortical rhythms; being natural graspable objects and tools differently represented in the brain, they affect in a different manner both behavioral and MEG findings, independent of presentation modality. These results provide experimental evidence that neural substrates responsible for conveying meaning to objects overlap with those where the object is represented, thus supporting an embodied view of semantic processing.

Influence of colour on object motor representation

Colour conveys specific information about the status/quality of an object; whereas its role in object recognition has been widely studied, little is known about its role in sensorimotor processes. We performed three experiments to assess whether colour influences the motor representation of graspable objects. In Experiment 1, we used a grasp compatibility task, in which participants categorized each object as natural or artifact, by performing reach-to-grasp movements. Response grasps could be compatible or incompatible with the ones normally used to manipulate the objects. Results showed faster reaction times for natural objects displayed in the correct colour compared with both opposite colour and correct colour artifact objects. In Experiment 2, to directly assess the effect of colour on object motor representation, we used an interference task in which an irrelevant object was shown while performing a pre-specified reach-to-grasp movement (i.e., verbal cues: small vs. large). Results highlighted a reversed compatibility effect when objects were shown in their correct colour, but only at the beginning of the movement (10 ms SOA). Finally, we run a third experiment using the same task as in Experiment 2. In this experiment, we compared the grasp compatibility effect driven by natural objects with the grasp compatibility effect driven by dangerous natural objects (e.g., cactus), which are objects that should not elicit a grasping program. The results of Experiment 3 confirm those of Experiment 2, highlighting also specific processes related to dangerous objects. Taken together, these results revealed that colour can be significant for the motor system, highlighting the close link between colour and shape, and also specific processes related to dangerous objects.

What matters is the underlying experience: Similar motor responses during processing observed hand actions and hand-related verbs

It is well-accepted that processing observed actions involves at some extent the same neural mechanisms responsible for action execution. More recently, it has been forwarded that also the processing of verbs expressing a specific motor content is subserved by the neural mechanisms allowing individuals to perform the content expressed by that linguistic material. This view is also known as embodiment and contrasts with a more classical approach to language processing that considers it as amodal. In the present study, we used a go/no-go paradigm, in which participants were requested to respond to real words and pictures and refrain from responding when presented stimuli were pseudowords and scrambled images. Real stimuli included pictures depicting hand- and foot-related actions and verbs expressing hand- and foot-related actions. We, therefore, directly compared the modulation of hand motor responses during the observation of actions and the presentation of verbs, expressing actions in the same category. The results have shown that participants gave slower hand motor responses during the observation of hand actions and the processing of hand-related verbs as than observed foot actions and related verbs. These findings support embodiment showing that whatever the modality of presentation (observed action or verb), the modulation of hand motor responses was similar, thus suggesting that processing seen actions and related verbs shares common mechanisms most likely involving the motor system and the underlying motor experience.

The neural inhibition network is causally involved in the disembodiment effect of linguistic negation

Negation applied to action contexts reduces the activation of the motor system. According to the Reusing Inhibition for Negation (RIN) hypothesis, such "disembodiment" effect occurs because understanding negations engages the reuse of inhibitory control mechanisms. Here, we investigated whether the right inferior frontal gyrus (rIFG) - a key area of the inhibitory control system - contributes to primary motor cortex (M1) processing of negated action-sentences. Using a perturb-and-measure paradigm, we applied off-line low-frequency repetitive TMS (rTMS) over the rIFG, before performing a reading task involving action and attentional sentences presented in both affirmative or negative form. During the reading task, motor excitability was assessed by recording motor-evoked potentials (MEPs) induced by single-pulse TMS (spTMS) over the left M1, at two loci in the sentence: the verb or the object. Results show that after sham stimulation (baseline), motor excitability measured on the verb, was reduced for negative, compared to affirmative action sentences. Crucially, neuromodulation of rIFG suppressed this inhibitory effect of negation, since motor excitability was equaled for negative and affirmative action sentences. As expected, no effect of negation was observed for attentional sentences or when the pulse was delivered over the object. Our study confirms that understanding negative action sentences inhibits M1. This effect took place at an early stage of semantic processing (i.e., while processing the verb in our task), and faded at a later time-point. Critically, by highlighting a causal role of rIFG in this motor inhibition, we provide direct neurophysiological support to the RIN hypothesis.

Abstract Action Language Processing in Eleven-Year-Old Children: Influence of Upper Limb Movement on Sentence Comprehension

Regarding the embodiment of language processing in adults, there is evidence of a close connection between sensorimotor brain areas and brain areas relevant to the processing of action verbs. This thesis is hotly debated and has therefore been thoroughly studied in adults. However, there are still questions concerning its development in children. The present study deals with the processing of action verbs in concrete and abstract sentences in 60 eleven-year-olds using a decision time paradigm. Sixty-five children mirrored arm movements or sat still and rated the semantic plausibility of sentences. The data of the current study suggest that eleven-year-olds are likely to misunderstand the meaning of action verbs in abstract contexts. Their decision times were faster and their error rates for action verbs in concrete sentences were lower. However, the gender of the children had a significant influence on the decision time and the number of errors, especially when processing abstract sentences. Females were more likely to benefit from an arm movement before the decision, while males were better if they sat still beforehand. Overall, children made quite a few errors when assessing the plausibility of sentences, but the female participants more often gave plausibility assessments that deviated from our expectations, especially when processing abstract sentences. It can be assumed that the embodiment of language processing plays some role in 11-year-old children, but is not yet as mature as it is in adults. Especially with regard to the processing of abstract language, the embodied system still has to change and mature in the course of child development.

Neurophysiological mechanisms of perspective-taking: An MEG investigation of agency

According to the embodied cognition framework, sensory and motor areas are recruited during language understanding through simulation processes. Behavioral and imaging findings point to a dependence of the latter on perspective-taking (e.g., first person "I" versus third person "s/he"). The current study aims at identifying possible neurophysiological correlates of perspective in a linguistic context. Twenty healthy participants were measured with magnetoencephalography (MEG) while semantically processing visually presented inflected German verbs in the first- and third-person perspective, simple present tense. Results show that the first-person perspective induces stronger beta (15-25 Hz) desynchronization in the right-hemispheric posterior superior temporal sulcus, ventral posterior cingulate gyrus, and V5/MT+ area; no modulation of sensorimotor cortex emerged. Moreover, a stronger event-related field (ERF) was observed for the first-person perspective at about 150 ms after pronoun-verb onset, originating in occipital and moving to central and left temporal cortical sites. No effect of perspective on sensory gating was found when targeting the N1 component related to tones following the linguistic stimuli. Results indicate an effect of linguistic perspective-taking on brain activation patterns. The contribution of the single brain areas and their role in self-other distinction is further discussed.

On the Boundaries between Decision and Action: Effector-selective Lateralization of Beta-frequency Power Is Modulated by the Lexical Frequency of Printed Words

Current computational and neuroscientific models of decision-making posit a discrete, serial processing distinction between upstream decisional stages and downstream processes of motor-response implementation. We investigated this framework in the context of two-alternative forced-choice tasks on linguistic stimuli, words and pseudowords. In two experiments, we assessed the impact of lexical frequency and action semantics on two effector-selective EEG indexes of motor-response activation: the lateralized readiness potential and the lateralization of beta-frequency power. This allowed us to track potentially continuous streams of processing progressively mapping the evaluation of linguistic stimuli onto corresponding response channels. Whereas action semantics showed no influence on EEG indexes of motor-response activation, lexical frequency affected the lateralization of response-locked beta-frequency power. We argue that these observations point toward a continuity between linguistic processing of word input stimuli and implementation of corresponding choice in terms of motor behavior. This interpretation challenges the commonly held assumption of a discrete processing distinction between decisional and motor-response processes in the context of decisions based on symbolic stimuli.

Language and motor processing in reading and typing: Insights from beta-frequency band power modulations

Power modulations of the EEG activity within the beta-frequency band were investigated across silent-reading and copy-typing tasks featuring emotionally negative and neutral words in order to clarify the interplay between language and motor processing. In reading, a single desynchronization surfaced 200-600 ms after target presentation, with a stronger power-decrease in lower beta frequencies for neutral compared to negative words. The typing task revealed two distinct desynchronizations. A first one surfaced within spatio-temporal coordinates closely resembling those of the desynchronization observed in the reading task, thus pointing towards a common origin at the level of linguistic processing of the input word stimuli. Additionally, a second motor-related desynchronization surfaced during the typed response, from 700 to 2000 ms after stimulus onset. Here, words' emotional connotation affected the higher beta band. The comparison between tasks thus suggests that different beta desynchronizations reflect distinct EEG landmarks for language and motor processing. Further, the effect of emotional connotation on the motor-related desynchronization of the typing task suggests that language processing can propagate its influence onto the stage of motor response execution, pointing against a serial flow of information from language onto motor processing.

The role of motor system in action-related language comprehension in L1 and L2: An fMRI study

The framework of embodied cognition has challenged the modular view of a language-cognition divide by suggesting that meaning-retrieval critically involves the sensory-motor system. Despite extensive research into the neural mechanisms underlying language-motor coupling, it remains unclear how the motor system might be differentially engaged by different levels of linguistic abstraction and language proficiency. To address this issue, we used fMRI to quantify neural activations in brain regions underlying motor and language processing in Chinese-English speakers' processing of literal, metaphorical, and abstract language in their L1 and L2. Results overall revealed a response in motor ROIs gradually attenuating in intensity from literal to abstract via metaphorical language in both L1 and L2. Furthermore, contrast analyses between L1 and L2 showed overall greater activations of motor ROIs in the L2. We conclude that motor involvement in language processing is graded rather than all-or-none and that the motor system has a dual-functional role.

Too late to be grounded? Motor resonance for action words acquired after middle childhood

Though well established for languages acquired in infancy, the role of embodied mechanisms remains poorly understood for languages learned in middle childhood and adulthood. To bridge this gap, we examined 34 experiments that assessed sensorimotor resonance during processing of action-related words in real and artificial languages acquired since age 7 and into adulthood. Evidence from late bilinguals indicates that foreign-language action words modulate neural activity in motor circuits and predictably facilitate or delay physical movements (even in an effector-specific fashion), with outcomes that prove partly sensitive to language proficiency. Also, data from newly learned vocabularies suggest that embodied effects emerge after brief periods of adult language exposure, remain stable through time, and hinge on the performance of bodily movements (and, seemingly, on action observation, too). In sum, our work shows that infant language exposure is not indispensable for the recruitment of embodied mechanisms during language processing, a finding that carries non-trivial theoretical, pedagogical, and clinical implications for neurolinguistics, in general, and bilingualism research, in particular.

Action verb processing specifically modulates motor behaviour and sensorimotor neuronal oscillations

Understanding action-related language recruits the brain’s motor system and can interact with motor behaviour. The current study shows MEG oscillatory patterns during verb-motor priming. Hand and foot verbs were followed by hand or foot responses, with faster reaction times for congruent conditions. In ROIs placed in the hand/arm and foot/leg portions of the sensorimotor cortex, this behavioural priming effect was accompanied by modulations in MEG oscillatory patterns preceding the responses. Power suppression in the alpha/beta frequency bands was reduced in congruent conditions in the body-part-specific ROIs. These results imply that the verb-motor priming effect may be a direct consequence of motor cortex contributions to action word processing.

Transcranial direct current stimulation influences bilingual language control mechanism: evidence from cross-frequency coupling

How to better suppress the interference from the non-target language when switching from one language to the other in bilingual production? The current study applied transcranial direct current stimulation over the right dorsolateral prefrontal cortex to modulate language control measured by cross-frequency coupling. We found that switching to L2 was more modulated by F4-F3 alpha-beta phase-amplitude compared to switching to L1 after receiving the anodal stimulation at the language task schema phase. These findings suggest that anodal stimulation affects the selection of the target language task schema by enhancing the activation of frontal areas and facilitating the coordination between the left and the right frontal hemispheres.

Brain Inhibitory Mechanisms Are Involved in the Processing of Sentential Negation, Regardless of Its Content. Evidence From EEG Theta and Beta Rhythms

The two-step process account of negation understanding posits an initial representation of the negated events, followed by a representation of the actual state of events. On the other hand, behavioral and neurophysiological studies provided evidence that linguistic negation suppresses or reduces the activation of the negated events, contributing to shift attention to the actual state of events. However, the specific mechanism of this suppression is poorly known. Recently, based on the brain organization principle of neural reuse (Anderson, 2010), it has been proposed that understanding linguistic negation partially relies upon the neurophysiological mechanisms of response inhibition. Specifically, it was reported that negated action-related sentences modulate EEG signatures of response inhibition (de Vega et al., 2016; Beltrán et al., 2018). In the current EEG study, we ponder whether the reusing of response inhibition processes by negation is constrained to action-related contents or consists of a more general-purpose mechanism. To this end, we employed the same dual-task paradigm as in our prior study—a Go/NoGo task embedded into a sentence comprehension task—but this time including both action and non-action sentences. The results confirmed that the increase of theta power elicited by NoGo trials was modulated by negative sentences, compared to their affirmative counterparts, and this polarity effect was statistically similar for both action- and non-action-related sentences. Thus, a general-purpose inhibitory control mechanism, rather than one specific for action language, is likely operating in the comprehension of sentential negation to produce the transition between alternative representations.

Effortful verb retrieval from semantic memory drives beta suppression in mesial frontal regions involved in action initiation

The contribution of the motor cortex to the semantic retrieval of verbs remains a subject of debate in neuroscience. Here, we examined whether additional engagement of the cortical motor system was required when access to verbs semantics was hindered during a verb generation task. We asked participants to produce verbs related to presented noun cues that were either strongly associated with a single verb to prompt fast and effortless verb retrieval, or were weakly associated with multiple verbs and more difficult to respond to. Using power suppression of magnetoencephalography beta oscillations (15-30 Hz) as an index of cortical activation, we performed a whole-brain analysis in order to identify the cortical regions sensitive to the difficulty of verb semantic retrieval. Highly reliable suppression of beta oscillations occurred 250 ms after the noun cue presentation and was sustained until the onset of verbal response. This was localized to multiple cortical regions, mainly in the temporal and frontal lobes of the left hemisphere. Crucially, the only cortical regions where beta suppression was sensitive to the task difficulty, were the higher order motor areas on the medial and lateral surfaces of the frontal lobe. Stronger activation of the premotor cortex and supplementary motor area accompanied the effortful verb retrieval and preceded the preparation of verbal responses for more than 500 ms, thus, overlapping with the time window of verb retrieval from semantic memory. Our results suggest that reactivation of verb-related motor plans in higher order motor circuitry promotes the semantic retrieval of target verbs.

How meaning unfolds in neural time: Embodied reactivations can precede multimodal semantic effects during language processing

Research on how the brain construes meaning during language use has prompted two conflicting accounts. According to the 'grounded view', word understanding involves quick reactivations of sensorimotor (embodied) experiences evoked by the stimuli, with simultaneous or later engagement of multimodal (conceptual) systems integrating information from various sensory streams. Contrariwise, for the 'symbolic view', this capacity depends crucially on multimodal operations, with embodied systems playing epiphenomenal roles after comprehension. To test these contradictory hypotheses, the present magnetoencephalography study assessed implicit semantic access to grammatically constrained action and non-action verbs (n = 100 per category) while measuring spatiotemporally precise signals from the primary motor cortex (M1, a core region subserving bodily movements) and the anterior temporal lobe (ATL, a putative multimodal semantic hub). Convergent evidence from sensor- and source-level analyses revealed that increased modulations for action verbs occurred earlier in M1 (∼130-190 ms) than in specific ATL hubs (∼250-410 ms). Moreover, machine-learning decoding showed that trial-by-trial classification peaks emerged faster in M1 (∼100-175 ms) than in the ATL (∼345-500 ms), with over 71% accuracy in both cases. Considering their latencies, these results challenge the 'symbolic view' and its implication that sensorimotor mechanisms play only secondary roles in semantic processing. Instead, our findings support the 'grounded view', showing that early semantic effects are critically driven by embodied reactivations and that these cannot be reduced to post-comprehension epiphenomena, even when words are individually classified. Briefly, our study offers non-trivial insights to constrain fine-grained models of language and understand how meaning unfolds in neural time.

Role of Sensorimotor Cortex in Gestural-Verbal Integration

Action comprehension that is related to language or gestural integration has been shown to engage the motor system in the brain, thus providing preliminary evidence for the gestural-verbal embodiment concept. Based on the involvement of the sensorimotor cortex (M1) in language processing, we aimed to further explore its role in the cognitive embodiment necessary for gestural-verbal integration. As such, we applied anodal (excitatory) and sham transcranial direct current stimulation (tDCS) over the left M1 (with reference electrode over the contralateral supraorbital region) during a gestural-verbal integration task where subjects had to make a decision about the semantic congruency of the gesture (prime) and the word (target). We used a cross-over within-subject design in young subjects. Attentional load and simple reaction time (RT) tasks served as control conditions, applied during stimulation (order of three tasks was counterbalanced). Our results showed that anodal (atDCS) compared to sham tDCS (stDCS) reduced RTs in the gestural-verbal integration task, specifically for incongruent pairs of gestures and verbal expressions, with no effect on control task performance. Our findings provide evidence for the involvement of the sensorimotor system in gestural-verbal integration performance. Further, our results suggest that functional modulation induced by sensorimotor tDCS may be specific to gestural-verbal integration. Future studies should now evaluate the modulatory effect of tDCS on semantic congruency by using tDCS over additional brain regions and include assessments of neural connectivity.

Alpha and Beta Oscillations Index Semantic Congruency between Speech and Gestures in Clear and Degraded Speech

Previous work revealed that visual semantic information conveyed by gestures can enhance degraded speech comprehension, but the mechanisms underlying these integration processes under adverse listening conditions remain poorly understood. We used MEG to investigate how oscillatory dynamics support speech–gesture integration when integration load is manipulated by auditory (e.g., speech degradation) and visual semantic (e.g., gesture congruency) factors. Participants were presented with videos of an actress uttering an action verb in clear or degraded speech, accompanied by a matching (mixing gesture + “mixing”) or mismatching (drinking gesture + “walking”) gesture. In clear speech, alpha/beta power was more suppressed in the left inferior frontal gyrus and motor and visual cortices when integration load increased in response to mismatching versus matching gestures. In degraded speech, beta power was less suppressed over posterior STS and medial temporal lobe for mismatching compared with matching gestures, showing that integration load was lowest when speech was degraded and mismatching gestures could not be integrated and disambiguate the degraded signal. Our results thus provide novel insights on how low-frequency oscillatory modulations in different parts of the cortex support the semantic audiovisual integration of gestures in clear and degraded speech: When speech is clear, the left inferior frontal gyrus and motor and visual cortices engage because higher-level semantic information increases semantic integration load. When speech is degraded, posterior STS/middle temporal gyrus and medial temporal lobe are less engaged because integration load is lowest when visual semantic information does not aid lexical retrieval and speech and gestures cannot be integrated.

Hearing and seeing meaning in noise: Alpha, beta, and gamma oscillations predict gestural enhancement of degraded speech comprehension

During face‐to‐face communication, listeners integrate speech with gestures. The semantic information conveyed by iconic gestures (e.g., a drinking gesture) can aid speech comprehension in adverse listening conditions. In this magnetoencephalography (MEG) study, we investigated the spatiotemporal neural oscillatory activity associated with gestural enhancement of degraded speech comprehension. Participants watched videos of an actress uttering clear or degraded speech, accompanied by a gesture or not and completed a cued‐recall task after watching every video. When gestures semantically disambiguated degraded speech comprehension, an alpha and beta power suppression and a gamma power increase revealed engagement and active processing in the hand‐area of the motor cortex, the extended language network (LIFG/pSTS/STG/MTG), medial temporal lobe, and occipital regions. These observed low‐ and high‐frequency oscillatory modulations in these areas support general unification, integration and lexical access processes during online language comprehension, and simulation of and increased visual attention to manual gestures over time. All individual oscillatory power modulations associated with gestural enhancement of degraded speech comprehension predicted a listener's correct disambiguation of the degraded verb after watching the videos. Our results thus go beyond the previously proposed role of oscillatory dynamics in unimodal degraded speech comprehension and provide first evidence for the role of low‐ and high‐frequency oscillations in predicting the integration of auditory and visual information at a semantic level.

Semantic discrimination impacts tDCS modulation of verb processing

Motor cortex activation observed during body-related verb processing hints at simulation accompanying linguistic understanding. By exploiting the up- and down-regulation that anodal and cathodal transcranial direct current stimulation (tDCS) exert on motor cortical excitability, we aimed at further characterizing the functional contribution of the motor system to linguistic processing. In a double-blind sham-controlled within-subjects design, online stimulation was applied to the left hemispheric hand-related motor cortex of 20 healthy subjects. A dual, double-dissociation task required participants to semantically discriminate concrete (hand/foot) from abstract verb primes as well as to respond with the hand or with the foot to verb-unrelated geometric targets. Analyses were conducted with linear mixed models. Semantic priming was confirmed by faster and more accurate reactions when the response effector was congruent with the verb's body part. Cathodal stimulation induced faster responses for hand verb primes thus indicating a somatotopical distribution of cortical activation as induced by body-related verbs. Importantly, this effect depended on performance in semantic discrimination. The current results point to verb processing being selectively modifiable by neuromodulation and at the same time to a dependence of tDCS effects on enhanced simulation. We discuss putative mechanisms operating in this reciprocal dependence of neuromodulation and motor resonance.

EEG beta-power changes reflect motor involvement in abstract action language processing

Brain oscillations in the α- and β-range become suppressed during motor processing and motor imagery. It has recently been discussed that such power changes also occur during action language processing. In our study, we compared β₂-oscillations (16-25Hz) during the observation of prototypical arm movements (revealed via motion tracking) as well as during semantic processing of concrete and abstract sentences containing arm-related action verbs. Whereas we did find a strong desynchronization in the β₂-range during action observation, the processing of action sentences evoked a rather weak desynchronization. However, this desynchronization occurred for action verbs in both concrete and abstract contexts. These results might indicate a tendency for abstract action language to be processed similar to concrete action language rather than abstract sentences. The oscillation patterns reflect the close relationship between language comprehension and motor functions - one of the core claims of current theories on embodied cognition.

Processing graspable object images and their nouns is impaired in Parkinson's disease patients

According to embodiment, the recruitment of the motor system is necessary to process language material expressing a motor content. Coherently, an impairment of the motor system should affect the capacity to process language items with a motor content. The aim of the present study was to assess the capacity to process graspable objects and their nouns in Parkinson's disease (PD) patients and healthy controls. Participants saw photos and nouns depicting graspable and non-graspable objects. Scrambled images and pseudo-words served as control stimuli. At 150 msec after stimulus presentation, they had to respond when the stimulus referred to a real object, and refrain from responding when it was meaningless (go-no go paradigm). In the control group, participants gave slower motor responses for stimuli (both photos and nouns) related to graspable objects as compared to non-graspable ones. This in keeping with data obtained in a previous study with young healthy participants. In the PD group, motor responses were similar for both graspable and non-graspable items. Moreover, error number was significantly greater than in controls. These findings support the notion that when the motor circuits are lesioned, like in PD, patients do not show the typical modulation of motor responses and have troubles in processing graspable objects and their nouns.

Auditory perception modulated by word reading

Theories of embodied cognition positing that sensorimotor areas are indispensable during language comprehension are supported by neuroimaging and behavioural studies. Among others, the auditory system has been suggested to be important for understanding sound-related words (visually presented) and the motor system for action-related words. In this behavioural study, using a sound detection task embedded in a lexical decision task, we show that in participants with high lexical decision performance sound verbs improve auditory perception. The amount of modulation was correlated with lexical decision performance. Our study provides convergent behavioural evidence of auditory cortex involvement in word processing, supporting the view of embodied language comprehension concerning the auditory domain.