1
|
Yu Y, Huang Q, Liu X, Gao S, Mao X, Li A. ERP-based evidence for the independent processing of structural and functional action semantics. Front Neurosci 2025; 19:1571972. [PMID: 40206409 PMCID: PMC11979279 DOI: 10.3389/fnins.2025.1571972] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/06/2025] [Accepted: 03/13/2025] [Indexed: 04/11/2025] Open
Abstract
In this study, the semantic processing and neural mechanisms of manipulative actions, categorized as structural actions and functional actions, were examined to assess whether these action types involve independent cognitive processes. Using a cue-stimulus paradigm with event-related potentials (ERPs), we analyzed neural responses to various manipulative actions. Manipulating the semantic congruency of structural actions (congruent vs. incongruent) and functional action types (wave vs. press) revealed distinct neural patterns. We observed distinct neural differences for functional actions in the 30-44 ms, 144-194 ms, 218-232 ms, 300-400 ms, and 562-576 ms windows. Early activation occurred in the left medial superior frontal gyrus, whereas sustained activity spread from the occipital and parietal regions to frontal regions between 144-194 ms and 300-400 ms. Late activation, occurring in the 562-576 ms window, was localized to the left middle frontal gyrus, right orbital inferior frontal gyrus, and right superior occipital gyrus. For structural actions, neural differences emerged in the 456-470 ms and 610-660 ms windows, which activated the parietal and temporal regions, including the left postcentral gyrus and right middle temporal gyrus. These findings suggest that the semantic processing of structural actions is partially independent of functional action cognition at the neural level.
Collapse
Affiliation(s)
- Yanglan Yu
- School of Psychology, Shanghai University of Sport, Shanghai, China
| | - Qin Huang
- School of Psychology, Shanghai University of Sport, Shanghai, China
| | - Xudong Liu
- School of Psychology, Shanghai University of Sport, Shanghai, China
| | - Shiying Gao
- School of Psychology, Shanghai University of Sport, Shanghai, China
| | - Xuechen Mao
- Department of Physical Education, Nanjing University of Chinese Medicine, Nanjing, China
| | - Anmin Li
- School of Psychology, Shanghai University of Sport, Shanghai, China
| |
Collapse
|
2
|
Tian L, Chen H, Kujala J, Parviainen T. Spatiotemporal dynamics of abstract concept processing: An MEG study. BRAIN AND LANGUAGE 2025; 260:105505. [PMID: 39637563 DOI: 10.1016/j.bandl.2024.105505] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/04/2023] [Revised: 08/06/2024] [Accepted: 11/27/2024] [Indexed: 12/07/2024]
Abstract
Our current understanding of how linguistic concepts are represented and retrieved in the brain is largely based on studies using concrete language, and only few studies have focused on the neural correlates of abstract concepts. The role of the motor system, besides the classical language network, has been intensively discussed in action-related concrete concepts. To advance our understanding of spatiotemporal dynamics underlying abstract concept processing, our study investigated to what extent language and motor regions are engaged in the processing of abstract concepts vs. concrete concepts. We used concrete, metaphorical, and abstract phrases as stimuli, creating a graded continuum of abstractness. Neuromagnetic signals were recorded from 26 Chinese native speakers using a 306-channel whole-head magnetoencephalography (MEG) system. Cluster-based permutation F-tests were carried out on the amplitude of source waveform for individual language and motor regions of interest (ROIs) in the three consecutive time-windows (200-300, 300-400, and 400-500 ms). Results showed that, compared with concrete and metaphorical phrases, abstract phrases evoked significantly weaker activation in the left posterior part of superior temporal sulcus (STS) at 200-300 ms, and significantly stronger activation in the left anterior temporal pole (TP) at 300-400 ms. We found no significant differences in the involvement of motor ROIs across conditions. Our results suggest that concrete concept processing engages more the posterior STS in an earlier time window, while abstract concept processing relies more strongly on the anterior TP in a later time window. Results are discussed by revisiting the ATL (anterior temporal lobe)-hub hypothesis and the novel definition of concrete and abstract concepts.
Collapse
Affiliation(s)
- Lili Tian
- Department of Psychology, University of Jyväskylä, Jyväskylä 40014, Finland; Centre for Interdisciplinary Brain Research, University of Jyväskylä, Jyväskylä 40014, Finland; School of Foreign Languages, Dalian University of Technology, Dalian 116024, China; Language and Brain Research Centre, Sichuan International Studies University, Chongqing 400031, China
| | - Hongjun Chen
- School of Foreign Languages, Dalian University of Technology, Dalian 116024, China.
| | - Jan Kujala
- Department of Psychology, University of Jyväskylä, Jyväskylä 40014, Finland
| | - Tiina Parviainen
- Department of Psychology, University of Jyväskylä, Jyväskylä 40014, Finland; Centre for Interdisciplinary Brain Research, University of Jyväskylä, Jyväskylä 40014, Finland.
| |
Collapse
|
3
|
Hernández D, Puupponen A, Keränen J, Ortega G, Jantunen T. Between bodily action and conventionalized structure: The neural mechanisms of constructed action in sign language comprehension. BRAIN AND LANGUAGE 2024; 252:105413. [PMID: 38608511 DOI: 10.1016/j.bandl.2024.105413] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/06/2023] [Revised: 02/22/2024] [Accepted: 04/07/2024] [Indexed: 04/14/2024]
Abstract
Sign languages (SLs) are expressed through different bodily actions, ranging from re-enactment of physical events (constructed action, CA) to sequences of lexical signs with internal structure (plain telling, PT). Despite the prevalence of CA in signed interactions and its significance for SL comprehension, its neural dynamics remain unexplored. We examined the processing of different types of CA (subtle, reduced, and overt) and PT in 35 adult deaf or hearing native signers. The electroencephalographic-based processing of signed sentences with incongruent targets was recorded. Attenuated N300 and early N400 were observed for CA in deaf but not in hearing signers. No differences were found between sentences with CA types in all signers, suggesting a continuum from PT to overt CA. Deaf signers focused more on body movements; hearing signers on faces. We conclude that CA is processed less effortlessly than PT, arguably because of its strong focus on bodily actions.
Collapse
Affiliation(s)
- Doris Hernández
- Sign Language Centre, Department of Language and Communication, University of Jyväskylä, Finland; Center for Interdisciplinary Brain Research (CIBR), Department of Psychology, University of Jyväskylä, Finland.
| | - Anna Puupponen
- Sign Language Centre, Department of Language and Communication, University of Jyväskylä, Finland
| | - Jarkko Keränen
- Sign Language Centre, Department of Language and Communication, University of Jyväskylä, Finland
| | - Gerardo Ortega
- Department of English Language and Applied Linguistics, University of Birmingham, UK
| | - Tommi Jantunen
- Sign Language Centre, Department of Language and Communication, University of Jyväskylä, Finland
| |
Collapse
|
4
|
Muraki EJ, Dahm SF, Pexman PM. Meaning in hand: Investigating shared mechanisms of motor imagery and sensorimotor simulation in language processing. Cognition 2023; 240:105589. [PMID: 37566931 DOI: 10.1016/j.cognition.2023.105589] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2022] [Revised: 07/26/2023] [Accepted: 08/03/2023] [Indexed: 08/13/2023]
Abstract
There is substantial evidence to support grounded theories of semantic representation, however the mechanisms of simulation in most theories are underspecified. In the present study, we used an individual differences approach to test whether motor imagery may share some mechanisms with sensorimotor simulations engaged during semantic processing. We quantified individual differences in motor imagery ability via implicit imagery tasks and explicit imagery questionnaires and tested their relationship to sensorimotor effects in syntactic classification tasks. In Experiment 1 (N = 185) we tested relationships between motor imagery and semantic processing of body-object interaction meaning (BOI; the degree to which you can interact with a word's referent) and foot/leg action meaning. We observed two interactions between imagery ability measured on the Florida Praxis Imagery Questionnaire (FPIQ) and BOI effects in semantic processing (response time and accuracy). In both interactions poorer imagery ability was associated with null BOI effects, whereas better imagery was associated with BOI effects. We also observed faster and more accurate responses to verbs associated with more foot/leg action meaning than verbs with less foot/leg action meaning, but this foot/leg action effect did not significantly interact with individual differences in motor imagery. In Experiment 2 (N = 195) we tested whether the interactions observed in Experiment 1 were dependent on the object-directed nature of the actions, or whether similar effects would be observed for hand actions not associated with objects. We also expanded our investigation beyond hand and foot imagery to consider whole body imagery. We observed an interaction between performance on a hand laterality judgement task (HLJT; assessing hand motor imagery) and sensorimotor effects in semantic processing of verbs associated with hand/arm action meaning. Participants with the fastest responses on the most difficult trials of the HLJT showed no significant difference in their response times to words with high and low hand/arm action meaning. We also observed faster and more accurate responses to high relative to low embodiment verbs, but this sensorimotor effect did not interact with individual differences in motor imagery. The results suggest specific (and not general) associations, in that some, but not all forms of hand and object-directed motor imagery are related to sensorimotor effects in language processing of hand/arm action verbs and nouns describing objects that are easy to interact with. As such, hand and object-directed motor imagery may share mechanisms with sensorimotor simulation during semantic processing.
Collapse
Affiliation(s)
- Emiko J Muraki
- Department of Psychology, University of Calgary, Canada; Hotchkiss Brain Institute, University of Calgary, Canada.
| | - Stephan F Dahm
- Department of Psychology, Universität Innsbruck, Austria
| | - Penny M Pexman
- Department of Psychology, University of Calgary, Canada; Hotchkiss Brain Institute, University of Calgary, Canada
| |
Collapse
|
5
|
Bechtold L, Cosper SH, Malyshevskaya A, Montefinese M, Morucci P, Niccolai V, Repetto C, Zappa A, Shtyrov Y. Brain Signatures of Embodied Semantics and Language: A Consensus Paper. J Cogn 2023; 6:61. [PMID: 37841669 PMCID: PMC10573703 DOI: 10.5334/joc.237] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2022] [Accepted: 07/29/2022] [Indexed: 10/17/2023] Open
Abstract
According to embodied theories (including embodied, embedded, extended, enacted, situated, and grounded approaches to cognition), language representation is intrinsically linked to our interactions with the world around us, which is reflected in specific brain signatures during language processing and learning. Moving on from the original rivalry of embodied vs. amodal theories, this consensus paper addresses a series of carefully selected questions that aim at determining when and how rather than whether motor and perceptual processes are involved in language processes. We cover a wide range of research areas, from the neurophysiological signatures of embodied semantics, e.g., event-related potentials and fields as well as neural oscillations, to semantic processing and semantic priming effects on concrete and abstract words, to first and second language learning and, finally, the use of virtual reality for examining embodied semantics. Our common aim is to better understand the role of motor and perceptual processes in language representation as indexed by language comprehension and learning. We come to the consensus that, based on seminal research conducted in the field, future directions now call for enhancing the external validity of findings by acknowledging the multimodality, multidimensionality, flexibility and idiosyncrasy of embodied and situated language and semantic processes.
Collapse
Affiliation(s)
- Laura Bechtold
- Institute for Experimental Psychology, Department for Biological Psychology, Heinrich-Heine University Düsseldorf, Germany
| | - Samuel H. Cosper
- Institute of Cognitive Science, University of Osnabrück, Germany
| | - Anastasia Malyshevskaya
- Centre for Cognition and Decision making, Institute for Cognitive Neuroscience, HSE University, Russian Federation
- Potsdam Embodied Cognition Group, Cognitive Sciences, University of Potsdam, Germany
| | | | | | - Valentina Niccolai
- Institute of Clinical Neuroscience and Medical Psychology, Medical Faculty, Heinrich-Heine University Düsseldorf, Germany
| | - Claudia Repetto
- Department of Psychology, Università Cattolica del Sacro Cuore, Milan, Italy
| | - Ana Zappa
- Laboratoire parole et langage, Aix-Marseille Université, Aix-en-Provence, France
| | - Yury Shtyrov
- Centre for Cognition and Decision making, Institute for Cognitive Neuroscience, HSE University, Russian Federation
- Center of Functionally Integrative Neuroscience, Department of Clinical Medicine, Aarhus University, Denmark
| |
Collapse
|
6
|
Tian L, Chen H, Heikkinen PP, Liu W, Parviainen T. Spatiotemporal Dynamics of Activation in Motor and Language Areas Suggest a Compensatory Role of the Motor Cortex in Second Language Processing. NEUROBIOLOGY OF LANGUAGE (CAMBRIDGE, MASS.) 2023; 4:178-197. [PMID: 37229145 PMCID: PMC10205076 DOI: 10.1162/nol_a_00093] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/15/2022] [Accepted: 11/14/2022] [Indexed: 05/27/2023]
Abstract
The involvement of the motor cortex in language understanding has been intensively discussed in the framework of embodied cognition. Although some studies have provided evidence for the involvement of the motor cortex in different receptive language tasks, the role that it plays in language perception and understanding is still unclear. In the present study, we explored the degree of involvement of language and motor areas in a visually presented sentence comprehension task, modulated by language proficiency (L1: native language, L2: second language) and linguistic abstractness (literal, metaphorical, and abstract). Magnetoencephalography data were recorded from 26 late Chinese learners of English. A cluster-based permutation F test was performed on the amplitude of the source waveform for each motor and language region of interest (ROI). Results showed a significant effect of language proficiency in both language and motor ROIs, manifested as overall greater involvement of language ROIs (short insular gyri and planum polare of the superior temporal gyrus) in the L1 than the L2 during 300-500 ms, and overall greater involvement of motor ROI (central sulcus) in the L2 than the L1 during 600-800 ms. We interpreted the over-recruitment of the motor area in the L2 as a higher demand for cognitive resources to compensate for the inadequate engagement of the language network. In general, our results indicate a compensatory role of the motor cortex in L2 understanding.
Collapse
Affiliation(s)
- Lili Tian
- Department of Psychology, University of Jyväskylä, Jyväskylä, Finland
- Centre for Interdisciplinary Brain Research, University of Jyväskylä, Jyväskylä, Finland
- School of Foreign Languages, Dalian University of Technology, Dalian, China
- Language and Brain Research Centre, Sichuan International Studies University, Chongqing, China
| | - Hongjun Chen
- School of Foreign Languages, Dalian University of Technology, Dalian, China
| | - Pyry Petteri Heikkinen
- Department of Psychology and Logopedics, Faculty of Medicine, University of Helsinki, Helsinki, Finland
- Faculty of Educational Sciences, University of Helsinki, Helsinki, Finland
| | - Wenya Liu
- Faculty of Information Technology, University of Jyväskylä, Jyväskylä, Finland
| | - Tiina Parviainen
- Department of Psychology, University of Jyväskylä, Jyväskylä, Finland
- Centre for Interdisciplinary Brain Research, University of Jyväskylä, Jyväskylä, Finland
| |
Collapse
|
7
|
Bayram M, Palluel-Germain R, Lebon F, Durand E, Harquel S, Perrone-Bertolotti M. Motor imagery training to improve language processing: What are the arguments? Front Hum Neurosci 2023; 17:982849. [PMID: 36816506 PMCID: PMC9929469 DOI: 10.3389/fnhum.2023.982849] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2022] [Accepted: 01/09/2023] [Indexed: 02/04/2023] Open
Abstract
Studies showed that motor expertise was found to induce improvement in language processing. Grounded and situated approaches attributed this effect to an underlying automatic simulation of the motor experience elicited by action words, similar to motor imagery (MI), and suggest shared representations of action conceptualization. Interestingly, recent results also suggest that the mental simulation of action by MI training induces motor-system modifications and improves motor performance. Consequently, we hypothesize that, since MI training can induce motor-system modifications, it could be used to reinforce the functional connections between motor and language system, and could thus lead to improved language performance. Here, we explore these potential interactions by reviewing recent fundamental and clinical literature in the action-language and MI domains. We suggested that exploiting the link between action language and MI could open new avenues for complementary language improvement programs. We summarize the current literature to evaluate the rationale behind this novel training and to explore the mechanisms underlying MI and its impact on language performance.
Collapse
Affiliation(s)
- Mariam Bayram
- Univ. Grenoble Alpes, Univ. Savoie Mont Blanc, CNRS, LPNC, 38000 Grenoble, France
| | | | - Florent Lebon
- Laboratoire INSERM U1093 Cognition, Action, et Plasticité Sensorimotrice, Université de Bourgogne, Faculté des Sciences du Sport (UFR STAPS), Dijon, France,Institut Universitaire de France (IUF), Paris, France
| | - Edith Durand
- Département d’Orthophonie, Université du Québec à Trois-Rivières, Trois-Rivières, QC, Canada
| | - Sylvain Harquel
- Defitech Chair of Clinical Neuroengineering, Center for Neuroprosthetics (CNP) and Brain Mind Institute (BMI), École Polytechnique Fédérale de Lausanne (EPFL), Geneva, Switzerland
| | - Marcela Perrone-Bertolotti
- Univ. Grenoble Alpes, Univ. Savoie Mont Blanc, CNRS, LPNC, 38000 Grenoble, France,Institut Universitaire de France (IUF), Paris, France,*Correspondence: Marcela Perrone-Bertolotti,
| |
Collapse
|
8
|
Shebani Z, Carota F, Hauk O, Rowe JB, Barsalou LW, Tomasello R, Pulvermüller F. Brain correlates of action word memory revealed by fMRI. Sci Rep 2022; 12:16053. [PMID: 36163225 PMCID: PMC9512810 DOI: 10.1038/s41598-022-19416-w] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/08/2021] [Accepted: 08/29/2022] [Indexed: 11/16/2022] Open
Abstract
Understanding language semantically related to actions activates the motor cortex. This activation is sensitive to semantic information such as the body part used to perform the action (e.g. arm-/leg-related action words). Additionally, motor movements of the hands/feet can have a causal effect on memory maintenance of action words, suggesting that the involvement of motor systems extends to working memory. This study examined brain correlates of verbal memory load for action-related words using event-related fMRI. Seventeen participants saw either four identical or four different words from the same category (arm-/leg-related action words) then performed a nonmatching-to-sample task. Results show that verbal memory maintenance in the high-load condition produced greater activation in left premotor and supplementary motor cortex, along with posterior-parietal areas, indicating that verbal memory circuits for action-related words include the cortical action system. Somatotopic memory load effects of arm- and leg-related words were observed, but only at more anterior cortical regions than was found in earlier studies employing passive reading tasks. These findings support a neurocomputational model of distributed action-perception circuits (APCs), according to which language understanding is manifest as full ignition of APCs, whereas working memory is realized as reverberant activity receding to multimodal prefrontal and lateral temporal areas.
Collapse
Affiliation(s)
- Zubaida Shebani
- Cognition and Brain Sciences Unit, University of Cambridge, 15 Chaucer Road, Cambridge, CB2 7EF, UK.
- Psychology Department, Sultan Qaboos University, Muscat, Oman.
| | - Francesca Carota
- Cognition and Brain Sciences Unit, University of Cambridge, 15 Chaucer Road, Cambridge, CB2 7EF, UK
- Max-Planck Institute for Psycholinguistics, Wundtlaan 1, Nijmegen, The Netherlands
- Brain Language Laboratory, Department of Philosophy, Freie Universität Berlin, 14195, Berlin, Germany
- Berlin School of Mind and Brain, Humboldt Universität zu Berlin, Berlin, Germany
| | - Olaf Hauk
- Cognition and Brain Sciences Unit, University of Cambridge, 15 Chaucer Road, Cambridge, CB2 7EF, UK
| | - James B Rowe
- Cognition and Brain Sciences Unit, University of Cambridge, 15 Chaucer Road, Cambridge, CB2 7EF, UK
- Department of Clinical Neurosciences and Cambridge University Hospitals NHS Trust, Cambridge University, Cambridge, CB2 2QQ, UK
| | - Lawrence W Barsalou
- Institute of Neuroscience and Psychology, University of Glasgow, Glasgow, UK
| | - Rosario Tomasello
- Brain Language Laboratory, Department of Philosophy, Freie Universität Berlin, 14195, Berlin, Germany
- Berlin School of Mind and Brain, Humboldt Universität zu Berlin, Berlin, Germany
- Cluster of Excellence 'Matters of Activity. Image Space Material', Humboldt Universität zu Berlin, 10099, Berlin, Germany
| | - Friedemann Pulvermüller
- Cognition and Brain Sciences Unit, University of Cambridge, 15 Chaucer Road, Cambridge, CB2 7EF, UK
- Brain Language Laboratory, Department of Philosophy, Freie Universität Berlin, 14195, Berlin, Germany
- Berlin School of Mind and Brain, Humboldt Universität zu Berlin, Berlin, Germany
- Cluster of Excellence 'Matters of Activity. Image Space Material', Humboldt Universität zu Berlin, 10099, Berlin, Germany
| |
Collapse
|
9
|
Röders D, Klepp A, Schnitzler A, Biermann-Ruben K, Niccolai V. Induced and Evoked Brain Activation Related to the Processing of Onomatopoetic Verbs. Brain Sci 2022; 12:brainsci12040481. [PMID: 35448012 PMCID: PMC9029984 DOI: 10.3390/brainsci12040481] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2022] [Revised: 03/16/2022] [Accepted: 03/31/2022] [Indexed: 02/01/2023] Open
Abstract
Grounded cognition theory postulates that cognitive processes related to motor or sensory content are processed by brain networks involved in motor execution and perception, respectively. Processing words with auditory features was shown to activate the auditory cortex. Our study aimed at determining whether onomatopoetic verbs (e.g., “tröpfeln”—to dripple), whose articulation reproduces the sound of respective actions, engage the auditory cortex more than non-onomatopoetic verbs. Alpha and beta brain frequencies as well as evoked-related fields (ERFs) were targeted as potential neurophysiological correlates of this linguistic auditory quality. Twenty participants were measured with magnetoencephalography (MEG) while semantically processing visually presented onomatopoetic and non-onomatopoetic German verbs. While a descriptively stronger left temporal alpha desynchronization for onomatopoetic verbs did not reach statistical significance, a larger ERF for onomatopoetic verbs emerged at about 240 ms in the centro-parietal area. Findings suggest increased cortical activation related to onomatopoeias in linguistically relevant areas.
Collapse
Affiliation(s)
- Dorian Röders
- Institute of Clinical Neuroscience and Medical Psychology, Medical Faculty, Heinrich-Heine University, 40225 Duesseldorf, Germany; (A.K.); (A.S.); (K.B.-R.); (V.N.)
- Neural Basis of Learning Lab, Institute for Cognitive Neuroscience, Faculty of Psychology, Ruhr University, 44801 Bochum, Germany
- Correspondence:
| | - Anne Klepp
- Institute of Clinical Neuroscience and Medical Psychology, Medical Faculty, Heinrich-Heine University, 40225 Duesseldorf, Germany; (A.K.); (A.S.); (K.B.-R.); (V.N.)
| | - Alfons Schnitzler
- Institute of Clinical Neuroscience and Medical Psychology, Medical Faculty, Heinrich-Heine University, 40225 Duesseldorf, Germany; (A.K.); (A.S.); (K.B.-R.); (V.N.)
| | - Katja Biermann-Ruben
- Institute of Clinical Neuroscience and Medical Psychology, Medical Faculty, Heinrich-Heine University, 40225 Duesseldorf, Germany; (A.K.); (A.S.); (K.B.-R.); (V.N.)
| | - Valentina Niccolai
- Institute of Clinical Neuroscience and Medical Psychology, Medical Faculty, Heinrich-Heine University, 40225 Duesseldorf, Germany; (A.K.); (A.S.); (K.B.-R.); (V.N.)
| |
Collapse
|
10
|
Xin X, Zhang Q. The Inhibition Effect of Affordances in Action Picture Naming: An ERP Study. J Cogn Neurosci 2022; 34:951-966. [PMID: 35303083 DOI: 10.1162/jocn_a_01847] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
How quickly are different kinds of conceptual knowledge activated in action picture naming? Using a masked priming paradigm, we manipulated the prime category type (artificial vs. natural), prime action type (precision, power, vs. neutral grip), and target action type (precision vs. power grip) in action picture naming, while electrophysiological signals were measured concurrently. Naming latencies showed an inhibition effect in the congruent action type condition compared with the neutral condition. ERP results showed that artificial and natural category primes induced smaller waveforms in precision or power action primes than neutral primes in the time window of 100-200 msec. Time-frequency results consistently presented a power desynchronization of the mu rhythm in the time window of 0-210 msec with precision action type artificial objects compared with neutral primes, which localized at the supplementary motor, precentral and postcentral areas in the left hemisphere. These findings suggest an inhibitory effect of affordances arising at conceptual preparation in action picture naming and provide evidence for embodied cognition.
Collapse
Affiliation(s)
- Xin Xin
- Renmin University of China, Beijing
| | | |
Collapse
|
11
|
Afonso O, Suárez-Coalla P, Cuetos F, Ibáñez A, Sedeño L, García AM. The Embodied Penman: Effector-Specific Motor-Language Integration During Handwriting. Cogn Sci 2020; 43:e12767. [PMID: 31310023 DOI: 10.1111/cogs.12767] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/08/2018] [Revised: 05/23/2019] [Accepted: 05/31/2019] [Indexed: 11/30/2022]
Abstract
Several studies have illuminated how processing manual action verbs (MaVs) affects the programming or execution of concurrent hand movements. Here, to circumvent key confounds in extant designs, we conducted the first assessment of motor-language integration during handwriting-a task in which linguistic and motoric processes are co-substantiated. Participants copied MaVs, non-manual action verbs, and non-action verbs as we collected measures of motor programming and motor execution. Programming latencies were similar across conditions, but execution was faster for MaVs than for the other categories, regardless of whether word meanings were accessed implicitly or explicitly. In line with the Hand-Action-Network Dynamic Language Embodiment (HANDLE) model, such findings suggest that effector-congruent verbs can prime manual movements even during highly automatized tasks in which motoric and verbal processes are naturally intertwined. Our paradigm opens new avenues for fine-grained explorations of embodied language processes.
Collapse
Affiliation(s)
- Olivia Afonso
- Department of Psychology, Health, & Professional Development, Faculty of Health & Life Sciences, Oxford Brookes University
| | | | | | - Agustín Ibáñez
- Laboratory of Experimental Psychology and Neuroscience (LPEN), Institute of Cognitive and Translational Neuroscience (INCYT), INECO Foundation, Favaloro University.,National Scientific and Technical Research Council (CONICET).,Universidad Autónoma del Caribe.,Center for Social and Cognitive Neuroscience (CSCN), School of Psychology, Universidad Adolfo Ibáñez.,Centre of Excellence in Cognition and its Disorders, Australian Research Council (ARC)
| | - Lucas Sedeño
- Laboratory of Experimental Psychology and Neuroscience (LPEN), Institute of Cognitive and Translational Neuroscience (INCYT), INECO Foundation, Favaloro University.,National Scientific and Technical Research Council (CONICET)
| | - Adolfo M García
- Laboratory of Experimental Psychology and Neuroscience (LPEN), Institute of Cognitive and Translational Neuroscience (INCYT), INECO Foundation, Favaloro University.,National Scientific and Technical Research Council (CONICET).,Faculty of Education, National University of Cuyo (UNCuyo)
| |
Collapse
|
12
|
García AM, Hesse E, Birba A, Adolfi F, Mikulan E, Caro MM, Petroni A, Bekinschtein TA, del Carmen García M, Silva W, Ciraolo C, Vaucheret E, Sedeño L, Ibáñez A. Time to Face Language: Embodied Mechanisms Underpin the Inception of Face-Related Meanings in the Human Brain. Cereb Cortex 2020; 30:6051-6068. [PMID: 32577713 PMCID: PMC7673477 DOI: 10.1093/cercor/bhaa178] [Citation(s) in RCA: 21] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/24/2019] [Revised: 04/21/2020] [Accepted: 06/02/2020] [Indexed: 12/18/2022] Open
Abstract
In construing meaning, the brain recruits multimodal (conceptual) systems and embodied (modality-specific) mechanisms. Yet, no consensus exists on how crucial the latter are for the inception of semantic distinctions. To address this issue, we combined electroencephalographic (EEG) and intracranial EEG (iEEG) to examine when nouns denoting facial body parts (FBPs) and nonFBPs are discriminated in face-processing and multimodal networks. First, FBP words increased N170 amplitude (a hallmark of early facial processing). Second, they triggered fast (~100 ms) activity boosts within the face-processing network, alongside later (~275 ms) effects in multimodal circuits. Third, iEEG recordings from face-processing hubs allowed decoding ~80% of items before 200 ms, while classification based on multimodal-network activity only surpassed ~70% after 250 ms. Finally, EEG and iEEG connectivity between both networks proved greater in early (0-200 ms) than later (200-400 ms) windows. Collectively, our findings indicate that, at least for some lexico-semantic categories, meaning is construed through fast reenactments of modality-specific experience.
Collapse
Affiliation(s)
- Adolfo M García
- Universidad de San Andrés, B1644BID Buenos Aires, Argentina
- National Scientific and Technical Research Council (CONICET), C1425FQB Buenos Aires, Argentina
- Faculty of Education, National University of Cuyo (UNCuyo), MM5502GKA Mendoza, Argentina
- Departamento de Lingüística y Literatura, Facultad de Humanidades, Universidad de Santiago de Chile, 9170020 Santiago, Chile
- Global Brain Health Institute, University of California, CA 94158 San Francisco, USA
| | - Eugenia Hesse
- Universidad de San Andrés, B1644BID Buenos Aires, Argentina
- National Scientific and Technical Research Council (CONICET), C1425FQB Buenos Aires, Argentina
| | - Agustina Birba
- Universidad de San Andrés, B1644BID Buenos Aires, Argentina
- National Scientific and Technical Research Council (CONICET), C1425FQB Buenos Aires, Argentina
| | - Federico Adolfi
- National Scientific and Technical Research Council (CONICET), C1425FQB Buenos Aires, Argentina
| | - Ezequiel Mikulan
- Department of Biomedical and Clinical Sciences “L. Sacco”, University of Milan, 20122 Milan, Italy
| | - Miguel Martorell Caro
- National Scientific and Technical Research Council (CONICET), C1425FQB Buenos Aires, Argentina
| | - Agustín Petroni
- Instituto de Ingeniería Biomédica, Facultad de Ingeniería, Universidad de Buenos Aires, C1063ACV Buenos Aires, Argentina
- Laboratorio de Inteligencia Artificial Aplicada, Departamento de Computación, Facultad de Ciencias Exactas y Naturales, Universidad de Buenos Aires, ICC-CONICET, C1063ACV Buenos Aires, Argentina
| | | | - María del Carmen García
- Programa de Cirugía de Epilepsia, Hospital Italiano de Buenos Aires, C1181ACH, Buenos Aires, Argentina
| | - Walter Silva
- Programa de Cirugía de Epilepsia, Hospital Italiano de Buenos Aires, C1181ACH, Buenos Aires, Argentina
| | - Carlos Ciraolo
- Programa de Cirugía de Epilepsia, Hospital Italiano de Buenos Aires, C1181ACH, Buenos Aires, Argentina
| | - Esteban Vaucheret
- Programa de Cirugía de Epilepsia, Hospital Italiano de Buenos Aires, C1181ACH, Buenos Aires, Argentina
| | - Lucas Sedeño
- National Scientific and Technical Research Council (CONICET), C1425FQB Buenos Aires, Argentina
| | - Agustín Ibáñez
- Universidad de San Andrés, B1644BID Buenos Aires, Argentina
- National Scientific and Technical Research Council (CONICET), C1425FQB Buenos Aires, Argentina
- Global Brain Health Institute, University of California, CA 94158 San Francisco, USA
- Center for Social and Cognitive Neuroscience (CSCN), School of Psychology, Universidad Adolfo Ibáñez, 8320000, Santiago, Chile
- Universidad Autónoma del Caribe, 080003, Barranquilla, Colombia
| |
Collapse
|
13
|
Tian L, Chen H, Zhao W, Wu J, Zhang Q, De A, Leppänen P, Cong F, Parviainen T. The role of motor system in action-related language comprehension in L1 and L2: An fMRI study. BRAIN AND LANGUAGE 2020; 201:104714. [PMID: 31790907 DOI: 10.1016/j.bandl.2019.104714] [Citation(s) in RCA: 28] [Impact Index Per Article: 5.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/11/2018] [Revised: 08/02/2019] [Accepted: 11/02/2019] [Indexed: 06/10/2023]
Abstract
The framework of embodied cognition has challenged the modular view of a language-cognition divide by suggesting that meaning-retrieval critically involves the sensory-motor system. Despite extensive research into the neural mechanisms underlying language-motor coupling, it remains unclear how the motor system might be differentially engaged by different levels of linguistic abstraction and language proficiency. To address this issue, we used fMRI to quantify neural activations in brain regions underlying motor and language processing in Chinese-English speakers' processing of literal, metaphorical, and abstract language in their L1 and L2. Results overall revealed a response in motor ROIs gradually attenuating in intensity from literal to abstract via metaphorical language in both L1 and L2. Furthermore, contrast analyses between L1 and L2 showed overall greater activations of motor ROIs in the L2. We conclude that motor involvement in language processing is graded rather than all-or-none and that the motor system has a dual-functional role.
Collapse
Affiliation(s)
- Lili Tian
- School of Foreign Languages, Dalian University of Technology, Dalian 116024, China; Department of Psychology, University of Jyväskylä, Jyväskylä 40014, Finland; Language and Brain Research Center, Sichuan International Studies University, Chongqing 400031, China
| | - Hongjun Chen
- School of Foreign Languages, Dalian University of Technology, Dalian 116024, China.
| | - Wei Zhao
- School of Biomedical Engineering, Faculty of Electronic Information and Electrical Engineering, Dalian University of Technology, Dalian 116024, China
| | - Jianlin Wu
- Department of Radiology, Affiliated Zhongshan Hospital of Dalian University, Dalian 116001, China
| | - Qing Zhang
- Department of Radiology, Affiliated Zhongshan Hospital of Dalian University, Dalian 116001, China
| | - Ailing De
- Department of Radiology, Affiliated Zhongshan Hospital of Dalian University, Dalian 116001, China
| | - Paavo Leppänen
- Department of Psychology, University of Jyväskylä, Jyväskylä 40014, Finland
| | - Fengyu Cong
- School of Biomedical Engineering, Faculty of Electronic Information and Electrical Engineering, Dalian University of Technology, Dalian 116024, China; Faculty of Information Technology, University of Jyväskylä, Jyväskylä 40014, Finland
| | - Tiina Parviainen
- Department of Psychology, University of Jyväskylä, Jyväskylä 40014, Finland; Centre for Interdisciplinary Brain Research, University of Jyväskylä, Jyväskylä 40014, Finland.
| |
Collapse
|
14
|
Klepp A, van Dijk H, Niccolai V, Schnitzler A, Biermann-Ruben K. Action verb processing specifically modulates motor behaviour and sensorimotor neuronal oscillations. Sci Rep 2019; 9:15985. [PMID: 31690784 PMCID: PMC6831701 DOI: 10.1038/s41598-019-52426-9] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2019] [Accepted: 10/14/2019] [Indexed: 11/09/2022] Open
Abstract
Understanding action-related language recruits the brain’s motor system and can interact with motor behaviour. The current study shows MEG oscillatory patterns during verb-motor priming. Hand and foot verbs were followed by hand or foot responses, with faster reaction times for congruent conditions. In ROIs placed in the hand/arm and foot/leg portions of the sensorimotor cortex, this behavioural priming effect was accompanied by modulations in MEG oscillatory patterns preceding the responses. Power suppression in the alpha/beta frequency bands was reduced in congruent conditions in the body-part-specific ROIs. These results imply that the verb-motor priming effect may be a direct consequence of motor cortex contributions to action word processing.
Collapse
Affiliation(s)
- Anne Klepp
- Institute of Clinical Neuroscience and Medical Psychology, Medical Faculty, Heinrich Heine University, 40225, Düsseldorf, Germany.
| | | | - Valentina Niccolai
- Institute of Clinical Neuroscience and Medical Psychology, Medical Faculty, Heinrich Heine University, 40225, Düsseldorf, Germany
| | - Alfons Schnitzler
- Institute of Clinical Neuroscience and Medical Psychology, Medical Faculty, Heinrich Heine University, 40225, Düsseldorf, Germany
| | - Katja Biermann-Ruben
- Institute of Clinical Neuroscience and Medical Psychology, Medical Faculty, Heinrich Heine University, 40225, Düsseldorf, Germany
| |
Collapse
|
15
|
How meaning unfolds in neural time: Embodied reactivations can precede multimodal semantic effects during language processing. Neuroimage 2019; 197:439-449. [PMID: 31059796 DOI: 10.1016/j.neuroimage.2019.05.002] [Citation(s) in RCA: 31] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2018] [Revised: 03/08/2019] [Accepted: 05/02/2019] [Indexed: 02/08/2023] Open
Abstract
Research on how the brain construes meaning during language use has prompted two conflicting accounts. According to the 'grounded view', word understanding involves quick reactivations of sensorimotor (embodied) experiences evoked by the stimuli, with simultaneous or later engagement of multimodal (conceptual) systems integrating information from various sensory streams. Contrariwise, for the 'symbolic view', this capacity depends crucially on multimodal operations, with embodied systems playing epiphenomenal roles after comprehension. To test these contradictory hypotheses, the present magnetoencephalography study assessed implicit semantic access to grammatically constrained action and non-action verbs (n = 100 per category) while measuring spatiotemporally precise signals from the primary motor cortex (M1, a core region subserving bodily movements) and the anterior temporal lobe (ATL, a putative multimodal semantic hub). Convergent evidence from sensor- and source-level analyses revealed that increased modulations for action verbs occurred earlier in M1 (∼130-190 ms) than in specific ATL hubs (∼250-410 ms). Moreover, machine-learning decoding showed that trial-by-trial classification peaks emerged faster in M1 (∼100-175 ms) than in the ATL (∼345-500 ms), with over 71% accuracy in both cases. Considering their latencies, these results challenge the 'symbolic view' and its implication that sensorimotor mechanisms play only secondary roles in semantic processing. Instead, our findings support the 'grounded view', showing that early semantic effects are critically driven by embodied reactivations and that these cannot be reduced to post-comprehension epiphenomena, even when words are individually classified. Briefly, our study offers non-trivial insights to constrain fine-grained models of language and understand how meaning unfolds in neural time.
Collapse
|
16
|
Does watching Han Solo or C-3PO similarly influence our language processing? PSYCHOLOGICAL RESEARCH 2019; 84:1572-1585. [PMID: 30931488 DOI: 10.1007/s00426-019-01169-3] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2018] [Accepted: 03/19/2019] [Indexed: 12/14/2022]
Abstract
Several studies have demonstrated that perceiving an action influences the subsequent processing of action verbs. However, which characteristics of the perceived action are truly determinant to enable this influence is still unknown. The current study investigated the role of the agent executing an action in this action-language relationship. Participants performed a semantic decision task after seeing a video of a human or a robot performing an action. The results of the first study showed that perceiving a human being executing an action as well as perceiving a robot facilitate subsequent language processing, suggesting that the humanness (The term "humanness" is used as meaning "belonging to human race" and not to refer to a personal quality) of the agent is not crucial in the link between action and language. However, this experiment was conducted with Japanese people who are very familiar with robots; thus, an alternative explanation could be that it is the unfamiliarity with the agent that could perturb the action-language relationship. To assess this hypothesis, we carried out two additional experiments with French participants. The results of the second study showed that, unlike the observation of a human agent, the observation of a robot did not influence language processing. Finally, the results of the third study showed that, after a familiarization phase, French participants too were influenced by the observation of a robot. Overall, the outcomes of these studies indicate that, more than the humanness of the agent, it is the familiarity which we have with this agent that is crucial in the action-language relationship.
Collapse
|
17
|
Shebani Z, Pulvermüller F. Flexibility in Language Action Interaction: The Influence of Movement Type. Front Hum Neurosci 2018; 12:252. [PMID: 29988612 PMCID: PMC6026896 DOI: 10.3389/fnhum.2018.00252] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2018] [Accepted: 05/30/2018] [Indexed: 11/13/2022] Open
Abstract
Recent neuropsychological studies in neurological patients and healthy subjects suggest a close functional relationship between the brain systems for language and action. Facilitation and inhibition effects of motor system activity on language processing have been demonstrated as well as causal effects in the reverse direction, from language processes on motor excitability or performance. However, as the documented effects between motor and language systems were sometimes facilitatory and sometimes inhibitory, the “sign” of these effects still remains to be explained. In a previous study, we reported a word-category-specific differential impairment of verbal working memory for concordant arm- and leg-related action words brought about by complex sequential movements of the hands and feet. In this article, we seek to determine whether the sign of the functional interaction between language and action systems of the human brain can be changed in a predictable manner by changing movement type. We here report that the sign of the effect of motor movement on action word memory can be reversed from interference to facilitation if, instead of complex movement sequences, simple repetitive movements are performed. Specifically, when engaged in finger tapping, subjects were able to remember relatively more arm-related action words (as compared to control conditions), thus documenting an enhancement of working memory brought about by simple hand movements. In contrast, when performing complex sequences of finger movements, an effector-specific degradation of action word memory was found. By manipulating the sign of the effect in accord with theory-driven predictions, these findings provide support for shared neural bases for motor movement and verbal working memory for action-related words and strengthen the argument that motor systems play a causal and functionally relevant role in language processing semantically related to action.
Collapse
Affiliation(s)
- Zubaida Shebani
- Cognition and Brain Sciences Unit, University of Cambridge, Cambridge, United Kingdom.,Linguistics Department, College of Humanities and Social Sciences, United Arab Emirates University, Al-Ain, United Arab Emirates
| | - Friedemann Pulvermüller
- Brain Language Laboratory, Department of Philosophy and Humanities, Freie Universität Berlin, Berlin, Germany.,Berlin School of Mind and Brain, Humboldt Universität zu Berlin, Berlin, Germany.,Einstein Center for Neurosciences, Berlin, Germany
| |
Collapse
|
18
|
Semantic discrimination impacts tDCS modulation of verb processing. Sci Rep 2017; 7:17162. [PMID: 29215039 PMCID: PMC5719444 DOI: 10.1038/s41598-017-17326-w] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2017] [Accepted: 11/17/2017] [Indexed: 12/31/2022] Open
Abstract
Motor cortex activation observed during body-related verb processing hints at simulation accompanying linguistic understanding. By exploiting the up- and down-regulation that anodal and cathodal transcranial direct current stimulation (tDCS) exert on motor cortical excitability, we aimed at further characterizing the functional contribution of the motor system to linguistic processing. In a double-blind sham-controlled within-subjects design, online stimulation was applied to the left hemispheric hand-related motor cortex of 20 healthy subjects. A dual, double-dissociation task required participants to semantically discriminate concrete (hand/foot) from abstract verb primes as well as to respond with the hand or with the foot to verb-unrelated geometric targets. Analyses were conducted with linear mixed models. Semantic priming was confirmed by faster and more accurate reactions when the response effector was congruent with the verb's body part. Cathodal stimulation induced faster responses for hand verb primes thus indicating a somatotopical distribution of cortical activation as induced by body-related verbs. Importantly, this effect depended on performance in semantic discrimination. The current results point to verb processing being selectively modifiable by neuromodulation and at the same time to a dependence of tDCS effects on enhanced simulation. We discuss putative mechanisms operating in this reciprocal dependence of neuromodulation and motor resonance.
Collapse
|
19
|
Strozyk JV, Dudschig C, Kaup B. Do I need to have my hands free to understand hand-related language? Investigating the functional relevance of experiential simulations. PSYCHOLOGICAL RESEARCH 2017; 83:406-418. [PMID: 28770384 DOI: 10.1007/s00426-017-0900-8] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2016] [Accepted: 07/27/2017] [Indexed: 01/22/2023]
Abstract
Theories of embodiment state that people mentally simulate the described situations and events during language comprehension. While several studies have provided evidence that these simulations exist, it is still unclear whether they are functionally relevant for comprehension. To investigate this question, we studied the effects of a secondary task on the processing of hand- and foot-related nouns. The secondary task occupied either the hand or the foot system, thereby impeding hand- or foot-related simulations, respectively. Participants performed a lexical decision task by responding to the presented nouns with their left hand or foot, depending on the color of the words, while withholding their response to pseudowords. In half of the experimental blocks, participants performed a simultaneous tapping task with their right hand (Experiment 1) or foot (Experiment 2). If simulations are functionally relevant for comprehension, the secondary task should affect the processing of hand words to a larger degree than the processing foot words in Experiment 1 and vice versa in Experiment 2. In both experiments, hand responses were faster for hand words than foot words, whereas the opposite was true for foot responses. This finding indicates that participants indeed simulated the words' meanings. Importantly, there was no difference between the influence of the hand tapping and the foot tapping task on lexical decision times to hand and foot words, indicating that experiential simulation might just be an optional by-product of language processing.
Collapse
Affiliation(s)
| | - Carolin Dudschig
- Fachbereich Psychologie, University of Tübingen, Schleichstr. 4, 72076, Tübingen, Germany
| | - Barbara Kaup
- Fachbereich Psychologie, University of Tübingen, Schleichstr. 4, 72076, Tübingen, Germany
| |
Collapse
|
20
|
Klepp A, Niccolai V, Sieksmeyer J, Arnzen S, Indefrey P, Schnitzler A, Biermann-Ruben K. Body-part specific interactions of action verb processing with motor behaviour. Behav Brain Res 2017; 328:149-158. [DOI: 10.1016/j.bbr.2017.04.002] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/24/2016] [Revised: 03/27/2017] [Accepted: 04/01/2017] [Indexed: 12/01/2022]
|
21
|
Schaller F, Weiss S, Müller HM. “Pushing the Button While Pushing the Argument”: Motor Priming of Abstract Action Language. Cogn Sci 2016; 41:1328-1349. [DOI: 10.1111/cogs.12433] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2015] [Revised: 05/13/2016] [Accepted: 05/16/2016] [Indexed: 11/29/2022]
Affiliation(s)
- Franziska Schaller
- Experimental Neurolinguistics Group; Bielefeld University
- Cluster of Excellence “Cognitive Interaction Technology”; Bielefeld University
| | - Sabine Weiss
- Experimental Neurolinguistics Group; Bielefeld University
- Cluster of Excellence “Cognitive Interaction Technology”; Bielefeld University
| | - Horst M. Müller
- Experimental Neurolinguistics Group; Bielefeld University
- Cluster of Excellence “Cognitive Interaction Technology”; Bielefeld University
| |
Collapse
|
22
|
Niccolai V, Klepp A, Weissler H, Hoogenboom N, Schnitzler A, Biermann-Ruben K. Correction: Grasping Hand Verbs: Oscillatory Beta and Alpha Correlates of Action-Word Processing. PLoS One 2016; 11:e0161985. [PMID: 27557044 PMCID: PMC4996496 DOI: 10.1371/journal.pone.0161985] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022] Open
|
23
|
Abstract
Theories of embodied cognition positing that sensorimotor areas are indispensable during language comprehension are supported by neuroimaging and behavioural studies. Among others, the auditory system has been suggested to be important for understanding sound-related words (visually presented) and the motor system for action-related words. In this behavioural study, using a sound detection task embedded in a lexical decision task, we show that in participants with high lexical decision performance sound verbs improve auditory perception. The amount of modulation was correlated with lexical decision performance. Our study provides convergent behavioural evidence of auditory cortex involvement in word processing, supporting the view of embodied language comprehension concerning the auditory domain.
Collapse
|
24
|
Grisoni L, Dreyer FR, Pulvermüller F. Somatotopic Semantic Priming and Prediction in the Motor System. Cereb Cortex 2016; 26:2353-66. [PMID: 26908635 PMCID: PMC4830302 DOI: 10.1093/cercor/bhw026] [Citation(s) in RCA: 48] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/14/2022] Open
Abstract
The recognition of action-related sounds and words activates motor regions, reflecting the semantic grounding of these symbols in action information; in addition, motor cortex exerts causal influences on sound perception and language comprehension. However, proponents of classic symbolic theories still dispute the role of modality-preferential systems such as the motor cortex in the semantic processing of meaningful stimuli. To clarify whether the motor system carries semantic processes, we investigated neurophysiological indexes of semantic relationships between action-related sounds and words. Event-related potentials revealed that action-related words produced significantly larger stimulus-evoked (Mismatch Negativity-like) and predictive brain responses (Readiness Potentials) when presented in body-part-incongruent sound contexts (e.g., “kiss” in footstep sound context; “kick” in whistle context) than in body-part-congruent contexts, a pattern reminiscent of neurophysiological correlates of semantic priming. Cortical generators of the semantic relatedness effect were localized in areas traditionally associated with semantic memory, including left inferior frontal cortex and temporal pole, and, crucially, in motor areas, where body-part congruency of action sound–word relationships was indexed by a somatotopic pattern of activation. As our results show neurophysiological manifestations of action-semantic priming in the motor cortex, they prove semantic processing in the motor system and thus in a modality-preferential system of the human brain.
Collapse
Affiliation(s)
- Luigi Grisoni
- Brain Language Laboratory, Department of Philosophy and Humanities, Freie Universtät Berlin, 14195 Berlin, Germany
| | - Felix R Dreyer
- Brain Language Laboratory, Department of Philosophy and Humanities, Freie Universtät Berlin, 14195 Berlin, Germany
| | - Friedemann Pulvermüller
- Brain Language Laboratory, Department of Philosophy and Humanities, Freie Universtät Berlin, 14195 Berlin, Germany Berlin School of Mind and Brain, Humboldt-Universität zu Berlin, 10099 Berlin, Germany
| |
Collapse
|
25
|
Mollo G, Pulvermüller F, Hauk O. Movement priming of EEG/MEG brain responses for action-words characterizes the link between language and action. Cortex 2015; 74:262-76. [PMID: 26706997 PMCID: PMC4729318 DOI: 10.1016/j.cortex.2015.10.021] [Citation(s) in RCA: 41] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/08/2014] [Revised: 08/06/2015] [Accepted: 10/24/2015] [Indexed: 12/20/2022]
Abstract
Activation in sensorimotor areas of the brain following perception of linguistic stimuli referring to objects and actions has been interpreted as evidence for strong theories of embodied semantics. Although a large number of studies have demonstrated this “language-to-action” link, important questions about how activation in the sensorimotor system affects language performance (“action-to-language” link) are yet unanswered. As several authors have recently pointed out, the debate should move away from an “embodied or not” focus, and rather aim to characterize the functional contributions of sensorimotor systems to language processing in more detail. For this purpose, we here introduce a novel movement priming paradigm in combination with electro- and magnetoencephalography (EEG/MEG), which allows investigating effects of motor cortex pre-activation on the spatio-temporal dynamics of action-word evoked brain activation. Participants initiated experimental trials by either finger- or foot-movements before executing a two alternative forced choice task employing action-words. We found differential brain activation during the early stages of subsequent hand- and leg-related word processing, respectively, albeit in the absence of behavioral effects. Distributed source estimation based on combined EEG/MEG measurements revealed that congruency effects between effector type used for response initiation (hand or foot) and action-word category (hand- or foot-related) occurred not only in motor cortex, but also in a classical language comprehension area, posterior superior temporal cortex, already 150 msec after the visual presentation of the word stimulus. This suggests that pre-activation of hand- and leg-motor networks may differentially facilitate the ignition of semantic cell assemblies for hand- and leg-related words, respectively. Our results demonstrate the usefulness of movement priming in combination with neuroimaging to functionally characterize the link between language and sensorimotor systems.
Collapse
Affiliation(s)
- Giovanna Mollo
- Medical Research Council Cognition and Brain Sciences Unit, Cambridge, UK; University of York, Department of Psychology, York, UK; Institute for Advanced Biomedical Technologies, G D'Annunzio University, Chieti, Italy
| | - Friedemann Pulvermüller
- Medical Research Council Cognition and Brain Sciences Unit, Cambridge, UK; Brain Language Laboratory, Department of Philosophy, Freie Universität Berlin, Germany
| | - Olaf Hauk
- Medical Research Council Cognition and Brain Sciences Unit, Cambridge, UK.
| |
Collapse
|
26
|
Are the motor features of verb meanings represented in the precentral motor cortices? Yes, but within the context of a flexible, multilevel architecture for conceptual knowledge. Psychon Bull Rev 2015; 22:1068-75. [DOI: 10.3758/s13423-014-0784-1] [Citation(s) in RCA: 88] [Impact Index Per Article: 8.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
27
|
Language-motor interference reflected in MEG beta oscillations. Neuroimage 2015; 109:438-48. [PMID: 25576646 DOI: 10.1016/j.neuroimage.2014.12.077] [Citation(s) in RCA: 38] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/21/2014] [Revised: 12/04/2014] [Accepted: 12/29/2014] [Indexed: 11/21/2022] Open
Abstract
The involvement of the brain's motor system in action-related language processing can lead to overt interference with simultaneous action execution. The aim of the current study was to find evidence for this behavioural interference effect and to investigate its neurophysiological correlates using oscillatory MEG analysis. Subjects performed a semantic decision task on single action verbs, describing actions executed with the hands or the feet, and abstract verbs. Right hand button press responses were given for concrete verbs only. Therefore, longer response latencies for hand compared to foot verbs should reflect interference. We found interference effects to depend on verb imageability: overall response latencies for hand verbs did not differ significantly from foot verbs. However, imageability interacted with effector: while response latencies to hand and foot verbs with low imageability were equally fast, those for highly imageable hand verbs were longer than for highly imageable foot verbs. The difference is reflected in motor-related MEG beta band power suppression, which was weaker for highly imageable hand verbs compared with highly imageable foot verbs. This provides a putative neuronal mechanism for language-motor interference where the involvement of cortical hand motor areas in hand verb processing interacts with the typical beta suppression seen before movements. We found that the facilitatory effect of higher imageability on action verb processing time is perturbed when verb and motor response relate to the same body part. Importantly, this effect is accompanied by neurophysiological effects in beta band oscillations. The attenuated power suppression around the time of movement, reflecting decreased cortical excitability, seems to result from motor simulation during action-related language processing. This is in line with embodied cognition theories.
Collapse
|
28
|
da Silva HS, Machado J, Cravo A, Parente MADMP, Carthery-Goulart MT. Action/Verb processing: Debates in neuroimaging and the contribution of studies in patients with Parkinson's disease. Dement Neuropsychol 2014; 8:3-13. [PMID: 29213873 PMCID: PMC5619442 DOI: 10.1590/s1980-57642014dn81000002] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
The objective of the current review was to verify whether studies investigating lexical-semantic difficulties in patients with Parkinson's disease (PD) support the Embodied Cognition model. Under this framework, it is predicted that patients with PD will have more difficulties in the semantic processing of action concepts (action verbs) than of motionless objects. We also verified how and whether these studies are following current debates of Neuroscience, particularly the debate between the Lexical and the Embodied Cognition models. Recent neuroimaging studies on the neural basis of the semantics of verbs were presented, as well as others that focused on the neural processing of verbs in PD. We concluded that few studies suitably verified the Embodied Cognition theory in the context of PD, especially using neuroimaging techniques. These limitations show there is much to investigate on the semantic difficulties with action verbs in these patients, where it is particularly important to control for psycholinguistic variables and the inherent semantic characteristics of verbs in future studies.
Collapse
Affiliation(s)
- Henrique Salmazo da Silva
- UFABC - Federal University of ABC. Center of Mathematics, Computation and Cognition. Neuroscience and Cognition Post-graduation. Language and Cognition Research Group (GELC-UFABC), Santo André, SP, Brazil
| | - Juliana Machado
- UFABC - Federal University of ABC. Center of Mathematics, Computation and Cognition. Neuroscience and Cognition Post-graduation. Language and Cognition Research Group (GELC-UFABC), Santo André, SP, Brazil
| | - André Cravo
- UFABC - Federal University of ABC. Center of Mathematics, Computation and Cognition. Neuroscience and Cognition Post-graduation. Language and Cognition Research Group (GELC-UFABC), Santo André, SP, Brazil
| | - Maria Alice de Mattos Pimenta Parente
- UFABC - Federal University of ABC. Center of Mathematics, Computation and Cognition. Neuroscience and Cognition Post-graduation. Language and Cognition Research Group (GELC-UFABC), Santo André, SP, Brazil
| | - Maria Teresa Carthery-Goulart
- UFABC - Federal University of ABC. Center of Mathematics, Computation and Cognition. Neuroscience and Cognition Post-graduation. Language and Cognition Research Group (GELC-UFABC), Santo André, SP, Brazil.,Behavioural and Cognitive Neurology Unit, University of São Paulo, School of Medicine, São Paulo, Brazil
| |
Collapse
|