1
|
Delogu F, Aurnhammer C, Brouwer H, Crocker MW. On the biphasic nature of the N400-P600 complex underlying language comprehension. Brain Cogn 2025; 186:106293. [PMID: 40154214 DOI: 10.1016/j.bandc.2025.106293] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/18/2024] [Revised: 03/13/2025] [Accepted: 03/13/2025] [Indexed: 04/01/2025]
Abstract
The ERP literature on language comprehension reveals variability in observing monophasic N400 versus biphasic N400-P600 effects in response to incongruent input, with the reasons for this inconsistency remaining unclear. Two interrelated factors may contribute: spatiotemporal overlap between the N400 and P600, where a strong N400-effect can obscure the P600, and the P600's sensitivity to depth of processing, as determined by the experimental setting. Building on previous findings reporting monophasic N400-effects with plausibility judgments, we investigated whether comprehension questions, encouraging more natural reading and deeper processing of the full content, would elicit a biphasic effect, suggesting reduced component overlap in such settings. Using a design fully crossing lexical association and plausibility, we found that the N400 is modulated by association and the P600 by plausibility. Crucially, a biphasic pattern emerged for implausible and unrelated words, suggesting a mitigation of component overlap compared to previous studies employing plausibility judgments. We interpret the results in light of current accounts of the N400 and P600, arguing that the empirical evidence strongly supports single-stream over multi-stream models. Importantly, our findings highlight the critical role of both component overlap and task demands in shaping the data that inform the development and evaluation of theoretical models.
Collapse
Affiliation(s)
- Francesca Delogu
- Department of Language Science and Technology, Saarland University, Saarbrücken, D-66123, Germany.
| | - Christoph Aurnhammer
- Department of Language Science and Technology, Saarland University, Saarbrücken, D-66123, Germany
| | - Harm Brouwer
- Department of Language Science and Technology, Saarland University, Saarbrücken, D-66123, Germany; Department of Cognitive Science and Artificial Intelligence, Tilburg University, Tilburg, The Netherlands
| | - Matthew W Crocker
- Department of Language Science and Technology, Saarland University, Saarbrücken, D-66123, Germany
| |
Collapse
|
2
|
Milligan S, Elaboudi A, Nestor B, Schotter ER. Individual differences in subcomponents of the N400: Comprehension ability predicts contextual support effects while spelling ability predicts orthographic anomaly effects. COGNITIVE, AFFECTIVE & BEHAVIORAL NEUROSCIENCE 2025:10.3758/s13415-025-01280-6. [PMID: 40075023 DOI: 10.3758/s13415-025-01280-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 02/07/2025] [Indexed: 03/14/2025]
Abstract
The N400 ERP component has been characterized as a response reflecting binding of semantic memory states to create a "multimodal conceptual representation" (Kutas & Federmeier, 2011). An assumption of this characterization is that the measured response itself reflects the synchronization of various neural processes required for language comprehension. Less is known, however, about how these processes vary across individuals and how specific language skills may modulate particular underlying subcomponents of the N400. In the current study, we measured the N400 response to words that were (1) unexpected (i.e., low cloze in low constraint) or (2) orthographically related (OR) anomalies compared with expected words (i.e., high cloze in high constraint), and we investigated how these effects were related to participants' reading comprehension ability, vocabulary, and spelling ability. We found that contextual support N400 effects were larger for individuals with superior reading comprehension skills, whereas OR anomaly N400 effects were larger for individuals with superior spelling ability. These findings support the characterization of the N400 as a composite of various comprehension-related neural processes. The current study demonstrates that individual differentiation in the strength of these skills is differentially associated with the N400 subcomponents related to contextual facilitation and orthographic processing. Reading comprehension ability is associated with stronger contextual support effects, which may reflect more effective use of contextual support in facilitating semantic retrieval. Spelling skill is more strongly associated with OR anomaly effects (in contexts supporting an orthographic neighbor of the presented anomalous word), which may reflect more precise word identification.
Collapse
Affiliation(s)
- Sara Milligan
- Department of Psychology, University of South Florida, 4202 E. Fowler Ave. PCD 4118G, Tampa, FL, 33620, USA.
| | - Ayah Elaboudi
- Department of Psychology, University of South Florida, 4202 E. Fowler Ave. PCD 4118G, Tampa, FL, 33620, USA
| | - Brian Nestor
- Tufts University School of Medicine, Boston, MA, USA
| | - Elizabeth R Schotter
- Department of Psychology, University of South Florida, 4202 E. Fowler Ave. PCD 4118G, Tampa, FL, 33620, USA
| |
Collapse
|
3
|
Toffolo KK, Freedman EG, Foxe JJ. Neurophysiological measures of covert semantic processing in neurotypical adolescents actively ignoring spoken sentence inputs: A high-density event-related potential (ERP) study. Neuroscience 2024; 560:238-253. [PMID: 39369943 DOI: 10.1016/j.neuroscience.2024.10.008] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/29/2024] [Revised: 10/01/2024] [Accepted: 10/03/2024] [Indexed: 10/08/2024]
Abstract
Language comprehension requires semantic processing of individual words and their context within a sentence. Well-characterized event-related potential (ERP) components (the N400 and late positivity component (LPC/P600)) provide neuromarkers of semantic processing, and are robustly evoked when semantic errors are introduced into sentences. These measures are useful for evaluating semantic processing in clinical populations, but it is not known whether they can be evoked in more severe neurodevelopmental disorders where explicit attention to the sentence inputs cannot be objectively assessed (i.e., when sentences are passively listened to). We evaluated whether N400 and LPC/P600 could be detected in adolescents who were explicitly ignoring sentence inputs. Specifically, it was asked whether explicit attention to spoken inputs was required for semantic processing, or if a degree of automatic processing occurs when the focus of attention is directed elsewhere? High-density ERPs were acquired from twenty-two adolescents (12-17 years), under two experimental conditions: 1. individuals actively determined whether the final word in a sentence was congruent or incongruent with sentence context, or 2. passively listened to background sentences while watching a video. When sentences were ignored, N400 and LPC/P600 were robustly evoked to semantic errors, albeit with reduced amplitudes and protracted/delayed latencies. Statistically distinct topographic distributions during passive versus active paradigms pointed to distinct generator configurations for semantic processing as a function of attention. Covert semantic processing continues in neurotypical adolescents when explicit attention is withdrawn from sentence inputs. As such, this approach could be used to objectively investigate semantic processing in populations with communication deficits.
Collapse
Affiliation(s)
- Kathryn K Toffolo
- The Frederick J. and Marion A. Schindler Cognitive Neurophysiology Laboratory, The Del Monte Institute for Neuroscience, Department of Neuroscience, University of Rochester School of Medicine and Dentistry, Rochester, NY 14620, USA
| | - Edward G Freedman
- The Frederick J. and Marion A. Schindler Cognitive Neurophysiology Laboratory, The Del Monte Institute for Neuroscience, Department of Neuroscience, University of Rochester School of Medicine and Dentistry, Rochester, NY 14620, USA
| | - John J Foxe
- The Frederick J. and Marion A. Schindler Cognitive Neurophysiology Laboratory, The Del Monte Institute for Neuroscience, Department of Neuroscience, University of Rochester School of Medicine and Dentistry, Rochester, NY 14620, USA.
| |
Collapse
|
4
|
Giglio L, Sharoh D, Ostarek M, Hagoort P. Connectivity of Fronto-Temporal Regions in Syntactic Structure Building During Speaking and Listening. NEUROBIOLOGY OF LANGUAGE (CAMBRIDGE, MASS.) 2024; 5:922-941. [PMID: 39439740 PMCID: PMC11495677 DOI: 10.1162/nol_a_00154] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/23/2024] [Accepted: 07/09/2024] [Indexed: 10/25/2024]
Abstract
The neural infrastructure for sentence production and comprehension has been found to be mostly shared. The same regions are engaged during speaking and listening, with some differences in how strongly they activate depending on modality. In this study, we investigated how modality affects the connectivity between regions previously found to be involved in syntactic processing across modalities. We determined how constituent size and modality affected the connectivity of the pars triangularis of the left inferior frontal gyrus (LIFG) and of the left posterior temporal lobe (LPTL) with the pars opercularis of the LIFG, the left anterior temporal lobe (LATL), and the rest of the brain. We found that constituent size reliably increased the connectivity across these frontal and temporal ROIs. Connectivity between the two LIFG regions and the LPTL was enhanced as a function of constituent size in both modalities, and it was upregulated in production possibly because of linearization and motor planning in the frontal cortex. The connectivity of both ROIs with the LATL was lower and only enhanced for larger constituent sizes, suggesting a contributing role of the LATL in sentence processing in both modalities. These results thus show that the connectivity among fronto-temporal regions is upregulated for syntactic structure building in both sentence production and comprehension, providing further evidence for accounts of shared neural resources for sentence-level processing across modalities.
Collapse
Affiliation(s)
- Laura Giglio
- Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands
- Donders Institute for Brain, Cognition and Behaviour, Nijmegen, The Netherlands
| | - Daniel Sharoh
- Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands
- Donders Institute for Brain, Cognition and Behaviour, Nijmegen, The Netherlands
| | - Markus Ostarek
- Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands
| | - Peter Hagoort
- Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands
- Donders Institute for Brain, Cognition and Behaviour, Nijmegen, The Netherlands
| |
Collapse
|
5
|
Wolpert M, Ao J, Zhang H, Baum S, Steinhauer K. The child the apple eats: processing of argument structure in Mandarin verb-final sentences. Sci Rep 2024; 14:20459. [PMID: 39227638 PMCID: PMC11372106 DOI: 10.1038/s41598-024-70318-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2023] [Accepted: 08/14/2024] [Indexed: 09/05/2024] Open
Abstract
Mandarin Chinese is typologically unusual among the world's languages in having flexible word order despite a near absence of inflectional morphology. These features of Mandarin challenge conventional linguistic notions such as subject and object and the divide between syntax and semantics. In the present study, we tested monolingual processing of argument structure in Mandarin verb-final sentences, where word order alone is not a reliable cue. We collected participants' responses to a forced agent-assignment task while measuring their electroencephalography data to capture real-time processing throughout each sentence. We found that sentence interpretation was not informed by word order in the absence of other cues, and while the coverbs BA and BEI were strong signals for agent selection, comprehension was a result of multiple cues. These results challenge previous reports of a linear ranking of cue strength. Event-related potentials showed that BA and BEI impacted participants' processing even before the verb was read and that role reversal anomalies elicited an N400 effect without a subsequent semantic P600. This study demonstrates that Mandarin sentence comprehension requires online interaction among cues in a language-specific manner, consistent with models that predict crosslinguistic differences in core sentence processing mechanisms.
Collapse
Affiliation(s)
- Max Wolpert
- Key Laboratory for Biomedical Engineering of Ministry of Education, College of Biomedical Engineering and Instrument Sciences, Zhejiang University, Hangzhou, 310027, China.
- Integrated Program in Neuroscience, McGill University, Room 302 Irving Ludmer Building, 1033 Pine Avenue West, Montreal, QC, H3A 1A1, Canada.
- Centre for Research on Brain, Language and Music, 2001 Av. McGill College #6, Montreal, QC, H3A 1G1, Canada.
| | - Jiarui Ao
- Integrated Program in Neuroscience, McGill University, Room 302 Irving Ludmer Building, 1033 Pine Avenue West, Montreal, QC, H3A 1A1, Canada
| | - Hui Zhang
- School of Foreign Languages and Cultures, Nanjing Normal University, Suiyuan Campus, Building 500, Nanjing, 210024, Jiangsu, China
| | - Shari Baum
- Centre for Research on Brain, Language and Music, 2001 Av. McGill College #6, Montreal, QC, H3A 1G1, Canada
- School of Communication Sciences and Disorders, McGill University, 2001 Av. McGill College #8, Montreal, QC, H3A 1G1, Canada
| | - Karsten Steinhauer
- Centre for Research on Brain, Language and Music, 2001 Av. McGill College #6, Montreal, QC, H3A 1G1, Canada
- School of Communication Sciences and Disorders, McGill University, 2001 Av. McGill College #8, Montreal, QC, H3A 1G1, Canada
| |
Collapse
|
6
|
Klingvall E, Heinat F. Lexical cues and discourse integration: An ERP study of the N400 and P600 components. Cortex 2024; 178:91-103. [PMID: 38986277 DOI: 10.1016/j.cortex.2024.06.009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/25/2023] [Revised: 03/18/2024] [Accepted: 06/11/2024] [Indexed: 07/12/2024]
Abstract
In a sentence reading ERP study in Swedish we investigated the roles of the N400 and P600 components. By manipulating ease of lexical retrieval and discourse integration of the critical words in four conditions (contextually primed/non-primed and degree of contextual fit), we explored these components from a sentence processing perspective. The results indicate that the N400 indexes lexical retrieval and access of stored conceptual knowledge, whereas the P600 component indexes pragmatic processes, such as integration of a word into the discourse context, or the information structural status of the word. The results support single-stream models of sentence processing where lexical retrieval and integration do not take place in parallel, as in multi-stream models.
Collapse
Affiliation(s)
- Eva Klingvall
- Lund University, Centre for Languages and Literature, SE-221 00 Lund, Sweden.
| | - Fredrik Heinat
- Lund University, Centre for Languages and Literature, SE-221 00 Lund, Sweden
| |
Collapse
|
7
|
Shain C, Kean H, Casto C, Lipkin B, Affourtit J, Siegelman M, Mollica F, Fedorenko E. Distributed Sensitivity to Syntax and Semantics throughout the Language Network. J Cogn Neurosci 2024; 36:1427-1471. [PMID: 38683732 DOI: 10.1162/jocn_a_02164] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/02/2024]
Abstract
Human language is expressive because it is compositional: The meaning of a sentence (semantics) can be inferred from its structure (syntax). It is commonly believed that language syntax and semantics are processed by distinct brain regions. Here, we revisit this claim using precision fMRI methods to capture separation or overlap of function in the brains of individual participants. Contrary to prior claims, we find distributed sensitivity to both syntax and semantics throughout a broad frontotemporal brain network. Our results join a growing body of evidence for an integrated network for language in the human brain within which internal specialization is primarily a matter of degree rather than kind, in contrast with influential proposals that advocate distinct specialization of different brain areas for different types of linguistic functions.
Collapse
Affiliation(s)
| | - Hope Kean
- Massachusetts Institute of Technology
| | | | | | | | | | | | | |
Collapse
|
8
|
Nour Eddine S, Brothers T, Wang L, Spratling M, Kuperberg GR. A predictive coding model of the N400. Cognition 2024; 246:105755. [PMID: 38428168 PMCID: PMC10984641 DOI: 10.1016/j.cognition.2024.105755] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2023] [Revised: 02/14/2024] [Accepted: 02/19/2024] [Indexed: 03/03/2024]
Abstract
The N400 event-related component has been widely used to investigate the neural mechanisms underlying real-time language comprehension. However, despite decades of research, there is still no unifying theory that can explain both its temporal dynamics and functional properties. In this work, we show that predictive coding - a biologically plausible algorithm for approximating Bayesian inference - offers a promising framework for characterizing the N400. Using an implemented predictive coding computational model, we demonstrate how the N400 can be formalized as the lexico-semantic prediction error produced as the brain infers meaning from the linguistic form of incoming words. We show that the magnitude of lexico-semantic prediction error mirrors the functional sensitivity of the N400 to various lexical variables, priming, contextual effects, as well as their higher-order interactions. We further show that the dynamics of the predictive coding algorithm provides a natural explanation for the temporal dynamics of the N400, and a biologically plausible link to neural activity. Together, these findings directly situate the N400 within the broader context of predictive coding research. More generally, they raise the possibility that the brain may use the same computational mechanism for inference across linguistic and non-linguistic domains.
Collapse
Affiliation(s)
- Samer Nour Eddine
- Department of Psychology and Center for Cognitive Science, Tufts University, United States of America.
| | - Trevor Brothers
- Department of Psychology and Center for Cognitive Science, Tufts University, United States of America; Department of Psychology, North Carolina A&T, United States of America
| | - Lin Wang
- Department of Psychology and Center for Cognitive Science, Tufts University, United States of America; Department of Psychiatry and the Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Harvard Medical School, United States of America
| | | | - Gina R Kuperberg
- Department of Psychology and Center for Cognitive Science, Tufts University, United States of America; Department of Psychiatry and the Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Harvard Medical School, United States of America
| |
Collapse
|
9
|
Fedorenko E, Ivanova AA, Regev TI. The language network as a natural kind within the broader landscape of the human brain. Nat Rev Neurosci 2024; 25:289-312. [PMID: 38609551 DOI: 10.1038/s41583-024-00802-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/23/2024] [Indexed: 04/14/2024]
Abstract
Language behaviour is complex, but neuroscientific evidence disentangles it into distinct components supported by dedicated brain areas or networks. In this Review, we describe the 'core' language network, which includes left-hemisphere frontal and temporal areas, and show that it is strongly interconnected, independent of input and output modalities, causally important for language and language-selective. We discuss evidence that this language network plausibly stores language knowledge and supports core linguistic computations related to accessing words and constructions from memory and combining them to interpret (decode) or generate (encode) linguistic messages. We emphasize that the language network works closely with, but is distinct from, both lower-level - perceptual and motor - mechanisms and higher-level systems of knowledge and reasoning. The perceptual and motor mechanisms process linguistic signals, but, in contrast to the language network, are sensitive only to these signals' surface properties, not their meanings; the systems of knowledge and reasoning (such as the system that supports social reasoning) are sometimes engaged during language use but are not language-selective. This Review lays a foundation both for in-depth investigations of these different components of the language processing pipeline and for probing inter-component interactions.
Collapse
Affiliation(s)
- Evelina Fedorenko
- Brain and Cognitive Sciences Department, Massachusetts Institute of Technology, Cambridge, MA, USA.
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, USA.
- The Program in Speech and Hearing in Bioscience and Technology, Harvard University, Cambridge, MA, USA.
| | - Anna A Ivanova
- School of Psychology, Georgia Institute of Technology, Atlanta, GA, USA
| | - Tamar I Regev
- Brain and Cognitive Sciences Department, Massachusetts Institute of Technology, Cambridge, MA, USA
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, USA
| |
Collapse
|
10
|
Blache P. A neuro-cognitive model of comprehension based on prediction and unification. Front Hum Neurosci 2024; 18:1356541. [PMID: 38655372 PMCID: PMC11035797 DOI: 10.3389/fnhum.2024.1356541] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2023] [Accepted: 03/20/2024] [Indexed: 04/26/2024] Open
Abstract
Most architectures and models of language processing have been built upon a restricted view of language, which is limited to sentence processing. These approaches fail to capture one primordial characteristic: efficiency. Many facilitation effects are known to be at play in natural situations such as conversation (shallow processing, no real access to the lexicon, etc.) without any impact on the comprehension. In this study, on the basis of a new model integrating into a unique architecture, we present these facilitation effects for accessing the meaning into the classical compositional architecture. This model relies on two mechanisms, prediction and unification, and provides a unique architecture for the description of language processing in its natural environment.
Collapse
Affiliation(s)
- Philippe Blache
- Laboratoire Parole et Langage (LPL-CNRS), Aix-en-Provence, France
- Institute of Language, Communication and the Brain (ILCB), Marseille, France
| |
Collapse
|
11
|
Regev TI, Kim HS, Chen X, Affourtit J, Schipper AE, Bergen L, Mahowald K, Fedorenko E. High-level language brain regions process sublexical regularities. Cereb Cortex 2024; 34:bhae077. [PMID: 38494886 PMCID: PMC11486690 DOI: 10.1093/cercor/bhae077] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2023] [Revised: 02/05/2024] [Accepted: 02/07/2024] [Indexed: 03/19/2024] Open
Abstract
A network of left frontal and temporal brain regions supports language processing. This "core" language network stores our knowledge of words and constructions as well as constraints on how those combine to form sentences. However, our linguistic knowledge additionally includes information about phonemes and how they combine to form phonemic clusters, syllables, and words. Are phoneme combinatorics also represented in these language regions? Across five functional magnetic resonance imaging experiments, we investigated the sensitivity of high-level language processing brain regions to sublexical linguistic regularities by examining responses to diverse nonwords-sequences of phonemes that do not constitute real words (e.g. punes, silory, flope). We establish robust responses in the language network to visually (experiment 1a, n = 605) and auditorily (experiments 1b, n = 12, and 1c, n = 13) presented nonwords. In experiment 2 (n = 16), we find stronger responses to nonwords that are more well-formed, i.e. obey the phoneme-combinatorial constraints of English. Finally, in experiment 3 (n = 14), we provide suggestive evidence that the responses in experiments 1 and 2 are not due to the activation of real words that share some phonology with the nonwords. The results suggest that sublexical regularities are stored and processed within the same fronto-temporal network that supports lexical and syntactic processes.
Collapse
Affiliation(s)
- Tamar I Regev
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, United States
- McGovern Institute for Brain Research, MIT, Cambridge, MA 02139, United States
| | - Hee So Kim
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, United States
- McGovern Institute for Brain Research, MIT, Cambridge, MA 02139, United States
| | - Xuanyi Chen
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, United States
- McGovern Institute for Brain Research, MIT, Cambridge, MA 02139, United States
- Department of Cognitive Sciences, Rice University, Houston, TX 77005, United States
| | - Josef Affourtit
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, United States
- McGovern Institute for Brain Research, MIT, Cambridge, MA 02139, United States
| | - Abigail E Schipper
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, United States
| | - Leon Bergen
- Department of Linguistics, University of California San Diego, San Diego CA 92093, United States
| | - Kyle Mahowald
- Department of Linguistics, University of Texas at Austin, Austin, TX 78712, United States
| | - Evelina Fedorenko
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, United States
- McGovern Institute for Brain Research, MIT, Cambridge, MA 02139, United States
- The Harvard Program in Speech and Hearing Bioscience and Technology, Boston, MA 02115, United States
| |
Collapse
|
12
|
Meyer P, Baeuchl C, Hoppstädter M. Insights from simultaneous EEG-fMRI and patient data illuminate the role of the anterior medial temporal lobe in N400 generation. Neuropsychologia 2024; 193:108762. [PMID: 38142959 DOI: 10.1016/j.neuropsychologia.2023.108762] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2023] [Revised: 11/17/2023] [Accepted: 12/16/2023] [Indexed: 12/26/2023]
Abstract
The N400, a negative event-related potential (ERP) peaking approximately 400 ms after stimulus onset, is known to reflect the processing of semantic information. While scalp recordings have contributed to understanding the psychological processes underlying the N400, they have been limited in identifying its neural basis. However, recent intracranial ERP recordings and fMRI studies have shed light on the crucial role of the anterior medial temporal lobe (AMTL) in semantic information processing. These findings suggest that the N400 partially represents activity in the AMTL structures. To investigate the neural underpinnings of the N400 effect, we simultaneously recorded ERPs and event-related fMRI during a semantic priming paradigm in a sample of 12 young, healthy subjects. Additionally, we collected ERPs and structural brain data from older healthy adults and patients with amnestic mild cognitive impairment (aMCI), a population characterized by neurodegenerative changes in the AMTL. In our fMRI results, we identified bilateral loci in the AMTL as the global maxima. Employing an EEG-informed fMRI analysis, we explored trial-to-trial fluctuations in semantic processing by linking single-trial N400 amplitudes to the Blood Oxygen Level Dependent (BOLD) signal. This approach provided the first direct evidence linking the N400 recorded at the scalp level to the corresponding BOLD signal in the AMTL. Consistent with these findings, patients with aMCI exhibited a diminished N400 effect compared to healthy older adults. Furthermore, voxel-based morphometry analysis revealed a correlation between the magnitude of the N400 effect and the integrity of the AMTL. By integrating data from simultaneous EEG-fMRI, and patient studies, our research advances our understanding of the neural substrate of the N400 and highlights the critical involvement of the AMTL in semantic processing.
Collapse
Affiliation(s)
- Patric Meyer
- SRH University Heidelberg, Heidelberg, Germany; Department for General and Applied Linguistics, Heidelberg University, Heidelberg, Germany; Department of Cognitive and Clinical Neuroscience, Central Institute of Mental Health, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany.
| | - Christian Baeuchl
- Department of Cognitive and Clinical Neuroscience, Central Institute of Mental Health, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany; Faculty of Psychology, Technische Universität Dresden, Dresden, Germany
| | - Michael Hoppstädter
- Department of Cognitive and Clinical Neuroscience, Central Institute of Mental Health, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany
| |
Collapse
|
13
|
Barthel M, Tomasello R, Liu M. Conditionals in context: Brain signatures of prediction in discourse processing. Cognition 2024; 242:105635. [PMID: 37883821 DOI: 10.1016/j.cognition.2023.105635] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/14/2022] [Revised: 10/04/2023] [Accepted: 10/05/2023] [Indexed: 10/28/2023]
Abstract
Comprehenders are known to generate expectations about upcoming linguistic input at the sentence and discourse level. However, most previous studies on prediction focused mainly on word-induced brain activity rather than examining neural activity preceding a critical stimulus in discourse processing, where prediction actually takes place. In this EEG study, participants were presented with multiple sentences resembling a discourse including conditional sentences with either only if or if, which are characterized by different semantics, triggering stronger or weaker predictions about the possible continuation of the presented discourses, respectively. Results revealed that discourses including only if, as compared to discourses with bare if, triggered an increased predictive neural activity before the expected critical word, resembling the readiness potential. Moreover, word-induced P300 brain responses were found to be enhanced by unpredictable discourse continuations and reduced in predictable discourse continuations. Intriguingly, brain responses preceding and following the critical word were found to be correlated, which yields evidence for predictive activity modulating word-induced processing on the discourse level. These findings shed light on the predictive nature of neural processes at the discourse level, critically advancing our understanding of the functional interconnection between discourse understanding and prediction processes in brain and mind.
Collapse
Affiliation(s)
- Mathias Barthel
- Leibniz Institute for the German Language, Mannheim, Germany; Department of English and American Studies, Humboldt-Universität zu Berlin, Germany.
| | - Rosario Tomasello
- Brain Language Laboratory, Department of Philosophy and Humanities, Freie Universität Berlin, Germany; Cluster of Excellence 'Matters of Activity. Image Space Material', Humboldt-Universität zu Berlin, Germany.
| | - Mingya Liu
- Department of English and American Studies, Humboldt-Universität zu Berlin, Germany
| |
Collapse
|
14
|
Huizeling E, Alday PM, Peeters D, Hagoort P. Combining EEG and 3D-eye-tracking to study the prediction of upcoming speech in naturalistic virtual environments: A proof of principle. Neuropsychologia 2023; 191:108730. [PMID: 37939871 DOI: 10.1016/j.neuropsychologia.2023.108730] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2023] [Revised: 09/15/2023] [Accepted: 11/03/2023] [Indexed: 11/10/2023]
Abstract
EEG and eye-tracking provide complementary information when investigating language comprehension. Evidence that speech processing may be facilitated by speech prediction comes from the observation that a listener's eye gaze moves towards a referent before it is mentioned if the remainder of the spoken sentence is predictable. However, changes to the trajectory of anticipatory fixations could result from a change in prediction or an attention shift. Conversely, N400 amplitudes and concurrent spectral power provide information about the ease of word processing the moment the word is perceived. In a proof-of-principle investigation, we combined EEG and eye-tracking to study linguistic prediction in naturalistic, virtual environments. We observed increased processing, reflected in theta band power, either during verb processing - when the verb was predictive of the noun - or during noun processing - when the verb was not predictive of the noun. Alpha power was higher in response to the predictive verb and unpredictable nouns. We replicated typical effects of noun congruence but not predictability on the N400 in response to the noun. Thus, the rich visual context that accompanied speech in virtual reality influenced language processing compared to previous reports, where the visual context may have facilitated processing of unpredictable nouns. Finally, anticipatory fixations were predictive of spectral power during noun processing and the length of time fixating the target could be predicted by spectral power at verb onset, conditional on the object having been fixated. Overall, we show that combining EEG and eye-tracking provides a promising new method to answer novel research questions about the prediction of upcoming linguistic input, for example, regarding the role of extralinguistic cues in prediction during language comprehension.
Collapse
Affiliation(s)
- Eleanor Huizeling
- Max Planck Institute for Psycholinguistics, Nijmegen, the Netherlands.
| | | | - David Peeters
- Department of Communication and Cognition, TiCC, Tilburg University, Tilburg, the Netherlands
| | - Peter Hagoort
- Max Planck Institute for Psycholinguistics, Nijmegen, the Netherlands; Radboud University, Donders Institute for Brain, Cognition and Behaviour, Nijmegen, the Netherlands
| |
Collapse
|
15
|
Schroën JAM, Gunter TC, Numssen O, Kroczek LOH, Hartwigsen G, Friederici AD. Causal evidence for a coordinated temporal interplay within the language network. Proc Natl Acad Sci U S A 2023; 120:e2306279120. [PMID: 37963247 PMCID: PMC10666120 DOI: 10.1073/pnas.2306279120] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2023] [Accepted: 10/06/2023] [Indexed: 11/16/2023] Open
Abstract
Recent neurobiological models on language suggest that auditory sentence comprehension is supported by a coordinated temporal interplay within a left-dominant brain network, including the posterior inferior frontal gyrus (pIFG), posterior superior temporal gyrus and sulcus (pSTG/STS), and angular gyrus (AG). Here, we probed the timing and causal relevance of the interplay between these regions by means of concurrent transcranial magnetic stimulation and electroencephalography (TMS-EEG). Our TMS-EEG experiments reveal region- and time-specific causal evidence for a bidirectional information flow from left pSTG/STS to left pIFG and back during auditory sentence processing. Adapting a condition-and-perturb approach, our findings further suggest that the left pSTG/STS can be supported by the left AG in a state-dependent manner.
Collapse
Affiliation(s)
- Joëlle A. M. Schroën
- Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig04103, Germany
| | - Thomas C. Gunter
- Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig04103, Germany
| | - Ole Numssen
- Methods and Development Group Brain Networks, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig04103, Germany
- Lise Meitner Research Group Cognition and Plasticity, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig04103, Germany
| | - Leon O. H. Kroczek
- Department of Psychology, Clinical Psychology and Psychotherapy, Universität Regensburg, Regensburg93053, Germany
| | - Gesa Hartwigsen
- Lise Meitner Research Group Cognition and Plasticity, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig04103, Germany
- Cognitive and Biological Psychology, Wilhelm Wundt Institute for Psychology, Leipzig04109, Germany
| | - Angela D. Friederici
- Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig04103, Germany
| |
Collapse
|
16
|
El Ouardi L, Yeou M, Faroqi-Shah Y. Neural correlates of pronoun processing: An activation likelihood estimation meta-analysis. BRAIN AND LANGUAGE 2023; 246:105347. [PMID: 37847932 PMCID: PMC11305457 DOI: 10.1016/j.bandl.2023.105347] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/23/2023] [Revised: 08/30/2023] [Accepted: 10/10/2023] [Indexed: 10/19/2023]
Abstract
Pronouns are unique linguistic devices that allow for the expression of referential relationships. Despite their communicative utility, the neural correlates of the operations involved in reference assignment and/or resolution, are not well-understood. The present study synthesized the neuroimaging literature on pronoun processing to test extant theories of pronoun comprehension. Following the PRISMA guidelines and thebest-practice recommendations for neuroimaging meta-analyses, a systematic literature search and record assessment were performed. As a result, 16 fMRI studies were included in the meta-analysis, and were coded in Scribe 3.6 for inclusion in the BrainMap database. The activation coordinates for the contrasts of interest were transformed into Talairach space and submitted to an Activation Likelihood Estimation (ALE) meta-analysis in GingerALE 3.0.1. The results indicated that pronoun processing had functional convergence in the left posterior middle and superior temporal gyri, potentially reflecting the retrieval, prediction and integration roles of these areas for pronoun processing.
Collapse
Affiliation(s)
- Loubna El Ouardi
- Department of Hearing and Speech Sciences, University of Maryland, College Park, Maryland, United States; Applied Language and Culture Studies Laboratory, Chouaib Doukkali University, El Jadida, Morocco.
| | - Mohamed Yeou
- Applied Language and Culture Studies Laboratory, Chouaib Doukkali University, El Jadida, Morocco
| | - Yasmeen Faroqi-Shah
- Department of Hearing and Speech Sciences, University of Maryland, College Park, Maryland, United States
| |
Collapse
|
17
|
Zheng Y, Gao P, Li X. The modulating effect of musical expertise on lexical-semantic prediction in speech-in-noise comprehension: Evidence from an EEG study. Psychophysiology 2023; 60:e14371. [PMID: 37350401 DOI: 10.1111/psyp.14371] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/09/2022] [Revised: 05/08/2023] [Accepted: 05/27/2023] [Indexed: 06/24/2023]
Abstract
Musical expertise has been proposed to facilitate speech perception and comprehension in noisy environments. This study further examined the open question of whether musical expertise modulates high-level lexical-semantic prediction to aid online speech comprehension in noisy backgrounds. Musicians and nonmusicians listened to semantically strongly/weakly constraining sentences during EEG recording. At verbs prior to target nouns, both groups showed a positivity-ERP effect (Strong vs. Weak) associated with the predictability of incoming nouns; this correlation effect was stronger in musicians than in nonmusicians. After the target nouns appeared, both groups showed an N400 reduction effect (Strong vs. Weak) associated with noun predictability, but musicians exhibited an earlier onset latency and stronger effect size of this correlation effect than nonmusicians. To determine whether musical expertise enhances anticipatory semantic processing in general, the same group of participants participated in a control reading comprehension experiment. The results showed that, compared with nonmusicians, musicians demonstrated more delayed ERP correlation effects of noun predictability at words preceding the target nouns; musicians also exhibited more delayed and reduced N400 decrease effects correlated with noun predictability at the target nouns. Taken together, these results suggest that musical expertise enhances lexical-semantic predictive processing in speech-in-noise comprehension. This musical-expertise effect may be related to the strengthened hierarchical speech processing in particular.
Collapse
Affiliation(s)
- Yuanyi Zheng
- CAS Key Laboratory of Behavioral Science, Institute of Psychology, Chinese Academy of Sciences, Beijing, China
- Department of Psychology, University of Chinese Academy of Sciences, Beijing, China
| | - Panke Gao
- CAS Key Laboratory of Behavioral Science, Institute of Psychology, Chinese Academy of Sciences, Beijing, China
- Department of Psychology, University of Chinese Academy of Sciences, Beijing, China
| | - Xiaoqing Li
- CAS Key Laboratory of Behavioral Science, Institute of Psychology, Chinese Academy of Sciences, Beijing, China
- Department of Psychology, University of Chinese Academy of Sciences, Beijing, China
- Jiangsu Collaborative Innovation Center for Language Ability, Jiangsu Normal University, Xuzhou, China
| |
Collapse
|
18
|
Graessner A, Duchow C, Zaccarella E, Friederici AD, Obrig H, Hartwigsen G. Electrophysiological correlates of basic semantic composition in people with aphasia. Neuroimage Clin 2023; 40:103516. [PMID: 37769366 PMCID: PMC10540050 DOI: 10.1016/j.nicl.2023.103516] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2023] [Revised: 09/21/2023] [Accepted: 09/22/2023] [Indexed: 09/30/2023]
Abstract
The neuroanatomical correlates of basic semantic composition have been investigated in previous neuroimaging and lesion studies, but research on the electrophysiology of the involved processes is scarce. A large literature on sentence-level event-related potentials (ERPs) during semantic processing has identified at least two relevant components - the N400 and the P600. Other studies demonstrated that these components are reduced and/or delayed in people with aphasia (PWA). However, it remains to be shown if these findings generalize beyond the sentence level. Specifically, it is an open question if an alteration in ERP responses in PWA can also be observed during basic semantic composition, providing a potential future diagnostic tool. The present study aimed to elucidate the electrophysiological dynamics of basic semantic composition in a group of post-stroke PWA. We included 20 PWA and 20 age-matched controls (mean age 58 years) and measured ERP responses while they performed a plausibility judgment task on two-word phrases that were either meaningful ("anxious horse"), anomalous ("anxious wood") or had the noun replaced by a pseudoword ("anxious gufel"). The N400 effect for anomalous versus meaningful phrases was similar in both groups. In contrast, unlike the control group, PWA did not show an N400 effect between pseudoword and meaningful phrases. Moreover, both groups exhibited a parietal P600 effect towards pseudoword phrases, while PWA showed an additional P600 over frontal electrodes. Finally, PWA showed an inverse correlation between the magnitude of the N400 and P600 effects: PWA exhibiting no or even reversed N400 effects towards anomalous and pseudoword phrases showed a stronger P600 effect. These results may reflect a compensatory mechanism which allows PWA to arrive at the correct interpretation of the phrase. When compositional processing capacities are impaired in the early N400 time-window, PWA may make use of a more elaborate re-analysis process reflected in the P600.
Collapse
Affiliation(s)
- Astrid Graessner
- Wilhelm Wundt Institute for Psychology, Leipzig University, Germany; Lise-Meitner Research Group Cognition and Plasticity, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany.
| | - Caroline Duchow
- Lise-Meitner Research Group Cognition and Plasticity, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Emiliano Zaccarella
- Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Angela D Friederici
- Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Hellmuth Obrig
- Clinic for Cognitive Neurology, University Hospital Leipzig, Germany; Department of Neurology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Gesa Hartwigsen
- Wilhelm Wundt Institute for Psychology, Leipzig University, Germany; Lise-Meitner Research Group Cognition and Plasticity, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| |
Collapse
|
19
|
Aurnhammer C, Delogu F, Brouwer H, Crocker MW. The P600 as a continuous index of integration effort. Psychophysiology 2023; 60:e14302. [PMID: 37042061 DOI: 10.1111/psyp.14302] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2022] [Revised: 03/01/2023] [Accepted: 03/04/2023] [Indexed: 04/13/2023]
Abstract
The integration of word meaning into an unfolding utterance representation is a core operation of incremental language comprehension. There is considerable debate, however, as to which component of the ERP signal-the N400 or the P600-directly reflects integrative processes, with far reaching consequences for the temporal organization and architecture of the comprehension system. Multi-stream models maintaining the N400 as integration crucially rely on the presence of a semantically attractive plausible alternative interpretation to account for the absence of an N400 effect in response to certain semantic anomalies, as reported in previous studies. The single-stream Retrieval-Integration account posits the P600 as an index of integration, further predicting that its amplitude varies continuously with integrative effort. Here, we directly test these competing hypotheses using a context manipulation design in which a semantically attractive alternative is either available or not, and target word plausibility is varied across three levels. An initial self-paced reading study revealed graded reading times for plausibility, suggesting differential integration effort. A subsequent ERP study showed no N400 differences across conditions, and that P600 amplitude is graded for plausibility. These findings are inconsistent with the interpretation of the N400 as an index of integration, as no N400 effect emerged even in the absence of a semantically attractive alternative. By contrast, the link between plausibility, reading times, and P600 amplitude supports the view that the P600 is a continuous index of integration effort. More generally, our results support a single-stream architecture and eschew the need for multi-stream accounts.
Collapse
Affiliation(s)
- Christoph Aurnhammer
- Department of Language Science and Technology, Saarland University, Saarbrücken, Germany
| | - Francesca Delogu
- Department of Language Science and Technology, Saarland University, Saarbrücken, Germany
| | - Harm Brouwer
- Department of Language Science and Technology, Saarland University, Saarbrücken, Germany
- Department of Cognitive Science and Artificial Intelligence, Tilburg University, Tilburg, the Netherlands
| | - Matthew W Crocker
- Department of Language Science and Technology, Saarland University, Saarbrücken, Germany
| |
Collapse
|
20
|
Antón Toro LF, Salto F, Requena C, Maestú F. Electrophysiological connectivity of logical deduction: Early cortical MEG study. Cortex 2023; 166:365-376. [PMID: 37499565 DOI: 10.1016/j.cortex.2023.06.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2022] [Revised: 04/14/2023] [Accepted: 06/15/2023] [Indexed: 07/29/2023]
Abstract
Complex human reasoning involves minimal abilities to extract conclusions implied in the available information. These abilities are considered "deductive" because they exemplify certain abstract relations among propositions or probabilities called deductive arguments. However, the electrophysiological dynamics which supports such complex cognitive processes has not been addressed yet. In this work we consider typically deductive logico-probabilistically valid inferences and aim to verify or refute their electrophysiological functional connectivity differences from invalid inferences with the same content (same relational variables, same stimuli, same relevant and salient features). We recorded the brain electrophysiological activity of 20 participants (age = 20.35 ± 3.23) by means of an MEG system during two consecutive reasoning tasks: a search task (invalid condition) without any specific deductive rules to follow, and a logically valid deductive task (valid condition) with explicit deductive rules as instructions. We calculated the functional connectivity (FC) for each condition and conducted a seed-based analysis in a set of cortical regions of interest. Finally, we used a cluster-based permutation test to compare the differences between logically valid and invalid conditions in terms of FC. As a first novel result we found higher FC for valid condition in beta band between regions of interest and left prefrontal, temporal, parietal, and cingulate structures. FC analysis allows a second novel result which is the definition of a propositional network with operculo-cingular, parietal and medial nodes, specifically including disputed medial deductive "core" areas. The experiment discloses measurable cortical processes which do not depend on content but on truth-functional propositional operators. These experimental novelties may contribute to understand the cortical bases of deductive processes.
Collapse
Affiliation(s)
- Luis F Antón Toro
- Research Group on Aging, Neuroscience and Applied Logic, Department of Psychology, Sociology and Philosophy, University of León, Campus Vegazana S/n 24171, León, Spain; Center for Cognitive and Computational Neuroscience (C3N), Complutense University of Madrid, Campus Somosaguas, 28223 Pozuelo, Madrid, Spain; Department of Psychology, Health Faculty, Camilo José Cela University (UCJC), C. Castillo de Alarcón, 49, 28692 Villafranca Del Castillo, Madrid, Spain.
| | - Francisco Salto
- Research Group on Aging, Neuroscience and Applied Logic, Department of Psychology, Sociology and Philosophy, University of León, Campus Vegazana S/n 24171, León, Spain.
| | - Carmen Requena
- Research Group on Aging, Neuroscience and Applied Logic, Department of Psychology, Sociology and Philosophy, University of León, Campus Vegazana S/n 24171, León, Spain.
| | - Fernando Maestú
- Center for Cognitive and Computational Neuroscience (C3N), Complutense University of Madrid, Campus Somosaguas, 28223 Pozuelo, Madrid, Spain; Department of Experimental Psychology, Complutense University of Madrid (UCM), Campus Somosaguas, 28223 Pozuelo, Madrid, Spain.
| |
Collapse
|
21
|
Gu B, Liu B, Beltrán D, de Vega M. ERP evidence for emotion-specific congruency effects between sentences and new words with disgust and sadness connotations. Front Psychol 2023; 14:1154442. [PMID: 37251037 PMCID: PMC10213552 DOI: 10.3389/fpsyg.2023.1154442] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2023] [Accepted: 04/21/2023] [Indexed: 05/31/2023] Open
Abstract
Introduction The present study investigated how new words with acquired connotations of disgust and sadness, both negatively valenced but distinctive emotions, modulate the brain dynamics in the context of emotional sentences. Methods Participants completed a learning session in which pseudowords were repeatedly paired with faces expressing disgust and sadness. An event-related potential (ERP) session followed the next day, in which participants received the learned pseudowords (herein, new words) combined with sentences and were asked to make emotional congruency judgment. Results Sad new words elicited larger negative waveform than disgusting new words in the 146-228 ms time window, and emotionally congruent trials showed larger positive waveform than emotionally incongruent trials in the 304-462 ms time window. Moreover, the source localization in the latter suggested that congruent trials elicited larger current densities than incongruent trials in a number of emotion-related brain structures (e.g., the orbitofrontal cortex and cingulate gyrus) and language-related brain structures (e.g., the temporal lobe and the lingual gyrus). Discussion These results suggested that faces are an effective source for the acquisition of words' emotional connotations, and such acquired connotations can generate semantic and emotional congruency effects in sentential contexts.
Collapse
Affiliation(s)
- Beixian Gu
- Institute for Language and Cognition, School of Foreign Languages, Dalian University of Technology, Dalian, China
- Instituto Universitario de Neurociencia (IUNE), Universidad de La Laguna, La Laguna, Spain
| | - Bo Liu
- Instituto Universitario de Neurociencia (IUNE), Universidad de La Laguna, La Laguna, Spain
- School of Foreign Languages, Dalian Maritime University, Dalian, China
| | - David Beltrán
- Instituto Universitario de Neurociencia (IUNE), Universidad de La Laguna, La Laguna, Spain
- Psychology Department, Universidad Nacional de Educación a Distancia (UNED), Madrid, Spain
| | - Manuel de Vega
- Instituto Universitario de Neurociencia (IUNE), Universidad de La Laguna, La Laguna, Spain
| |
Collapse
|
22
|
Tkacheva L, Flaksman M, Sedelkina Y, Lavitskaya Y, Nasledov A, Korotaevskaya E. Neural Indicators of Visual Andauditory Recognition of Imitative Words on Different De-Iconization Stages. Brain Sci 2023; 13:brainsci13040681. [PMID: 37190646 DOI: 10.3390/brainsci13040681] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2023] [Revised: 04/16/2023] [Accepted: 04/17/2023] [Indexed: 05/17/2023] Open
Abstract
The research aims to reveal neural indicators of recognition for iconic words and the possible cross-modal multisensory integration behind this process. The goals of this research are twofold: (1) to register event-related potentials (ERP) in the brain in the process of visual and auditory recognition of Russian imitative words on different de-iconization stages; and (2) to establish whether differences in the brain activity arise while processing visual and auditory stimuli of different nature. Sound imitative (onomatopoeic, mimetic, and ideophonic) words are words with iconic correlation between form and meaning (iconicity being a relationship of resemblance). Russian adult participants (n = 110) were presented with 15 stimuli both visually and auditorily. The stimuli material was equally distributed into three groups according to the criterion of (historical) iconicity loss: five explicit sound imitative (SI) words, five implicit SI words and five non-SI words. It was established that there was no statistically significant difference between visually presented explicit or implicit SI words and non-SI words respectively. However, statistically significant differences were registered for auditorily presented explicit SI words in contrast to implicit SI words in the N400 ERP component, as well as implicit SI words in contrast to non-SI words in the P300 ERP component. We thoroughly analyzed the integrative brain activity in response to explicit IS words and compared it to that in response to implicit SI and non-SI words presented auditorily. The data yielded by this analysis showed the N400 ERP component was more prominent during the recognition process of the explicit SI words received from the central channels (specifically Cz). We assume that these results indicate a specific brain response associated with directed attention in the process of performing cognitive decision making tasks regarding explicit and implicit SI words presented auditorily. This may reflect a higher level of cognitive complexity in identifying this type of stimuli considering the experimental task challenges that may involve cross-modal integration process.
Collapse
Affiliation(s)
- Liubov Tkacheva
- Department of Pedagogy and Pedagogical Psychology, Saint Petersburg State University, 199034 Saint Petersburg, Russia
| | - Maria Flaksman
- Department for English and American Studies, Ludwig Maximilian University, 80799 München, Germany
| | - Yulia Sedelkina
- Department of Foreign Languages and Linguo-Didactics, Saint Petersburg State University, 199034 Saint Petersburg, Russia
| | - Yulia Lavitskaya
- Department of Foreign Languages and Linguo-Didactics, Saint Petersburg State University, 199034 Saint Petersburg, Russia
| | - Andrey Nasledov
- Department of Pedagogy and Pedagogical Psychology, Saint Petersburg State University, 199034 Saint Petersburg, Russia
| | - Elizaveta Korotaevskaya
- Department of Clinical Psychology, Saint Petersburg State University, 199034 Saint Petersburg, Russia
| |
Collapse
|
23
|
Wang L, Schoot L, Brothers T, Alexander E, Warnke L, Kim M, Khan S, Hämäläinen M, Kuperberg GR. Predictive coding across the left fronto-temporal hierarchy during language comprehension. Cereb Cortex 2023; 33:4478-4497. [PMID: 36130089 PMCID: PMC10110445 DOI: 10.1093/cercor/bhac356] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/21/2022] [Revised: 08/08/2022] [Accepted: 08/15/2022] [Indexed: 11/12/2022] Open
Abstract
We used magnetoencephalography (MEG) and event-related potentials (ERPs) to track the time-course and localization of evoked activity produced by expected, unexpected plausible, and implausible words during incremental language comprehension. We suggest that the full pattern of results can be explained within a hierarchical predictive coding framework in which increased evoked activity reflects the activation of residual information that was not already represented at a given level of the fronto-temporal hierarchy ("error" activity). Between 300 and 500 ms, the three conditions produced progressively larger responses within left temporal cortex (lexico-semantic prediction error), whereas implausible inputs produced a selectively enhanced response within inferior frontal cortex (prediction error at the level of the event model). Between 600 and 1,000 ms, unexpected plausible words activated left inferior frontal and middle temporal cortices (feedback activity that produced top-down error), whereas highly implausible inputs activated left inferior frontal cortex, posterior fusiform (unsuppressed orthographic prediction error/reprocessing), and medial temporal cortex (possibly supporting new learning). Therefore, predictive coding may provide a unifying theory that links language comprehension to other domains of cognition.
Collapse
Affiliation(s)
- Lin Wang
- Department of Psychiatry and the Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Harvard Medical School, Charlestown, MA 02129, United States
- Department of Psychology, Tufts University, Medford, MA 02155, United States
| | - Lotte Schoot
- Department of Psychiatry and the Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Harvard Medical School, Charlestown, MA 02129, United States
- Department of Psychology, Tufts University, Medford, MA 02155, United States
| | - Trevor Brothers
- Department of Psychiatry and the Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Harvard Medical School, Charlestown, MA 02129, United States
- Department of Psychology, Tufts University, Medford, MA 02155, United States
| | - Edward Alexander
- Department of Psychiatry and the Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Harvard Medical School, Charlestown, MA 02129, United States
- Department of Psychology, Tufts University, Medford, MA 02155, United States
| | - Lena Warnke
- Department of Psychiatry and the Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Harvard Medical School, Charlestown, MA 02129, United States
| | - Minjae Kim
- Department of Psychology, Tufts University, Medford, MA 02155, United States
| | - Sheraz Khan
- Department of Psychiatry and the Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Harvard Medical School, Charlestown, MA 02129, United States
| | - Matti Hämäläinen
- Department of Psychiatry and the Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Harvard Medical School, Charlestown, MA 02129, United States
| | - Gina R Kuperberg
- Department of Psychiatry and the Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Harvard Medical School, Charlestown, MA 02129, United States
- Department of Psychology, Tufts University, Medford, MA 02155, United States
| |
Collapse
|
24
|
Xu F, Fan L, Tian L, Cheng L. Making and revising predictive inferences during Chinese narrative text reading: Evidence from an electrophysiological study. Front Psychol 2023; 13:1061725. [PMID: 36710800 PMCID: PMC9880981 DOI: 10.3389/fpsyg.2022.1061725] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2022] [Accepted: 12/20/2022] [Indexed: 01/15/2023] Open
Abstract
The current study employed the event-related potential (ERP) technique to investigate predictive inference revision during Chinese narrative text reading among Chinese native speakers. Experiment 1 studied predictive inference revision by ensuring high contextual constraints for activation of the primary predictive inferences. Experiment 2 inspected the effects of the weaker inference alternatives on the revision process. Longer reading time and less positive mean average amplitude with two subcomponents of P300 (P3a and P3b) in the revise condition suggest that readers could detect inconsistent information and disconfirm the incorrect predictive inferences. However, they have difficulties in either integrating the alternative predictive inferences (N400) or revising the incorrect ones (P600), especially when the alternatives are of weaker activation levels. This study supports the Knowledge Revision Components (KReC) framework by verifying remaining activation of the disconfirmed primary inferences and extends it by considering effects of competitive alternatives on the predictive inference revision process.
Collapse
Affiliation(s)
- Fei Xu
- School of Humanities and Foreign Languages, Qingdao University of Technology, Qingdao, China
| | - Lin Fan
- Research Institute of Foreign Languages, Beijing Foreign Studies University, Beijing, China,*Correspondence: Lin Fan, ✉ ;
| | - Lingyun Tian
- School of Foreign Languages, Harbin University of Science and Technology, Heilongjiang, China,National Research Centre for Foreign Language Education, Beijing Foreign Studies University, Beijing, China
| | - Lulu Cheng
- School of Foreign Studies, China University of Petroleum (East China), Qingdao, China,Shanghai Center for Research in English Language Education, Shanghai International Studies University, Shanghai, China
| |
Collapse
|
25
|
Onnis L, Lim A, Cheung S, Huettig F. Is the Mind Inherently Predicting? Exploring Forward and Backward Looking in Language Processing. Cogn Sci 2022; 46:e13201. [PMID: 36240464 PMCID: PMC9786242 DOI: 10.1111/cogs.13201] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2020] [Revised: 08/23/2022] [Accepted: 08/29/2022] [Indexed: 12/30/2022]
Abstract
Prediction is one characteristic of the human mind. But what does it mean to say the mind is a "prediction machine" and inherently forward looking as is frequently claimed? In natural languages, many contexts are not easily predictable in a forward fashion. In English, for example, many frequent verbs do not carry unique meaning on their own but instead, rely on another word or words that follow them to become meaningful. Upon reading take a the processor often cannot easily predict walk as the next word. But the system can "look back" and integrate walk more easily when it follows take a (e.g., as opposed to *make|get|have a walk). In the present paper, we provide further evidence for the importance of both forward and backward-looking in language processing. In two self-paced reading tasks and an eye-tracking reading task, we found evidence that adult English native speakers' sensitivity to word forward and backward conditional probability significantly predicted reading times over and above psycholinguistic predictors of reading latencies. We conclude that both forward and backward-looking (prediction and integration) appear to be important characteristics of language processing. Our results thus suggest that it makes just as much sense to call the mind an "integration machine" which is inherently backward 'looking.'
Collapse
Affiliation(s)
- Luca Onnis
- Centre for Multilingualism in Society across the LifespanUniversity of Oslo,Department of Linguistics and Scandinavian StudiesUniversity of Oslo
| | - Alfred Lim
- School of PsychologyUniversity of Nottingham Malaysia Campus
| | | | | |
Collapse
|
26
|
Uddén J, Hultén A, Schoffelen JM, Lam N, Harbusch K, van den Bosch A, Kempen G, Petersson KM, Hagoort P. Supramodal Sentence Processing in the Human Brain: fMRI Evidence for the Influence of Syntactic Complexity in More Than 200 Participants. NEUROBIOLOGY OF LANGUAGE (CAMBRIDGE, MASS.) 2022; 3:575-598. [PMID: 37215341 PMCID: PMC10158636 DOI: 10.1162/nol_a_00076] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/03/2021] [Accepted: 06/13/2022] [Indexed: 05/24/2023]
Abstract
This study investigated two questions. One is: To what degree is sentence processing beyond single words independent of the input modality (speech vs. reading)? The second question is: Which parts of the network recruited by both modalities is sensitive to syntactic complexity? These questions were investigated by having more than 200 participants read or listen to well-formed sentences or series of unconnected words. A largely left-hemisphere frontotemporoparietal network was found to be supramodal in nature, i.e., independent of input modality. In addition, the left inferior frontal gyrus (LIFG) and the left posterior middle temporal gyrus (LpMTG) were most clearly associated with left-branching complexity. The left anterior temporal lobe showed the greatest sensitivity to sentences that differed in right-branching complexity. Moreover, activity in LIFG and LpMTG increased from sentence onset to end, in parallel with an increase of the left-branching complexity. While LIFG, bilateral anterior temporal lobe, posterior MTG, and left inferior parietal lobe all contribute to the supramodal unification processes, the results suggest that these regions differ in their respective contributions to syntactic complexity related processing. The consequences of these findings for neurobiological models of language processing are discussed.
Collapse
Affiliation(s)
- Julia Uddén
- Max Planck Institute for Psycholinguistics, Nijmegen, the Netherlands
- Donders Institute for Brain, Cognition and Behaviour, Centre for Cognitive Neuroimaging, Radboud University, Nijmegen, the Netherlands
- Department of Linguistics, Stockholm University, Stockholm, Sweden
- Department of Psychology, Stockholm University, Stockholm, Sweden
| | - Annika Hultén
- Max Planck Institute for Psycholinguistics, Nijmegen, the Netherlands
- Donders Institute for Brain, Cognition and Behaviour, Centre for Cognitive Neuroimaging, Radboud University, Nijmegen, the Netherlands
| | - Jan-Mathijs Schoffelen
- Donders Institute for Brain, Cognition and Behaviour, Centre for Cognitive Neuroimaging, Radboud University, Nijmegen, the Netherlands
| | - Nietzsche Lam
- Max Planck Institute for Psycholinguistics, Nijmegen, the Netherlands
- Donders Institute for Brain, Cognition and Behaviour, Centre for Cognitive Neuroimaging, Radboud University, Nijmegen, the Netherlands
| | - Karin Harbusch
- Department of Computer Science, University of Koblenz-Landau, Koblenz, Germany
| | - Antal van den Bosch
- Donders Institute for Brain, Cognition and Behaviour, Centre for Cognitive Neuroimaging, Radboud University, Nijmegen, the Netherlands
| | - Gerard Kempen
- Max Planck Institute for Psycholinguistics, Nijmegen, the Netherlands
| | - Karl Magnus Petersson
- Max Planck Institute for Psycholinguistics, Nijmegen, the Netherlands
- Donders Institute for Brain, Cognition and Behaviour, Centre for Cognitive Neuroimaging, Radboud University, Nijmegen, the Netherlands
| | - Peter Hagoort
- Max Planck Institute for Psycholinguistics, Nijmegen, the Netherlands
- Donders Institute for Brain, Cognition and Behaviour, Centre for Cognitive Neuroimaging, Radboud University, Nijmegen, the Netherlands
| |
Collapse
|
27
|
Chien SE, Yang YH, Ono Y, Yeh SL. Theta activity in semantic priming under visual crowding as revealed by magnetoencephalography. Neurosci Res 2022; 185:29-39. [PMID: 36113812 DOI: 10.1016/j.neures.2022.09.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2021] [Revised: 08/29/2022] [Accepted: 09/11/2022] [Indexed: 11/27/2022]
Abstract
Crowding refers to impaired object recognition of peripheral visual targets caused by nearby flankers. It has been shown that the response to a word was faster when it was preceded by a semantically related than unrelated crowded prime, demonstrating that semantic priming survives crowding. This study examines neural correlates of semantic priming under visual crowding using magnetoencephalography with four conditions: prime (isolated, crowded) x prime-target relationship (related, unrelated). Participants judged whether the target was a word or a nonword. We found significant differences in θ activity at the left inferior frontal gyrus (IFG) for both isolated and crowded primes when comparing the unrelated and related conditions, although the activation was delayed with the crowded prime compared to the isolated prime. The locations within the IFG were also different: theta-band activation was at BA 45 in the isolated condition and at BA 47 in the crowded condition. Phase-locking-value analysis revealed that bilateral IFG was more synchronized with unrelated prime-target pairs than related pairs regardless of whether the primes were isolated or crowded, indicating the recruitment of the right hemisphere when the prime-target semantic relationship was remote. Finally, the distinct waveform patterns found in the isolated and crowded conditions from both the source localization and PLV analysis suggest different neural mechanisms for processing semantic information with isolated primes versus crowded primes.
Collapse
Affiliation(s)
- Sung-En Chien
- Department of Psychology, National Taiwan University, Taipei, Taiwan
| | - Yung-Hao Yang
- Department of Psychology, National Taiwan University, Taipei, Taiwan
| | - Yumie Ono
- School of Science and Technology, Meiji University, Kanagawa, Japan
| | - Su-Ling Yeh
- Department of Psychology, National Taiwan University, Taipei, Taiwan; Graduate Institute of Brain and Mind Sciences, National Taiwan University, Taipei, Taiwan; Neurobiology and Cognitive Science Center, National Taiwan University, Taipei, Taiwan; Center for Artificial Intelligence and Advanced Robotics, National Taiwan University, Taipei, Taiwan.
| |
Collapse
|
28
|
Huettig F, Audring J, Jackendoff R. A parallel architecture perspective on pre-activation and prediction in language processing. Cognition 2022; 224:105050. [DOI: 10.1016/j.cognition.2022.105050] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2021] [Revised: 12/15/2021] [Accepted: 01/26/2022] [Indexed: 11/03/2022]
|
29
|
Coopmans CW, de Hoop H, Hagoort P, Martin AE. Effects of Structure and Meaning on Cortical Tracking of Linguistic Units in Naturalistic Speech. NEUROBIOLOGY OF LANGUAGE (CAMBRIDGE, MASS.) 2022; 3:386-412. [PMID: 37216060 PMCID: PMC10158633 DOI: 10.1162/nol_a_00070] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/14/2021] [Accepted: 03/02/2022] [Indexed: 05/24/2023]
Abstract
Recent research has established that cortical activity "tracks" the presentation rate of syntactic phrases in continuous speech, even though phrases are abstract units that do not have direct correlates in the acoustic signal. We investigated whether cortical tracking of phrase structures is modulated by the extent to which these structures compositionally determine meaning. To this end, we recorded electroencephalography (EEG) of 38 native speakers who listened to naturally spoken Dutch stimuli in different conditions, which parametrically modulated the degree to which syntactic structure and lexical semantics determine sentence meaning. Tracking was quantified through mutual information between the EEG data and either the speech envelopes or abstract annotations of syntax, all of which were filtered in the frequency band corresponding to the presentation rate of phrases (1.1-2.1 Hz). Overall, these mutual information analyses showed stronger tracking of phrases in regular sentences than in stimuli whose lexical-syntactic content is reduced, but no consistent differences in tracking between sentences and stimuli that contain a combination of syntactic structure and lexical content. While there were no effects of compositional meaning on the degree of phrase-structure tracking, analyses of event-related potentials elicited by sentence-final words did reveal meaning-induced differences between conditions. Our findings suggest that cortical tracking of structure in sentences indexes the internal generation of this structure, a process that is modulated by the properties of its input, but not by the compositional interpretation of its output.
Collapse
Affiliation(s)
- Cas W. Coopmans
- Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands
- Centre for Language Studies, Radboud University, Nijmegen, The Netherlands
| | - Helen de Hoop
- Centre for Language Studies, Radboud University, Nijmegen, The Netherlands
| | - Peter Hagoort
- Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands
| | - Andrea E. Martin
- Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands
| |
Collapse
|
30
|
Murphy E, Woolnough O, Rollo PS, Roccaforte ZJ, Segaert K, Hagoort P, Tandon N. Minimal Phrase Composition Revealed by Intracranial Recordings. J Neurosci 2022; 42:3216-3227. [PMID: 35232761 PMCID: PMC8994536 DOI: 10.1523/jneurosci.1575-21.2022] [Citation(s) in RCA: 24] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2021] [Revised: 01/11/2022] [Accepted: 01/18/2022] [Indexed: 11/21/2022] Open
Abstract
The ability to comprehend phrases is an essential integrative property of the brain. Here, we evaluate the neural processes that enable the transition from single-word processing to a minimal compositional scheme. Previous research has reported conflicting timing effects of composition, and disagreement persists with respect to inferior frontal and posterior temporal contributions. To address these issues, 19 patients (10 male, 9 female) implanted with penetrating depth or surface subdural intracranial electrodes, heard auditory recordings of adjective-noun, pseudoword-noun, and adjective-pseudoword phrases and judged whether the phrase matched a picture. Stimulus-dependent alterations in broadband gamma activity, low-frequency power, and phase-locking values across the language-dominant left hemisphere were derived. This revealed a mosaic located on the lower bank of the posterior superior temporal sulcus (pSTS), in which closely neighboring cortical sites displayed exclusive sensitivity to either lexicality or phrase structure, but not both. Distinct timings were found for effects of phrase composition (210-300 ms) and pseudoword processing (∼300-700 ms), and these were localized to neighboring electrodes in pSTS. The pars triangularis and temporal pole encoded anticipation of composition in broadband low frequencies, and both regions exhibited greater functional connectivity with pSTS during phrase composition. Our results suggest that the pSTS is a highly specialized region composed of sparsely interwoven heterogeneous constituents that encodes both lower and higher level linguistic features. This hub in pSTS for minimal phrase processing may form the neural basis for the human-specific computational capacity for forming hierarchically organized linguistic structures.SIGNIFICANCE STATEMENT Linguists have claimed that the integration of multiple words into a phrase demands a computational procedure distinct from single-word processing. Here, we provide intracranial recordings from a large patient cohort, with high spatiotemporal resolution, to track the cortical dynamics of phrase composition. Epileptic patients volunteered to participate in a task in which they listened to phrases (red boat), word-pseudoword or pseudoword-word pairs (e.g., red fulg). At the onset of the second word in phrases, greater broadband high gamma activity was found in posterior superior temporal sulcus in electrodes that exclusively indexed phrasal meaning and not lexical meaning. These results provide direct, high-resolution signatures of minimal phrase composition in humans, a potentially species-specific computational capacity.
Collapse
Affiliation(s)
- Elliot Murphy
- Vivian L. Smith Department of Neurosurgery, McGovern Medical School, University of Texas Health Science Center at Houston, Houston, Texas 77030
- Texas Institute for Restorative Neurotechnologies, University of Texas Health Science Center at Houston, Houston, Texas 77030
| | - Oscar Woolnough
- Vivian L. Smith Department of Neurosurgery, McGovern Medical School, University of Texas Health Science Center at Houston, Houston, Texas 77030
- Texas Institute for Restorative Neurotechnologies, University of Texas Health Science Center at Houston, Houston, Texas 77030
| | - Patrick S Rollo
- Vivian L. Smith Department of Neurosurgery, McGovern Medical School, University of Texas Health Science Center at Houston, Houston, Texas 77030
- Texas Institute for Restorative Neurotechnologies, University of Texas Health Science Center at Houston, Houston, Texas 77030
| | - Zachary J Roccaforte
- Vivian L. Smith Department of Neurosurgery, McGovern Medical School, University of Texas Health Science Center at Houston, Houston, Texas 77030
| | - Katrien Segaert
- School of Psychology and Centre for Human Brain Health, University of Birmingham, Birmingham B15 2TT, United Kingdom
- Max Planck Institute for Psycholinguistics, Nijmegen, 6525 XD Nijmegen, The Netherlands
| | - Peter Hagoort
- Max Planck Institute for Psycholinguistics, Nijmegen, 6525 XD Nijmegen, The Netherlands
- Donders Institute for Brain, Cognition and Behaviour, Nijmegen, 6525 HR Nijmegen, The Netherlands
| | - Nitin Tandon
- Vivian L. Smith Department of Neurosurgery, McGovern Medical School, University of Texas Health Science Center at Houston, Houston, Texas 77030
- Texas Institute for Restorative Neurotechnologies, University of Texas Health Science Center at Houston, Houston, Texas 77030
- Memorial Hermann Hospital, Texas Medical Center, Houston, Texas 77030
| |
Collapse
|
31
|
Dini H, Simonetti A, Bigne E, Bruni LE. EEG theta and N400 responses to congruent versus incongruent brand logos. Sci Rep 2022; 12:4490. [PMID: 35296710 PMCID: PMC8927156 DOI: 10.1038/s41598-022-08363-1] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/25/2021] [Accepted: 03/04/2022] [Indexed: 11/14/2022] Open
Abstract
Neuroimaging and behavioral studies have shown that brands convey meaning to consumers. To investigate the immediate reactions of the brain to brand logos, followed either by congruent or incongruent pictorial brand-related cues, can deepen understanding of the semantic processing of brands, and perhaps how consolidated the logo is in consumers’ minds. Participants were exposed to different brand-related image sets, that were either congruent (a match between brand-related images and brand logo) or incongruent (a mismatch between brand-related images and brand logo) while having their brain signals recorded. Event-related potential and EEG time–frequency domain features were extracted from the signals of the target image (brand logo). The results showed significantly larger N400 peak and relative theta power increase for incongruent compared to congruent logos, which could be attributed to an error-monitoring process. Thus, we argue that brands are encoded deeply in consumers’ minds, and cognitive processing of mismatched (vs matched) brand logos is more difficult, leading to greater error monitoring. The results were mostly consistent with previous studies investigating semantic incongruences in the linguistic field. Therefore, the error-monitoring process could be extended beyond linguistic forms, for example to images and brands.
Collapse
Affiliation(s)
- Hossein Dini
- The Augmented Cognition Lab, Aalborg University, 2450, Copenhagen, Denmark
| | - Aline Simonetti
- Department of Marketing and Market Research, University of Valencia, 46022, Valencia, Spain
| | - Enrique Bigne
- Department of Marketing and Market Research, University of Valencia, 46022, Valencia, Spain.
| | - Luis Emilio Bruni
- The Augmented Cognition Lab, Aalborg University, 2450, Copenhagen, Denmark
| |
Collapse
|
32
|
Does the character-based dimension of stories impact narrative processing? An event-related potentials (ERPs) study. Cogn Process 2022; 23:255-267. [PMID: 35048215 DOI: 10.1007/s10339-021-01070-1] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2021] [Accepted: 11/26/2021] [Indexed: 11/03/2022]
Abstract
This event-related potentials (ERPs) study investigated online processes of integration of information relating to characters in narrative comprehension. The final sample included twenty-nine participants who read short third-person stories in which the plausibility of the characters' actions was manipulated. Stories were administered in three conditions: a character-based congruent condition including a target word that was consistent with the character's job; a character-based incongruent condition with a target word inconsistent with the character's job; a character-based neutral condition, narrating the action of a character presented by his/her proper name without information about his/her job. Results comparing the ERPs elicited by the experimental conditions revealed a greater negative amplitude of the N400 in the right temporal regions in response to the character-based incongruent compared to the character-based congruent narratives. This finding shows that implicit background character-based information affects the N400, with readers rapidly using this information to comprehend narratives.
Collapse
|
33
|
Nour Eddine S, Brothers T, Kuperberg GR. The N400 in silico: A review of computational models. PSYCHOLOGY OF LEARNING AND MOTIVATION 2022. [DOI: 10.1016/bs.plm.2022.03.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
|
34
|
Markiewicz R, Segaert K, Mazaheri A. How the healthy ageing brain supports semantic binding during language comprehension. Eur J Neurosci 2021; 54:7899-7917. [PMID: 34779069 DOI: 10.1111/ejn.15525] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/15/2021] [Revised: 11/01/2021] [Accepted: 11/05/2021] [Indexed: 01/02/2023]
Abstract
Semantic binding refers to constructing complex meaning based on elementary building blocks. Using electroencephalography (EEG), we investigated the age-related changes in modulations of oscillatory brain activity supporting lexical retrieval and semantic binding. Young and older adult participants were visually presented two-word phrases, which for the first word revealed a lexical retrieval signature (e.g., swift vs. swrfeq) and for the second word revealed a semantic binding signature (e.g., horse in a semantic binding "swift horse" vs. no binding "swrfeq horse" context). The oscillatory brain activity associated with lexical retrieval as well as semantic binding significantly differed between healthy older and young adults. Specifically for lexical retrieval, we found that different age groups exhibited opposite patterns of theta and alpha modulation, which as a combined picture suggest that lexical retrieval is associated with different and delayed signatures in older compared with young adults. For semantic binding, in young adults, we found a signature in the low-beta range centred around the target word onset (i.e., a smaller low-beta increase for binding relative to no binding), whereas in healthy older adults, we found an opposite binding signature about ~500 ms later in the low- and high-beta range (i.e., a smaller low- and high-beta decrease for binding relative to no binding). The novel finding of a different and delayed oscillatory signature for semantic binding in healthy older adults reflects that the integration of word meaning into the semantic context takes longer and relies on different mechanisms in healthy older compared with young adults.
Collapse
Affiliation(s)
- Roksana Markiewicz
- School of Psychology, University of Birmingham, Birmingham, UK.,Centre for Human Brain Health, University of Birmingham, Birmingham, UK
| | - Katrien Segaert
- School of Psychology, University of Birmingham, Birmingham, UK.,Centre for Human Brain Health, University of Birmingham, Birmingham, UK.,Centre for Developmental Science, University of Birmingham, Birmingham, UK
| | - Ali Mazaheri
- School of Psychology, University of Birmingham, Birmingham, UK.,Centre for Human Brain Health, University of Birmingham, Birmingham, UK
| |
Collapse
|
35
|
Zheng Y, Zhao Z, Yang X, Li X. The impact of musical expertise on anticipatory semantic processing during online speech comprehension: An electroencephalography study. BRAIN AND LANGUAGE 2021; 221:105006. [PMID: 34392023 DOI: 10.1016/j.bandl.2021.105006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/05/2021] [Revised: 07/29/2021] [Accepted: 07/30/2021] [Indexed: 06/13/2023]
Abstract
Musical experience has been found to aid speech perception. This electroencephalography study further examined whether and how musical expertise affects high-level predictive semantic processing in speech comprehension. Musicians and non-musicians listened to semantically strongly/weakly constraining sentences, with each sentence being primed by a congruent/incongruent sentence-prosody. At the target nouns, a N400 reduction effect (strongly vs. weakly constraining) was observed in both groups, with the onset-latency of this effect being delayed for incongruent (vs. congruent) priming. At the transitive verbs preceding these target nouns, musicians' event-related-potential amplitude (in incongruent-priming) and beta-band oscillatory power (in congruent- and incongruent-priming) showed a semantic-constraint effect, and were correlated with the predictability of incoming nouns; non-musicians only demonstrated an event-related-potential semantic-constraint effect, which was correlated with the predictability of current verbs. These results indicate musical expertise enhances semantic prediction tendency in speech comprehension, and this effect might be not just an aftereffect of facilitated acoustic/phonological processing.
Collapse
Affiliation(s)
- Yuanyi Zheng
- CAS Key Laboratory of Behavioral Science, Institute of Psychology, Chinese Academy of Sciences, Beijing 100101, China; Department of Psychology, University of Chinese Academy of Sciences, Beijing 100149, China
| | - Zitong Zhao
- CAS Key Laboratory of Behavioral Science, Institute of Psychology, Chinese Academy of Sciences, Beijing 100101, China; Department of Psychology, University of Chinese Academy of Sciences, Beijing 100149, China
| | - Xiaohong Yang
- CAS Key Laboratory of Behavioral Science, Institute of Psychology, Chinese Academy of Sciences, Beijing 100101, China; Department of Psychology, University of Chinese Academy of Sciences, Beijing 100149, China
| | - Xiaoqing Li
- CAS Key Laboratory of Behavioral Science, Institute of Psychology, Chinese Academy of Sciences, Beijing 100101, China; Department of Psychology, University of Chinese Academy of Sciences, Beijing 100149, China.
| |
Collapse
|
36
|
Retrieval (N400) and integration (P600) in expectation-based comprehension. PLoS One 2021; 16:e0257430. [PMID: 34582472 PMCID: PMC8478172 DOI: 10.1371/journal.pone.0257430] [Citation(s) in RCA: 24] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/16/2021] [Accepted: 08/31/2021] [Indexed: 11/24/2022] Open
Abstract
Expectation-based theories of language processing, such as Surprisal theory, are supported by evidence of anticipation effects in both behavioural and neurophysiological measures. Online measures of language processing, however, are known to be influenced by factors such as lexical association that are distinct from—but often confounded with—expectancy. An open question therefore is whether a specific locus of expectancy related effects can be established in neural and behavioral processing correlates. We address this question in an event-related potential experiment and a self-paced reading experiment that independently cross expectancy and lexical association in a context manipulation design. We find that event-related potentials reveal that the N400 is sensitive to both expectancy and lexical association, while the P600 is modulated only by expectancy. Reading times, in turn, reveal effects of both association and expectancy in the first spillover region, followed by effects of expectancy alone in the second spillover region. These findings are consistent with the Retrieval-Integration account of language comprehension, according to which lexical retrieval (N400) is facilitated for words that are both expected and associated, whereas integration difficulty (P600) will be greater for unexpected words alone. Further, an exploratory analysis suggests that the P600 is not merely sensitive to expectancy violations, but rather, that there is a continuous relation. Taken together, these results suggest that the P600, like reading times, may reflect a meaning-centric notion of Surprisal in language comprehension.
Collapse
|
37
|
Naumann R, Petersen W. A Theoretical Framework for a Hybrid View of the N400. Front Psychol 2021; 12:678020. [PMID: 34566758 PMCID: PMC8455922 DOI: 10.3389/fpsyg.2021.678020] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2021] [Accepted: 07/13/2021] [Indexed: 11/13/2022] Open
Abstract
In this study, we present a novel theoretical account of the N400 event-related potential (ERP) component. Hybrid views interpret this ERP component in terms of two cognitive operations: (i) access of information, which is related to predictions (predictability component), and (ii) integration of information, which is related to plausibility (plausibility component). Though there is an empirical evidence for this view, what has been left open so far is how these two operations can be defined. In our approach, both components are related to categorization. The critical word and the argument position it is related to are associated with categories that have a graded structure. This graded structure is defined in terms of weights both on attributes and values of features belonging to a category. The weights, in turn, are defined using probability distributions. The predictability component is defined in terms of the information gain with respect to non mismatched features between the two categories. The plausibility component is defined as the difference in the degree of typicality between the two categories. Finally, the N400 amplitude is defined as a function of both components.
Collapse
Affiliation(s)
- Ralf Naumann
- Department of Computational Linguistics, Institute for Language and Information Science, Heinrich-Heine-Universität Düsseldorf, Düsseldorf, Germany
| | - Wiebke Petersen
- Department of Computational Linguistics, Institute for Language and Information Science, Heinrich-Heine-Universität Düsseldorf, Düsseldorf, Germany
| |
Collapse
|
38
|
Giglio L, Ostarek M, Weber K, Hagoort P. Commonalities and Asymmetries in the Neurobiological Infrastructure for Language Production and Comprehension. Cereb Cortex 2021; 32:1405-1418. [PMID: 34491301 PMCID: PMC8971077 DOI: 10.1093/cercor/bhab287] [Citation(s) in RCA: 30] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2021] [Revised: 07/19/2021] [Accepted: 07/20/2021] [Indexed: 01/30/2023] Open
Abstract
The neurobiology of sentence production has been largely understudied compared to the neurobiology of sentence comprehension, due to difficulties with experimental control and motion-related artifacts in neuroimaging. We studied the neural response to constituents of increasing size and specifically focused on the similarities and differences in the production and comprehension of the same stimuli. Participants had to either produce or listen to stimuli in a gradient of constituent size based on a visual prompt. Larger constituent sizes engaged the left inferior frontal gyrus (LIFG) and middle temporal gyrus (LMTG) extending to inferior parietal areas in both production and comprehension, confirming that the neural resources for syntactic encoding and decoding are largely overlapping. An ROI analysis in LIFG and LMTG also showed that production elicited larger responses to constituent size than comprehension and that the LMTG was more engaged in comprehension than production, while the LIFG was more engaged in production than comprehension. Finally, increasing constituent size was characterized by later BOLD peaks in comprehension but earlier peaks in production. These results show that syntactic encoding and parsing engage overlapping areas, but there are asymmetries in the engagement of the language network due to the specific requirements of production and comprehension.
Collapse
Affiliation(s)
- Laura Giglio
- Max Planck Institute for Psycholinguistics, 6525 XD Nijmegen, The Netherlands.,Donders Institute for Cognition, Brain and Behaviour, Radboud University, 6525 AJ Nijmegen, The Netherlands
| | - Markus Ostarek
- Max Planck Institute for Psycholinguistics, 6525 XD Nijmegen, The Netherlands.,Donders Institute for Cognition, Brain and Behaviour, Radboud University, 6525 AJ Nijmegen, The Netherlands
| | - Kirsten Weber
- Max Planck Institute for Psycholinguistics, 6525 XD Nijmegen, The Netherlands.,Donders Institute for Cognition, Brain and Behaviour, Radboud University, 6525 AJ Nijmegen, The Netherlands
| | - Peter Hagoort
- Max Planck Institute for Psycholinguistics, 6525 XD Nijmegen, The Netherlands.,Donders Institute for Cognition, Brain and Behaviour, Radboud University, 6525 AJ Nijmegen, The Netherlands
| |
Collapse
|
39
|
Junge C, Boumeester M, Mills DL, Paul M, Cosper SH. Development of the N400 for Word Learning in the First 2 Years of Life: A Systematic Review. Front Psychol 2021; 12:689534. [PMID: 34276518 PMCID: PMC8277998 DOI: 10.3389/fpsyg.2021.689534] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2021] [Accepted: 05/27/2021] [Indexed: 11/13/2022] Open
Abstract
The N400 ERP component is a direct neural index of word meaning. Studies show that the N400 component is already present in early infancy, albeit often delayed. Many researchers capitalize on this finding, using the N400 component to better understand how early language acquisition unfolds. However, variability in how researchers quantify the N400 makes it difficult to set clear predictions or build theory. Not much is known about how the N400 component develops in the first 2 years of life in terms of its latency and topographical distributions, nor do we know how task parameters affect its appearance. In the current paper we carry out a systematic review, comparing over 30 studies that report the N400 component as a proxy of semantic processing elicited in infants between 0 and 24 months old who listened to linguistic stimuli. Our main finding is that there is large heterogeneity across semantic-priming studies in reported characteristics of the N400, both with respect to latency and to distributions. With age, the onset of the N400 insignificantly decreases, while its offset slightly increases. We also examined whether the N400 appears different for recently-acquired novel words vs. existing words: both situations reveal heterogeneity across studies. Finally, we inspected whether the N400 was modulated differently with studies using a between-subject design. In infants with more proficient language skills the N400 was more often present or showed itself here with earlier latency, compared to their peers; but no consistent patterns were observed for distribution characteristics of the N400. One limitation of the current review is that we compared studies that widely differed in choice of EEG recordings, pre-processing steps and quantification of the N400, all of which could affect the characteristics of the infant N400. The field is still missing research that systematically tests development of the N400 using the same paradigm across infancy.
Collapse
Affiliation(s)
- Caroline Junge
- Department of Experimental Psychology, Utrecht University, Utrecht, Netherlands
| | - Marlijne Boumeester
- Department of Experimental Psychology, Utrecht University, Utrecht, Netherlands
| | - Debra L. Mills
- School of Psychology, Bangor University, Bangor, United Kingdom
| | - Mariella Paul
- Psychology of Language Research Group, Georg-August-Universität Göttingen, Göttingen, Germany
| | - Samuel H. Cosper
- Institute of Cognitive Science, University of Osnabrück, Osnabrück, Germany
| |
Collapse
|
40
|
Baggio G. Compositionality in a Parallel Architecture for Language Processing. Cogn Sci 2021; 45:e12949. [PMID: 34018238 DOI: 10.1111/cogs.12949] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2020] [Revised: 11/20/2020] [Accepted: 01/27/2021] [Indexed: 01/18/2023]
Abstract
Compositionality has been a central concept in linguistics and philosophy for decades, and it is increasingly prominent in many other areas of cognitive science. Its status, however, remains contentious. Here, I reassess the nature and scope of the principle of compositionality (Partee, 1995) from the perspective of psycholinguistics and cognitive neuroscience. First, I review classic arguments for compositionality and conclude that they fail to establish compositionality as a property of human language. Next, I state a new competence argument, acknowledging the fact that any competent user of a language L can assign to most expressions in L at least one meaning which is a function only of the meanings of the expression's parts and of its syntactic structure. I then discuss selected results from cognitive neuroscience, indicating that the human brain possesses the processing capacities presupposed by the competence argument. Finally, I outline a language processing architecture consistent with the neuroscience results, where semantic representations may be generated by a syntax-driven stream and by an "asyntactic" processing stream, jointly or independently. Compositionality is viewed as a constraint on computation in the former stream only.
Collapse
Affiliation(s)
- Giosuè Baggio
- Language Acquisition and Language Processing Lab, Department of Language and Literature, Faculty of Humanities, Norwegian University of Science and Technology
| |
Collapse
|
41
|
Delogu F, Brouwer H, Crocker MW. When components collide: Spatiotemporal overlap of the N400 and P600 in language comprehension. Brain Res 2021; 1766:147514. [PMID: 33974906 DOI: 10.1016/j.brainres.2021.147514] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2021] [Revised: 03/30/2021] [Accepted: 05/04/2021] [Indexed: 01/23/2023]
Abstract
The problem of spatiotemporal overlap between event-related potential (ERP) components is generally acknowledged in language research. However, its implications for the interpretation of experimental results are often overlooked. In a previous experiment on the functional interpretation of the N400 and P600, it was argued that a P600 effect to implausible words was largely obscured - in one of two implausible conditions - by an overlapping N400 effect of semantic association. In the present ERP study, we show that the P600 effect of implausibility is uncovered when the critical condition is tested against a proper baseline condition which elicits a similar N400 amplitude, while it is obscured when tested against a baseline condition producing an N400 effect. Our findings reveal that component overlap can result in the apparent absence or presence of an effect in the surface signal and should therefore be carefully considered when interpreting ERP patterns. Importantly, we show that, by factoring in the effects of spatiotemporal overlap between the N400 and P600 on the surface signal, which we reveal using rERP analysis, apparent inconsistencies in previous findings are easily reconciled, enabling us to draw unambiguous conclusions about the functional interpretation of the N400 and P600 components. Overall, our results provide compelling evidence that the N400 reflects lexical retrieval processes, while the P600 indexes compositional integration of word meaning into the unfolding utterance interpretation.
Collapse
Affiliation(s)
- Francesca Delogu
- Department of Language Science and Technology, Saarland University, Building C7.1, 66123 Saarbrücken, Germany.
| | - Harm Brouwer
- Department of Language Science and Technology, Saarland University, Building C7.1, 66123 Saarbrücken, Germany
| | - Matthew W Crocker
- Department of Language Science and Technology, Saarland University, Building C7.1, 66123 Saarbrücken, Germany
| |
Collapse
|
42
|
Not all arguments are processed equally: a distributional model of argument complexity. LANG RESOUR EVAL 2021. [DOI: 10.1007/s10579-021-09533-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
|
43
|
Barbieri E, Litcofsky KA, Walenski M, Chiappetta B, Mesulam MM, Thompson CK. Online sentence processing impairments in agrammatic and logopenic primary progressive aphasia: Evidence from ERP. Neuropsychologia 2021; 151:107728. [PMID: 33326758 PMCID: PMC7875464 DOI: 10.1016/j.neuropsychologia.2020.107728] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2020] [Revised: 12/07/2020] [Accepted: 12/09/2020] [Indexed: 10/22/2022]
Abstract
Evidence from psycholinguistic research indicates that sentence processing is impaired in Primary Progressive Aphasia (PPA), and more so in individuals with agrammatic (PPA-G) than logopenic (PPA-L) subtypes. Studies have mostly focused on offline sentence production ability, reporting impaired production of verb morphology (e.g., tense, agreement) and verb-argument structure (VAS) in PPA-G, and mixed findings in PPA-L. However, little is known about real-time sentence comprehension in PPA. The present study is the first to compare real-time semantic, morphosyntactic and VAS processing in individuals with PPA (10 with PPA-G and 9 with PPA-L), and in two groups of healthy (22 young and 19 older) individuals, using event-related potentials (ERP). Participants were instructed to listen to sentences that were either well-formed (n = 150) or contained a violation of semantics (e.g., *Owen was mentoring pumpkins at the party, n = 50), morphosyntax (e.g., *The actors was singing in the theatre, n = 50) or VAS (*Ryan was devouring on the couch, n = 50), and were required to perform a sentence acceptability judgment task while EEG was recorded. Results indicated that in the semantic task both healthy and PPA groups showed an N400 response to semantic violations, which was delayed in PPA and older (vs. younger) groups. Morphosyntactic violations elicited a P600 in both groups of healthy individuals and in PPA-L, but not in PPA-G. A similar P600 response was also found only in healthy individuals for VAS violations; whereas, abnormal ERP responses were observed in both PPA groups, with PPA-G showing no evidence of VAS violation detection and PPA-L showing a delayed and abnormally-distributed positive component that was negatively associated with offline sentence comprehension scores. These findings support characterizations of sentence processing impairments in PPA-G, by providing online evidence that VAS and morphosyntactic processing are impaired, in the face of substantially preserved semantic processing. In addition, the results indicate that on-line processing of VAS information may also be impaired in PPA-L, despite their near-normal accuracy on standardized language tests of argument structure production.
Collapse
Affiliation(s)
- Elena Barbieri
- Aphasia and Neurolinguistics Research Laboratory, Department of Communication Sciences and Disorders, Northwestern University, Evanston, IL, United States.
| | - Kaitlyn A Litcofsky
- Aphasia and Neurolinguistics Research Laboratory, Department of Communication Sciences and Disorders, Northwestern University, Evanston, IL, United States
| | - Matthew Walenski
- Aphasia and Neurolinguistics Research Laboratory, Department of Communication Sciences and Disorders, Northwestern University, Evanston, IL, United States
| | - Brianne Chiappetta
- Aphasia and Neurolinguistics Research Laboratory, Department of Communication Sciences and Disorders, Northwestern University, Evanston, IL, United States
| | - Marek-Marsel Mesulam
- Mesulam Center for Cognitive Neurology and Alzheimer's Disease, Northwestern University, Chicago, IL, United States; Department of Neurology, Northwestern University, Chicago, IL, United States
| | - Cynthia K Thompson
- Aphasia and Neurolinguistics Research Laboratory, Department of Communication Sciences and Disorders, Northwestern University, Evanston, IL, United States; Mesulam Center for Cognitive Neurology and Alzheimer's Disease, Northwestern University, Chicago, IL, United States; Department of Neurology, Northwestern University, Chicago, IL, United States
| |
Collapse
|
44
|
Vega-Mendoza M, Pickering MJ, Nieuwland MS. Concurrent use of animacy and event-knowledge during comprehension: Evidence from event-related potentials. Neuropsychologia 2021; 152:107724. [PMID: 33347913 DOI: 10.1016/j.neuropsychologia.2020.107724] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2019] [Revised: 10/02/2020] [Accepted: 12/08/2020] [Indexed: 10/22/2022]
Abstract
In two ERP experiments, we investigated whether readers prioritize animacy over real-world event-knowledge during sentence comprehension. We used the paradigm of Paczynski and Kuperberg (2012), who argued that animacy is prioritized based on the observations that the 'related anomaly effect' (reduced N400s for context-related anomalous words compared to unrelated words) does not occur for animacy violations, and that animacy violations but not relatedness violations elicit P600 effects. Participants read passive sentences with plausible agents (e.g., The prescription for the mental disorder was written by the psychiatrist) or implausible agents that varied in animacy and semantic relatedness (schizophrenic/guard/pill/fence). In Experiment 1 (with a plausibility judgment task), plausible sentences elicited smaller N400s relative to all types of implausible sentences. Crucially, animate words elicited smaller N400s than inanimate words, and related words elicited smaller N400s than unrelated words, but Bayesian analysis revealed substantial evidence against an interaction between animacy and relatedness. Moreover, at the P600 time-window, we observed more positive ERPs for animate than inanimate words and for related than unrelated words at anterior regions. In Experiment 2 (without judgment task), we observed an N400 effect with animacy violations, but no other effects. Taken together, the results of our experiments fail to support a prioritized role of animacy information over real-world event-knowledge, but they support an interactive, constraint-based view on incremental semantic processing.
Collapse
Affiliation(s)
- Mariana Vega-Mendoza
- Department of Psychology, School of Philosophy, Psychology and Language Sciences, University of Edinburgh, Edinburgh, Scotland, UK; Department of Business Administration, Technology and Social Sciences. Engineering Psychology, Luleå University of Technology, Luleå, Sweden.
| | - Martin J Pickering
- Department of Psychology, School of Philosophy, Psychology and Language Sciences, University of Edinburgh, Edinburgh, Scotland, UK
| | - Mante S Nieuwland
- Department of Psychology, School of Philosophy, Psychology and Language Sciences, University of Edinburgh, Edinburgh, Scotland, UK; Max Planck Institute for Psycholinguistics, Nijmegen, the Netherlands; Donders Institute for Cognition, Brain and Behaviour, Nijmegen, the Netherlands; Heinrich-Heine-University, Düsseldorf, Germany
| |
Collapse
|
45
|
He Y, Luell S, Muralikrishnan R, Straube B, Nagels A. Gesture's body orientation modulates the N400 for visual sentences primed by gestures. Hum Brain Mapp 2020; 41:4901-4911. [PMID: 32808721 PMCID: PMC7643362 DOI: 10.1002/hbm.25166] [Citation(s) in RCA: 17] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2020] [Revised: 07/16/2020] [Accepted: 07/23/2020] [Indexed: 01/08/2023] Open
Abstract
Body orientation of gesture entails social-communicative intention, and may thus influence how gestures are perceived and comprehended together with auditory speech during face-to-face communication. To date, despite the emergence of neuroscientific literature on the role of body orientation on hand action perception, limited studies have directly investigated the role of body orientation in the interaction between gesture and language. To address this research question, we carried out an electroencephalography (EEG) experiment presenting to participants (n = 21) videos of frontal and lateral communicative hand gestures of 5 s (e.g., raising a hand), followed by visually presented sentences that are either congruent or incongruent with the gesture (e.g., "the mountain is high/low…"). Participants underwent a semantic probe task, judging whether a target word is related or unrelated to the gesture-sentence event. EEG results suggest that, during the perception phase of handgestures, while both frontal and lateral gestures elicited a power decrease in both the alpha (8-12 Hz) and the beta (16-24 Hz) bands, lateral versus frontal gestures elicited reduced power decrease in the beta band, source-located to the medial prefrontal cortex. For sentence comprehension, at the critical word whose meaning is congruent/incongruent with the gesture prime, frontal gestures elicited an N400 effect for gesture-sentence incongruency. More importantly, this incongruency effect was significantly reduced for lateral gestures. These findings suggest that body orientation plays an important role in gesture perception, and that its inferred social-communicative intention may influence gesture-language interaction at semantic level.
Collapse
Affiliation(s)
- Yifei He
- Department of Psychiatry and PsychotherapyPhilipps‐University MarburgMarburgGermany
| | - Svenja Luell
- Department of General LinguisticsJohannes‐Gutenberg University MainzMainzGermany
| | - R. Muralikrishnan
- Department of NeuroscienceMax Planck Institute for Empirical AestheticsFrankfurtGermany
| | - Benjamin Straube
- Department of Psychiatry and PsychotherapyPhilipps‐University MarburgMarburgGermany
| | - Arne Nagels
- Department of General LinguisticsJohannes‐Gutenberg University MainzMainzGermany
| |
Collapse
|
46
|
The neural substrate of noun morphological inflection: A rapid event-related fMRI study in Italian. Neuropsychologia 2020; 151:107699. [PMID: 33271155 DOI: 10.1016/j.neuropsychologia.2020.107699] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/12/2020] [Revised: 11/26/2020] [Accepted: 11/26/2020] [Indexed: 11/21/2022]
Abstract
The present research investigated the neural correlates of nominal inflection and aimed at disclosing their possible link with the frequency distribution of noun inflectional features: grammatical gender, inflectional suffixes and inflectional classes. The properties of the Italian nominal system were exploited since it allows to explore exhaustively fine-grained phenomena in the inflectional processing. An event-related functional magnetic resonance imaging (fMRI) experiment was carried out where Italian masculine and feminine nouns were visually presented to 50 healthy participants in an overt inflectional task: the generation of the plural from the singular and vice versa. The grammatical gender and the citation form suffix of nouns were manipulated in a factorial design. Functional data showed that inflectional operations for nouns activate an extensive cortical network involving the left inferior and right superior frontal gyri, the left and right middle temporal gyri, the posterior cingulate cortex and the cerebellum. Activations were variably modulated by the distributional features of gender-dependent properties of nouns. Particularly, cortical activity increased during inflectional operations for small and/or scarcely consistent inflectional classes. These findings demonstrate the relevance of specific morphological (inflectional suffixes) and distributional features (size and consistency) shared by groups of words (inflectional classes) in a language, particularly when implementing cognitive operations required for language processing.
Collapse
|
47
|
Meaning before grammar: A review of ERP experiments on the neurodevelopmental origins of semantic processing. Psychon Bull Rev 2020; 27:441-464. [PMID: 31950458 DOI: 10.3758/s13423-019-01677-8] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/20/2022]
Abstract
According to traditional linguistic theories, the construction of complex meanings relies firmly on syntactic structure-building operations. Recently, however, new models have been proposed in which semantics is viewed as being partly autonomous from syntax. In this paper, we discuss some of the developmental implications of syntax-based and autonomous models of semantics. We review event-related brain potential (ERP) studies on semantic processing in infants and toddlers, focusing on experiments reporting modulations of N400 amplitudes using visual or auditory stimuli and different temporal structures of trials. Our review suggests that infants can relate or integrate semantic information from temporally overlapping stimuli across modalities by 6 months of age. The ability to relate or integrate semantic information over time, within and across modalities, emerges by 9 months. The capacity to relate or integrate information from spoken words in sequences and sentences appears by 18 months. We also review behavioral and ERP studies showing that grammatical and syntactic processing skills develop only later, between 18 and 32 months. These results provide preliminary evidence for the availability of some semantic processes prior to the full developmental emergence of syntax: non-syntactic meaning-building operations are available to infants, albeit in restricted ways, months before the abstract machinery of grammar is in place. We discuss this hypothesis in light of research on early language acquisition and human brain development.
Collapse
|
48
|
Tan Y, Hagoort P. Catecholaminergic Modulation of Semantic Processing in Sentence Comprehension. Cereb Cortex 2020; 30:6426-6443. [PMID: 32776103 PMCID: PMC7609945 DOI: 10.1093/cercor/bhaa204] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2019] [Revised: 05/26/2020] [Accepted: 07/06/2020] [Indexed: 12/23/2022] Open
Abstract
Catecholamine (CA) function has been widely implicated in cognitive functions that are tied to the prefrontal cortex and striatal areas. The present study investigated the effects of methylphenidate, which is a CA agonist, on the electroencephalogram (EEG) response related to semantic processing using a double-blind, placebo-controlled, randomized, crossover, within-subject design. Forty-eight healthy participants read semantically congruent or incongruent sentences after receiving 20-mg methylphenidate or a placebo while their brain activity was monitored with EEG. To probe whether the catecholaminergic modulation is task-dependent, in one condition participants had to focus on comprehending the sentences, while in the other condition, they only had to attend to the font size of the sentence. The results demonstrate that methylphenidate has a task-dependent effect on semantic processing. Compared to placebo, when semantic processing was task-irrelevant, methylphenidate enhanced the detection of semantic incongruence as indexed by a larger N400 amplitude in the incongruent sentences; when semantic processing was task-relevant, methylphenidate induced a larger N400 amplitude in the semantically congruent condition, which was followed by a larger late positive complex effect. These results suggest that CA-related neurotransmitters influence language processing, possibly through the projections between the prefrontal cortex and the striatum, which contain many CA receptors.
Collapse
Affiliation(s)
- Yingying Tan
- Max Planck Institute for Psycholinguistics, Nijmegen 6525 XD, The Netherlands
| | - Peter Hagoort
- Max Planck Institute for Psycholinguistics, Nijmegen 6525 XD, The Netherlands.,Donders Institute for Brain, Cognition, and Behaviour, Radboud University, Nijmegen 6500 HB, The Netherlands
| |
Collapse
|
49
|
Papageorgiou C, Stachtea X, Papageorgiou P, Alexandridis AT, Makris G, Chrousos G, Kosteletos G. Gender-dependent variations in optical illusions: evidence from N400 waveforms. Physiol Meas 2020; 41:095006. [PMID: 33021228 DOI: 10.1088/1361-6579/abb2eb] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/19/2023]
Abstract
OBJECTIVE The cognitive mechanisms (especially the gender-related ones) underlying optical illusion processing remain elusive. Since the N400 component of event-related potentials (ERPs) is an index of the semantic integration of information processing tasks, the present study focuses on gender-related differences in N400 waveforms elicited during the reasoning process applied to reach a valid conclusion of optical illusions engaging working memory (WM). APPROACH Fifty-one healthy participants (28 males, age = 34.25 years ± 10.25, years of education = 16.00 years ± 1.78; and 23 females, age = 33.43 ± 7.93, years of education = 15.56 ± 1.82) were measured. The N400 ERP component was evoked by 39 optical illusions adjusted to induce WM. We compared brain activation patterns while participants maintained conclusions of the optical illusions in WM. The N400 of ERPs was recorded during the WM phase, during which participants were required to draw a logical conclusion regarding the correctness of the optical illusions. MAIN RESULTS Analysis revealed that females compared to males exhibited significantly increased N400 amplitudes located at parietal and occipital sites, whereas males exhibited significantly higher N400 amplitudes located at frontal areas. Furthermore, females compared to males demonstrated significantly prolonged latencies of the N400 component located at right frontotemporal abductions. SIGNIFICANCE These results suggest that coupling of optical illusions with WM engages distinct gender-related variations of brain semantic processing as reflected by the N400 ERP component. Based on the dual process account, our study gives support to the notion that women tend to employ a more deliberate and slower semantic reasoning than the men who tend to employ an automatic and fast one. Topographically, within the network sub-serving the semantic operation, the posterior brain areas responsible for sensorimotor integration-related processes elicit a greater brain activation among females while the anterior brain areas responsible for control and storage/retrieval operation elicit a greater brain activation among males.
Collapse
Affiliation(s)
- Charalabos Papageorgiou
- 1st Department of Psychiatry, School of Medicine, National and Kapodistrian University of Athens, Athens, Greece. University Mental Health Research Institute (UMHRI), Athens, Greece
| | | | | | | | | | | | | |
Collapse
|
50
|
Youssofzadeh V, Stout J, Ustine C, Gross WL, Conant LL, Humphries CJ, Binder JR, Raghavan M. Mapping language from MEG beta power modulations during auditory and visual naming. Neuroimage 2020; 220:117090. [DOI: 10.1016/j.neuroimage.2020.117090] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/19/2020] [Revised: 06/06/2020] [Accepted: 06/23/2020] [Indexed: 01/22/2023] Open
|