1
|
Chanoine V, Todorović S, Nazarian B, Badier JM, Kanzari K, Brovelli A, Kotz SA, Runnqvist E. Dataset for Evaluating the Production of Phonotactically Legal and Illegal Pseudowords. Sci Data 2025; 12:792. [PMID: 40368935 PMCID: PMC12078460 DOI: 10.1038/s41597-025-05127-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2024] [Accepted: 05/01/2025] [Indexed: 05/16/2025] Open
Abstract
The "MEG-GLOUPS" dataset offers a curated collection of raw magnetoencephalography recordings from seventeen French participants engaged in a pseudoword learning task as well as resting-state activity before and after the task. A dataset called Gloups with the same participants and a similar learning task adapted to functional magnetic resonance imaging is already available. In the learning task, participants were instructed to pronounce monosyllabic pseudowords, which were presented both visually and auditorily. These pseudowords were either phonotactically legal or illegal in the participants' native language, French. We organized the dataset according to the Brain Imaging Data Structure (BIDS), pre-processed the data and performed a minimal analysis of Event-Related Fields (ERFs), to ensure data quality and integrity of the dataset. This data collection includes comprehensive descriptions of the theoretical background, methods, data recordings, and technical validation.
Collapse
Affiliation(s)
- Valérie Chanoine
- Aix Marseille Univ, CNRS, LPL, Aix-en-Provence, France.
- Aix-Marseille Univ, ILCB, Aix-en-Provence, France.
| | | | - Bruno Nazarian
- Institut de Neurosciences de la Timone UMR 7289, Aix Marseille Université, CNRS, 13005, Marseille, France
| | | | | | - Andrea Brovelli
- Institut de Neurosciences de la Timone UMR 7289, Aix Marseille Université, CNRS, 13005, Marseille, France
| | - Sonja A Kotz
- Department of Neuropsychology and Psychopharmacology, Maastricht University, Maastricht, The Netherlands
- Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Elin Runnqvist
- Aix Marseille Univ, CNRS, LPL, Aix-en-Provence, France.
- Aix-Marseille Univ, ILCB, Aix-en-Provence, France.
| |
Collapse
|
2
|
te Rietmolen N, Strijkers K, Morillon B. Moving rhythmically can facilitate naturalistic speech perception in a noisy environment. Proc Biol Sci 2025; 292:20250354. [PMID: 40199360 PMCID: PMC11978457 DOI: 10.1098/rspb.2025.0354] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2024] [Revised: 03/14/2025] [Accepted: 03/14/2025] [Indexed: 04/10/2025] Open
Abstract
The motor system is known to process temporal information, and moving rhythmically while listening to a melody can improve auditory processing. In three interrelated behavioural experiments, we demonstrate that this effect translates to speech processing. Motor priming improves the efficiency of subsequent naturalistic speech-in-noise processing under specific conditions. (i) Moving rhythmically at the lexical rate (~1.8 Hz) significantly improves subsequent speech processing compared to moving at other rates, such as the phrasal or syllabic rates. (ii) The impact of such rhythmic motor priming is not influenced by whether it is self-generated or triggered by an auditory beat. (iii) Overt lexical vocalization, regardless of its semantic content, also enhances the efficiency of subsequent speech processing. These findings provide evidence for the functional role of the motor system in processing the temporal dynamics of naturalistic speech.
Collapse
Affiliation(s)
- Noémie te Rietmolen
- Institute for Language, Communication, and the Brain (ILCB), Aix-Marseille Université, Marseille, France
| | - Kristof Strijkers
- Laboratoire Parole et Langage (LPL), Aix-Marseille Université & CNRS, Aix-en-Provence, France
| | - Benjamin Morillon
- INSERM, Institut de Neurosciences des Systèmes (INS), Aix Marseille Université, Marseille, France
| |
Collapse
|
3
|
Gao P, Jiang Z, Yang Y, Zheng Y, Feng G, Li X. Temporal neural dynamics of understanding communicative intentions from speech prosody. Neuroimage 2024; 299:120830. [PMID: 39245398 DOI: 10.1016/j.neuroimage.2024.120830] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/08/2024] [Revised: 08/29/2024] [Accepted: 09/01/2024] [Indexed: 09/10/2024] Open
Abstract
Understanding the correct intention of a speaker is critical for social interaction. Speech prosody is an important source for understanding speakers' intentions during verbal communication. However, the neural dynamics by which the human brain translates the prosodic cues into a mental representation of communicative intentions in real time remains unclear. Here, we recorded EEG (electroencephalograph) while participants listened to dialogues. The prosodic features of the critical words at the end of sentences were manipulated to signal either suggestion, warning, or neutral intentions. The results showed that suggestion and warning intentions evoked enhanced late positive event-related potentials (ERPs) compared to the neutral condition. Linear mixed-effects model (LMEM) regression and representational similarity analysis (RSA) analyses revealed that these ERP effects were distinctively correlated with prosodic acoustic analysis, emotional valence evaluation, and intention interpretation in different time windows; The onset latency significantly increased as the processing level of abstractness and communicative intentionality increased. Neural representations of intention and emotional information emerged and parallelly persisted over a long time window, guiding the correct identification of communicative intention. These results provide new insights into understanding the structural components of intention processing and their temporal neural dynamics underlying communicative intention comprehension from speech prosody in online social interactions.
Collapse
Affiliation(s)
- Panke Gao
- CAS Key Laboratory of Behavioral Science, Institute of Psychology, Chinese Academy of Sciences, Beijing, China; Department of Psychology, University of Chinese Academy of Sciences, Beijing, China
| | - Zhufang Jiang
- CAS Key Laboratory of Behavioral Science, Institute of Psychology, Chinese Academy of Sciences, Beijing, China; Department of Psychology, University of Chinese Academy of Sciences, Beijing, China
| | - Yufang Yang
- CAS Key Laboratory of Behavioral Science, Institute of Psychology, Chinese Academy of Sciences, Beijing, China; Department of Psychology, University of Chinese Academy of Sciences, Beijing, China; Jiangsu Collaborative Innovation Center for Language Ability, Jiangsu Normal University, Xuzhou, China
| | - Yuanyi Zheng
- School of Psychology, Shenzhen University, Shenzhen, Guangdong, China
| | - Gangyi Feng
- Department of Linguistics and Modern Languages, The Chinese University of Hong Kong, Shatin, N.T., Hong Kong SAR, China; Brain and Mind Institute, The Chinese University of Hong Kong, Shatin, N.T., Hong Kong SAR, China.
| | - Xiaoqing Li
- CAS Key Laboratory of Behavioral Science, Institute of Psychology, Chinese Academy of Sciences, Beijing, China; Department of Psychology, University of Chinese Academy of Sciences, Beijing, China; Jiangsu Collaborative Innovation Center for Language Ability, Jiangsu Normal University, Xuzhou, China.
| |
Collapse
|
4
|
Franco J, Laganaro M. Are brain activity changes underlying rare word production after learning specific or do they extend to semantically related rare words? Cortex 2024; 178:174-189. [PMID: 39018954 DOI: 10.1016/j.cortex.2024.06.008] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2023] [Revised: 03/12/2024] [Accepted: 06/10/2024] [Indexed: 07/19/2024]
Abstract
Learning words in the mother tongue is a fundamental lifelong skill that involves complex cognitive and neural changes. In adults, newly learned words affect the organization of the lexical-semantic network and, compared to words that have been in the lexicon for longer, they activate the same cortical areas, but more extensively and/or intensively. It is however still unclear (1) which brain and cognitive processes underlying word production change when infrequent/unknown words are compared before and after learning and (2) whether integrating newly learned words impacts word specific processes or has a broader impact on unlearned words. The present study aims to investigate the electrophysiological changes underlying the production of rare words induced by learning and the effect of learning on an unlearned list of rare words belonging to the same semantic categories. To this end, 24 neurotypical adults learned one of two matched lists of 40 concrete rare words from 4 semantic categories. EEG (electroencephalographic) recordings were acquired during a referential word production task (picture naming) of the learned and unlearned words before and after the learning phase. The results show that the production of rare word is associated with event-related (ERP) differences between before and after learning in the period from 300 to 800 msec following the presentation of the imaged concept (picture). These differences consisted in a larger involvement of left temporal and parietal regions after learning between 300 and 400 msec i.e., the time window likely corresponding to lexical and phonological encoding processes. Crucially, the ERP changes are not restricted to the production of the learned rare words, but are also observed when participants try to retrieve words of a list of semantically and lexically matched rare words that they have not learned. The ERP changes on unlearned rare words are weaker and suggest that learning new words induces boarder effects also on unlearned words.
Collapse
Affiliation(s)
- Julie Franco
- Faculty of Psychology and Educational Science, University of Geneva, Geneva, Switzerland.
| | - Marina Laganaro
- Faculty of Psychology and Educational Science, University of Geneva, Geneva, Switzerland.
| |
Collapse
|
5
|
Perkušić Čović M, Vujović I, Šoda J, Palmović M, Rogić Vidaković M. Overt Word Reading and Visual Object Naming in Adults with Dyslexia: Electroencephalography Study in Transparent Orthography. Bioengineering (Basel) 2024; 11:459. [PMID: 38790326 PMCID: PMC11117949 DOI: 10.3390/bioengineering11050459] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2024] [Revised: 05/01/2024] [Accepted: 05/02/2024] [Indexed: 05/26/2024] Open
Abstract
The study aimed to investigate overt reading and naming processes in adult people with dyslexia (PDs) in shallow (transparent) language orthography. The results of adult PDs are compared with adult healthy controls HCs. Comparisons are made in three phases: pre-lexical (150-260 ms), lexical (280-700 ms), and post-lexical stage of processing (750-1000 ms) time window. Twelve PDs and HCs performed overt reading and naming tasks under EEG recording. The word reading and naming task consisted of sparse neighborhoods with closed phonemic onset (words/objects sharing the same onset). For the analysis of the mean ERP amplitude for pre-lexical, lexical, and post-lexical time window, a mixed design ANOVA was performed with the right (F4, FC2, FC6, C4, T8, CP2, CP6, P4) and left (F3, FC5, FC1, T7, C3, CP5, CP1, P7, P3) electrode sites, within-subject factors and group (PD vs. HC) as between-subject factor. Behavioral response latency results revealed significantly prolonged reading latency between HCs and PDs, while no difference was detected in naming response latency. ERP differences were found between PDs and HCs in the right hemisphere's pre-lexical time window (160-200 ms) for word reading aloud. For visual object naming aloud, ERP differences were found between PDs and HCs in the right hemisphere's post-lexical time window (900-1000 ms). The present study demonstrated different distributions of the electric field at the scalp in specific time windows between two groups in the right hemisphere in both word reading and visual object naming aloud, suggesting alternative processing strategies in adult PDs. These results indirectly support the view that adult PDs in shallow language orthography probably rely on the grapho-phonological route during overt word reading and have difficulties with phoneme and word retrieval during overt visual object naming in adulthood.
Collapse
Affiliation(s)
- Maja Perkušić Čović
- Polyclinic for Rehabilitation of People with Developmental Disorders, 21000 Split, Croatia;
| | - Igor Vujović
- Signal Processing, Analysis, and Advanced Diagnostics Research and Education Laboratory (SPAADREL), Faculty of Maritime Studies, University of Split, 21000 Split, Croatia; (I.V.); (J.Š.)
| | - Joško Šoda
- Signal Processing, Analysis, and Advanced Diagnostics Research and Education Laboratory (SPAADREL), Faculty of Maritime Studies, University of Split, 21000 Split, Croatia; (I.V.); (J.Š.)
| | - Marijan Palmović
- Laboratory for Psycholinguistic Research, Department of Speech and Language Pathology, University of Zagreb, 10000 Zagreb, Croatia;
| | - Maja Rogić Vidaković
- Laboratory for Human and Experimental Neurophysiology, Department of Neuroscience, School of Medicine, University of Split, 21000 Split, Croatia
| |
Collapse
|
6
|
Morkovina O, Manukyan P, Sharapkova A. Picture naming test through the prism of cognitive neuroscience and linguistics: adapting the test for cerebellar tumor survivors-or pouring new wine in old sacks? Front Psychol 2024; 15:1332391. [PMID: 38566942 PMCID: PMC10985186 DOI: 10.3389/fpsyg.2024.1332391] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2023] [Accepted: 02/20/2024] [Indexed: 04/04/2024] Open
Abstract
A picture naming test (PNT) has long been regarded as an integral part of neuropsychological assessment. In current research and clinical practice, it serves a variety of purposes. PNTs are used to assess the severity of speech impairment in aphasia, monitor possible cognitive decline in aging patients with or without age-related neurodegenerative disorders, track language development in children and map eloquent brain areas to be spared during surgery. In research settings, picture naming tests provide an insight into the process of lexical retrieval in monolingual and bilingual speakers. However, while numerous advances have occurred in linguistics and neuroscience since the classic, most widespread PNTs were developed, few of them have found their way into test design. Consequently, despite the popularity of PNTs in clinical and research practice, their relevance and objectivity remain questionable. The present study provides an overview of literature where relevant criticisms and concerns have been expressed over the recent decades. It aims to determine whether there is a significant gap between conventional test design and the current understanding of the mechanisms underlying lexical retrieval by focusing on the parameters that have been experimentally proven to influence picture naming. We discuss here the implications of these findings for improving and facilitating test design within the picture naming paradigm. Subsequently, we highlight the importance of designing specialized tests with a particular target group in mind, so that test variables could be selected for cerebellar tumor survivors.
Collapse
Affiliation(s)
- Olga Morkovina
- Laboratory of Diagnostics and Advancing Cognitive Functions, Research Institute for Brain Development and Peak Performance, RUDN University, Moscow, Russia
- Department of English, Faculty of Computational Mathematics and Cybernetics, Lomonosov Moscow State University, Moscow, Russia
| | - Piruza Manukyan
- Laboratory of Diagnostics and Advancing Cognitive Functions, Research Institute for Brain Development and Peak Performance, RUDN University, Moscow, Russia
| | - Anastasia Sharapkova
- Laboratory of Diagnostics and Advancing Cognitive Functions, Research Institute for Brain Development and Peak Performance, RUDN University, Moscow, Russia
- Department of English Linguistics, Faculty of Philology, Lomonosov Moscow State University, Moscow, Russia
| |
Collapse
|
7
|
Carota F, Schoffelen JM, Oostenveld R, Indefrey P. Parallel or sequential? Decoding conceptual and phonological/phonetic information from MEG signals during language production. Cogn Neuropsychol 2023; 40:298-317. [PMID: 38105574 DOI: 10.1080/02643294.2023.2283239] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2023] [Accepted: 11/08/2023] [Indexed: 12/19/2023]
Abstract
Speaking requires the temporally coordinated planning of core linguistic information, from conceptual meaning to articulation. Recent neurophysiological results suggested that these operations involve a cascade of neural events with subsequent onset times, whilst competing evidence suggests early parallel neural activation. To test these hypotheses, we examined the sources of neuromagnetic activity recorded from 34 participants overtly naming 134 images from 4 object categories (animals, tools, foods and clothes). Within each category, word length and phonological neighbourhood density were co-varied to target phonological/phonetic processes. Multivariate pattern analyses (MVPA) searchlights in source space decoded object categories in occipitotemporal and middle temporal cortex, and phonological/phonetic variables in left inferior frontal (BA 44) and motor cortex early on. The findings suggest early activation of multiple variables due to intercorrelated properties and interactivity of processing, thus raising important questions about the representational properties of target words during the preparatory time enabling overt speaking.
Collapse
Affiliation(s)
- Francesca Carota
- Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands
- Donders Institute for Cognitive Neuroscience, Radboud University, Nijmegen, The Netherlands
| | - Jan-Mathijs Schoffelen
- Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands
- Donders Institute for Cognitive Neuroscience, Radboud University, Nijmegen, The Netherlands
| | - Robert Oostenveld
- Donders Institute for Cognitive Neuroscience, Radboud University, Nijmegen, The Netherlands
- NatMEG, Karolinska Institutet, Stockholm, Sweden
| | - Peter Indefrey
- Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands
- Donders Institute for Cognitive Neuroscience, Radboud University, Nijmegen, The Netherlands
- Institut für Sprache und Information, Heinrich Heine University, Düsseldorf, Germany
| |
Collapse
|
8
|
Laganaro M. Time-course of phonetic (motor speech) encoding in utterance production. Cogn Neuropsychol 2023; 40:287-297. [PMID: 37944062 DOI: 10.1080/02643294.2023.2279739] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/15/2023] [Accepted: 10/31/2023] [Indexed: 11/12/2023]
Abstract
Speaking involves the preparation of the linguistic content of an utterance and of the motor programs leading to articulation. The temporal dynamics of linguistic versus motor-speech (phonetic) encoding is highly debated: phonetic encoding has been associated either to the last quarter of an utterance preparation time (∼150ms before articulation), or to virtually the entire planning time, simultaneously with linguistic encoding. We (i) review the evidence on the time-course of motor-speech encoding based on EEG/MEG event-related (ERP) studies and (ii) strive to replicate the early effects of phonological-phonetic factors in referential word production by reanalysing a large EEG/ERP dataset. The review indicates that motor-speech encoding is engaged during at least the last 300ms preceding articulation (about half of a word planning lag). By contrast, the very early involvement of phonological-phonetic factors could be replicated only partially and is not as robust as in the second half of the utterance planning time-window.
Collapse
Affiliation(s)
- Marina Laganaro
- Faculty of Psychology and Educational Science, University of Geneva, Geneva, Switzerland
| |
Collapse
|
9
|
Hu J, Small H, Kean H, Takahashi A, Zekelman L, Kleinman D, Ryan E, Nieto-Castañón A, Ferreira V, Fedorenko E. Precision fMRI reveals that the language-selective network supports both phrase-structure building and lexical access during language production. Cereb Cortex 2023; 33:4384-4404. [PMID: 36130104 PMCID: PMC10110436 DOI: 10.1093/cercor/bhac350] [Citation(s) in RCA: 28] [Impact Index Per Article: 14.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2022] [Revised: 08/01/2022] [Accepted: 08/02/2022] [Indexed: 11/13/2022] Open
Abstract
A fronto-temporal brain network has long been implicated in language comprehension. However, this network's role in language production remains debated. In particular, it remains unclear whether all or only some language regions contribute to production, and which aspects of production these regions support. Across 3 functional magnetic resonance imaging experiments that rely on robust individual-subject analyses, we characterize the language network's response to high-level production demands. We report 3 novel results. First, sentence production, spoken or typed, elicits a strong response throughout the language network. Second, the language network responds to both phrase-structure building and lexical access demands, although the response to phrase-structure building is stronger and more spatially extensive, present in every language region. Finally, contra some proposals, we find no evidence of brain regions-within or outside the language network-that selectively support phrase-structure building in production relative to comprehension. Instead, all language regions respond more strongly during production than comprehension, suggesting that production incurs a greater cost for the language network. Together, these results align with the idea that language comprehension and production draw on the same knowledge representations, which are stored in a distributed manner within the language-selective network and are used to both interpret and generate linguistic utterances.
Collapse
Affiliation(s)
- Jennifer Hu
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, United States
| | - Hannah Small
- Department of Cognitive Science, Johns Hopkins University, Baltimore, MD 21218, United States
| | - Hope Kean
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, United States
- McGovern Institute for Brain Research, MIT, Cambridge, MA 02139, United States
| | - Atsushi Takahashi
- McGovern Institute for Brain Research, MIT, Cambridge, MA 02139, United States
| | - Leo Zekelman
- Program in Speech and Hearing Bioscience and Technology, Harvard University, Cambridge, MA 02138, United States
| | | | - Elizabeth Ryan
- St. George’s Medical School, St. George’s University, Grenada, West Indies
| | - Alfonso Nieto-Castañón
- McGovern Institute for Brain Research, MIT, Cambridge, MA 02139, United States
- Department of Speech, Language, and Hearing Sciences, Boston University, Boston, MA 02215, United States
| | - Victor Ferreira
- Department of Psychology, UCSD, La Jolla, CA 92093, United States
| | - Evelina Fedorenko
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, United States
- McGovern Institute for Brain Research, MIT, Cambridge, MA 02139, United States
- Program in Speech and Hearing Bioscience and Technology, Harvard University, Cambridge, MA 02138, United States
| |
Collapse
|
10
|
Tomasello R. Linguistic signs in action: The neuropragmatics of speech acts. BRAIN AND LANGUAGE 2023; 236:105203. [PMID: 36470125 PMCID: PMC9856589 DOI: 10.1016/j.bandl.2022.105203] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/25/2022] [Revised: 09/07/2022] [Accepted: 11/07/2022] [Indexed: 06/05/2023]
Abstract
What makes human communication exceptional is the ability to grasp speaker's intentions beyond what is said verbally. How the brain processes communicative functions is one of the central concerns of the neurobiology of language and pragmatics. Linguistic-pragmatic theories define these functions as speech acts, and various pragmatic traits characterise them at the levels of propositional content, action sequence structure, related commitments and social aspects. Here I discuss recent neurocognitive studies, which have shown that the use of identical linguistic signs in conveying different communicative functions elicits distinct and ultra-rapid neural responses. Interestingly, cortical areas show differential involvement underlying various pragmatic features related to theory-of-mind, emotion and action for specific speech acts expressed with the same utterances. Drawing on a neurocognitive model, I posit that understanding speech acts involves the expectation of typical partner follow-up actions and that this predictive knowledge is immediately reflected in mind and brain.
Collapse
Affiliation(s)
- Rosario Tomasello
- Brain Language Laboratory, Department of Philosophy and Humanities, Freie Universität Berlin, 14195 Berlin, Germany; Cluster of Excellence 'Matters of Activity. Image Space Material', Humboldt Universität zu Berlin, 10099 Berlin, Germany.
| |
Collapse
|
11
|
Seghier ML. Multiple functions of the angular gyrus at high temporal resolution. Brain Struct Funct 2023; 228:7-46. [PMID: 35674917 DOI: 10.1007/s00429-022-02512-y] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2022] [Accepted: 05/22/2022] [Indexed: 02/07/2023]
Abstract
Here, the functions of the angular gyrus (AG) are evaluated in the light of current evidence from transcranial magnetic/electric stimulation (TMS/TES) and EEG/MEG studies. 65 TMS/TES and 52 EEG/MEG studies were examined in this review. TMS/TES literature points to a causal role in semantic processing, word and number processing, attention and visual search, self-guided movement, memory, and self-processing. EEG/MEG studies reported AG effects at latencies varying between 32 and 800 ms in a wide range of domains, with a high probability to detect an effect at 300-350 ms post-stimulus onset. A three-phase unifying model revolving around the process of sensemaking is then suggested: (1) early AG involvement in defining the current context, within the first 200 ms, with a bias toward the right hemisphere; (2) attention re-orientation and retrieval of relevant information within 200-500 ms; and (3) cross-modal integration at late latencies with a bias toward the left hemisphere. This sensemaking process can favour accuracy (e.g. for word and number processing) or plausibility (e.g. for comprehension and social cognition). Such functions of the AG depend on the status of other connected regions. The much-debated semantic role is also discussed as follows: (1) there is a strong TMS/TES evidence for a causal semantic role, (2) current EEG/MEG evidence is however weak, but (3) the existing arguments against a semantic role for the AG are not strong. Some outstanding questions for future research are proposed. This review recognizes that cracking the role(s) of the AG in cognition is possible only when its exact contributions within the default mode network are teased apart.
Collapse
Affiliation(s)
- Mohamed L Seghier
- Department of Biomedical Engineering, Khalifa University of Science and Technology, Abu Dhabi, UAE. .,Healthcare Engineering Innovation Center (HEIC), Khalifa University of Science and Technology, Abu Dhabi, UAE.
| |
Collapse
|
12
|
Phonological activation improves semantic access provided by Arabic digits and number words. Mem Cognit 2022; 51:997-1010. [PMID: 36449248 DOI: 10.3758/s13421-022-01372-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 11/06/2022] [Indexed: 12/05/2022]
Abstract
Arabic digits (e.g., "6") and number words (e.g., "", "six", " ") are the two main formats in which numbers can be represented. Although phonology plays a crucial role in the semantic accessing of alphabetic words and Chinese characters, whether it is involved in the processing of different numerical notations, which have been shown to be dissociable from characters, is still unknown. Using a parity judgment task, two experiments were performed by manipulating the phonological relationship between a prime and a target. The primes were Tibetan or Chinese characters and the targets were presented either as number words (Experiment 1) or as Arabic digits (Experiment 2). The results revealed that phonology affected semantic access for both number words and Arabic digits. Additionally, semantic access for Tibetan number words was more susceptible to phonological information. The results for Arabic digits followed the same pattern for Tibetan primes. Further, language proficiency also affected the role of phonology in number processing. Participants with low language proficiency relied more on phonological encoding when processing the numbers. The results suggest that phonology is crucial for semantic access of different numerical notations.
Collapse
|
13
|
Grisoni L, Pulvermüller F. Predictive and perceptual phonemic processing in articulatory motor areas: A prediction potential & mismatch negativity study. Cortex 2022; 155:357-372. [DOI: 10.1016/j.cortex.2022.06.017] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/09/2021] [Revised: 03/29/2022] [Accepted: 06/27/2022] [Indexed: 11/15/2022]
|
14
|
Tomasello R, Grisoni L, Boux I, Sammler D, Pulvermüller F. OUP accepted manuscript. Cereb Cortex 2022; 32:4885-4901. [PMID: 35136980 PMCID: PMC9626830 DOI: 10.1093/cercor/bhab522] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2021] [Revised: 11/16/2021] [Accepted: 12/17/2021] [Indexed: 11/20/2022] Open
Abstract
During conversations, speech prosody provides important clues about the speaker’s communicative intentions. In many languages, a rising vocal pitch at the end of a sentence typically expresses a question function, whereas a falling pitch suggests a statement. Here, the neurophysiological basis of intonation and speech act understanding were investigated with high-density electroencephalography (EEG) to determine whether prosodic features are reflected at the neurophysiological level. Already approximately 100 ms after the sentence-final word differing in prosody, questions, and statements expressed with the same sentences led to different neurophysiological activity recorded in the event-related potential. Interestingly, low-pass filtered sentences and acoustically matched nonvocal musical signals failed to show any neurophysiological dissociations, thus suggesting that the physical intonation alone cannot explain this modulation. Our results show rapid neurophysiological indexes of prosodic communicative information processing that emerge only when pragmatic and lexico-semantic information are fully expressed. The early enhancement of question-related activity compared with statements was due to sources in the articulatory-motor region, which may reflect the richer action knowledge immanent to questions, namely the expectation of the partner action of answering the question. The present findings demonstrate a neurophysiological correlate of prosodic communicative information processing, which enables humans to rapidly detect and understand speaker intentions in linguistic interactions.
Collapse
Affiliation(s)
- Rosario Tomasello
- Address correspondence to Rosario Tomasello, Brain Language Laboratory, Department of Philosophy and Humanities, WE4, Freie Universität Berlin, Habelschwerdter Allee 45, 14195 Berlin, Germany.
| | - Luigi Grisoni
- Brain Language Laboratory, Department of Philosophy and Humanities, Freie Universität Berlin, 14195 Berlin, Germany
- Cluster of Excellence ‘Matters of Activity. Image Space Material’, Humboldt Universität zu Berlin, 10099 Berlin, Germany
| | - Isabella Boux
- Brain Language Laboratory, Department of Philosophy and Humanities, Freie Universität Berlin, 14195 Berlin, Germany
- Berlin School of Mind and Brain, Humboldt Universität zu Berlin, 10117 Berlin, Germany
- Einstein Center for Neurosciences, 10117 Berlin, Germany
| | - Daniela Sammler
- Research Group ‘Neurocognition of Music and Language’, Max Planck Institute for Empirical Aesthetics, 60322 Frankfurt am Main, Germany
- Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, 04103 Leipzig, Germany
| | - Friedemann Pulvermüller
- Brain Language Laboratory, Department of Philosophy and Humanities, Freie Universität Berlin, 14195 Berlin, Germany
- Cluster of Excellence ‘Matters of Activity. Image Space Material’, Humboldt Universität zu Berlin, 10099 Berlin, Germany
- Berlin School of Mind and Brain, Humboldt Universität zu Berlin, 10117 Berlin, Germany
- Einstein Center for Neurosciences, 10117 Berlin, Germany
| |
Collapse
|
15
|
Lin HP, Kuhlen AK, Melinger A, Aristei S, Abdel Rahman R. Concurrent semantic priming and lexical interference for close semantic relations in blocked-cyclic picture naming: Electrophysiological signatures. Psychophysiology 2021; 59:e13990. [PMID: 34931331 DOI: 10.1111/psyp.13990] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2021] [Revised: 10/27/2021] [Accepted: 11/30/2021] [Indexed: 11/29/2022]
Abstract
In the present study, we employed event-related brain potentials to investigate the effects of semantic similarity on different planning stages during language production. We manipulated semantic similarity by controlling feature overlap within taxonomical hierarchies. In a blocked-cyclic naming task, participants named pictures in repeated cycles, blocked in semantically close, distant, or unrelated conditions. Only closely related items, but not distantly related items, induced semantic blocking effects. In the first presentation cycle, naming was facilitated, and amplitude modulations in the N1 component around 140-180 ms post-stimulus onset predicted this behavioral facilitation. In contrast, in later cycles, naming was delayed, and a negative-going posterior amplitude modulation around 250-350 ms post-stimulus onset predicted this interference. These findings indicate easier object recognition or identification underlying initial facilitation and increased difficulties during lexical selection. The N1 modulation was reduced but persisted in later cycles in which interference dominated, and the posterior negativity was also present in cycle 1 in which facilitation dominated, demonstrating concurrent effects of conceptual priming and lexical interference in all naming cycles. Our assumptions about the functional role these two opposing forces play in producing semantic context effects are further supported by the finding that the joint modulation of these two ERPs on naming latency exclusively emerged when naming closely related, but not unrelated items. The current findings demonstrate that close relations, but not distant taxonomic relations, induce stronger semantic blocking effects, and that temporally overlapping electrophysiological signatures reflect a trade-off between facilitatory priming and interfering lexical competition.
Collapse
Affiliation(s)
- Hsin-Pei Lin
- Department of Psychology, Humboldt-Universität zu Berlin, Berlin, Germany.,Berlin School of Mind and Brain, Humboldt-Universität zu Berlin, Berlin, Germany
| | - Anna K Kuhlen
- Department of Psychology, Humboldt-Universität zu Berlin, Berlin, Germany
| | | | - Sabrina Aristei
- Department of Behavioral and Cognitive Sciences, Université du Luxembourg, Esch-sur-Alzette, Luxembourg
| | - Rasha Abdel Rahman
- Department of Psychology, Humboldt-Universität zu Berlin, Berlin, Germany.,Berlin School of Mind and Brain, Humboldt-Universität zu Berlin, Berlin, Germany
| |
Collapse
|
16
|
Branzi FM, Martin CD, Paz-Alonso PM. Task-Relevant Representations and Cognitive Control Demands Modulate Functional Connectivity from Ventral Occipito-Temporal Cortex During Object Recognition Tasks. Cereb Cortex 2021; 32:3068-3080. [PMID: 34918042 PMCID: PMC9290561 DOI: 10.1093/cercor/bhab401] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2021] [Revised: 10/05/2021] [Accepted: 10/06/2021] [Indexed: 12/02/2022] Open
Abstract
The left ventral occipito-temporal cortex (vOTC) supports extraction and processing of visual features. However, it has remained unclear whether left vOTC-based functional connectivity (FC) differs according to task-relevant representations (e.g., lexical, visual) and control demands imposed by the task, even when similar visual-semantic processing is required for object identification. Here, neural responses to the same set of pictures of meaningful objects were measured, while the type of task that participants had to perform (picture naming versus size-judgment task), and the level of cognitive control required by the picture naming task (high versus low interference contexts) were manipulated. Explicit retrieval of lexical representations in the picture naming task facilitated activation of lexical/phonological representations, modulating FC between left vOTC and dorsal anterior-cingulate-cortex/pre-supplementary-motor-area. This effect was not observed in the size-judgment task, which did not require explicit word-retrieval of object names. Furthermore, retrieving the very same lexical/phonological representation in the high versus low interference contexts during picture naming increased FC between left vOTC and left caudate. These findings support the proposal that vOTC functional specialization emerges from interactions with task-relevant brain regions.
Collapse
Affiliation(s)
- Francesca M Branzi
- Department of Psychological Sciences, Institute of Population Health, University of Liverpool, Liverpool L69 7ZA, UK.,MRC Cognition & Brain Sciences Unit, University of Cambridge, Cambridge CB2 7EF, UK
| | - Clara D Martin
- BCBL. Basque Center on Cognition, Brain and Language, San Sebastian 20009, Spain.,IKERBASQUE, Basque Foundation for Science, Bilbao 48013, Spain
| | - Pedro M Paz-Alonso
- BCBL. Basque Center on Cognition, Brain and Language, San Sebastian 20009, Spain.,IKERBASQUE, Basque Foundation for Science, Bilbao 48013, Spain
| |
Collapse
|
17
|
Fairs A, Michelas A, Dufour S, Strijkers K. The Same Ultra-Rapid Parallel Brain Dynamics Underpin the Production and Perception of Speech. Cereb Cortex Commun 2021; 2:tgab040. [PMID: 34296185 PMCID: PMC8262084 DOI: 10.1093/texcom/tgab040] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2021] [Revised: 05/28/2021] [Accepted: 06/03/2021] [Indexed: 11/20/2022] Open
Abstract
The temporal dynamics by which linguistic information becomes available is one of the key properties to understand how language is organized in the brain. An unresolved debate between different brain language models is whether words, the building blocks of language, are activated in a sequential or parallel manner. In this study, we approached this issue from a novel perspective by directly comparing the time course of word component activation in speech production versus perception. In an overt object naming task and a passive listening task, we analyzed with mixed linear models at the single-trial level the event-related brain potentials elicited by the same lexico-semantic and phonological word knowledge in the two language modalities. Results revealed that both word components manifested simultaneously as early as 75 ms after stimulus onset in production and perception; differences between the language modalities only became apparent after 300 ms of processing. The data provide evidence for ultra-rapid parallel dynamics of language processing and are interpreted within a neural assembly framework where words recruit the same integrated cell assemblies across production and perception. These word assemblies ignite early on in parallel and only later on reverberate in a behavior-specific manner.
Collapse
Affiliation(s)
- Amie Fairs
- Aix-Marseille University & CNRS, LPL, 13100 Aix-en-Provence, France
| | | | - Sophie Dufour
- Aix-Marseille University & CNRS, LPL, 13100 Aix-en-Provence, France
| | | |
Collapse
|
18
|
Lorenz A, Zwitserlood P, Bürki A, Regel S, Ouyang G, Abdel Rahman R. Morphological facilitation and semantic interference in compound production: An ERP study. Cognition 2021; 209:104518. [PMID: 33545513 DOI: 10.1016/j.cognition.2020.104518] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/30/2019] [Revised: 10/28/2020] [Accepted: 11/11/2020] [Indexed: 11/18/2022]
Abstract
This study investigates the production of nominal compounds (Experiment 1) and simple nouns (Experiment 2) in a picture-word interference (PWI) paradigm to test models of morpho-lexical representation and processing. The continuous electroencephalogram (EEG) was registered and event-related brain potentials [ERPs] were analyzed in addition to picture-naming latencies. Experiment 1 used morphologically and semantically related distractor words to tap into different pre-articulatory planning stages during compound production. Relative to unrelated distractors, naming was speeded when distractors corresponded to morphemes of the compound (sun or flower for the target sunflower), but slowed when distractors were from the same semantic category as the compound (tulip ➔ sunflower). Distractors from the same category as the compound's first constituent (moon ➔ sunflower) had no influence. The diverging effects for semantic and morphological distractors replicate results from earlier studies. ERPs revealed different effects of morphological and semantic distractors with an interesting time course: morphological effects had an earlier onset. Comparable to the naming latencies, no ERP effects were obtained for distractors from the same semantic category as the compound's first constituent. Experiment 2 investigated the effectiveness of the latter distractors, presenting them with pictures of the compounds' first constituents (e.g., moon ➔ sun). Interference was confirmed both behaviorally and in the ERPs, showing that the absence of an effect in Experiment 1 was not due to the materials used. Considering current models of speech production, the data are best explained by a cascading flow of activation throughout semantic, lexical and morpho-phonological steps of speech planning.
Collapse
Affiliation(s)
- Antje Lorenz
- Department of Psychology, Neurocognitive Psychology, Humboldt-Universität zu Berlin, Germany.
| | - Pienie Zwitserlood
- Department of Psychology and Otto Creutzfeldt Center for Cognitive and Behavioral Neuroscience, University of Münster, Germany
| | - Audrey Bürki
- Department of Linguistics, University of Potsdam, Germany
| | - Stefanie Regel
- Department of Psychology, Neurocognitive Psychology, Humboldt-Universität zu Berlin, Germany
| | - Guang Ouyang
- Faculty of Education, University of Hong Kong, China
| | - Rasha Abdel Rahman
- Department of Psychology, Neurocognitive Psychology, Humboldt-Universität zu Berlin, Germany
| |
Collapse
|
19
|
Feng C, Damian MF, Qu Q. Parallel Processing of Semantics and Phonology in Spoken Production: Evidence from Blocked Cyclic Picture Naming and EEG. J Cogn Neurosci 2021; 33:725-738. [PMID: 33475451 DOI: 10.1162/jocn_a_01675] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Spoken language production involves lexical-semantic access and phonological encoding. A theoretically important question concerns the relative time course of these two cognitive processes. The predominant view has been that semantic and phonological codes are accessed in successive stages. However, recent evidence seems difficult to reconcile with a sequential view but rather suggests that both types of codes are accessed in parallel. Here, we used ERPs combined with the "blocked cyclic naming paradigm" in which items overlapped either semantically or phonologically. Behaviorally, both semantic and phonological overlap caused interference relative to unrelated baseline conditions. Crucially, ERP data demonstrated that the semantic and phonological effects emerged at a similar latency (∼180 msec after picture onset) and within a similar time window (180-380 msec). These findings suggest that access to phonological information takes place at a relatively early stage during spoken planning, largely in parallel with semantic processing.
Collapse
Affiliation(s)
- Chen Feng
- Key Laboratory of Behavioral Science, Institute of Psychology, Chinese Academy of Sciences, Beijing, China.,Department of Psychology, University of Chinese Academy of Sciences, Beijing, China
| | | | - Qingqing Qu
- Key Laboratory of Behavioral Science, Institute of Psychology, Chinese Academy of Sciences, Beijing, China.,Department of Psychology, University of Chinese Academy of Sciences, Beijing, China
| |
Collapse
|
20
|
Atanasova T, Fargier R, Zesiger P, Laganaro M. Dynamics of Word Production in the Transition from Adolescence to Adulthood. NEUROBIOLOGY OF LANGUAGE (CAMBRIDGE, MASS.) 2021; 2:1-21. [PMID: 37213419 PMCID: PMC10158562 DOI: 10.1162/nol_a_00024] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/03/2020] [Accepted: 09/09/2020] [Indexed: 05/23/2023]
Abstract
Changes in word production occur across the lifespan. Previous studies have shown electrophysiological, temporal, and functional differences between children and adults accompanying behavioral changes in picture-naming tasks (Laganaro, Tzieropoulos, Fraunfelder, & Zesiger, 2015). Thus, a shift toward adult-like processes in referential word production occurs somewhere between the ages of 13 and 20. Our aim was to investigate when and how children develop adult-like behavior and brain activation in word production. Toward this aim, performance and event-related potentials (ERP) in a referential word production task were recorded and compared for two groups of adolescents (aged 14 to 16 and 17 to 18), children (aged 10 to 13), and young adults (aged 20 to 30). Both groups of adolescents displayed adult-like production latencies, which were longer only for children, while accuracy was lower in the younger adolescents and in children, compared to adults. ERP waveform analysis and topographic pattern analysis revealed significant intergroup differences in key time-windows on stimulus-locked ERPs, both early (150-220 ms)-associated with pre-linguistic processes-and late (280-330 ms)-associated with lexical processes. The results indicate that brain activation underlying referential word production is completely adult-like in 17-year-old adolescents, whereas an intermediate pattern is still observed in adolescents aged 14 to 16 years old, although their production speed, but not their accuracy, is already adult-like.
Collapse
Affiliation(s)
| | - Raphaël Fargier
- Laboratoire Parole et Langage, Aix-Marseille University, Marseille, France
| | - Pascal Zesiger
- Faculty of Psychology and Educational Sciences, University of Geneva, Geneva, Switzerland
| | - Marina Laganaro
- Faculty of Psychology and Educational Sciences, University of Geneva, Geneva, Switzerland
| |
Collapse
|
21
|
Boux I, Tomasello R, Grisoni L, Pulvermüller F. Brain signatures predict communicative function of speech production in interaction. Cortex 2020; 135:127-145. [PMID: 33360757 DOI: 10.1016/j.cortex.2020.11.008] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2020] [Revised: 11/05/2020] [Accepted: 11/18/2020] [Indexed: 10/22/2022]
Abstract
People normally know what they want to communicate before they start speaking. However, brain indicators of communication are typically observed only after speech act onset, and it is unclear when any anticipatory brain activity prior to speaking might first emerge, along with the communicative intentions it possibly reflects. Here, we investigated brain activity prior to the production of different speech act types, request and naming actions performed by uttering single words embedded into language games with a partner, similar to natural communication. Starting ca. 600 msec before speech onset, an event-related potential maximal at fronto-central electrodes, which resembled the Readiness Potential, was larger when preparing requests compared to naming actions. Analysis of the cortical sources of this anticipatory brain potential suggests a relatively stronger involvement of fronto-central motor regions for requests, which may reflect the speaker's expectation of the partner actions typically following requests, e.g., the handing over of a requested object. Our results indicate that different neuronal circuits underlying the processing of different speech act types activate already before speaking. Results are discussed in light of previous work addressing the neural basis of speech act understanding and predictive brain indexes of language comprehension.
Collapse
Affiliation(s)
- Isabella Boux
- Brain Language Laboratory, Department of Philosophy and Humanities, WE4 Freie Universität Berlin, Berlin, Germany; Einstein Center for Neurosciences, Berlin, Germany; Berlin School of Mind and Brain, Humboldt Universität zu Berlin, Berlin, Germany.
| | - Rosario Tomasello
- Brain Language Laboratory, Department of Philosophy and Humanities, WE4 Freie Universität Berlin, Berlin, Germany; Cluster of Excellence 'Matters of Activity. Image Space Material', Humboldt Universität zu Berlin, Berlin, Germany.
| | - Luigi Grisoni
- Brain Language Laboratory, Department of Philosophy and Humanities, WE4 Freie Universität Berlin, Berlin, Germany
| | - Friedemann Pulvermüller
- Brain Language Laboratory, Department of Philosophy and Humanities, WE4 Freie Universität Berlin, Berlin, Germany; Einstein Center for Neurosciences, Berlin, Germany; Berlin School of Mind and Brain, Humboldt Universität zu Berlin, Berlin, Germany; Cluster of Excellence 'Matters of Activity. Image Space Material', Humboldt Universität zu Berlin, Berlin, Germany
| |
Collapse
|
22
|
Qu Q, Feng C, Hou F, Damian MF. Syllables and phonemes as planning units in Mandarin Chinese spoken word production: Evidence from ERPs. Neuropsychologia 2020; 146:107559. [DOI: 10.1016/j.neuropsychologia.2020.107559] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2020] [Revised: 07/09/2020] [Accepted: 07/10/2020] [Indexed: 10/23/2022]
|
23
|
Neurophysiological evidence for rapid processing of verbal and gestural information in understanding communicative actions. Sci Rep 2019; 9:16285. [PMID: 31705052 PMCID: PMC6841672 DOI: 10.1038/s41598-019-52158-w] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2019] [Accepted: 10/12/2019] [Indexed: 11/08/2022] Open
Abstract
During everyday social interaction, gestures are a fundamental part of human communication. The communicative pragmatic role of hand gestures and their interaction with spoken language has been documented at the earliest stage of language development, in which two types of indexical gestures are most prominent: the pointing gesture for directing attention to objects and the give-me gesture for making requests. Here we study, in adult human participants, the neurophysiological signatures of gestural-linguistic acts of communicating the pragmatic intentions of naming and requesting by simultaneously presenting written words and gestures. Already at ~150 ms, brain responses diverged between naming and request actions expressed by word-gesture combination, whereas the same gestures presented in isolation elicited their earliest neurophysiological dissociations significantly later (at ~210 ms). There was an early enhancement of request-evoked brain activity as compared with naming, which was due to sources in the frontocentral cortex, consistent with access to action knowledge in request understanding. In addition, an enhanced N400-like response indicated late semantic integration of gesture-language interaction. The present study demonstrates that word-gesture combinations used to express communicative pragmatic intentions speed up the brain correlates of comprehension processes – compared with gesture-only understanding – thereby calling into question current serial linguistic models viewing pragmatic function decoding at the end of a language comprehension cascade. Instead, information about the social-interactive role of communicative acts is processed instantaneously.
Collapse
|
24
|
Branzi FM, Martin CD, Carreiras M, Paz-Alonso PM. Functional connectivity reveals dissociable ventrolateral prefrontal mechanisms for the control of multilingual word retrieval. Hum Brain Mapp 2019; 41:80-94. [PMID: 31515906 PMCID: PMC7268045 DOI: 10.1002/hbm.24788] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2019] [Revised: 08/26/2019] [Accepted: 08/27/2019] [Indexed: 11/25/2022] Open
Abstract
This functional magnetic resonance imaging study established that different portions of the ventrolateral prefrontal cortex (vlPFC) support reactive and proactive language control processes during multilingual word retrieval. The study also examined whether proactive language control consists in the suppression of the nontarget lexicon. Healthy multilingual volunteers participated in a task that required them to name pictures alternately in their dominant and less‐dominant languages. Two crucial variables were manipulated: the cue‐target interval (CTI) to either engage (long CTI) or prevent (short CTI) proactive control processes, and the cognate status of the to‐be‐named pictures (noncognates vs. cognates) to capture selective pre‐activation of the target language. The results of the functional connectivity analysis showed a clear segregation between functional networks related to mid‐vlPFC and anterior vlPFC during multilingual language production. Furthermore, the results revealed that multilinguals engage in proactive control to prepare the target language. This proactive modulation, enacted by anterior vlPFC, is achieved by boosting the activation of lexical representations in the target language. Finally, control processes supported by both mid‐vlPFC and the left inferior parietal lobe, were similarly engaged by reactive and proactive control, possibly exerted on phonological representations to reduce cross‐language interference.
Collapse
Affiliation(s)
- Francesca M Branzi
- BCBL - Basque Center on Cognition, Brain and Language, San Sebastian, Spain.,MRC Cognition and Brain Sciences Unit, University of Cambridge, Cambridge, UK
| | - Clara D Martin
- BCBL - Basque Center on Cognition, Brain and Language, San Sebastian, Spain.,IKERBASQUE, Basque Foundation for Science, Bilbao, Spain
| | - Manuel Carreiras
- BCBL - Basque Center on Cognition, Brain and Language, San Sebastian, Spain.,IKERBASQUE, Basque Foundation for Science, Bilbao, Spain
| | - Pedro M Paz-Alonso
- BCBL - Basque Center on Cognition, Brain and Language, San Sebastian, Spain
| |
Collapse
|
25
|
Montani V, Chanoine V, Grainger J, Ziegler JC. Frequency-tagged visual evoked responses track syllable effects in visual word recognition. Cortex 2019; 121:60-77. [PMID: 31550616 DOI: 10.1016/j.cortex.2019.08.014] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2019] [Revised: 06/11/2019] [Accepted: 08/11/2019] [Indexed: 01/05/2023]
Abstract
The processing of syllables in visual word recognition was investigated using a novel paradigm based on steady-state visual evoked potentials (SSVEPs). French words were presented to proficient readers in a delayed naming task. Words were split into two segments, the first of which was flickered at 18.75 Hz and the second at 25 Hz. The first segment either matched (congruent condition) or did not match (incongruent condition) the first syllable. The SSVEP responses in the congruent condition showed increased power compared to the responses in the incongruent condition, providing new evidence that syllables are important sublexical units in visual word recognition and reading aloud. With respect to the neural correlates of the effect, syllables elicited an early activation of a right hemisphere network. This network is typically associated with the programming of complex motor sequences, cognitive control and timing. Subsequently, responses were obtained in left hemisphere areas related to phonological processing.
Collapse
Affiliation(s)
- Veronica Montani
- Aix-Marseille University and CNRS, Brain and Language Research Institute, Marseille Cedex 3, France.
| | - Valérie Chanoine
- Aix-Marseille University, Institute of Language, Communication and the Brain, Brain and Language Research Institute, Aix-en-Provence, France
| | | | | |
Collapse
|
26
|
Strijkers K, Chanoine V, Munding D, Dubarry AS, Trébuchon A, Badier JM, Alario FX. Grammatical class modulates the (left) inferior frontal gyrus within 100 milliseconds when syntactic context is predictive. Sci Rep 2019; 9:4830. [PMID: 30886251 PMCID: PMC6423026 DOI: 10.1038/s41598-019-41376-x] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/20/2018] [Accepted: 03/04/2019] [Indexed: 11/09/2022] Open
Abstract
The current study set out to examine the spatiotemporal dynamics of predictive processing during syntactic processing. To do so, we conducted an MEG experiment in which we contrasted MRI-constrained sources elicited by nouns and verbs when they were preceded by a predictive syntactic context (i.e., possessive pronouns for nouns, and personal pronouns for verbs) versus a non-predictive syntactic context (visually matched symbols). The results showed rapid (from ~80 ms onwards) noun-verb differences in the left and (to a lesser extent) right inferior frontal gyri (IFG), but only when those nouns and verbs were preceded by the syntactically predictive context (i.e. their corresponding pronoun). Furthermore, the contrast between possessive and personal pronouns that preceded the rapid noun-verb modulations in the (L)IFG also produced differences in source activation in various regions of the prefrontal cortex (the superior frontal and orbitofrontal cortex). We suggest the data show that syntactic unification manifests very early on during processing in the LIFG. The speed of such syntactic unification operations is hypothesized to be driven by predictive top-down activations stemming from a domain-general network in the prefrontal cortex.
Collapse
Affiliation(s)
- Kristof Strijkers
- Aix Marseille Université, CNRS, LPL, 13100, Aix-en-Provence, France.
| | - Valerie Chanoine
- Aix Marseille Université, Institute of Language, Communication and the Brain, Brain and Language Research Institute, 13100, Aix-en-Provence, France
| | - Dashiel Munding
- Aix Marseille Université, CNRS, LPC, 13331, Marseille cedex 3, France
| | | | - Agnès Trébuchon
- Aix Marseille Université, INSERM, INS, 13005, Marseille, France
| | | | - F-Xavier Alario
- Aix Marseille Université, CNRS, LPC, 13331, Marseille cedex 3, France
| |
Collapse
|
27
|
Weiss Lucas C, Kallioniemi E, Neuschmelting V, Nettekoven C, Pieczewski J, Jonas K, Goldbrunner R, Karhu J, Grefkes C, Julkunen P. Cortical Inhibition of Face and Jaw Muscle Activity and Discomfort Induced by Repetitive and Paired-Pulse TMS During an Overt Object Naming Task. Brain Topogr 2019; 32:418-434. [DOI: 10.1007/s10548-019-00698-9] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2018] [Accepted: 01/16/2019] [Indexed: 01/27/2023]
|
28
|
The involvement of left inferior frontal and middle temporal cortices in word production unveiled by greater facilitation effects following brain damage. Neuropsychologia 2018; 121:122-134. [DOI: 10.1016/j.neuropsychologia.2018.10.026] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2018] [Revised: 09/26/2018] [Accepted: 10/29/2018] [Indexed: 11/23/2022]
|
29
|
Fairs A, Bögels S, Meyer AS. Dual-tasking with simple linguistic tasks: Evidence for serial processing. Acta Psychol (Amst) 2018; 191:131-148. [PMID: 30268022 DOI: 10.1016/j.actpsy.2018.09.006] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2017] [Revised: 09/06/2018] [Accepted: 09/10/2018] [Indexed: 11/29/2022] Open
Abstract
In contrast to the large amount of dual-task research investigating the coordination of a linguistic and a non-linguistic task, little research has investigated how two linguistic tasks are coordinated. However, such research would greatly contribute to our understanding of how interlocutors combine speech planning and listening in conversation. In three dual-task experiments we studied how participants coordinated the processing of an auditory stimulus (S1), which was either a syllable or a tone, with selecting a name for a picture (S2). Two SOAs, of 0 ms and 1000 ms, were used. To vary the time required for lexical selection and to determine when lexical selection took place, the pictures were presented with categorically related or unrelated distractor words. In Experiment 1 participants responded overtly to both stimuli. In Experiments 2 and 3, S1 was not responded to overtly, but determined how to respond to S2, by naming the picture or reading the distractor aloud. Experiment 1 yielded additive effects of SOA and distractor type on the picture naming latencies. The presence of semantic interference at both SOAs indicated that lexical selection occurred after response selection for S1. With respect to the coordination of S1 and S2 processing, Experiments 2 and 3 yielded inconclusive results. In all experiments, syllables interfered more with picture naming than tones. This is likely because the syllables activated phonological representations also implicated in picture naming. The theoretical and methodological implications of the findings are discussed.
Collapse
Affiliation(s)
- Amie Fairs
- Max Planck Institute for Psycholinguistics, P.O. Box 310, 6500AH Nijmegen, the Netherlands; International Max Planck Research School for Language Sciences, P.O. Box 310, 6500AH Nijmegen, the Netherlands.
| | - Sara Bögels
- Max Planck Institute for Psycholinguistics, P.O. Box 310, 6500AH Nijmegen, the Netherlands; Donders Institute for Brain, Cognition and Behaviour, P.O. Box 9010, 6500GL Nijmegen, the Netherlands
| | - Antje S Meyer
- Max Planck Institute for Psycholinguistics, P.O. Box 310, 6500AH Nijmegen, the Netherlands; Donders Institute for Brain, Cognition and Behaviour, P.O. Box 9010, 6500GL Nijmegen, the Netherlands
| |
Collapse
|
30
|
Okada K, Matchin W, Hickok G. Phonological Feature Repetition Suppression in the Left Inferior Frontal Gyrus. J Cogn Neurosci 2018; 30:1549-1557. [PMID: 29877763 DOI: 10.1162/jocn_a_01287] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Models of speech production posit a role for the motor system, predominantly the posterior inferior frontal gyrus, in encoding complex phonological representations for speech production, at the phonemic, syllable, and word levels [Roelofs, A. A dorsal-pathway account of aphasic language production: The WEAVER++/ARC model. Cortex, 59(Suppl. C), 33-48, 2014; Hickok, G. Computational neuroanatomy of speech production. Nature Reviews Neuroscience, 13, 135-145, 2012; Guenther, F. H. Cortical interactions underlying the production of speech sounds. Journal of Communication Disorders, 39, 350-365, 2006]. However, phonological theory posits subphonemic units of representation, namely phonological features [Chomsky, N., & Halle, M. The sound pattern of English, 1968; Jakobson, R., Fant, G., & Halle, M. Preliminaries to speech analysis. The distinctive features and their correlates. Cambridge, MA: MIT Press, 1951], that specify independent articulatory parameters of speech sounds, such as place and manner of articulation. Therefore, motor brain systems may also incorporate phonological features into speech production planning units. Here, we add support for such a role with an fMRI experiment of word sequence production using a phonemic similarity manipulation. We adapted and modified the experimental paradigm of Oppenheim and Dell [Oppenheim, G. M., & Dell, G. S. Inner speech slips exhibit lexical bias, but not the phonemic similarity effect. Cognition, 106, 528-537, 2008; Oppenheim, G. M., & Dell, G. S. Motor movement matters: The flexible abstractness of inner speech. Memory & Cognition, 38, 1147-1160, 2010]. Participants silently articulated words cued by sequential visual presentation that varied in degree of phonological feature overlap in consonant onset position: high overlap (two shared phonological features; e.g., /r/ and /l/) or low overlap (one shared phonological feature, e.g., /r/ and /b/). We found a significant repetition suppression effect in the left posterior inferior frontal gyrus, with increased activation for phonologically dissimilar words compared with similar words. These results suggest that phonemes, particularly phonological features, are part of the planning units of the motor speech system.
Collapse
|
31
|
Variation in the speech signal as a window into the cognitive architecture of language production. Psychon Bull Rev 2018; 25:1973-2004. [PMID: 29383571 DOI: 10.3758/s13423-017-1423-4] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
The pronunciation of words is highly variable. This variation provides crucial information about the cognitive architecture of the language production system. This review summarizes key empirical findings about variation phenomena, integrating corpus, acoustic, articulatory, and chronometric data from phonetic and psycholinguistic studies. It examines how these data constrain our current understanding of word production processes and highlights major challenges and open issues that should be addressed in future research.
Collapse
|