1
|
Umejima K, Flynn S, Sakai KL. Enhanced activations in the dorsal inferior frontal gyrus specifying the who, when, and what for successful building of sentence structures in a new language. Sci Rep 2024; 14:54. [PMID: 38167632 PMCID: PMC10761922 DOI: 10.1038/s41598-023-50896-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/16/2023] [Accepted: 12/27/2023] [Indexed: 01/05/2024] Open
Abstract
It has been argued that the principles constraining first language acquisition also constrain second language acquisition; however, neuroscientific evidence for this is scant, and even less for third and subsequent languages. We conducted fMRI experiments to evaluate this claim by focusing on the building of complex sentence structures in Kazakh, a new language for participants having acquired at least two languages. The participants performed grammaticality judgment and subject-verb matching tasks with spoken sentences. We divided the participants into two groups based on the performance levels attained in one of the experimental tasks: High in Group I and Low in Group II. A direct comparison of the two groups, which examined those participants who parsed the structures, indicated significantly stronger activations for Group I in the dorsal left inferior frontal gyrus (L. IFG). Focusing on Group I, we tested the contrast between the initial and final phases in our testing, which examined when the structures were parsed, as well as the contrast which examined what structures were parsed. These analyses further demonstrated focal activations in the dorsal L. IFG alone. Among the individual participants, stronger activation in the dorsal L. IFG, measured during the sentence presentations, predicted higher accuracy rates and shorter response times for executing the tasks that followed. These results cannot be explained by task difficulty or memory loads, and they, instead, indicate a critical and consistent role of the dorsal L. IFG during the initial to intermediate stages of grammar acquisition in a new target language. Such functional specificity of the dorsal L. IFG provides neuroscientific evidence consistent with the claims made by the Cumulative-Enhancement model in investigating language acquisition beyond target second and third languages.
Collapse
Affiliation(s)
- Keita Umejima
- Department of Basic Science, Graduate School of Arts and Sciences, The University of Tokyo, 3-8-1 Komaba, Meguro-Ku, Tokyo, 153-8902, Japan
| | - Suzanne Flynn
- Department of Linguistics and Philosophy, Massachusetts Institute of Technology, 77 Massachusetts Avenue, 32-D808, Cambridge, MA, 02139, USA
| | - Kuniyoshi L Sakai
- Department of Basic Science, Graduate School of Arts and Sciences, The University of Tokyo, 3-8-1 Komaba, Meguro-Ku, Tokyo, 153-8902, Japan.
| |
Collapse
|
2
|
van der Burght CL, Friederici AD, Maran M, Papitto G, Pyatigorskaya E, Schroën JAM, Trettenbrein PC, Zaccarella E. Cleaning up the Brickyard: How Theory and Methodology Shape Experiments in Cognitive Neuroscience of Language. J Cogn Neurosci 2023; 35:2067-2088. [PMID: 37713672 DOI: 10.1162/jocn_a_02058] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/17/2023]
Abstract
The capacity for language is a defining property of our species, yet despite decades of research, evidence on its neural basis is still mixed and a generalized consensus is difficult to achieve. We suggest that this is partly caused by researchers defining "language" in different ways, with focus on a wide range of phenomena, properties, and levels of investigation. Accordingly, there is very little agreement among cognitive neuroscientists of language on the operationalization of fundamental concepts to be investigated in neuroscientific experiments. Here, we review chains of derivation in the cognitive neuroscience of language, focusing on how the hypothesis under consideration is defined by a combination of theoretical and methodological assumptions. We first attempt to disentangle the complex relationship between linguistics, psychology, and neuroscience in the field. Next, we focus on how conclusions that can be drawn from any experiment are inherently constrained by auxiliary assumptions, both theoretical and methodological, on which the validity of conclusions drawn rests. These issues are discussed in the context of classical experimental manipulations as well as study designs that employ novel approaches such as naturalistic stimuli and computational modeling. We conclude by proposing that a highly interdisciplinary field such as the cognitive neuroscience of language requires researchers to form explicit statements concerning the theoretical definitions, methodological choices, and other constraining factors involved in their work.
Collapse
Affiliation(s)
| | - Angela D Friederici
- Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Matteo Maran
- Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
- International Max Planck Research School on Neuroscience of Communication, Leipzig, Germany
| | - Giorgio Papitto
- Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
- International Max Planck Research School on Neuroscience of Communication, Leipzig, Germany
| | - Elena Pyatigorskaya
- Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
- International Max Planck Research School on Neuroscience of Communication, Leipzig, Germany
| | - Joëlle A M Schroën
- Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
- International Max Planck Research School on Neuroscience of Communication, Leipzig, Germany
| | - Patrick C Trettenbrein
- Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
- International Max Planck Research School on Neuroscience of Communication, Leipzig, Germany
- University of Göttingen, Göttingen, Germany
| | - Emiliano Zaccarella
- Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| |
Collapse
|
3
|
Benítez-Burraco A, Zaccarella E, Murphy E. Editorial: The evolution of the brain hardware for language. Front Psychol 2023; 14:1323737. [PMID: 38022910 PMCID: PMC10654676 DOI: 10.3389/fpsyg.2023.1323737] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2023] [Accepted: 10/23/2023] [Indexed: 12/01/2023] Open
Affiliation(s)
- Antonio Benítez-Burraco
- Department of Spanish, Linguistics, and Theory of Literature (Linguistics), University of Seville, Seville, Spain
| | - Emiliano Zaccarella
- Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Elliot Murphy
- Vivian L. Smith Department of Neurosurgery, McGovern Medical School, University of Texas Health Science Center at Houston, Houston, TX, United States
- Texas Institute for Restorative Neurotechnologies, University of Texas Health Science Center at Houston, Houston, TX, United States
| |
Collapse
|
4
|
Arioli M, Segatta C, Papagno C, Tettamanti M, Cattaneo Z. Social perception in deaf individuals: A meta-analysis of neuroimaging studies. Hum Brain Mapp 2023; 44:5402-5415. [PMID: 37609693 PMCID: PMC10543108 DOI: 10.1002/hbm.26444] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2023] [Revised: 06/22/2023] [Accepted: 07/22/2023] [Indexed: 08/24/2023] Open
Abstract
Deaf individuals may report difficulties in social interactions. However, whether these difficulties depend on deafness affecting social brain circuits is controversial. Here, we report the first meta-analysis comparing brain activations of hearing and (prelingually) deaf individuals during social perception. Our findings showed that deafness does not impact on the functional mechanisms supporting social perception. Indeed, both deaf and hearing control participants recruited regions of the action observation network during performance of different social tasks employing visual stimuli, and including biological motion perception, face identification, action observation, viewing, identification and memory for signs and lip reading. Moreover, we found increased recruitment of the superior-middle temporal cortex in deaf individuals compared with hearing participants, suggesting a preserved and augmented function during social communication based on signs and lip movements. Overall, our meta-analysis suggests that social difficulties experienced by deaf individuals are unlikely to be associated with brain alterations but may rather depend on non-supportive environments.
Collapse
Affiliation(s)
- Maria Arioli
- Department of Human and Social SciencesUniversity of BergamoBergamoItaly
| | - Cecilia Segatta
- Department of Human and Social SciencesUniversity of BergamoBergamoItaly
| | - Costanza Papagno
- Center for Mind/Brain Sciences (CIMeC)University of TrentoTrentoItaly
| | | | - Zaira Cattaneo
- Department of Human and Social SciencesUniversity of BergamoBergamoItaly
- IRCCS Mondino FoundationPaviaItaly
| |
Collapse
|
5
|
Tuckute G, Sathe A, Srikant S, Taliaferro M, Wang M, Schrimpf M, Kay K, Fedorenko E. Driving and suppressing the human language network using large language models. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.04.16.537080. [PMID: 37090673 PMCID: PMC10120732 DOI: 10.1101/2023.04.16.537080] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/25/2023]
Abstract
Transformer models such as GPT generate human-like language and are highly predictive of human brain responses to language. Here, using fMRI-measured brain responses to 1,000 diverse sentences, we first show that a GPT-based encoding model can predict the magnitude of brain response associated with each sentence. Then, we use the model to identify new sentences that are predicted to drive or suppress responses in the human language network. We show that these model-selected novel sentences indeed strongly drive and suppress activity of human language areas in new individuals. A systematic analysis of the model-selected sentences reveals that surprisal and well-formedness of linguistic input are key determinants of response strength in the language network. These results establish the ability of neural network models to not only mimic human language but also noninvasively control neural activity in higher-level cortical areas, like the language network.
Collapse
Affiliation(s)
- Greta Tuckute
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
| | - Aalok Sathe
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
| | - Shashank Srikant
- Computer Science & Artificial Intelligence Laboratory, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
- MIT-IBM Watson AI Lab, Cambridge, MA 02142, USA
| | - Maya Taliaferro
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
| | - Mingye Wang
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
| | - Martin Schrimpf
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
- Quest for Intelligence, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
- Neuro-X Institute, École Polytechnique Fédérale de Lausanne, CH-1015 Lausanne, Switzerland
| | - Kendrick Kay
- Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN 55455 USA
| | - Evelina Fedorenko
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
- The Program in Speech and Hearing Bioscience and Technology, Harvard University, Cambridge, MA 02138 USA
| |
Collapse
|
6
|
Friederici AD. Evolutionary neuroanatomical expansion of Broca's region serving a human-specific function. Trends Neurosci 2023; 46:786-796. [PMID: 37596132 DOI: 10.1016/j.tins.2023.07.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2023] [Revised: 06/23/2023] [Accepted: 07/20/2023] [Indexed: 08/20/2023]
Abstract
The question concerning the evolution of language is directly linked to the debate on whether language and action are dependent or not and to what extent Broca's region serves as a common neural basis. The debate resulted in two opposing views, one arguing for and one against the dependence of language and action mainly based on neuroscientific data. This article presents an evolutionary neuroanatomical framework which may offer a solution to this dispute. It is proposed that in humans, Broca's region houses language and action independently in spatially separated subregions. This became possible due to an evolutionary expansion of Broca's region in the human brain, which was not paralleled by a similar expansion in the chimpanzee's brain, providing additional space needed for the neural representation of language in humans.
Collapse
Affiliation(s)
- Angela D Friederici
- Max Planck Institute for Human Cognitive and Brain Sciences, Department of Neuropsychology, Stephanstraße 1A, 04103 Leipzig, Germany.
| |
Collapse
|
7
|
Su WC, Culotta M, Mueller J, Tsuzuki D, Bhat AN. Autism-Related Differences in Cortical Activation When Observing, Producing, and Imitating Communicative Gestures: An fNIRS Study. Brain Sci 2023; 13:1284. [PMID: 37759885 PMCID: PMC10527424 DOI: 10.3390/brainsci13091284] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2023] [Revised: 08/16/2023] [Accepted: 08/28/2023] [Indexed: 09/29/2023] Open
Abstract
Children with autism spectrum disorder (ASD) have difficulties in gestural communication during social interactions. However, the neural mechanisms involved in naturalistic gestural communication remain poorly understood. In this study, cortical activation patterns associated with gestural communication were examined in thirty-two children with and without ASD (mean age: 11.0 years, SE: 0.6 years). Functional near-infrared spectroscopy (fNIRS) was used to record cortical activation while children produced, observed, or imitated communicative gestures. Children with ASD demonstrated more spatial and temporal errors when performing and imitating communicative gestures. Although both typically developing (TD) children and children with ASD showed left-lateralized cortical activation during gesture production, children with ASD showed hyperactivation in the middle/inferior frontal gyrus (MIFG) during observation and imitation, and hypoactivation in the middle/superior temporal gyrus (MSTG) during gesture production compared to their TD peers. More importantly, children with ASD exhibited greater MSTG activation during imitation than during gesture production, suggesting that imitation could be an effective intervention strategy to engage cortical regions crucial for processing and producing gestures. Our study provides valuable insights into the neural mechanisms underlying gestural communication difficulties in ASD, while also identifying potential neurobiomarkers that could serve as objective measures for evaluating intervention effectiveness in children with ASD.
Collapse
Affiliation(s)
- Wan-Chun Su
- Department of Physical Therapy, University of Delaware, Newark, DE 19713, USA; (W.-C.S.); (M.C.)
- Biomechanics and Movement Science Program, College of Health Sciences, University of Delaware, Newark, DE 19713, USA
| | - McKenzie Culotta
- Department of Physical Therapy, University of Delaware, Newark, DE 19713, USA; (W.-C.S.); (M.C.)
- Biomechanics and Movement Science Program, College of Health Sciences, University of Delaware, Newark, DE 19713, USA
| | - Jessica Mueller
- Department of Behavioral Health, Swank Autism Center, Nemours Children’s Hospital, Wilmington, DE 19803, USA;
| | - Daisuke Tsuzuki
- Department of Information Sciences, Kochi University, Kochi 780-8520, Japan;
| | - Anjana N. Bhat
- Department of Physical Therapy, University of Delaware, Newark, DE 19713, USA; (W.-C.S.); (M.C.)
- Biomechanics and Movement Science Program, College of Health Sciences, University of Delaware, Newark, DE 19713, USA
- Interdisciplinary Neuroscience Graduate Program, Department of Psychological and Brain Sciences, University of Delaware, Newark, DE 19713, USA
| |
Collapse
|
8
|
Setti F, Handjaras G, Bottari D, Leo A, Diano M, Bruno V, Tinti C, Cecchetti L, Garbarini F, Pietrini P, Ricciardi E. A modality-independent proto-organization of human multisensory areas. Nat Hum Behav 2023; 7:397-410. [PMID: 36646839 PMCID: PMC10038796 DOI: 10.1038/s41562-022-01507-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2022] [Accepted: 12/05/2022] [Indexed: 01/18/2023]
Abstract
The processing of multisensory information is based upon the capacity of brain regions, such as the superior temporal cortex, to combine information across modalities. However, it is still unclear whether the representation of coherent auditory and visual events requires any prior audiovisual experience to develop and function. Here we measured brain synchronization during the presentation of an audiovisual, audio-only or video-only version of the same narrative in distinct groups of sensory-deprived (congenitally blind and deaf) and typically developed individuals. Intersubject correlation analysis revealed that the superior temporal cortex was synchronized across auditory and visual conditions, even in sensory-deprived individuals who lack any audiovisual experience. This synchronization was primarily mediated by low-level perceptual features, and relied on a similar modality-independent topographical organization of slow temporal dynamics. The human superior temporal cortex is naturally endowed with a functional scaffolding to yield a common representation across multisensory events.
Collapse
Affiliation(s)
- Francesca Setti
- MoMiLab, IMT School for Advanced Studies Lucca, Lucca, Italy
| | | | - Davide Bottari
- MoMiLab, IMT School for Advanced Studies Lucca, Lucca, Italy
| | - Andrea Leo
- Department of Translational Research and Advanced Technologies in Medicine and Surgery, University of Pisa, Pisa, Italy
| | - Matteo Diano
- Department of Psychology, University of Turin, Turin, Italy
| | - Valentina Bruno
- Manibus Lab, Department of Psychology, University of Turin, Turin, Italy
| | - Carla Tinti
- Department of Psychology, University of Turin, Turin, Italy
| | - Luca Cecchetti
- MoMiLab, IMT School for Advanced Studies Lucca, Lucca, Italy
| | | | - Pietro Pietrini
- MoMiLab, IMT School for Advanced Studies Lucca, Lucca, Italy
| | | |
Collapse
|
9
|
Giovannelli F, Borgheresi A, Lucidi G, Squitieri M, Gavazzi G, Suppa A, Berardelli A, Viggiano MP, Cincotta M. Language-related motor facilitation in Italian Sign Language signers. Cereb Cortex 2023:6988100. [PMID: 36646456 DOI: 10.1093/cercor/bhac536] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2022] [Revised: 12/23/2022] [Accepted: 12/24/2022] [Indexed: 01/18/2023] Open
Abstract
Linguistic tasks facilitate corticospinal excitability as revealed by increased motor evoked potential (MEP) induced by transcranial magnetic stimulation (TMS) in the dominant hand. This modulation of the primary motor cortex (M1) excitability may reflect the relationship between speech and gestures. It is conceivable that in healthy individuals who use a sign language this cortical excitability modulation could be rearranged. The aim of this study was to evaluate the effect of spoken language tasks on M1 excitability in a group of hearing signers. Ten hearing Italian Sign Language (LIS) signers and 16 non-signer healthy controls participated. Single-pulse TMS was applied to either M1 hand area at the baseline and during different tasks: (i) reading aloud, (ii) silent reading, (iii) oral movements, (iv) syllabic phonation and (v) looking at meaningless non-letter strings. Overall, M1 excitability during the linguistic and non-linguistic tasks was higher in LIS group compared to the control group. In LIS group, MEPs were significantly larger during reading aloud, silent reading and non-verbal oral movements, regardless the hemisphere. These results suggest that in hearing signers there is a different modulation of the functional connectivity between the speech-related brain network and the motor system.
Collapse
Affiliation(s)
- Fabio Giovannelli
- Department of Neuroscience, Psychology, Drug Research and Child's Health (NEUROFARBA), Section of Psychology, University of Florence, Florence 50135, Italy
| | - Alessandra Borgheresi
- Unit of Neurology of Florence, Central Tuscany Local Health Authority, Florence 50143, Italy
| | - Giulia Lucidi
- Unit of Neurology of Florence, Central Tuscany Local Health Authority, Florence 50143, Italy
| | - Martina Squitieri
- Unit of Neurology of Florence, Central Tuscany Local Health Authority, Florence 50143, Italy
| | - Gioele Gavazzi
- Department of Neuroscience, Psychology, Drug Research and Child's Health (NEUROFARBA), Section of Psychology, University of Florence, Florence 50135, Italy
| | - Antonio Suppa
- Department of Human Neurosciences, Sapienza University of Rome, Rome 00185, Italy.,IRCCS Neuromed, Pozzilli (IS) 86077, Italy
| | - Alfredo Berardelli
- Department of Human Neurosciences, Sapienza University of Rome, Rome 00185, Italy.,IRCCS Neuromed, Pozzilli (IS) 86077, Italy
| | - Maria Pia Viggiano
- Department of Neuroscience, Psychology, Drug Research and Child's Health (NEUROFARBA), Section of Psychology, University of Florence, Florence 50135, Italy
| | - Massimo Cincotta
- Unit of Neurology of Florence, Central Tuscany Local Health Authority, Florence 50143, Italy
| |
Collapse
|
10
|
Maran M, Numssen O, Hartwigsen G, Zaccarella E. Online neurostimulation of Broca's area does not interfere with syntactic predictions: A combined TMS-EEG approach to basic linguistic combination. Front Psychol 2022; 13:968836. [PMID: 36619118 PMCID: PMC9815778 DOI: 10.3389/fpsyg.2022.968836] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2022] [Accepted: 09/13/2022] [Indexed: 01/11/2023] Open
Abstract
Categorical predictions have been proposed as the key mechanism supporting the fast pace of syntactic composition in language. Accordingly, grammar-based expectations are formed-e.g., the determiner "a" triggers the prediction for a noun-and facilitate the analysis of incoming syntactic information, which is then checked against a single or few other word categories. Previous functional neuroimaging studies point towards Broca's area in the left inferior frontal gyrus (IFG) as one fundamental cortical region involved in categorical prediction during incremental language processing. Causal evidence for this hypothesis is however still missing. In this study, we combined Electroencephalography (EEG) and Transcranial Magnetic Stimulation (TMS) to test whether Broca's area is functionally relevant in predictive mechanisms for language. We transiently perturbed Broca's area during the first word in a two-word construction, while simultaneously measuring the Event-Related Potential (ERP) correlates of syntactic composition. We reasoned that if Broca's area is involved in predictive mechanisms for syntax, disruptive TMS during the first word would mitigate the difference in the ERP responses for predicted and unpredicted categories in basic two-word constructions. Contrary to this hypothesis, perturbation of Broca's area at the predictive stage did not affect the ERP correlates of basic composition. The correlation strength between the electrical field induced by TMS and the ERP responses further confirmed this pattern. We discuss the present results considering an alternative account of the role of Broca's area in syntactic composition, namely the bottom-up integration of words into constituents, and of compensatory mechanisms within the language predictive network.
Collapse
Affiliation(s)
- Matteo Maran
- Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany,International Max Planck Research School on Neuroscience of Communication: Function, Structure, and Plasticity, Leipzig, Germany,*Correspondence: Matteo Maran,
| | - Ole Numssen
- Lise Meitner Research Group Cognition and Plasticity, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Gesa Hartwigsen
- Lise Meitner Research Group Cognition and Plasticity, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Emiliano Zaccarella
- Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| |
Collapse
|
11
|
Huang X, Izumi SI, Suzukamo Y. Neural and behavioral alterations of a real-time interpersonal distance (IPD) development process in differing social status interactions. Front Behav Neurosci 2022; 16:969440. [PMCID: PMC9616044 DOI: 10.3389/fnbeh.2022.969440] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/16/2022] [Accepted: 09/23/2022] [Indexed: 11/13/2022] Open
Abstract
BackgroundEvidence showed neural changes in interpersonal distance (IPD) interaction, and neural activities are affected by relationships (such as friends or strangers). Behavior studies proved that social status strongly affects IPD between two persons. However, how the differing social status impacts neural alterations in the IPD interactions remains unknown.ObjectivesThe teacher-student relationship is a typical representation of the difference in social status. The present study aims to investigate the IPD performance and brain processes underlying real-time differing social status during the development process from teacher-student interactions.Materials and methodsWe designed three within-subject experiments corresponding to the inclusion, control, and affection stages of IPD. Altogether, 38 valid healthy participants participated in three experiments with a teacher (differing social status condition, DS condition) and a peer student (peer social status condition, PS condition) separately. This study employed functional near-infrared spectroscopy (fNIRS) and modified real-time stop-distance paradigms to record IPD performance and neural processes.ResultsFor IPD performance, significantly larger IPD gaps were shown in the DS condition than in the PS condition, and IPD feedback affected IPD performance. For neural alterations, activated frontopolar area (FPA, BA10), dorsolateral prefrontal cortex (DLPFC, BA9/BA46), and Broca’s area (BA45) were observed across the IPD stages. Importantly, brain activation shifts with the development of IPD. In addition, results showed that differences in Oxy-Hb changes were located in the FPA (BA10), DLPFC (BA9/BA46), and Broca’s area (BA45) between the DS and PS conditions across IPD stages. Additionally, negative correlations were found between Oxy-Hb changes and IPD performance.ConclusionWe propose prefrontal cortex (PFC) and Broca’s area involvement in IPD interactions, initially focusing on evaluation and action periods, and later on IPD-evaluation processes after feedback. In addition, a difference in Oxy-Hb activities implies the complexity of relationships and social status in IPD interactions.
Collapse
Affiliation(s)
- Xinxin Huang
- Department of Physical Medicine and Rehabilitation, Tohoku University Graduate School of Medicine, Sendai, Japan
| | - Shin-Ichi Izumi
- Department of Physical Medicine and Rehabilitation, Tohoku University Graduate School of Medicine, Sendai, Japan
- Department of Physical Medicine and Rehabilitation, Graduate School of Biomedical Engineering, Tohoku University, Sendai, Japan
- *Correspondence: Shin-Ichi Izumi,
| | - Yoshimi Suzukamo
- Department of Physical Medicine and Rehabilitation, Tohoku University Graduate School of Medicine, Sendai, Japan
| |
Collapse
|
12
|
Uddén J, Hultén A, Schoffelen JM, Lam N, Harbusch K, van den Bosch A, Kempen G, Petersson KM, Hagoort P. Supramodal Sentence Processing in the Human Brain: fMRI Evidence for the Influence of Syntactic Complexity in More Than 200 Participants. NEUROBIOLOGY OF LANGUAGE (CAMBRIDGE, MASS.) 2022; 3:575-598. [PMID: 37215341 PMCID: PMC10158636 DOI: 10.1162/nol_a_00076] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/03/2021] [Accepted: 06/13/2022] [Indexed: 05/24/2023]
Abstract
This study investigated two questions. One is: To what degree is sentence processing beyond single words independent of the input modality (speech vs. reading)? The second question is: Which parts of the network recruited by both modalities is sensitive to syntactic complexity? These questions were investigated by having more than 200 participants read or listen to well-formed sentences or series of unconnected words. A largely left-hemisphere frontotemporoparietal network was found to be supramodal in nature, i.e., independent of input modality. In addition, the left inferior frontal gyrus (LIFG) and the left posterior middle temporal gyrus (LpMTG) were most clearly associated with left-branching complexity. The left anterior temporal lobe showed the greatest sensitivity to sentences that differed in right-branching complexity. Moreover, activity in LIFG and LpMTG increased from sentence onset to end, in parallel with an increase of the left-branching complexity. While LIFG, bilateral anterior temporal lobe, posterior MTG, and left inferior parietal lobe all contribute to the supramodal unification processes, the results suggest that these regions differ in their respective contributions to syntactic complexity related processing. The consequences of these findings for neurobiological models of language processing are discussed.
Collapse
Affiliation(s)
- Julia Uddén
- Max Planck Institute for Psycholinguistics, Nijmegen, the Netherlands
- Donders Institute for Brain, Cognition and Behaviour, Centre for Cognitive Neuroimaging, Radboud University, Nijmegen, the Netherlands
- Department of Linguistics, Stockholm University, Stockholm, Sweden
- Department of Psychology, Stockholm University, Stockholm, Sweden
| | - Annika Hultén
- Max Planck Institute for Psycholinguistics, Nijmegen, the Netherlands
- Donders Institute for Brain, Cognition and Behaviour, Centre for Cognitive Neuroimaging, Radboud University, Nijmegen, the Netherlands
| | - Jan-Mathijs Schoffelen
- Donders Institute for Brain, Cognition and Behaviour, Centre for Cognitive Neuroimaging, Radboud University, Nijmegen, the Netherlands
| | - Nietzsche Lam
- Max Planck Institute for Psycholinguistics, Nijmegen, the Netherlands
- Donders Institute for Brain, Cognition and Behaviour, Centre for Cognitive Neuroimaging, Radboud University, Nijmegen, the Netherlands
| | - Karin Harbusch
- Department of Computer Science, University of Koblenz-Landau, Koblenz, Germany
| | - Antal van den Bosch
- Donders Institute for Brain, Cognition and Behaviour, Centre for Cognitive Neuroimaging, Radboud University, Nijmegen, the Netherlands
| | - Gerard Kempen
- Max Planck Institute for Psycholinguistics, Nijmegen, the Netherlands
| | - Karl Magnus Petersson
- Max Planck Institute for Psycholinguistics, Nijmegen, the Netherlands
- Donders Institute for Brain, Cognition and Behaviour, Centre for Cognitive Neuroimaging, Radboud University, Nijmegen, the Netherlands
| | - Peter Hagoort
- Max Planck Institute for Psycholinguistics, Nijmegen, the Netherlands
- Donders Institute for Brain, Cognition and Behaviour, Centre for Cognitive Neuroimaging, Radboud University, Nijmegen, the Netherlands
| |
Collapse
|
13
|
Murphy E, Woolnough O, Rollo PS, Roccaforte ZJ, Segaert K, Hagoort P, Tandon N. Minimal Phrase Composition Revealed by Intracranial Recordings. J Neurosci 2022; 42:3216-3227. [PMID: 35232761 PMCID: PMC8994536 DOI: 10.1523/jneurosci.1575-21.2022] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2021] [Revised: 01/11/2022] [Accepted: 01/18/2022] [Indexed: 11/21/2022] Open
Abstract
The ability to comprehend phrases is an essential integrative property of the brain. Here, we evaluate the neural processes that enable the transition from single-word processing to a minimal compositional scheme. Previous research has reported conflicting timing effects of composition, and disagreement persists with respect to inferior frontal and posterior temporal contributions. To address these issues, 19 patients (10 male, 9 female) implanted with penetrating depth or surface subdural intracranial electrodes, heard auditory recordings of adjective-noun, pseudoword-noun, and adjective-pseudoword phrases and judged whether the phrase matched a picture. Stimulus-dependent alterations in broadband gamma activity, low-frequency power, and phase-locking values across the language-dominant left hemisphere were derived. This revealed a mosaic located on the lower bank of the posterior superior temporal sulcus (pSTS), in which closely neighboring cortical sites displayed exclusive sensitivity to either lexicality or phrase structure, but not both. Distinct timings were found for effects of phrase composition (210-300 ms) and pseudoword processing (∼300-700 ms), and these were localized to neighboring electrodes in pSTS. The pars triangularis and temporal pole encoded anticipation of composition in broadband low frequencies, and both regions exhibited greater functional connectivity with pSTS during phrase composition. Our results suggest that the pSTS is a highly specialized region composed of sparsely interwoven heterogeneous constituents that encodes both lower and higher level linguistic features. This hub in pSTS for minimal phrase processing may form the neural basis for the human-specific computational capacity for forming hierarchically organized linguistic structures.SIGNIFICANCE STATEMENT Linguists have claimed that the integration of multiple words into a phrase demands a computational procedure distinct from single-word processing. Here, we provide intracranial recordings from a large patient cohort, with high spatiotemporal resolution, to track the cortical dynamics of phrase composition. Epileptic patients volunteered to participate in a task in which they listened to phrases (red boat), word-pseudoword or pseudoword-word pairs (e.g., red fulg). At the onset of the second word in phrases, greater broadband high gamma activity was found in posterior superior temporal sulcus in electrodes that exclusively indexed phrasal meaning and not lexical meaning. These results provide direct, high-resolution signatures of minimal phrase composition in humans, a potentially species-specific computational capacity.
Collapse
Affiliation(s)
- Elliot Murphy
- Vivian L. Smith Department of Neurosurgery, McGovern Medical School, University of Texas Health Science Center at Houston, Houston, Texas 77030
- Texas Institute for Restorative Neurotechnologies, University of Texas Health Science Center at Houston, Houston, Texas 77030
| | - Oscar Woolnough
- Vivian L. Smith Department of Neurosurgery, McGovern Medical School, University of Texas Health Science Center at Houston, Houston, Texas 77030
- Texas Institute for Restorative Neurotechnologies, University of Texas Health Science Center at Houston, Houston, Texas 77030
| | - Patrick S Rollo
- Vivian L. Smith Department of Neurosurgery, McGovern Medical School, University of Texas Health Science Center at Houston, Houston, Texas 77030
- Texas Institute for Restorative Neurotechnologies, University of Texas Health Science Center at Houston, Houston, Texas 77030
| | - Zachary J Roccaforte
- Vivian L. Smith Department of Neurosurgery, McGovern Medical School, University of Texas Health Science Center at Houston, Houston, Texas 77030
| | - Katrien Segaert
- School of Psychology and Centre for Human Brain Health, University of Birmingham, Birmingham B15 2TT, United Kingdom
- Max Planck Institute for Psycholinguistics, Nijmegen, 6525 XD Nijmegen, The Netherlands
| | - Peter Hagoort
- Max Planck Institute for Psycholinguistics, Nijmegen, 6525 XD Nijmegen, The Netherlands
- Donders Institute for Brain, Cognition and Behaviour, Nijmegen, 6525 HR Nijmegen, The Netherlands
| | - Nitin Tandon
- Vivian L. Smith Department of Neurosurgery, McGovern Medical School, University of Texas Health Science Center at Houston, Houston, Texas 77030
- Texas Institute for Restorative Neurotechnologies, University of Texas Health Science Center at Houston, Houston, Texas 77030
- Memorial Hermann Hospital, Texas Medical Center, Houston, Texas 77030
| |
Collapse
|
14
|
Holmer E, Schönström K, Andin J. Associations Between Sign Language Skills and Resting-State Functional Connectivity in Deaf Early Signers. Front Psychol 2022; 13:738866. [PMID: 35369269 PMCID: PMC8975249 DOI: 10.3389/fpsyg.2022.738866] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/09/2021] [Accepted: 02/03/2022] [Indexed: 11/13/2022] Open
Abstract
The processing of a language involves a neural language network including temporal, parietal, and frontal cortical regions. This applies to spoken as well as signed languages. Previous research suggests that spoken language proficiency is associated with resting-state functional connectivity (rsFC) between language regions and other regions of the brain. Given the similarities in neural activation for spoken and signed languages, rsFC-behavior associations should also exist for sign language tasks. In this study, we explored the associations between rsFC and two types of linguistic skills in sign language: phonological processing skill and accuracy in elicited sentence production. Fifteen adult, deaf early signers were enrolled in a resting-state functional magnetic resonance imaging (fMRI) study. In addition to fMRI data, behavioral tests of sign language phonological processing and sentence reproduction were administered. Using seed-to-voxel connectivity analysis, we investigated associations between behavioral proficiency and rsFC from language-relevant nodes: bilateral inferior frontal gyrus (IFG) and posterior superior temporal gyrus (STG). Results showed that worse sentence processing skill was associated with stronger positive rsFC between the left IFG and left sensorimotor regions. Further, sign language phonological processing skill was associated with positive rsFC from right IFG to middle frontal gyrus/frontal pole although this association could possibly be explained by domain-general cognitive functions. Our findings suggest a possible connection between rsFC and developmental language outcomes in deaf individuals.
Collapse
Affiliation(s)
- Emil Holmer
- Linnaeus Centre HEAD, Swedish Institute for Disability Research, Department of Behavioural Sciences and Learning, Linköping University, Linköping, Sweden
- Center for Medical Image Science and Visualization, Linköping, Sweden
- *Correspondence: Emil Holmer,
| | | | - Josefine Andin
- Linnaeus Centre HEAD, Swedish Institute for Disability Research, Department of Behavioural Sciences and Learning, Linköping University, Linköping, Sweden
| |
Collapse
|
15
|
Caldwell HB. Sign and Spoken Language Processing Differences in the Brain: A Brief Review of Recent Research. Ann Neurosci 2022; 29:62-70. [PMID: 35875424 PMCID: PMC9305909 DOI: 10.1177/09727531211070538] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2021] [Accepted: 11/29/2021] [Indexed: 11/27/2022] Open
Abstract
Background: It is currently accepted that sign languages and spoken languages have significant processing commonalities. The evidence supporting this often merely investigates frontotemporal pathways, perisylvian language areas, hemispheric lateralization, and event-related potentials in typical settings. However, recent evidence has explored beyond this and uncovered numerous modality-dependent processing differences between sign languages and spoken languages by accounting for confounds that previously invalidated processing comparisons and by delving into the specific conditions in which they arise. However, these processing differences are often shallowly dismissed as unspecific to language. Summary: This review examined recent neuroscientific evidence for processing differences between sign and spoken language modalities and the arguments against these differences’ importance. Key distinctions exist in the topography of the left anterior negativity (LAN) and with modulations of event-related potential (ERP) components like the N400. There is also differential activation of typical spoken language processing areas, such as the conditional role of the temporal areas in sign language (SL) processing. Importantly, sign language processing uniquely recruits parietal areas for processing phonology and syntax and requires the mapping of spatial information to internal representations. Additionally, modality-specific feedback mechanisms distinctively involve proprioceptive post-output monitoring in sign languages, contrary to spoken languages’ auditory and visual feedback mechanisms. The only study to find ERP differences post-production revealed earlier lexical access in sign than spoken languages. Themes of temporality, the validity of an analogous anatomical mechanisms viewpoint, and the comprehensiveness of current language models were also discussed to suggest improvements for future research. Key message: Current neuroscience evidence suggests various ways in which processing differs between sign and spoken language modalities that extend beyond simple differences between languages. Consideration and further exploration of these differences will be integral in developing a more comprehensive view of language in the brain.
Collapse
Affiliation(s)
- Hayley Bree Caldwell
- Cognitive and Systems Neuroscience Research Hub (CSN-RH), School of Justice and Society, University of South Australia Magill Campus, Magill, South Australia, Australia
| |
Collapse
|
16
|
Limb Preference in Animals: New Insights into the Evolution of Manual Laterality in Hominids. Symmetry (Basel) 2022. [DOI: 10.3390/sym14010096] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/23/2023] Open
Abstract
Until the 1990s, the notion of brain lateralization—the division of labor between the two hemispheres—and its more visible behavioral manifestation, handedness, remained fiercely defined as a human specific trait. Since then, many studies have evidenced lateralized functions in a wide range of species, including both vertebrates and invertebrates. In this review, we highlight the great contribution of comparative research to the understanding of human handedness’ evolutionary and developmental pathways, by distinguishing animal forelimb asymmetries for functionally different actions—i.e., potentially depending on different hemispheric specializations. Firstly, lateralization for the manipulation of inanimate objects has been associated with genetic and ontogenetic factors, with specific brain regions’ activity, and with morphological limb specializations. These could have emerged under selective pressures notably related to the animal locomotion and social styles. Secondly, lateralization for actions directed to living targets (to self or conspecifics) seems to be in relationship with the brain lateralization for emotion processing. Thirdly, findings on primates’ hand preferences for communicative gestures accounts for a link between gestural laterality and a left-hemispheric specialization for intentional communication and language. Throughout this review, we highlight the value of functional neuroimaging and developmental approaches to shed light on the mechanisms underlying human handedness.
Collapse
|
17
|
Andin J, Holmer E. Reorganization of large-scale brain networks in deaf signing adults: The role of auditory cortex in functional reorganization following deafness. Neuropsychologia 2022; 166:108139. [PMID: 34990695 DOI: 10.1016/j.neuropsychologia.2021.108139] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2021] [Revised: 12/17/2021] [Accepted: 12/31/2021] [Indexed: 01/24/2023]
Abstract
If the brain is deprived of input from one or more senses during development, functional and structural reorganization of the deprived regions takes place. However, little is known about how sensory deprivation affects large-scale brain networks. In the present study, we use data-driven independent component analysis (ICA) to characterize large-scale brain networks in 15 deaf early signers and 24 hearing non-signers based on resting-state functional MRI data. We found differences between the groups in independent components representing the left lateralized control network, the default network, the ventral somatomotor network, and the attention network. In addition, we showed stronger functional connectivity for deaf compared to hearing individuals from the middle and superior temporal cortices to the cingulate cortex, insular cortex, cuneus and precuneus, supramarginal gyrus, supplementary motor area, and cerebellum crus 1, and stronger connectivity for hearing non-signers to hippocampus, middle and superior frontal gyri, pre- and postcentral gyri, and cerebellum crus 8. These results show that deafness induces large-scale network reorganization, with the middle/superior temporal cortex as a central node of plasticity. Cross-modal reorganization may be associated with behavioral adaptations to the environment, including superior ability in some visual functions such as visual working memory and visual attention, in deaf signers.
Collapse
Affiliation(s)
- Josefine Andin
- Linnaeus Centre HEAD, Department of Behavioural Sciences and Learning, Linköping University, SE, 581 83, Linköping, Sweden.
| | - Emil Holmer
- Linnaeus Centre HEAD, Department of Behavioural Sciences and Learning, Linköping University, SE, 581 83, Linköping, Sweden; Center for Medical Image Science and Visualization, Linköping University, Sweden.
| |
Collapse
|
18
|
Lai K, Liu J, Wang J, Zheng Y, Liang M, Wang S. Resting-state EEG reveals global network deficiency in prelingually deaf children with late cochlear implantation. Front Pediatr 2022; 10:909069. [PMID: 36147821 PMCID: PMC9487891 DOI: 10.3389/fped.2022.909069] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/12/2022] [Accepted: 08/16/2022] [Indexed: 11/13/2022] Open
Abstract
There are individual differences in rehabilitation after cochlear implantation that can be explained by brain plasticity. However, from the perspective of brain networks, the effect of implantation age on brain plasticity is unclear. The present study investigated electroencephalography functional networks in the resting state, including eyes-closed and eyes-open conditions, in 31 children with early cochlear implantation, 24 children with late cochlear implantation, and 29 children with normal hearing. Resting-state functional connectivity was measured with phase lag index, and we investigated the connectivity between the sensory regions for each frequency band. Network topology was examined using minimum spanning tree to obtain the network backbone characteristics. The results showed stronger connectivity between auditory and visual regions but reduced global network efficiency in children with late cochlear implantation in the theta and alpha bands. Significant correlations were observed between functional backbone characteristics and speech perception scores in children with cochlear implantation. Collectively, these results reveal an important effect of implantation age on the extent of brain plasticity from a network perspective and indicate that characteristics of the brain network can reflect the extent of rehabilitation of children with cochlear implantation.
Collapse
Affiliation(s)
- Kaiying Lai
- Philosophy and Social Science Laboratory of Reading and Development in Children and Adolescents (South China Normal University), Ministry of Education, Guangzhou, China
| | - Jiahao Liu
- Department of Otolaryngology, Sun Yat-sen Memorial Hospital, Guangzhou, China
| | - Junbo Wang
- Department of Otolaryngology, Sun Yat-sen Memorial Hospital, Guangzhou, China
| | - Yiqing Zheng
- Department of Otolaryngology, Sun Yat-sen Memorial Hospital, Guangzhou, China
| | - Maojin Liang
- Department of Otolaryngology, Sun Yat-sen Memorial Hospital, Guangzhou, China
| | - Suiping Wang
- Philosophy and Social Science Laboratory of Reading and Development in Children and Adolescents (South China Normal University), Ministry of Education, Guangzhou, China
| |
Collapse
|
19
|
Abstract
The first 40 years of research on the neurobiology of sign languages (1960-2000) established that the same key left hemisphere brain regions support both signed and spoken languages, based primarily on evidence from signers with brain injury and at the end of the 20th century, based on evidence from emerging functional neuroimaging technologies (positron emission tomography and fMRI). Building on this earlier work, this review focuses on what we have learned about the neurobiology of sign languages in the last 15-20 years, what controversies remain unresolved, and directions for future research. Production and comprehension processes are addressed separately in order to capture whether and how output and input differences between sign and speech impact the neural substrates supporting language. In addition, the review includes aspects of language that are unique to sign languages, such as pervasive lexical iconicity, fingerspelling, linguistic facial expressions, and depictive classifier constructions. Summary sketches of the neural networks supporting sign language production and comprehension are provided with the hope that these will inspire future research as we begin to develop a more complete neurobiological model of sign language processing.
Collapse
|
20
|
Papitto G, Lugli L, Borghi AM, Pellicano A, Binkofski F. Embodied negation and levels of concreteness: A TMS study on German and Italian language processing. Brain Res 2021; 1767:147523. [PMID: 34010607 DOI: 10.1016/j.brainres.2021.147523] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2021] [Revised: 04/23/2021] [Accepted: 05/15/2021] [Indexed: 12/01/2022]
Abstract
According to the embodied cognition perspective, linguistic negation may block the motor simulations induced by language processing. Transcranial magnetic stimulation (TMS) was applied to the left primary motor cortex (hand area) of monolingual Italian and German healthy participants during a rapid serial visual presentation of sentences from their own language. In these languages, the negative particle is located at the beginning and at the end of the sentence, respectively. The study investigated whether the interruption of the motor simulation processes, accounted for by reduced motor evoked potentials (MEPs), takes place similarly in two languages differing on the position of the negative marker. Different levels of sentence concreteness were also manipulated to investigate if negation exerts generalized effects or if it is affected by the semantic features of the sentence. Our findings indicate that negation acts as a block on motor representations, but independently from the language and words concreteness level.
Collapse
Affiliation(s)
- Giorgio Papitto
- Max Planck Institute for Human Cognitive and Brain Sciences, Department of Neuropsychology, Leipzig, Germany; International Max Planck Research School on Neuroscience of Communication: Function, Structure, and Plasticity, Leipzig, Germany.
| | - Luisa Lugli
- Department of Philosophy and Communication, University of Bologna, Bologna, Italy
| | - Anna M Borghi
- Department of Dynamic and Clinical Psychology, and Health Studies, Faculty of Medicine and Psychology, Sapienza University of Rome, Rome, Italy; Institute of Cognitive Sciences and Technologies, National Research Council, Rome, Italy
| | - Antonello Pellicano
- Division of Clinical Cognitive Sciences, Department of Neurology, RWTH Aachen University, Aachen, Germany
| | - Ferdinand Binkofski
- Division of Clinical Cognitive Sciences, Department of Neurology, RWTH Aachen University, Aachen, Germany; Institute of Neuroscience and Medicine (INM-4), Research Center Jülich GmbH, Jülich, Germany
| |
Collapse
|
21
|
Trettenbrein PC, Zaccarella E. Controlling Video Stimuli in Sign Language and Gesture Research: The OpenPoseR Package for Analyzing OpenPose Motion-Tracking Data in R. Front Psychol 2021; 12:628728. [PMID: 33679550 PMCID: PMC7932993 DOI: 10.3389/fpsyg.2021.628728] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2020] [Accepted: 01/29/2021] [Indexed: 01/08/2023] Open
Abstract
Researchers in the fields of sign language and gesture studies frequently present their participants with video stimuli showing actors performing linguistic signs or co-speech gestures. Up to now, such video stimuli have been mostly controlled only for some of the technical aspects of the video material (e.g., duration of clips, encoding, framerate, etc.), leaving open the possibility that systematic differences in video stimulus materials may be concealed in the actual motion properties of the actor’s movements. Computer vision methods such as OpenPose enable the fitting of body-pose models to the consecutive frames of a video clip and thereby make it possible to recover the movements performed by the actor in a particular video clip without the use of a point-based or markerless motion-tracking system during recording. The OpenPoseR package provides a straightforward and reproducible way of working with these body-pose model data extracted from video clips using OpenPose, allowing researchers in the fields of sign language and gesture studies to quantify the amount of motion (velocity and acceleration) pertaining only to the movements performed by the actor in a video clip. These quantitative measures can be used for controlling differences in the movements of an actor in stimulus video clips or, for example, between different conditions of an experiment. In addition, the package also provides a set of functions for generating plots for data visualization, as well as an easy-to-use way of automatically extracting metadata (e.g., duration, framerate, etc.) from large sets of video files.
Collapse
Affiliation(s)
- Patrick C Trettenbrein
- Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany.,International Max Planck Research School on Neuroscience of Communication: Structure, Function, and Plasticity (IMPRS NeuroCom), Leipzig, Germany
| | - Emiliano Zaccarella
- Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| |
Collapse
|
22
|
Psycholinguistic norms for more than 300 lexical signs in German Sign Language (DGS). Behav Res Methods 2021; 53:1817-1832. [PMID: 33575986 PMCID: PMC8516755 DOI: 10.3758/s13428-020-01524-y] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 12/11/2020] [Indexed: 02/06/2023]
Abstract
Sign language offers a unique perspective on the human faculty of language by illustrating that linguistic abilities are not bound to speech and writing. In studies of spoken and written language processing, lexical variables such as, for example, age of acquisition have been found to play an important role, but such information is not as yet available for German Sign Language (Deutsche Gebärdensprache, DGS). Here, we present a set of norms for frequency, age of acquisition, and iconicity for more than 300 lexical DGS signs, derived from subjective ratings by 32 deaf signers. We also provide additional norms for iconicity and transparency for the same set of signs derived from ratings by 30 hearing non-signers. In addition to empirical norming data, the dataset includes machine-readable information about a sign’s correspondence in German and English, as well as annotations of lexico-semantic and phonological properties: one-handed vs. two-handed, place of articulation, most likely lexical class, animacy, verb type, (potential) homonymy, and potential dialectal variation. Finally, we include information about sign onset and offset for all stimulus clips from automated motion-tracking data. All norms, stimulus clips, data, as well as code used for analysis are made available through the Open Science Framework in the hope that they may prove to be useful to other researchers: 10.17605/OSF.IO/MZ8J4
Collapse
|
23
|
Trettenbrein PC, Papitto G, Friederici AD, Zaccarella E. Functional neuroanatomy of language without speech: An ALE meta-analysis of sign language. Hum Brain Mapp 2020; 42:699-712. [PMID: 33118302 PMCID: PMC7814757 DOI: 10.1002/hbm.25254] [Citation(s) in RCA: 22] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2020] [Accepted: 10/09/2020] [Indexed: 12/19/2022] Open
Abstract
Sign language (SL) conveys linguistic information using gestures instead of sounds. Here, we apply a meta‐analytic estimation approach to neuroimaging studies (N = 23; subjects = 316) and ask whether SL comprehension in deaf signers relies on the same primarily left‐hemispheric cortical network implicated in spoken and written language (SWL) comprehension in hearing speakers. We show that: (a) SL recruits bilateral fronto‐temporo‐occipital regions with strong left‐lateralization in the posterior inferior frontal gyrus known as Broca's area, mirroring functional asymmetries observed for SWL. (b) Within this SL network, Broca's area constitutes a hub which attributes abstract linguistic information to gestures. (c) SL‐specific voxels in Broca's area are also crucially involved in SWL, as confirmed by meta‐analytic connectivity modeling using an independent large‐scale neuroimaging database. This strongly suggests that the human brain evolved a lateralized language network with a supramodal hub in Broca's area which computes linguistic information independent of speech.
Collapse
Affiliation(s)
- Patrick C Trettenbrein
- Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany.,International Max Planck Research School on Neuroscience of Communication: Structure, Function, and Plasticity (IMPRS NeuroCom), Leipzig, Germany
| | - Giorgio Papitto
- Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany.,International Max Planck Research School on Neuroscience of Communication: Structure, Function, and Plasticity (IMPRS NeuroCom), Leipzig, Germany
| | - Angela D Friederici
- Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Emiliano Zaccarella
- Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| |
Collapse
|