1
|
Xu T, Jiang X, Zhang P, Wang A. Introducing the Sisu Voice Matching Test (SVMT): A novel tool for assessing voice discrimination in Chinese. Behav Res Methods 2025; 57:86. [PMID: 39900852 DOI: 10.3758/s13428-025-02608-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 01/16/2025] [Indexed: 02/05/2025]
Abstract
Existing standardized tests for voice discrimination are based mainly on Indo-European languages, particularly English. However, voice identity perception is influenced by language familiarity, with listeners generally performing better in their native language than in a foreign one. To provide a more accurate and comprehensive assessment of voice discrimination, it is crucial to develop tests tailored to the native language of the test takers. In response, we developed the Sisu Voice Matching Test (SVMT), a pioneering tool designed specifically for Mandarin Chinese speakers. The SVMT was designed to model real-world communication since it includes both pseudo-word and pseudo-sentence stimuli and covers both the ability to categorize identical voices as the same and the ability to categorize distinct voices as different. Built on a neurally validated voice-space model and item response theory, the SVMT ensures high reliability, validity, appropriate difficulty, and strong discriminative power, while maintaining a concise test duration of approximately 10 min. Therefore, by taking into account the effects of language nativeness, the SVMT complements existing voice tests based on other languages' phonologies to provide a more accurate assessment of voice discrimination ability for Mandarin Chinese speakers. Future research can use the SVMT to deepen our understanding of the mechanisms underlying human voice identity perception, especially in special populations, and to examining the relationship between voice identity recognition and other cognitive processes.
Collapse
Affiliation(s)
- Tianze Xu
- Institute of Linguistics, Shanghai International Studies University, Shanghai, 201620, China
| | - Xiaoming Jiang
- Institute of Linguistics, Shanghai International Studies University, Shanghai, 201620, China.
- Key Laboratory of Language Science and Multilingual Artificial Intelligence, Shanghai International Studies University, Shanghai, 201620, China.
| | - Peng Zhang
- Institute of Linguistics, Shanghai International Studies University, Shanghai, 201620, China
| | - Anni Wang
- Institute of Linguistics, Shanghai International Studies University, Shanghai, 201620, China
| |
Collapse
|
2
|
Sauppe S, Naess Å, Roversi G, Meyer M, Bornkessel-Schlesewsky I, Bickel B. An Agent-First Preference in a Patient-First Language During Sentence Comprehension. Cogn Sci 2023; 47:e13340. [PMID: 37715510 DOI: 10.1111/cogs.13340] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/08/2022] [Revised: 07/05/2023] [Accepted: 08/30/2023] [Indexed: 09/17/2023]
Abstract
The language comprehension system preferentially assumes that agents come first during incremental processing. While this might reflect a biologically fixed bias, shared with other domains and other species, the evidence is limited to languages that place agents first, and so the bias could also be learned from usage frequency. Here, we probe the bias with electroencephalography (EEG) in Äiwoo, a language that by default places patients first, but where sentence-initial nouns are still locally ambiguous between patient or agent roles. Comprehenders transiently interpreted nonhuman nouns as patients, eliciting a negativity when disambiguation was toward the less common agent-initial order. By contrast and against frequencies, human nouns were transiently interpreted as agents, eliciting an N400-like negativity when the disambiguation was toward patient-initial order. Consistent with the notion of a fixed property, the agent bias is robust against usage frequency for human referents. However, this bias can be reversed by frequency experience for nonhuman referents.
Collapse
Affiliation(s)
- Sebastian Sauppe
- Department of Comparative Language Science, University of Zurich
- Center for the Interdisciplinary Study of Language Evolution, University of Zurich
| | - Åshild Naess
- Department of Linguistics and Scandinavian Studies, University of Oslo
| | - Giovanni Roversi
- Department of Linguistics and Philosophy, Massachusetts Institute of Technology
| | - Martin Meyer
- Department of Comparative Language Science, University of Zurich
- Center for the Interdisciplinary Study of Language Evolution, University of Zurich
- Cognitive Psychology Unit, Psychological Institute, University of Klagenfurt
| | - Ina Bornkessel-Schlesewsky
- Cognitive Neuroscience Laboratory, Australian Research Centre for Interactive and Virtual Environments, University of South Australia
| | - Balthasar Bickel
- Department of Comparative Language Science, University of Zurich
- Center for the Interdisciplinary Study of Language Evolution, University of Zurich
| |
Collapse
|
3
|
Maran M, Numssen O, Hartwigsen G, Zaccarella E. Online neurostimulation of Broca's area does not interfere with syntactic predictions: A combined TMS-EEG approach to basic linguistic combination. Front Psychol 2022; 13:968836. [PMID: 36619118 PMCID: PMC9815778 DOI: 10.3389/fpsyg.2022.968836] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2022] [Accepted: 09/13/2022] [Indexed: 01/11/2023] Open
Abstract
Categorical predictions have been proposed as the key mechanism supporting the fast pace of syntactic composition in language. Accordingly, grammar-based expectations are formed-e.g., the determiner "a" triggers the prediction for a noun-and facilitate the analysis of incoming syntactic information, which is then checked against a single or few other word categories. Previous functional neuroimaging studies point towards Broca's area in the left inferior frontal gyrus (IFG) as one fundamental cortical region involved in categorical prediction during incremental language processing. Causal evidence for this hypothesis is however still missing. In this study, we combined Electroencephalography (EEG) and Transcranial Magnetic Stimulation (TMS) to test whether Broca's area is functionally relevant in predictive mechanisms for language. We transiently perturbed Broca's area during the first word in a two-word construction, while simultaneously measuring the Event-Related Potential (ERP) correlates of syntactic composition. We reasoned that if Broca's area is involved in predictive mechanisms for syntax, disruptive TMS during the first word would mitigate the difference in the ERP responses for predicted and unpredicted categories in basic two-word constructions. Contrary to this hypothesis, perturbation of Broca's area at the predictive stage did not affect the ERP correlates of basic composition. The correlation strength between the electrical field induced by TMS and the ERP responses further confirmed this pattern. We discuss the present results considering an alternative account of the role of Broca's area in syntactic composition, namely the bottom-up integration of words into constituents, and of compensatory mechanisms within the language predictive network.
Collapse
Affiliation(s)
- Matteo Maran
- Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany,International Max Planck Research School on Neuroscience of Communication: Function, Structure, and Plasticity, Leipzig, Germany,*Correspondence: Matteo Maran,
| | - Ole Numssen
- Lise Meitner Research Group Cognition and Plasticity, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Gesa Hartwigsen
- Lise Meitner Research Group Cognition and Plasticity, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Emiliano Zaccarella
- Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| |
Collapse
|
4
|
Bornkessel-Schlesewsky I, Sharrad I, Howlett CA, Alday PM, Corcoran AW, Bellan V, Wilkinson E, Kliegl R, Lewis RL, Small SL, Schlesewsky M. Rapid adaptation of predictive models during language comprehension: Aperiodic EEG slope, individual alpha frequency and idea density modulate individual differences in real-time model updating. Front Psychol 2022; 13:817516. [PMID: 36092106 PMCID: PMC9461998 DOI: 10.3389/fpsyg.2022.817516] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/18/2021] [Accepted: 07/22/2022] [Indexed: 11/13/2022] Open
Abstract
Predictive coding provides a compelling, unified theory of neural information processing, including for language. However, there is insufficient understanding of how predictive models adapt to changing contextual and environmental demands and the extent to which such adaptive processes differ between individuals. Here, we used electroencephalography (EEG) to track prediction error responses during a naturalistic language processing paradigm. In Experiment 1, 45 native speakers of English listened to a series of short passages. Via a speaker manipulation, we introduced changing intra-experimental adjective order probabilities for two-adjective noun phrases embedded within the passages and investigated whether prediction error responses adapt to reflect these intra-experimental predictive contingencies. To this end, we calculated a novel measure of speaker-based, intra-experimental surprisal (“speaker-based surprisal”) as defined on a trial-by-trial basis and by clustering together adjectives with a similar meaning. N400 amplitude at the position of the critical second adjective was used as an outcome measure of prediction error. Results showed that N400 responses attuned to speaker-based surprisal over the course of the experiment, thus indicating that listeners rapidly adapt their predictive models to reflect local environmental contingencies (here: the probability of one type of adjective following another when uttered by a particular speaker). Strikingly, this occurs in spite of the wealth of prior linguistic experience that participants bring to the laboratory. Model adaptation effects were strongest for participants with a steep aperiodic (1/f) slope in resting EEG and low individual alpha frequency (IAF), with idea density (ID) showing a more complex pattern. These results were replicated in a separate sample of 40 participants in Experiment 2, which employed a highly similar design to Experiment 1. Overall, our results suggest that individuals with a steep aperiodic slope adapt their predictive models most strongly to context-specific probabilistic information. Steep aperiodic slope is thought to reflect low neural noise, which in turn may be associated with higher neural gain control and better cognitive control. Individuals with a steep aperiodic slope may thus be able to more effectively and dynamically reconfigure their prediction-related neural networks to meet current task demands. We conclude that predictive mechanisms in language are highly malleable and dynamic, reflecting both the affordances of the present environment as well as intrinsic information processing capabilities of the individual.
Collapse
Affiliation(s)
- Ina Bornkessel-Schlesewsky
- Cognitive Neuroscience Laboratory, Australian Research Centre for Interactive and Virtual Environments, University of South Australia, Adelaide, SA, Australia
- *Correspondence: Ina Bornkessel-Schlesewsky
| | - Isabella Sharrad
- Cognitive Neuroscience Laboratory, Australian Research Centre for Interactive and Virtual Environments, University of South Australia, Adelaide, SA, Australia
| | - Caitlin A. Howlett
- Innovation, Implementation and Clinical Translation (IIMPACT) in Health, University of South Australia, Adelaide, SA, Australia
| | | | - Andrew W. Corcoran
- Cognition and Philosophy Laboratory, Monash University, Melbourne, VIC, Australia
- Monash Centre for Consciousness and Contemplative Studies, Monash University, Melbourne, VIC, Australia
| | - Valeria Bellan
- Cognitive Neuroscience Laboratory, Australian Research Centre for Interactive and Virtual Environments, University of South Australia, Adelaide, SA, Australia
- Innovation, Implementation and Clinical Translation (IIMPACT) in Health, University of South Australia, Adelaide, SA, Australia
| | - Erica Wilkinson
- Innovation, Implementation and Clinical Translation (IIMPACT) in Health, University of South Australia, Adelaide, SA, Australia
| | - Reinhold Kliegl
- Division of Training and Movement Science, University of Potsdam, Potsdam, Germany
| | - Richard L. Lewis
- Department of Psychology, University of Michigan, Ann Arbor, MI, United States
- Weinberg Institute for Cognitive Science, University of Michigan, Ann Arbor, MI, United States
| | - Steven L. Small
- School of Behavioral and Brain Sciences, University of Texas at Dallas, Dallas, TX, United States
| | - Matthias Schlesewsky
- Cognitive Neuroscience Laboratory, Australian Research Centre for Interactive and Virtual Environments, University of South Australia, Adelaide, SA, Australia
| |
Collapse
|
5
|
Puhacheuskaya V, Järvikivi J. I was being sarcastic!: The effect of foreign accent and political ideology on irony (mis)understanding. Acta Psychol (Amst) 2022; 222:103479. [PMID: 34954540 DOI: 10.1016/j.actpsy.2021.103479] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2021] [Revised: 12/17/2021] [Accepted: 12/18/2021] [Indexed: 11/19/2022] Open
Abstract
Misunderstood ironic intents may injure the conversation and impede connecting with others. Prior research suggests that ironic compliments, a rarer type of irony, are considered less ironic when spoken with a foreign accent. Using more ecologically-valid stimuli with natural prosodic cues, we found that this effect also applied to ironic criticisms, not just to ironic compliments. English native speakers (N = 96) listened to dialogs between Canadian English speakers and their foreign-accented peers, rating targets on multiple scales (irony, certainty in the speaker's intent, appropriateness, and offensiveness). Generalized additive mixed modelling showed that 1) ironic comments were rated lower for irony when foreign-accented, whereas literal comments were unaffected by accent; 2) the listener's political orientation, but not empathy or need for cognitive closure, modulated irony detection accuracy. The results are discussed in terms of linguistic expectations, social distance, cultural stereotypes, and personality differences.
Collapse
|